logo

Extra Block Types (EBT) - New Layout Builder experience❗

Extra Block Types (EBT) - styled, customizable block types: Slideshows, Tabs, Cards, Accordions and many others. Built-in settings for background, DOM Box, javascript plugins. Experience the future of layout building today.

Demo EBT modules Download EBT modules

❗Extra Paragraph Types (EPT) - New Paragraphs experience

Extra Paragraph Types (EPT) - analogical paragraph based set of modules.

Demo EPT modules Download EPT modules

Scroll
  1. Home
  2. Forums
  3. Drupal CMS
  4. Web servers & hostings

How to create the correct robots.txt file for Drupal

22/02/2025, by Anonymous (not verified)
Forums
Web servers & hostings

Hello! Could you please tell me how to properly prevent all bots from indexing user profiles and their messages? Would it be sufficient to specify it like this:

Disallow: /profiles/

Disallow: /user/register/
Disallow: /user/password/
Disallow: /user/login/

Disallow: /?q=user/password/
Disallow: /?q=user/register/
Disallow: /?q=user/login/

Do I need to specifically mention /messages as well?

Thank you in advance for your help!