Neverending Story (decadence1) wrote in lj_userdoc,
Neverending Story

What can I do to *make* my journal be [more likely to be] indexed by search engines?

This is in the "working with other sites" FAQ category - this FAQ (
Posting this as a new top level entry, following advice; I'd previously commented in an old entry.

I'd like to raise the issue of something perhaps being added for those rare support requests where someone DOES want their journal to be indexed by search engines. Since it's a rare request, I think a new FAQ would be overkill but perhaps some inclusion in #50? Example support request:

On the same issue (I have no idea where to otherwise post this), the FAQ states:
Additionally, if you have a paid account, a robots.txt file will be added to your paid URL (such as Not all robots respect the rules, but most of the popular search sites' robots do.

For user who might want their sites to be indexed, suggest we add some blurb about whether or not the robots.txt file is user-configurable? In the same manner as META tags may be switched on or off (2nd para.)

E.g., will show (where example used is a Paid Account) that all search robots are disallowed from all sections of the domain (syntax explanation at so the site cannot be indexed via robots (not all robots obey these rules as the FAQ explains, and there are search methods other than robots).
I am assuming the robots.txt file is not user-configurable but I do not know for certain.

  • FAQ232

    There is a typo (or two) in FAQ232. I'm talking about the following sentence: Ddd them to your Friends list them with the Add Friend button at…

  • New FAQ: How do I deal with spam?

    This FAQ is meant to tie together all of our spam-related information, currently spread over several different categories. Ideally, I'd like to have…

  • Identity Account FAQs

    As LiveJournal Support regularly uses the term identity accounts both in answers to users and amongst themselves, and some system pages refer to…

  • Post a new comment


    Comments allowed for members only

    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded