Difference between revisions of "Intersite Wishlist"

From Dreamwidth Notes
Jump to: navigation, search
m (Intersite Wishlist: Robots.txt should be customizable so users have more refined control over the indexing of their content.)
 
Line 2: Line 2:
  
 
* http://community.livejournal.com/suggestions/885584.html - Robots.txt should be customizable so as to allow users to permit/forbid indexing by specific sites or limit the indexing of only certain types of content, rather than the current all-or-nothing option provided by LJ.
 
* http://community.livejournal.com/suggestions/885584.html - Robots.txt should be customizable so as to allow users to permit/forbid indexing by specific sites or limit the indexing of only certain types of content, rather than the current all-or-nothing option provided by LJ.
 +
** This would also be helpful for when content has already been indexed by Google.  Google responds to "remove indexed content" requests by asking people to add a custom code to their page source, to prove that the page belongs to them. [[User:Maura|Maura]]

Latest revision as of 20:37, 21 February 2009


  • http://community.livejournal.com/suggestions/885584.html - Robots.txt should be customizable so as to allow users to permit/forbid indexing by specific sites or limit the indexing of only certain types of content, rather than the current all-or-nothing option provided by LJ.
    • This would also be helpful for when content has already been indexed by Google. Google responds to "remove indexed content" requests by asking people to add a custom code to their page source, to prove that the page belongs to them. Maura