http://wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&feed=atom&action=historyBot Policy - Revision history2024-03-29T01:07:08ZRevision history for this page on the wikiMediaWiki 1.23.0//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=12848&oldid=prevAzureLunaticDW: Linkifying API (not in official version)2017-05-07T21:02:32Z<p>Linkifying API (not in official version)</p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 21:02, 7 May 2017</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 9:</td>
<td colspan="2" class="diff-lineno">Line 9:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Good clients send a proper user-agent (or other info string) that includes a contact email address. That will let us contact you if there are any problems.</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Good clients send a proper user-agent (or other info string) that includes a contact email address. That will let us contact you if there are any problems.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Be kind to the system! Rate-limit your requests, and try to cache data whenever possible.</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Be kind to the system! Rate-limit your requests, and try to cache data whenever possible.</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Don't screen-scrape the HTML/BML output of the site. If you can't do something you want to do through an API, let us know, and we'll try to add an API for it.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* Don't screen-scrape the HTML/BML output of the site. If you can't do something you want to do through an <ins class="diffchange diffchange-inline">[[Dreamwidth_API|</ins>API<ins class="diffchange diffchange-inline">]]</ins>, let us know, and we'll try to add an API for it.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Try to avoid asking for users' passwords. If there's something you can't do through the protocol or through our APIs, let us know, and we'll add it. If you have to ask for users' passwords, you should tell people what you'll do with them, and warn users to change their passwords before and after they access your client if they're worried.</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>* Try to avoid asking for users' passwords. If there's something you can't do through the protocol or through our APIs, let us know, and we'll add it. If you have to ask for users' passwords, you should tell people what you'll do with them, and warn users to change their passwords before and after they access your client if they're worried.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
</table>AzureLunaticDW//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=12847&oldid=prevAzureLunaticDW: Updated to most recent version on the site. Retained link to the wiki page on compatible clients, which may or may not be up to date.2017-05-07T20:55:27Z<p>Updated to most recent version on the site. Retained link to the wiki page on compatible clients, which may or may not be up to date.</p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 20:55, 7 May 2017</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>This <del class="diffchange diffchange-inline">page outlines </del>a <del class="diffchange diffchange-inline">proposal for </del>the Dreamwidth Studios "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwidth servers.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>This <ins class="diffchange diffchange-inline">is </ins>a <ins class="diffchange diffchange-inline">mirror of </ins>the Dreamwidth Studios "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwidth servers.  </div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>'''<del class="diffchange diffchange-inline">This document is a proposal </del>and <del class="diffchange diffchange-inline">subject </del>to <del class="diffchange diffchange-inline">change</del>.'''</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>'''<ins class="diffchange diffchange-inline">The official </ins>and <ins class="diffchange diffchange-inline">most up </ins>to <ins class="diffchange diffchange-inline">date version is always at [https://www.dreamwidth.org/site/bot Dreamwidth's bot policy] page</ins>.'''</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>== General <del class="diffchange diffchange-inline">Purpose </del>Guidelines ==</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>== General Guidelines ==</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">Things to keep in mind that </del>are <del class="diffchange diffchange-inline">just generally useful</del>:</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">The overall guidelines for bot/tool authors </ins>are <ins class="diffchange diffchange-inline">pretty simple</ins>:</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Good clients send a proper user-agent (or other info string) that includes a contact email address.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* Good clients send a proper user-agent (or other info string) that includes a contact email address<ins class="diffchange diffchange-inline">. That will let us contact you if there are any problems</ins>.</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Be kind to the system<del class="diffchange diffchange-inline">, try to rate </del>limit your requests, <del class="diffchange diffchange-inline">don</del>'t <del class="diffchange diffchange-inline">abuse </del>the <del class="diffchange diffchange-inline">servers</del>.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* Be kind to the system<ins class="diffchange diffchange-inline">! Rate-</ins>limit your requests, <ins class="diffchange diffchange-inline">and try to cache data whenever possible.</ins></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* <del class="diffchange diffchange-inline">DW staff and volunteers are more than happy </del>to <del class="diffchange diffchange-inline">work with </del>you <del class="diffchange diffchange-inline">to </del>do <del class="diffchange diffchange-inline">neat projects, fix problems in </del>the <del class="diffchange diffchange-inline">servers, </del>or tell you if <del class="diffchange diffchange-inline">something is good or not</del>. <del class="diffchange diffchange-inline"> Just ask!</del></div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">* Don</ins>'t <ins class="diffchange diffchange-inline">screen-scrape </ins>the <ins class="diffchange diffchange-inline">HTML/BML output of the site. If you can't do something you want to do through an API, let us know, and we'll try to add an API for it</ins>.</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* <ins class="diffchange diffchange-inline">Try </ins>to <ins class="diffchange diffchange-inline">avoid asking for users' passwords. If there's something </ins>you <ins class="diffchange diffchange-inline">can't </ins>do <ins class="diffchange diffchange-inline">through </ins>the <ins class="diffchange diffchange-inline">protocol </ins>or <ins class="diffchange diffchange-inline">through our APIs, let us know, and we'll add it. If you have to ask for users' passwords, you should </ins>tell <ins class="diffchange diffchange-inline">people what </ins>you<ins class="diffchange diffchange-inline">'ll do with them, and warn users to change their passwords before and after they access your client </ins>if <ins class="diffchange diffchange-inline">they're worried</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Client Applications ==</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Client Applications ==</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>A [[Compatible_clients|client application]] is defined as a tool that runs under the control of an end user<del class="diffchange diffchange-inline">.  For example, the Semagic client, jbackup, ljMigrate, and similar tools that are run under someone's control for personal use</del>.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>A [[Compatible_clients|client application]] is defined as a tool that runs under the control of an end user <ins class="diffchange diffchange-inline">(whether as a downloadable program or an in-browser object)</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">These </del>tools <del class="diffchange diffchange-inline">are generally unrestricted</del>. <del class="diffchange diffchange-inline"> We may, from </del>time to time, <del class="diffchange diffchange-inline">have </del>to restrict some of the API methods they use <del class="diffchange diffchange-inline">(such as syncitems</del>, <del class="diffchange diffchange-inline">getevents) </del>if there <del class="diffchange diffchange-inline">is </del>too much load on the site. <del class="diffchange diffchange-inline"> Generally speaking, though, we will not </del>do this unless it's absolutely necessary to <del class="diffchange diffchange-inline">protect </del>the <del class="diffchange diffchange-inline">good </del>functioning of the site.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">Generally, we don't restrict these </ins>tools. <ins class="diffchange diffchange-inline">From </ins>time to time, <ins class="diffchange diffchange-inline">we may need </ins>to restrict some of the API methods they use, if there<ins class="diffchange diffchange-inline">'s </ins>too much load on the site. <ins class="diffchange diffchange-inline">We won't </ins>do this unless it's absolutely necessary to <ins class="diffchange diffchange-inline">preserve </ins>the <ins class="diffchange diffchange-inline">proper </ins>functioning of the site<ins class="diffchange diffchange-inline">, and only on a temporary basis</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Third Party Sites/Utilities ==</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Third Party Sites/Utilities ==</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">Things </del>that fall into this category <del class="diffchange diffchange-inline">are more restricted</del>, <del class="diffchange diffchange-inline">as </del>they have the potential to <del class="diffchange diffchange-inline">do great harm individually</del>. <del class="diffchange diffchange-inline"> </del>We <del class="diffchange diffchange-inline">are </del>here to serve our users (which includes client applications), but third party sites that scrape data sources <del class="diffchange diffchange-inline">are not </del>our primary <del class="diffchange diffchange-inline">function</del>.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">We place more restrictions on things </ins>that fall into this category, <ins class="diffchange diffchange-inline">since </ins>they have the potential to <ins class="diffchange diffchange-inline">seriously impact site load</ins>. We<ins class="diffchange diffchange-inline">'re </ins>here to serve our users (which includes client applications), but third<ins class="diffchange diffchange-inline">-</ins>party sites that scrape data sources <ins class="diffchange diffchange-inline">aren't </ins>our primary <ins class="diffchange diffchange-inline">audience</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>Generally speaking, if your site is going to be <del class="diffchange diffchange-inline">very </del>small and <del class="diffchange diffchange-inline">hit DW little (this term is purposefully vague)</del>, you can go right ahead and do it. <del class="diffchange diffchange-inline"> </del>If <del class="diffchange diffchange-inline">it </del>becomes a problem we <del class="diffchange diffchange-inline">will </del>contact you and let you know that your particular <del class="diffchange diffchange-inline">access </del>is turning out to be <del class="diffchange diffchange-inline">hard for us</del>.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>Generally speaking, if your site is going to be small and <ins class="diffchange diffchange-inline">access Dreamwidth infrequently</ins>, you can go right ahead and do it. <ins class="diffchange diffchange-inline">(Yes, these terms are purposefully vague -- use your best judgement, and contact us with any questions.) </ins>If <ins class="diffchange diffchange-inline">your use </ins>becomes a problem<ins class="diffchange diffchange-inline">, </ins>we<ins class="diffchange diffchange-inline">'ll </ins>contact you and let you know that your particular <ins class="diffchange diffchange-inline">tool </ins>is turning out to be <ins class="diffchange diffchange-inline">a load problem. This is one of the reasons why it's so critical to include contact information in your user agent</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">On the other hand, if </del>you intend to run a service (or your service gets popular) and you <del class="diffchange diffchange-inline">are doing dozens or hundreds of </del>requests, <del class="diffchange diffchange-inline">then you should </del>contact us and let us know what <del class="diffchange diffchange-inline">you are doing so </del>we can make <del class="diffchange diffchange-inline">sure we have the proper resources </del>to support your <del class="diffchange diffchange-inline">site.</del></div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">If </ins>you intend to run a service (or your service gets popular)<ins class="diffchange diffchange-inline">, </ins>and you<ins class="diffchange diffchange-inline">'re making frequent </ins>requests, contact us and let us know<ins class="diffchange diffchange-inline">. This will let us examine your tool and see </ins>what <ins class="diffchange diffchange-inline">changes </ins>we can make <ins class="diffchange diffchange-inline">on our end </ins>to <ins class="diffchange diffchange-inline">better </ins>support your use, and <ins class="diffchange diffchange-inline">what changes </ins>we can <ins class="diffchange diffchange-inline">suggest in your tool </ins>to be <ins class="diffchange diffchange-inline">gentler on </ins>the <ins class="diffchange diffchange-inline">site</ins>.</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> </div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">We ask that all third party sites access Dreamwidth APIs on a special domain: '''b.dreamwidth.org'''.  If you </del>use <del class="diffchange diffchange-inline">this domain for your XML-RPC endpoints and web access</del>, <del class="diffchange diffchange-inline">you will have full ability to access the site, but we will be able to separate which traffic is bot traffic </del>and <del class="diffchange diffchange-inline">which traffic is user traffic.  In case the site becomes overloaded, </del>we can <del class="diffchange diffchange-inline">turn off this domain </del>to <del class="diffchange diffchange-inline">mitigate third party traffic.</del></div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div> </div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div></div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">(Note: this domain doesn't work yet.  This page is just a proposal, it will </del>be <del class="diffchange diffchange-inline">implemented sometime, if </del>the <del class="diffchange diffchange-inline">proposal is well received</del>.<del class="diffchange diffchange-inline">)</del></div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== IP Rate Limiting ==</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== IP Rate Limiting ==</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>From time to time you may find your IP address temporarily banned if we determine that your site is hitting <del class="diffchange diffchange-inline">the </del>servers too <del class="diffchange diffchange-inline">hard</del>. <del class="diffchange diffchange-inline"> </del>In this case, please contact us and let us know <del class="diffchange diffchange-inline">which </del>IP <del class="diffchange diffchange-inline">has </del>been banned so we can <del class="diffchange diffchange-inline">determine how best to serve your needs</del>.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>From time to time<ins class="diffchange diffchange-inline">, </ins>you may find your IP address temporarily banned<ins class="diffchange diffchange-inline">, </ins>if we determine that your site is hitting <ins class="diffchange diffchange-inline">our </ins>servers too <ins class="diffchange diffchange-inline">frequently or causing too much of a traffic or load spike</ins>. In this case, please contact us and let us know <ins class="diffchange diffchange-inline">the </ins>IP <ins class="diffchange diffchange-inline">that's </ins>been banned so we can <ins class="diffchange diffchange-inline">work out a solution</ins>.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Dreamwidth.org]]</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Dreamwidth.org]]</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Data Sources]]</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Data Sources]]</div></td></tr>
</table>AzureLunaticDW//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=5837&oldid=prevFoxfirefey at 17:42, 13 September 20092009-09-13T17:42:25Z<p></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 17:42, 13 September 2009</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 34:</td>
<td colspan="2" class="diff-lineno">Line 34:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Dreamwidth.org]]</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>[[Category: Dreamwidth.org]]</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">[[Category: Data Sources]]</ins></div></td></tr>
</table>Foxfirefey//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=3182&oldid=prevAdalger at 19:24, 28 March 20092009-03-28T19:24:17Z<p></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 19:24, 28 March 2009</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>This page outlines a proposal for the Dreamwidth "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwidth servers.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>This page outlines a proposal for the Dreamwidth <ins class="diffchange diffchange-inline">Studios </ins>"Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwidth servers.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>'''This document is a proposal and subject to change.'''</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>'''This document is a proposal and subject to change.'''</div></td></tr>
</table>Adalger//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=3181&oldid=prevAdalger: /* Client Applications */2009-03-28T19:23:49Z<p><span dir="auto"><span class="autocomment">Client Applications</span></span></p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 19:23, 28 March 2009</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 13:</td>
<td colspan="2" class="diff-lineno">Line 13:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Client Applications ==</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>== Client Applications ==</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>A client application is defined as a tool that runs under the control of an end user.  For example, the Semagic client, jbackup, ljMigrate, and similar tools that are run under someone's control for personal use.</div></td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>A <ins class="diffchange diffchange-inline">[[Compatible_clients|</ins>client application<ins class="diffchange diffchange-inline">]] </ins>is defined as a tool that runs under the control of an end user.  For example, the Semagic client, jbackup, ljMigrate, and similar tools that are run under someone's control for personal use.</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>These tools are generally unrestricted.  We may, from time to time, have to restrict some of the API methods they use (such as syncitems, getevents) if there is too much load on the site.  Generally speaking, though, we will not do this unless it's absolutely necessary to protect the good functioning of the site.</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>These tools are generally unrestricted.  We may, from time to time, have to restrict some of the API methods they use (such as syncitems, getevents) if there is too much load on the site.  Generally speaking, though, we will not do this unless it's absolutely necessary to protect the good functioning of the site.</div></td></tr>
</table>Adalger//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=2398&oldid=prevFoxfirefey: categorize2009-02-22T09:32:39Z<p>categorize</p>
<table class='diff diff-contentalign-left'>
<col class='diff-marker' />
<col class='diff-content' />
<col class='diff-marker' />
<col class='diff-content' />
<tr style='vertical-align: top;'>
<td colspan='2' style="background-color: white; color:black; text-align: center;">← Older revision</td>
<td colspan='2' style="background-color: white; color:black; text-align: center;">Revision as of 09:32, 22 February 2009</td>
</tr><tr><td colspan="2" class="diff-lineno">Line 32:</td>
<td colspan="2" class="diff-lineno">Line 32:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>From time to time you may find your IP address temporarily banned if we determine that your site is hitting the servers too hard.  In this case, please contact us and let us know which IP has been banned so we can determine how best to serve your needs.</div></td><td class='diff-marker'> </td><td style="background-color: #f9f9f9; color: #333333; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #e6e6e6; vertical-align: top; white-space: pre-wrap;"><div>From time to time you may find your IP address temporarily banned if we determine that your site is hitting the servers too hard.  In this case, please contact us and let us know which IP has been banned so we can determine how best to serve your needs.</div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color:black; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">[[Category: Dreamwidth.org]]</ins></div></td></tr>
</table>Foxfirefey//wiki.dreamwidth.net/wiki/index.php?title=Bot_Policy&diff=2360&oldid=prevXb95: New page: This page outlines a proposal for the Dreamwidth "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwid...2009-02-21T07:07:02Z<p>New page: This page outlines a proposal for the Dreamwidth "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwid...</p>
<p><b>New page</b></p><div>This page outlines a proposal for the Dreamwidth "Bot Policy", the rules that third party applications and tools must abide by in order to prevent being blocked from accessing the Dreamwidth servers.<br />
<br />
'''This document is a proposal and subject to change.'''<br />
<br />
== General Purpose Guidelines ==<br />
<br />
Things to keep in mind that are just generally useful:<br />
<br />
* Good clients send a proper user-agent (or other info string) that includes a contact email address.<br />
* Be kind to the system, try to rate limit your requests, don't abuse the servers.<br />
* DW staff and volunteers are more than happy to work with you to do neat projects, fix problems in the servers, or tell you if something is good or not. Just ask!<br />
<br />
== Client Applications ==<br />
<br />
A client application is defined as a tool that runs under the control of an end user. For example, the Semagic client, jbackup, ljMigrate, and similar tools that are run under someone's control for personal use.<br />
<br />
These tools are generally unrestricted. We may, from time to time, have to restrict some of the API methods they use (such as syncitems, getevents) if there is too much load on the site. Generally speaking, though, we will not do this unless it's absolutely necessary to protect the good functioning of the site.<br />
<br />
== Third Party Sites/Utilities ==<br />
<br />
Things that fall into this category are more restricted, as they have the potential to do great harm individually. We are here to serve our users (which includes client applications), but third party sites that scrape data sources are not our primary function.<br />
<br />
Generally speaking, if your site is going to be very small and hit DW little (this term is purposefully vague), you can go right ahead and do it. If it becomes a problem we will contact you and let you know that your particular access is turning out to be hard for us.<br />
<br />
On the other hand, if you intend to run a service (or your service gets popular) and you are doing dozens or hundreds of requests, then you should contact us and let us know what you are doing so we can make sure we have the proper resources to support your site.<br />
<br />
We ask that all third party sites access Dreamwidth APIs on a special domain: '''b.dreamwidth.org'''. If you use this domain for your XML-RPC endpoints and web access, you will have full ability to access the site, but we will be able to separate which traffic is bot traffic and which traffic is user traffic. In case the site becomes overloaded, we can turn off this domain to mitigate third party traffic.<br />
<br />
(Note: this domain doesn't work yet. This page is just a proposal, it will be implemented sometime, if the proposal is well received.)<br />
<br />
== IP Rate Limiting ==<br />
<br />
From time to time you may find your IP address temporarily banned if we determine that your site is hitting the servers too hard. In this case, please contact us and let us know which IP has been banned so we can determine how best to serve your needs.</div>Xb95