Talk:BrewWiki.com

Blocking user agent
When User:Bumble Bee tries to connect to this wiki and get stats it fails with an 403 Forbidden error. The server in question is blocking the request. This is what it looks like from :

% curl -A "Python-urllib/2.7 (WikiApiary; Bumble Bee; +http://wikiapiary.com/wiki/User:Bumble_Bee)" "http://www.brewwiki.com/api.php?action=query&meta=siteinfo&siprop=statistics&format=json" <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

HTTP Error 403 Error 403 We're sorry, but we could not fulfill your request for /api.php?action=query&amp;meta=siteinfo&amp;siprop=statistics&amp;format=json on this server. You do not have permission to access this server. Your technical support key is: 40f4-39e2-17f4-e8c8 You can use this key to fix this problem yourself. If you are unable to fix the problem yourself, please contact brewwiki at brewwiki.com and be sure to provide the technical support key shown above.

If the request is repeated from curl without specifying a user agent it works:

% curl "http://www.brewwiki.com/api.php?action=query&meta=siteinfo&siprop=statistics&format=json" {"query":{"statistics":{"pages":293,"articles":140,"edits":12864,"images":159,"users":6255,"activeusers":22,"admins":4,"jobs":0}}}

The issue is clearly not Bumble Bee, as this curl which works shows:

% curl -A "(WikiApiary; Bumble Bee; +http://wikiapiary.com/wiki/User:Bumble_Bee)" "http://www.brewwiki.com/api.php?action=query&meta=siteinfo&siprop=statistics&format=json" {"query":{"statistics":{"pages":293,"articles":140,"edits":12864,"images":159,"users":6255,"activeusers":22,"admins":4,"jobs":0}}}

The 403 block is in place on the Python  signature.

% curl -A "Python-urllib/2.7" "http://www.brewwiki.com/api.php?action=query&meta=siteinfo&siprop=statistics&format=json" <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">

HTTP Error 403 Error 403 We're sorry, but we could not fulfill your request for /api.php?action=query&amp;meta=siteinfo&amp;siprop=statistics&amp;format=json on this server. You do not have permission to access this server. Your technical support key is: 40f4-39e2-17f4-e8c8 You can use this key to fix this problem yourself. If you are unable to fix the problem yourself, please contact brewwiki at brewwiki.com and be sure to provide the technical support key shown above.

The message in the 403 return suggests that this is a block that is put in place by the ISP, not the wiki.

This makes me wonder, perhaps the user agent for Bumble Bee should drop the  signature and just identify itself as Bumble Bee with no descriptive information of the technology used.

The block here can actually be bypassed just by changing "Python" to "python" in the user agent as well.

% curl -A "python-urllib/2.7" "http://www.brewwiki.com/api.php?action=query&meta=siteinfo&siprop=statistics&format=json" {"query":{"statistics":{"pages":293,"articles":140,"edits":12864,"images":159,"users":6255,"activeusers":22,"admins":4,"jobs":0}}}

Thingles (talk) 20:01, 18 January 2013 (UTC)


 * Hmm, I think it will just be a matter of time before the ISP blocks "python" as well. I think the user agent information should be dropped. All interesting information is provided on Bumble Bees page and it would also save a couple of KB in the server log. However, I guess that it is a matter of good manners to make Bumble Bee respect the robots exclusion standard, i. e. a  --&#91;&#91;kgh&#93;&#93; (talk) 10:18, 19 January 2013 (UTC)