Property:Has bot segment

Has bot segment is a Has type::Number and is assigned by Template:Website. The purpose of this property is to group Category:Websites into a small number of groups for bots to separately collect information for. As the number of websites increases above several hundred, User:Bumble Bee will operate better by doing multiple sites concurrently. Rather than introducing a lot of complexity with multithreaded programming in the bot, we instead just group the sites into multiple segments and the scripts can then deal with subsets of the sites concurrently, with multiple processes.

This property using a modulo of the  by the number of bots running. Segment 0 will always exist (because modulo 1 of any integer is 0). Currently this property is modulo 2, thus creating two segments 0 and 1. The statistics scripts then run 2 at a time via cron, with one instance taking segment 0 and the other segment 1.

Currently the breakdown across  websites: