Forum OpenACS Development: Load on OpenACS.org

Collapse
Posted by Gustaf Neumann on
Dear all,

I have noticed a large number of requests from the Alibaba hosting space — at times more than 100 requests per second — targeting the relatively slow /bugtracker pages. These requests were handled by the default connection pool and therefore had a negative impact on regular site interactions.

To reduce the impact on ordinary traffic, I have moved these requests to the resource-limited bots connection pool. From the Munin statistics, it looks like longer sequences of such requests have already been occurring for about a week.

We may need to consider additional measures to handle this more robustly, for example stricter rate limiting, more specific filtering of expensive bugtracker queries, or caching/limiting some of the generated list views.

Best regards,
Gustaf