The crawler has now caught up with the queue, and operations are back to normal. We apologize for any inconveniences caused.

We were hit by multiple, simultaneous issues today. Those issues have now been resolved and the crawler is running again. However, we have built up a rather large queue, so sites will still be delayed a while yet.

We are currently experiencing substantial delays in the crawl queue, and as a consequence many crawls are delayed. We're investigating the situation with highest priority.