Crawler Service Delay

Incident Report for Crawldesk

Resolved

Impact: Some customers experienced slower-than-usual syncing of their documentation into Crawldesk search.

Timeline: 5 Sept 2025, 10:15–12:45 IST

Cause: A sudden spike in crawl requests created a queue backlog.

Fix: Additional worker capacity was added to clear the backlog.

Follow-up: We’re adjusting auto-scaling rules to handle traffic spikes more smoothly in the future.

Posted Sep 05, 2025 - 09:17 UTC

This incident affected: Crawler Service.