Timeout Settings
When it comes to timeouts, Scraping Robot has you covered with a default timeout of 120 seconds (2 minutes). This setting ensures that your scraping requests are handled efficiently, even when faced with temporary challenges like bans or delays. Here’s everything you need to know about our timeout process:
Why 120 Seconds?
Our default timeout is designed to balance efficiency and reliability. If a request encounters a temporary ban or other obstacles, Scraping Robot automatically retries the request until it succeeds—without any extra effort on your part. This means:
No charges for retries or failed attempts.
Only the final, successful scrape is billed.
We recommend setting your software to match this timeout (120 seconds) to ensure smooth operation.
What Happens If You Cancel Early?
If you cancel a request before the 2-minute timeout, keep in mind that the request will still be charged. That’s because resources are already allocated to handle the scrape, even if you decide to cancel midway.
Last updated