For developers looking to regularly send thousands of keyword jobs to our API, here are some recommended guidelines on how to 'batch-up' and send your jobs to us.
Please do follow these suggestions in conjunction with observing the methods and processes described in the full SERPs API documentation.
Request Limitations
The default limit is 70 POST requests per second.
Recommended limit: Send a maximum of 5 concurrent requests per second to avoid hitting the limit.
Batch Processing
A single POST request now takes ~200 ms, which means one thread can create up to 5 jobs per second.
With 5 concurrent threads, you can create up to 90,000 jobs per hour, depending on network conditions and distance.
Sending Jobs
Send all your daily jobs at once with a callback URL.
Wait for the callback from our system to confirm job completion.
Avoiding Gaps in Processing
Do not rely on batches where you send, for example, 500 jobs, wait for their completion, and then send another batch.
This method can cause processing gaps due to the time needed to finish the last jobs of the first batch and the creation of new jobs for the second batch.
If you have any questions or need an increase in limits then please contact our team at support@authoritas.com.