Limits

1min

Collection Limits
Rainforest API imposes the following limits on Collections. If you wish to discuss changing a particular limit on your account please contact [email protected]﻿
Resource
Limit
Collections per Account
10,000 
You can have up to 10,000 Collections set up on your account at any one time. To add more you should delete old or unused Collections.
Requests per Collection
15,000 when using include_html=false 
100 when using include_html=true 
Note When adding requests with include_html=true to a Collection the maximum number of requests is lower (100) because including the HTML within the response makes the Collection Result Sets much larger. The limit is in place to ensure Result Set files are of a manageable size. If you have need to run a large number of requests all with include_html=true then simply split the requests across multiple 100-request Collections.  
Note When adding requests with the max_page parameter (for Automatic Pagination) the total requests in a Collection is the combination of max_page X number of requests . For example, for a Collection populated with requests with max_page=10 set the maximum number of requests that could be added to the Collection would be 1,500 (rather than 15,000).
Requests Added per API Request
1,000 
Add 1,000 requests per API request, up to the maximum of 15,000.
Requests Added per Bulk CSV Upload
15,000
Automatic Pagination
When adding requests with the max_page parameter set (for automatic pagination) the maximum max_page value is 100 (meaning for each request up to 100 pages will be automatically retrieved).
Collections Expire After
2 months 
Any Collection that has not been started for over 2 months is automatically deleted. Collections can be set to expire sooner on the Profile page of the Dashboard.
Result Sets Expire After
14 days 
Result Sets are available to download for 14 days.
Concurrently Running Collections
5 for Collections with up to 250 Requests 
1 for Collections with greater than 250 Requests 
Customized concurrency settings can be arranged on request. If you have a specific thruput requirement required please contact our Support Team to discuss.
Queued Collections
There is no limit on the number of Collections you can start. They will be queued until a slot to process them is available.
Execution Speed
Rainforest API runs all Requests within a Collection concurrently. As a guide, a Collection containing the maximum 15,000 Requests will take 2-3 minutes to return results.
﻿

Resource	Limit
Collections per Account	10,000 You can have up to 10,000 Collections set up on your account at any one time. To add more you should delete old or unused Collections.
Requests per Collection	15,000 when using include_html=false 100 when using include_html=true Note When adding requests with include_html=true to a Collection the maximum number of requests is lower (100) because including the HTML within the response makes the Collection Result Sets much larger. The limit is in place to ensure Result Set files are of a manageable size. If you have need to run a large number of requests all with include_html=true then simply split the requests across multiple 100-request Collections. Note When adding requests with the max_page parameter (for Automatic Pagination) the total requests in a Collection is the combination of max_page X number of requests . For example, for a Collection populated with requests with max_page=10 set the maximum number of requests that could be added to the Collection would be 1,500 (rather than 15,000).
Requests Added per API Request	1,000 Add 1,000 requests per API request, up to the maximum of 15,000.
Requests Added per Bulk CSV Upload	15,000
Automatic Pagination	When adding requests with the max_page parameter set (for automatic pagination) the maximum max_page value is 100 (meaning for each request up to 100 pages will be automatically retrieved).
Collections Expire After	2 months Any Collection that has not been started for over 2 months is automatically deleted. Collections can be set to expire sooner on the Profile page of the Dashboard.
Result Sets Expire After	14 days Result Sets are available to download for 14 days.
Concurrently Running Collections	5 for Collections with up to 250 Requests 1 for Collections with greater than 250 Requests Customized concurrency settings can be arranged on request. If you have a specific thruput requirement required please contact our Support Team to discuss.
Queued Collections	There is no limit on the number of Collections you can start. They will be queued until a slot to process them is available.
Execution Speed	Rainforest API runs all Requests within a Collection concurrently. As a guide, a Collection containing the maximum 15,000 Requests will take 2-3 minutes to return results.

Overview

Priorities