Frequently Asked Questions
What counts as a page?
A page is a webpage and we describe it in detail here. For our billing purposes a page is a HTTP request (generally a HTTP GET or POST request but could be more). A redirect request can trigger more page requests and AJAX or XHR requests can trigger more page requests.
WHY iS A SETUP FEE REQUIRED?
We need to program and build software to your exact specification. Then we need to test it and perform Quality Assurance (QA) to ensure it meets your needs. All these human intensive actions are included in our nominal setup fees.
Do I need to download software or build my own scraper?
No. Our “full service” includes everything. You do not need to download software or write scrapers or worry about getting blocked or proxies or servers etc. We do everything for you and you just get the data back from us.
WHAT's INCLUDED IN THE MONTHLY SUBSCRIPTION?
Our monthly subscription includes all the costs associated with the data gathering – ie servers, bandwidth, proxy costs etc. It also includes monitoring for website structure changes and handling most common changes. Also included is the data quality checks we perform and the support we provide.
What is the difference between the on-demand and susbscription plans?
The On-Demand plan is for one-off data needs. If you need the data once or if you need the data less frequently, say whenever you want a data refresh, the on-demand plan may work better. Our subscription plans provide the cheapest per-unit pricing but they require a monthly subscription.
can we outsource our in-house operations to scrapehero?
Yes. We specialize in taking over small and large scale in-house scraping operations and building a transition plan that does not impact ongoing operations. Most companies that reach out to us have outgrown in-house operations that have issues everyday, are expensive and hard to maintain.
can you provide data using an api?
Yes. We build custom APIs frequently and you can get data returned back to you using a typical REST API. You can use our API to get finite amount of data back in realltime and also trigger certain control actions.
do you work with corporate procurement, ACCOUNTING, legal and compliance departments?
Yes. We work with large global organizations to build custom contracts and also handle various corporate payment methods. We also include legal and compliance groups in our workflow to ensure our customers are comfortable with how we gather data.