A web scraping provider is an essential vendor or provider to most organizations, especially the highly data-driven organizations.
The early wave of outsourcing led to a significant body of knowledge on how to evaluate outsourcing providers or vendors. Google has about 1500 pages related to these two common phrases. However, there is barely any information on how to evaluate web scraping or data scraping vendors or service providers
Web scraping service providers or vendors are somewhat similar to outsourcing providers in a general sense just like web scraping software is similar to software. As you can see that comparison while valid, does not really provide a good blueprint or checklist for evaluation.
We will help create a RFP (Request for Proposal) or RFI (Request for Information) template for web scraping services through the rest of this article.
Key criteria for evaluation
The questions above should provide a good starting point to help you evaluate the vendor. It is important to not just copy paste these questions, but instead to “make them your own” based on your needs and criteria.
e.g. Information Security may not be applicable to most organizations because the data gathered is public data anyway.