What can we generally scrape? We only scrape public data.  Public Data Public data is any data/information/text available on a website that does not require you to login and is not prohibited from being accessed in the sites robots.txt file. How to check The easiest way to verify if the data is public or private … Continue reading Public vs Private Data