Web-Crawling for All: A Universal, Accessible Framework for Collecting Digital Data

The demand for more efficient analytical research tools is on the rise as data scientists and academics alike pursue more robust data-driven results in their studies. Suppose you have some population of interest you would like to observe, such as a set of schools, individuals with a specific profession, etc. that has a digital footprint. How does one go about gathering all the available data on the desired community, ensuring completeness while maintaining the right focus?

Project Report