Monday, October 20, 2025

Snow Plough backend.

I have the Snow Plow backend running on vps.snowscraper.ca that will do the heavy lifting of scraping sites. Especially those with dynamically generated content. The cpu / memory requirements for such pages are beyond the pi zero 2's capabilities. It will also allow for me to collaborate all the scraped data from the resorts to create interesting charts and statistics, such as: all resort bases among other neat metrics in the future. As well, it will also allow for a centralized database of all the resorts data so that if they change their website structure I can easily update it on there and all the snow scrapers will have access to the correct data.

No comments:

Post a Comment

Snow Plough backend.

I have the Snow Plow backend running on  vps.snowscraper.ca  that will do the heavy lifting of scraping sites. Especially those with dynamic...