reading-notes

Web Scraping

Web scraping is essentially ripping info off a website automatically.
when web scraping, it is important to read through the sites terms and conditions to understand if youre legally allowed to use their data.
make sure not to scrape the data too fast because you could break the site and potentially be banned from it as a result.
many sites block or automatically ban when scraping
use the inspect on the browser to find the exact html element you want to target
you can use many cool libraries like playwrite and chromium to assist in scraping
web scraping can be used to automate actions on a website. useful for gaining info automatically or even to test the site repeatedly