This is a website that scrapes stores like newegg for deals on PC parts since I want to build a PC.
This is a website that scrapes stores like newegg for deals on PC parts since I want to build a PC.
I did a bunch of work to scrape newegg with a cors proxy. I’m going to set up my own proxy if I get around to it since the public ones either don’t work and tell me they don’t support ipv6 or are unreliable. I also tried and failed to scrape ebay. They have pretty good bot protection. I would have to make it a node application and run it in a headless browser, and have the user do any bot tests for it. Idk if I want PC deals that badly. The other option is to sign up for ebay’s dev program and I don’t really want to read through their agreement they make you sign to figure out if what I’m doing is frowned upon.
Log in to leave a comment
I made a working website that fetches from the newegg api and presents that to the user. I’m working on different requests to newegg and other sites.
Log in to leave a comment