personalized search engine that crawls thru a predefined set of domains and puts it to a database for user to search.
debugging
Fix frontend, try to speed up queries, add wikipedia integration
Log in to leave a comment
I decided to make it more user-friendly and usable, not relient on the system admin. The most challeging thing is the database design, that was changed a lot since last ship.
Add user supported crawling and bug fixes in engine
Change database structure to distinguish between user-added pages and system-added.
Log in to leave a comment
Add statistics page, fix routing in react, Massively improve search engine, change database structure, bug fixes + more
Log in to leave a comment
I started it out when i wanted to create a search engine for myself to replace Google, however mid coding i realized the hardest part is data gathering, many websites will block you unless you use proxies, which i lack, so i got it a functional state, and ended it here.
Improve frontend a bit, and make search engine smarter & remove crawling ? urls
Touchups
Bug fixes
Log in to leave a comment
Add basic frontend
Fix crawler looping problem
Implement not very good search algorithm
Log in to leave a comment
Start of the backend server, analyze page, respect robots.txt, read page, store to database
Log in to leave a comment