Obtain data successfully from encrypted packet and do basic scheme server -> proxy and vice-versa
0
Log in to leave a comment
Activity
Fix frontend, try to speed up queries, add wikipedia integration
0
Log in to leave a comment
Shipped this project!
I decided to make it more user-friendly and usable, not relient on the system admin. The most challeging thing is the database design, that was changed a lot since last ship.
Add user supported crawling and bug fixes in engine
Change database structure to distinguish between user-added pages and system-added.
0
Log in to leave a comment
Add statistics page, fix routing in react, Massively improve search engine, change database structure, bug fixes + more
0
Log in to leave a comment
Shipped this project!
I started it out when i wanted to create a search engine for myself to replace Google, however mid coding i realized the hardest part is data gathering, many websites will block you unless you use proxies, which i lack, so i got it a functional state, and ended it here.
Improve frontend a bit, and make search engine smarter & remove crawling ? urls
Touchups
Bug fixes
0
Log in to leave a comment
Add basic frontend
Fix crawler looping problem
Implement not very good search algorithm
- Several bug fixes
0
Log in to leave a comment
Start of the backend server, analyze page, respect robots.txt, read page, store to database
0
Log in to leave a comment