Started the project. It currently can recursively scan through a webpage tree and download all files/routes it finds. Has simple deduplication. Currently, there is no file structure.
All file names, hashes and locations are stored in a sqlite database.
0
Log in to leave a comment