Suggestions? Try wpull , wail, heritrix. Also: https://github.com/BruceDone/awesome-crawler
A very efficient crawl is hard, maybe resign yourself to mediocrity and use what works but for a bit longer. When done, maybe share because one copy rarely survives.
Re: The End
- Forum: Announcements
- Topic: The End
- Replies: 591
- Views: 1840050
- Tue Nov 24, 2020 6:15 pm
- Jump to post