This is a toy project I built at home for fun. Not intended for production use.
Krolla is tool that uses Puppeteer to inform users about Mixed Content usage on their brand-new https://
websites.
- Add crawling ability
- Create a worker pool so that the code doesn't create millions of Puppeteer instances
- Add jsdoc
- Move class Worker to a separate module
- Improve error handling in async chains
- Implement actual reporting
- Make it so that each
worker
doesn't have to wait on others to keep on crawling - Use Puppeteer further to report Mixed Content
- Cleanup / refactoring
- Add throttling capabilities
- Explore streams
- Explore generators to implement the pending urls queue