Skip to content

Releases: viperior/sea-spider

v1.3.1

29 Sep 11:41
Compare
Choose a tag to compare
v1.3.1 Pre-release
Pre-release

Issues fixed

  • Bump urllib3 from 1.26.4 to 1.26.7

v1.3.0

16 Apr 19:39
Compare
Choose a tag to compare

Issues fixed

  • Ensure the log file is created automatically when the spider is activated for the first time
  • Replace calls to the deprecated function, logging.warn() with logging.warning()
  • Bump urllib3 version from 1.26.3 to 1.26.4

Improvements

  • Add timestamp to log lines
  • Add VS Code settings directory to .gitignore
  • Add namespace condition to the self-call to main() in the seaspider module

v1.2.0

01 Mar 05:55
Compare
Choose a tag to compare

New features

  • Errors are visually highlighted in the report
  • Basic navigation for report
  • Add timestamp to report

Improvements

  • Status icons in the status cloud can be clicked
  • URLs in report details can be clicked

v1.1.0

26 Feb 04:26
Compare
Choose a tag to compare

New features

  • Crawl a list of URLs stored in CSV format
  • Generate HTML report with crawl results
  • Quickly purge the crawl cache with purge_cache.py

Issues fixed

  • Classify http: links without redirects as problems

Improvements

  • Add more detail on basic usage and modifying values in the config file

v1.0.0

22 Feb 02:50
Compare
Choose a tag to compare

New features

  • Recursive exploration
  • Cache crawl results to JSON files
  • Restrict crawler to origin domain
  • Report status code statistics

v0.1.0

21 Feb 05:07
Compare
Choose a tag to compare

New features

  • Simple SEO spider that checks for broken links on a target URL