Skip to content

基于百度、搜狗、360等浏览器的爬虫,集成百度贴吧爬虫

Notifications You must be signed in to change notification settings

zhaohaihao/crawler-engine

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

crawler-engine

基于百度、搜狗、360等浏览器的爬虫,集成百度贴吧爬虫

cralwer-search

负责百度、搜狗、360等搜索引擎以及百度贴吧内容、图片等搜索结果数据的爬取

crawler-data-process

负责对上述爬虫所得数据的以下操作:
数据打包(目前只支持excel格式)、
加密压缩、
解密解压缩、
解析入库

开发完善中...

About

基于百度、搜狗、360等浏览器的爬虫,集成百度贴吧爬虫

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages