Skip to content

turtlescrape is a very simple project to turn web scraping from multiple lines of code down into just one line by using BeautifulSoup4 in the background.

License

Notifications You must be signed in to change notification settings

maturner5/turtlescrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

turtlescrape

This is a very simple project written in Python 3.8.5 to make scraping websites easier so you don't have to type all of the code for the library yourself.

This project uses these libraries: BeautifulSoup4, urllib.request and sys.

Install

Command:

pip install turtlescrape

You must also have BeautifulSoup4 installed.

Usage

Right now this project only has one function: turtlescrape().

To call it simply

from __init__ import turtlescrape

turtlescrape(url, *args, **kwargs)

Look at the example project in order to get a feel for it.

Notice

This project is most definetly broken in ways. But we all start somewhere, so input is definetly appreciated.

Not all websites let you scrape them. I have yet to figure out a workaround for that problem so in the meantime this code just throws up an error.

About

turtlescrape is a very simple project to turn web scraping from multiple lines of code down into just one line by using BeautifulSoup4 in the background.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages