Skip to content

A little web scraping project for creating a calendar that will be populated with SIFF Egyptian movies

License

Notifications You must be signed in to change notification settings

MatthewWolff/SIFFCalendarScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SIFFCalendarScraper

A little web scraping project for populating subscribable Google Calendars with weekly SIFF movie screenings! (not affiliated with SIFF)

Join one of the calendars - linktr.ee/SIFFCalendars

Getting Started

  1. Getting API Credentials

  2. Update the workspace + constants

    • Once you have your API credentials, create a file in the workspace root called credentials.json
    • You'll then need to update the constants.py so that the GoogleCalendar enum points at your calendar(s)
  3. Install dependencies

    make install

    Alternatively, you can set up a virtual environment to avoid polluting your global pip environment:

    python -m venv .venv
    source .venv/bin/activate
    pip install -r requirements.txt
  4. Run it! It will print logs to standard out as well as to a log file

    ./runner  # note: if you're using a venv, you'll need to update the runner's shebang
  5. Set up a crontab with crontab -e. I added this line so that it runs twice a day:

    0 8,17 * * * /home/matthew/SIFFCalendarScraper/runner >> calendar.error.log 2>&1
    

    Because I'm running this on a raspberry-pi, I created a separate branch for pi-specific changes. Here's the diff: raspberry-pi

About

A little web scraping project for creating a calendar that will be populated with SIFF Egyptian movies

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published