Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CzechVR, LethalHardcoreVR, and VRHush scrapers not working. #1718

Open
dudeGuy2342 opened this issue May 3, 2024 · 5 comments
Open

CzechVR, LethalHardcoreVR, and VRHush scrapers not working. #1718

dudeGuy2342 opened this issue May 3, 2024 · 5 comments

Comments

@dudeGuy2342
Copy link

dudeGuy2342 commented May 3, 2024

CzechVR doesn't scrape dates beyond first page.
LethalHardcoreVR scrapes nothing.
VRHush VRP Hub scrapes scenes from up to one before the last of the 2nd page twice.
VRHush doesn't scrape scenes beyond first page.

@dudeGuy2342 dudeGuy2342 changed the title CzechVR, LethalHardcoreVR, and VRHush scrappers not working. CzechVR, LethalHardcoreVR, and VRHush scrapers not working. May 3, 2024
@theRealKLH
Copy link
Collaborator

theRealKLH commented May 3, 2024

Using an empty DB...

  • CzechVR, I just scraped 1372 scenes. You may be a few releases behind. there was a czechvr scraper update last month
  • VRHush/VRAllure, I just scraped 809 scenes (check that you aren't getting caught by captcha)
  • VRHush VRP Hub, I just scraped 551 scenes (MANY dupes). Scraper needs an update (or just don't use it)
  • LethalHardcore recently updated their site to use React ( LethalHardcoreVR not scraping #1696 ), so that scraper is DEAD! you'll have to do "custom scraper" (Advanced / Create Custom Site) via SLR or POVR or VRPORN or VRPHUB

@dudeGuy2342
Copy link
Author

dudeGuy2342 commented May 3, 2024

Nope, I was using the current version. When I roll back to 0.4.22 I am able to scrape all CzechVR scenes, just no dates past the first page, and am able to fully scrape VRHush. However, 0.4.25 have the stated issues.

@Saturnix
Copy link

Nope, I was using the current version. When I roll back to 0.4.22 I am able to scrape all CzechVR scenes, just no dates past the first page, and am able to fully scrape VRHush. However, 0.4.25 have the stated issues.

When scraping single scenes, use links from czechvrnetwork.com instead of czechvr.com

The bug only appears on the latter. I think it used to work on both, but I'm unsure.

@SturmB
Copy link

SturmB commented Sep 11, 2024

LethalHardcore recently updated their site to use React ( #1696 ), so that scraper is DEAD! you'll have to do "custom scraper" (Advanced / Create Custom Site) via SLR or POVR or VRPORN or VRPHUB

@theRealKLH Could you explain the best procedure for doing this? I've attempted to add a custom site for LethalHardcore using SLR and although I'm pretty sure I filled the fields in correctly, it only seems to scrape one scene.

image

@SturmB
Copy link

SturmB commented Sep 12, 2024

Please disregard my previous comment. I was just missing a step, apparently. This morning, after a re-scrape, it found all the other scenes. Yay!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants