Releases: mikf/gallery-dl
Releases · mikf/gallery-dl
v1.26.5
Extractors
Additions
- [deviantart] add
intermediary
option (#4955) - [inkbunny] add
unread
extractor (#4934) - [mastodon] support non-numeric status IDs (#4936)
- [myhentaigallery] recognize
/g/
URLs (#4920) - [postmill] add support (#4917, #4919)
- {shimmie2[ support
rule34hentai.net
(#861, #4789, #4945)
Fixes
- [deviantart] add workaround for integer
client-id
values (#4924) - [exhentai] fix error for infinite
fallback-retries
(#4911) - [inkbunny] stop pagination on empty results
- [patreon] fix bootstrap data extraction again (#4904)
- [tumblr] fix exception after waiting for rate limit (#4916)
Improvements
- [exhentai] output continuation URL when interrupted (#4782)
- [inkbunny] improve
/submissionsviewall.php
patterns (#4934) - [tumblr] support infinite
fallback-retries
- [twitter] default to
tweets
timeline whenreplies
are enabled (#4953)
Metadata
- [danbooru] provide
tags
as list (#4942) - [deviantart] set
is_original
for intermediary URLs tofalse
- [twitter] remove
date_liked
(#3850, #4108, #4657)
Docker
- add Docker instructions to README (#4850)
- fix auto-generation of
latest
tags
v1.26.4
Extractors
Additions
- [exhentai] add
fallback-retries
option (#4792) - [urlgalleries] add
gallery
extractor (#919, #1184, #2905, #4886)
Fixes
- [nijie] fix image URLs of multi-image posts (#4876)
- [patreon] fix bootstrap data extraction (#4904, #4906)
- [twitter] fix
/media
timelines (#4898, #4899) - [twitter] retry API requests when response contains incomplete results (#4811)
Improvements
- [exhentai] store more cookies when logging in with username & password (#4881)
- [twitter] generalize "Login Required" errors (#4734, #4324)
Options
- add
-e/--error-file
command-line andoutput.errorfile
config option (#4732)
Miscellaneous
- automatically build and push Docker images
- prompt for passwords on login when necessary
- fix
util.dump_response()
to work withbytes
header values
v1.26.3
Extractors
Additions
- [behance] support
text
modules (#4799) - [behance] add
modules
option (#4799) - [blogger] support
www.micmicidol.club
(#4759) - [erome] add
count
metadata (#4812) - [exhentai] add
gp
option (#4576) - [fapello] support
.su
TLD (#4840, #4841) - [pixeldrain] add
file
andalbum
extractors (#4839) - [pixeldrain] add
api-key
option (#4839) - [tmohentai] add
gallery
extractor (#4808, #4832)
Fixes
- [cyberdrop] update to site layout changes
- [exhentai] handle
Downloading … requires GP
errors (#4576, #4763) - [exhentai] fix empty API URL with
"source": "hitomi"
(#4829) - [hentaifoundry] check for and update expired sessions (#4694)
- [hiperdex] fix
manga
metadata - [idolcomplex] update to site layout changes
- [imagefap] fix resolution of single images
- [instagram] fix exception on empty
video_versions
(#4795) - [mangaread] fix extraction
- [mastodon] fix reblogs (#4580)
- [nitter] fix video extraction (#4853, #4855)
- [pornhub] fix
user
metadata for gifs - [tumblr] fix
day
extractor - [wallpapercave] fix extraction
- [warosu] fix file URLs
- [webtoons] fix pagination when receiving an HTTP redirect
- [xvideos] fix metadata extraction
- [zerochan] fix metadata extraction
Improvements
- [hentaicosplays] force
https://
for download URLs - [oauth] warn when cache is enabled but not writeable (#4771)
- [sankaku] update URL patterns
- [twitter] ignore promoted Tweets (#3894, #4790)
- [weibo] detect redirects to login page (#4773)
Removals
- [foolslide] remove
powermanga.org
Downloaders
Changes
- [http] treat files not passing
filesize-min
/-max
as skipped (#4821)
Options
Additions
- add
metadata-extractor
option (#4549) - support
metadata-*
names for*-metadata
options
(for exampleurl-metadata
is now also recognized asmetadata-url
)
CLI
Additions
- implement
-I/--input-file-comment
and-x/--input-file-delete
options (#4732) - add
--ugoira
as a general version of--ugoira-conv
and co. - add
--mtime
as a general version of--mtime-from-date
- add
--cbz
Fixes
- allow
--mtime-from-date
to work with Weibo`s metadata structure
Miscellaneous
Additions
- add a simple Dockerfile (#4831)
v1.26.2
Extractors
Additions
- [4archive] add
thread
andboard
extractors (#1262, #2418, #4400, #4710, #4714) - [hitomi] recognize
imageset
gallery URLs (#4756) - [kemonoparty] add
revision_index
metadata field (#4727) - [misskey] support
misskey.design
(#4713) - [reddit] support Reddit Mobile share links (#4693)
- [sankaku] support
/posts/
tag search URLs (#4740) - [twitter] recognize
fixupx.com
URLs (#4755)
Fixes
- [exhentai] update to site layout changes (#4730, #4754)
- [exhentai] provide fallback URLs (#1021, #4745)
- [exhentai] disable
DH
ciphers to avoidDH_KEY_TOO_SMALL
errors (#1021, #4593) - [idolcomplex] disable sending Referer headers (#4726)
- [instagram] update API headers
- [kemonoparty] fix parsing of non-standard
date
values (#4676) - [patreon] fix
campaign_id
extraction (#4699, #4715, #4736, #4738) - [pixiv] load cookies for non-OAuth URLs (#4760)
- [twitter] fix avatars without
date
information (#4696) - [twitter] restore truncated retweet texts (#3430, #4690)
- [weibo] fix Sina Visitor requests
Improvements
- [behance] unescape embed URLs (#4742)
- [fantia] simplify
tags
to a list of strings (#4752) - [kemonoparty] limit
title
length (#4741) - [nijie] set 1-2s delay between requests to avoid 429 errors
- [patreon] provide ways to manually specify a user's campaign_id
https://www.patreon.com/id:12345
https://www.patreon.com/USER?c=12345
https://www.patreon.com/USER?campaign_id=12345
- [twitter] cache
user_by_…
results (#4719)
Post Processors
Fixes
- [metadata] ignore non-string tag values (#4764)
Miscellaneous
Fixes
- prevent crash when
stdout.line_buffering
is not defined (#642)
v1.26.1
Extractors
Additions
- [bunkr] add extractor for media URLs (#4684)
- [chevereto] add generic extractors for
chevereto
sites (#4664) - [deviantart] implement
"group": "skip"
(#4630) - [fantia] add
content_count
andcontent_num
metadata fields (#4627) - [imgbb] add
displayname
anduser_id
metadata (#4626) - [kemonoparty] support post revisions; add
revisions
option (#4498, #4597) - [kemonoparty] support searches (#3385, #4057)
- [kemonoparty] support discord URLs with channel IDs (#4662)
- [moebooru] add
metadata
option (#4646) - [newgrounds] support multi-image posts (#4642)
- [sankaku] support
/posts/
URLs (#4688) - [twitter] add
sensitive
metadata field (#4619)
Fixes
- [4chanarchives] disable Referer headers by default (#4686)
- [bunkr] fix
/d/
file URLs (#4685) - [deviantart] expand nested comment replies (#4653)
- [deviantart] disable
jwt
(#4652) - [hentaifoundry] fix
.swf
file downloads (#4641) - [imgbb] fix
user
metadata extraction (#4626) - [imgbb] update pagination end condition (#4626)
- [kemonoparty] update API endpoints (#4676, #4677)
- [patreon] update
campaign_id
path (#4639) - [reddit] fix wrong previews (#4649)
- [redgifs] fix
niches
extraction (#4666, #4667) - [twitter] fix crash due to missing
source
(#4620) - [warosu] fix extraction (#4634)
Post Processors
Additions
- support
{_filename}
,{_directory}
, and{_path}
replacement fields for--exec
(#4633)
Miscellaneous
Improvements
- avoid temporary copies with
--cookies-from-browser
by opening cookie databases in read-only mode
v1.26.0
-
Extractors
Additions
- [behance] add
date
metadata field (#4417) - [danbooru] support
booru.borvar.art
(#4096) - [danbooru] support
donmai.moe
- [deviantart] add
is_original
metadata field (#4559) - [e621] support
e6ai.net
(#4320) - [exhentai] add
fav
option (#4409) - [gelbooru_v02] support
xbooru.com
(#4493) - [instagram] add
following
extractor (#1848) - [pillowfort] support
/tagged/
URLs (#4570) - [pornhub] add
gif
support (#4463) - [reddit] add
previews
option (#4322) - [redgifs] add
niches
extractor (#4311, #4312) - [redgifs] support
order
parameter for user URLs (#4583) - [twitter] add
user
extractor andinclude
option (#4275) - [twitter] add
tweet-endpoint
option (#4307) - [twitter] add
date_original
metadata for retweets (#4337, #4443) - [twitter] extract
source
metadata (#4459) - [twitter] support
x.com
URLs (#4452)
Improvements
- include
Referer
header in all HTTP requests (#4490, #4518)
(can be disabled withreferer
option) - [behance] show errors for mature content (#4417)
- [deviantart] re-add
quality
option and/intermediary/
transform - [fantia] improve metadata extraction (#4126)
- [instagram] better error messages for invalid users (#4606)
- [mangadex] support multiple values for
lang
(#4093) - [mastodon] support
/@USER/following
URLs (#4608) - [moebooru] match search URLs with empty
tags
(#4354) - [pillowfort] extract
b2_lg_url
media (#4570) - [reddit] improve comment metadata (#4482)
- [reddit] ignore
/message/compose
URLs (#4482, #4581) - [redgifs] provide
collection
metadata as separate field (#4508) - [redgifs] match
gfycat
image URLs (#4558) - [twitter] improve error messages for single Tweets (#4369)
Fixes
- [acidimg] fix extraction
- [architizer] fix extraction (#4537)
- [behance] fix and update
user
extractor (#4417) - [behance] fix cookie usage (#4417)
- [behance] handle videos without
renditions
(#4523) - [bunkr] fix media domain for
cdn9
(#4386, #4412) - [bunkr] fix extracting
.wmv
files (#4419) - [bunkr] fix media domain for
cdn-pizza.bunkr.ru
(#4489) - [bunkr] fix extraction (#4514, #4532, #4529, #4540)
- [deviantart] fix full resolution URLs for non-downloadable images (#293, #4548, #4563)
- [deviantart] fix shortened URLs (#4316)
- [deviantart] fix search (#4384)
- [deviantart] update Eclipse API endpoints (#4553, #4615)
- [deviantart] use private tokens for
is_mature
posts (#4563) - [flickr] update default API credentials (#4332)
- [giantessbooru] fix extraction (#4373)
- [hiperdex] fix crash for titles containing Unicode characters (#4325)
- [hiperdex] fix
manga
metadata - [imagefap] fix pagination (#3013)
- [imagevenue] fix extraction (#4473)
- [instagram] fix private posts with long shortcodes (#4362)
- [instagram] fix video preview archive IDs (#2135, #4455)
- [instagram] handle exceptions due to missing media (#4555)
- [issuu] fix extraction (#4420)
- [jpgfish] update domain to
jpg1.su
(#4494) - [kemonoparty] update
favorite
API endpoint (#4522) - [lensdump] fix extraction (#4352)
- [mangakakalot] update domain
- [reddit] fix
preview.redd.it
URLs (#4470) - [patreon] fix extraction (#4547)
- [pixiv] handle errors for private novels (#4481)
- [pornhub] fix extraction (#4301)
- [pururin] fix extraction (#4375)
- [subscribestar] fix preview detection (#4468)
- [twitter] fix crash on private user (#4349)
- [twitter] fix
TweetWithVisibilityResults
(#4369) - [twitter] fix crash when
sortIndex
is undefined (#4499) - [zerochan] fix
tags
extraction (#4315, #4319)
Removals
- [gfycat] remove module
- [shimmie2] remove
meme.museum
- [behance] add
-
Post Processors
Changes
- update
finalize
events- add
finalize-error
andfinalize-success
events that trigger
depending on whether error(s) did or did not happen - change
finalize
to always trigger regardless of error status
- add
Additions
- add
python
post processor - add
prepare-after
event (#4083) - [ugoira] add
"framerate": "uniform"
(#4421)
Improvements
- [ugoira] extend
ffmpeg-output
(#4421)
Fixes
- update
-
Downloaders
Fixes
- [http] close connection when file already exists (#4403)
-
Options
Additions
- support
parent>child
categories for child extractor options,
for example animgur
album from areddit
thread withreddit>imgur
- implement
subconfigs
option (#4440) - add
"ascii+"
as a specialpath-restrict
value (#4371)
Removals
- remove
pyopenssl
option
- support
-
Tests
Improvements
-
Miscellaneous
Fixes
v1.25.8
Changes
- update default User-Agent header to Firefox 115 ESR
Additions
- [gfycat] support
@me
user (#3770, #4271) - [gfycat] implement login support (#3770, #4271)
- [reddit] notify users about registering an OAuth application (#4292)
- [twitter] add
ratelimit
option (#4251) - [twitter] use
TweetResultByRestId
endpoint that allows accessing single Tweets without login (#4250)
Fixes
- [bunkr] use
.la
TLD formedia-files12
servers (#4147, #4276) - [erome] ignore duplicate album IDs
- [fantia] send
X-Requested-With
header (#4273) - [gelbooru_v01] fix
source
metadata (#4302, #4303) - [gelbooru_v01] update
vidyart
domain - [jpgfish] update domain to
jpeg.pet
- [mangaread] fix
tags
metadata extraction - [naverwebtoon] fix
comic
metadata extraction - [newgrounds] extract & pass auth token during login (#4268)
- [paheal] fix extraction (#4262, #4293)
- [paheal] unescape
source
- [philomena] fix
--range
(#4288) - [philomena] handle
429 Too Many Requests
errors (#4288) - [pornhub] set
accessAgeDisclaimerPH
cookie (#4301) - [reddit] use 0.6s delay between API requests (#4292)
- [seiga] set
skip_fetish_warning
cookie (#4242) - [slideshare] fix extraction
- [twitter] fix
following
extractor not getting all users (#4287) - [twitter] use GraphQL search endpoint by default (#4264)
- [twitter] do not treat missing
TimelineAddEntries
instruction as fatal (#4278) - [weibo] fix cursor-based pagination
- [wikifeet] fix
tag
extraction (#4289, #4291)
Removals
- [bcy] remove module
- [lineblog] remove module
v1.25.7
Additions
- [flickr] add
exif
option - [flickr] add
metadata
option (#4227) - [mangapark] add
source
option (#3969) - [twitter] extend
conversations
option (#4211)
Fixes
- [furaffinity] improve
description
HTML (#4224) - [gelbooru_v01] fix
--range
(#4167) - [hentaifox] fix titles containing
@
(#4201) - [mangapark] update to v5 (#3969)
- [piczel] update API server address (#4244)
- [poipiku] improve error detection (#4206)
- [sankaku] improve warnings for unavailable posts
- [senmanga] ensure download URLs have a scheme (#4235)
v1.25.6
Additions
- [blogger] download files from
lh*.googleusercontent.com
(#4070) - [fantia] extract
plan
metadata (#2477) - [fantia] emit warning for non-visible content sections (#4128)
- [furaffinity] extract
favorite_id
metadata (#4133) - [jschan] add generic extractors for jschan image boards (#3447)
- [kemonoparty] support
.su
TLDs (#4139) - [pixiv:novel] add
novel-bookmark
extractor (#4111) - [pixiv:novel] add
full-series
option (#4111) - [postimage] add gallery support, update image extractor (#3115, #4134)
- [redgifs] support galleries (#4021)
- [twitter] extract
conversation_id
metadata (#3839) - [vipergirls] add login support (#4166)
- [vipergirls] use API endpoints (#4166)
- [formatter] implement
H
conversion (#4164)
Fixes
- [acidimg] fix extraction (#4136)
- [bunkr] update domain to bunkrr.su (#4159, #4189)
- [bunkr] fix video downloads
- [fanbox] prevent exception due to missing embeds (#4088)
- [instagram] fix retrieving
/tagged
posts (#4122) - [jpgfish] update domain to
jpg.pet
(#4138) - [pixiv:novel] fix error with embeds extraction (#4175)
- [pornhub] improve redirect handling (#4188)
- [reddit] fix crash due to empty
crosspost_parent_lists
(#4120, #4172) - [redgifs] update
search
URL pattern (#4115, #4185) - [senmanga] fix and update (#4160)
- [twitter] use GraphQL API search endpoint (#3942)
- [wallhaven] improve HTTP error handling (#4192)
- [weibo] prevent fatal exception due to missing video data (#4150)
- [weibo] fix
.json
extension for some videos
v1.25.5
Additions
- [8muses] add
parts
metadata field (#3329) - [danbooru] add
date
metadata field (#4047) - [e621] add
date
metadata field (#4047) - [gofile] add basic password support (#4056)
- [imagechest] implement API support (#4065)
- [instagram] add
order-files
option (#3993, #4017) - [instagram] add
order-posts
option (#3993, #4017) - [instagram] add
metadata
option (#3107) - [jpgfish] add
jpg.fishing
extractors (#2657, #2719) - [lensdump] add
lensdump.com
extractors (#2078, #4104) - [mangaread] add
mangaread.org
extractors (#2425, #2781) - [misskey] add
favorite
extractor (#3950) - [pixiv] add
novel
support (#1241, #4044) - [reddit] support cross-posted media (#887, #3586, #3976)
- [postprocessor:exec] support tilde expansion for
command
- [formatter] support slicing strings as bytes (#4087)
Fixes
- [8muses] fix value of
album[url]
(#3329) - [danbooru] refactor pagination logic (#4002)
- [fanbox] skip invalid posts (#4088)
- [gofile] automatically fetch
website-token
- [kemonoparty] fix kemono and coomer logins sharing the same cache (#4098)
- [newgrounds] add default delay between requests (#4046)
- [nsfwalbum] detect placeholder images
- [poipiku] extract full
descriptions
(#4066) - [tcbscans] update domain to
tcbscans.com
(#4080) - [twitter] extract TwitPic URLs in text (#3792, #3796)
- [weibo] require numeric IDs to have length >= 10 (#4059)
- [ytdl] fix crash due to removed
no_color
attribute - [cookies] improve logging behavior (#4050)