etc/yt-dlp
0
0
Fork 0
mirror of https://github.com/yt-dlp/yt-dlp.git synced 2024-11-05 23:45:06 +00:00
Code Issues Projects Releases Wiki Activity
22505 commits 3 branches 99 tags 83 MiB
Commit graph

295 commits

Author SHA1 Message Date
pukkandan
14f25df2b6
[compat] Remove deprecated functions from core code 2022-06-25 00:14:12 +05:30
pukkandan
54007a45f1
[cleanup] Consistent style for file heads 2022-06-25 00:08:58 +05:30
pukkandan
ac66811112
[compat] Remove more functions 
Removing any more will require changes to a large number of extractors
 2022-06-25 00:08:55 +05:30
pukkandan
9809740ba5
[extractor, cleanup] Reduce direct use of _downloader 2022-06-23 09:57:26 +05:30
pukkandan
0c36dc00d7
[extractor/npr] Implement e50c3500b4 differently 
Closes #4141
 2022-06-23 01:46:49 +05:30
pukkandan
3975b4d2e8
Allow extractors to specify section_start/end for clips 2022-06-22 02:44:28 +05:30
pukkandan
612f2be5d3
Bugfix for 7b2c3f47c6 2022-06-20 12:03:35 +05:30
pukkandan
7b2c3f47c6
[cleanup] Misc 2022-06-20 11:44:55 +05:30
pukkandan
8072ef2bbd
[extractor/BiliIntl] Fix metadata extraction 
Closes #4116
 2022-06-20 03:05:46 +05:30
coletdev
f0bc6e2019
[extractor] Add default parameter to _search_json (#4057) 
Authored by: pukkandan, coletdjnz
 2022-06-18 17:55:18 -07:00
pukkandan
a70635b8a1
[cleanup, utils] Don't use kwargs for format_field 2022-06-18 08:13:22 +05:30
christoph-heinrich
e121e3cee7
[cleanup] Minor fixes (#4096) 
Authored by: christoph-heinrich
 2022-06-17 18:57:22 -07:00
Evan Spensley
145c5a83a8
[extractor/GoogleDrive] Add folder extractor (#4009) 
Closes #3388
Authored by: evansp, pukkandan
 2022-06-14 06:33:29 -07:00
pukkandan
f3c0c77304
[extractor] Handle json_ld with multiple @types 
Closes: #4022
 2022-06-13 19:12:34 +05:30
pukkandan
56ba69e4c9
[cleanup] Misc fixes 
Closes #4027
 2022-06-11 05:00:12 +05:30
Aurélien Grosdidier
d05460e5fe
[extractor/FranceCulture] Fix extractor (#3874) 
Closes #3742
Authored by: aurelg, pukkandan
 2022-06-10 16:22:34 -07:00
pukkandan
b7c47b7438
[extractor] Add _search_json 
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
 2022-06-06 19:46:45 +05:30
Lesmiscore
0bea4fd807
[extractor/0000studio] Add extractors (#3959) 
Authored by: Lesmiscore
 2022-06-05 14:37:05 +09:00
pukkandan
1890fc6389
[cleanup] Misc fixes 
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
 2022-06-03 21:45:35 +05:30
pukkandan
c4910024f3
[extractor] Fix bug in 617f658b7e 
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
 2022-06-03 17:25:20 +05:30
siddharth ravikumar
e50c3500b4
[extractor/npr] Use stream url from json-ld (#3455) 
Closes #1934
Authored by: r5d
 2022-06-02 17:51:11 -07:00
pukkandan
09d02ea429
[extractor] Fix bug in f95b9dee45 
Closes #3951
 2022-06-03 06:16:01 +05:30
pukkandan
f95b9dee45
[extractor] Add dev option --load-pages 2022-06-01 02:03:22 +05:30
pukkandan
617f658b7e
[extractor, cleanup] Refactor _download_... methods 2022-06-01 01:57:16 +05:30
Lesmiscore
222a230871
[extractor/common] Recognize src attribute from HTML5 media elements (#3899) 
Authored by: Lesmiscore
 2022-05-29 22:48:04 +09:00
coletdjnz
ee27297f82
[extractor/youtube] Fix initial player response extraction 
Authored by: pukkandan, coletdjnz
 2022-05-29 19:54:22 +12:00
pukkandan
8a82af3511
[cleanup] Misc fixes and cleanup 
Closes #3780, Closes #3853, Closes #3850
 2022-05-27 04:43:43 +05:30
pukkandan
c487cf0010
[cleanup] Misc 2022-05-21 16:01:53 +05:30
pukkandan
2762dbb17e
[compat] Add functools.cached_property 2022-05-20 21:06:37 +05:30
pukkandan
21633673c3
[cleanup] Minor fixes 2022-05-18 09:04:30 +05:30
pukkandan
2414649192
[cleanup] Misc cleanup 2022-05-17 00:07:43 +05:30
pukkandan
82d020804d
[extractor] Use classmethod/property where possible 
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
 2022-05-13 00:23:26 +05:30
pukkandan
8dcce6a89c
[extractor] Document netrc machines 
Closes #3169
 2022-05-11 22:10:15 +05:30
pukkandan
d4736fdb43
Remove warning for videos with an empty title 2022-05-07 19:45:33 +05:30
pukkandan
3fe75fdc80
[cleanup] Misc fixes (see desc) 
* Do not warn when fixup is skipped for existing file
* [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors
* [utils] write_string: Fix bug in 59f943cd50
* [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048
* [docs] Remove note about permissions. Closes #3597
 2022-05-01 04:58:38 +05:30
pukkandan
1d485a1a79
[cleanup] Misc fixes 
Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
 2022-04-29 07:39:33 +05:30
pukkandan
0a5a191a2a
Improve --clean-infojson 
It should not removes fields that may be needed for `--load-infojson`.
Eg: `_ffmpeg_args`, `_has_drm`
 2022-04-28 20:04:40 +05:30
Elyse
a076c1f97a
[extractor] Update manifest_urls after redirect (#3575) 
Authored by: elyse0
 2022-04-27 15:50:01 -07:00
Elyse
779da8e31b
[extractor] Update dash manifest_url after redirects (#3563) 
Closes #2696 
Authored by: elyse0
 2022-04-27 11:01:35 -07:00
felix
77f9033095
[compat] Split into sub-modules (#2173) 
Authored by: fstirlitz, pukkandan
 2022-04-18 04:26:43 +05:30
pukkandan
f82711587c
[cleanup] Sort imports 
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
 2022-04-12 05:32:52 +05:30
pukkandan
86e5f3ed2e
[cleanup] Upgrade syntax 
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
 2022-04-12 05:32:51 +05:30
pukkandan
f9934b9614
[cleanup] Mark some compat variables for removal (#2173) 
Authored by fstirlitz, pukkandan
 2022-04-12 05:32:50 +05:30
felix
cfb0511d82
[cleanup] Remove unused code paths (#2173) 
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
 2022-04-12 05:32:50 +05:30
coletdev
61d3665d9d
[youtube] Fix uploader for collaborative playlists (#3332) 
Authored by: coletdjnz
 2022-04-07 01:11:16 -07:00
pukkandan
a44ca5a470
[cleanup] Misc fixes 
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
 2022-04-05 18:12:18 +05:30
pukkandan
04f3fd2c89
[cleanup] Use _html_extract_title 2022-04-04 15:13:30 +05:30
Fam0r
fbfde1c3e6
[elonet] Rewrite extractor (#3277) 
Closes #2911
Authored by: Fam0r, pukkandan
 2022-04-03 08:11:50 -07:00
pukkandan
90137ca4be
[utils] Add filter_dict 2022-03-28 08:25:04 +05:30
pukkandan
ae6a1b9585
[docs] Minor improvements 
Closes #3127, Closes #3081, Closes #3177
 2022-03-24 07:30:25 +05:30
pukkandan
231025c463
Fix bug in 52efa4b312 
Closes #3173
 2022-03-24 07:28:10 +05:30
pukkandan
700ccbe3f1
[extractor] Allow control characters inside json 
Closes #3174
 2022-03-24 07:28:07 +05:30
pukkandan
52efa4b312
[extractor] Add _perform_login function (#2943) 
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
 2022-03-18 13:53:33 -07:00
coletdjnz
a825ffbffa
[extractor] Support merging subtitles with data 
Authored-by: coletdjnz
 2022-03-12 11:22:28 +13:00
pukkandan
08d30158ec
[cleanup, docs] Misc cleanup 
Closes #2828, closes #2734, closes #2802, closes #2937
 2022-03-08 22:38:06 +05:30
pukkandan
497d2fab6c
[utils] Better traceback for ExtractorError 2022-03-08 12:04:49 +05:30
Zenon Mousmoulas
27231526ae
[ant1newsgr] Add extractor (#1982) 
Authored by: zmousm
 2022-03-04 13:52:48 -08:00
pukkandan
a10aa588b0
[FormatSort] Consider acodec=ogg as vorbis 2022-03-04 19:49:38 +05:30
pukkandan
7265a2190c
Fix doubling of video_id in ExtractorError 2022-03-04 19:37:43 +05:30
coletdev
ded9f32667
[extractor] Support --mark-watched without _NETRC_MACHINE (#2939) 
Authored by: coletdjnz
 2022-03-03 23:27:09 -08:00
Lesmiscore (Naoya Ozaki)
77cc7c6e60
[nhk] Add support for NHK for School (#2850) 
Authored by: Lesmiscore
 2022-02-23 01:15:08 +09:00
pukkandan
ffa89477ea
[extractor] Fix for manifests without period duration 
Closes #2705
Authored by: dirkf, pukkandan
 2022-02-17 19:07:23 +05:30
pukkandan
297e9952b6
[extractor] Allow http_headers to be specified for thumbnails 2022-02-11 23:31:12 +05:30
pukkandan
079a7cfc71
[downloader] Do not use aria2c for non-native m3u8 
Closes #2718
 2022-02-11 12:09:03 +05:30
pukkandan
455a15e2dc
[cleanup,docs] Minor fixes 
Closes #2541, #2484
 2022-02-03 21:00:39 +05:30
pukkandan
85553414ae
[generic] Allow further processing of json_ld URL 
Closes #2578
 2022-02-02 07:33:16 +05:30
pukkandan
fc08bdd6ab
[extractor] Allow non-fatal title extraction 2022-01-24 21:04:38 +05:30
pukkandan
2edb38e8ca
[extractor] Extract video inside Article json_ld 
Closes #2448
 2022-01-24 03:24:07 +05:30
pukkandan
f40ee5e9a0
[extractor] Add convinience function _yes_playlist 2022-01-24 01:07:14 +05:30
pukkandan
6970b6005e
[cleanup] Minor fixes 
Closes #2334
 2022-01-21 13:27:44 +05:30
coletdjnz
6c73052c0a
[youtube] Extract channel subscriber count (#2399) 
Closes #2350
* Adds `channel_follower_count` field
Authored-by: coletdjnz
 2022-01-21 06:04:36 +00:00
pukkandan
311b6615d8
[extractor] Improve url_result and related 2022-01-20 21:14:40 +05:30
pukkandan
135dfa2c7e
[extractor,cleanup] Use _search_nextjs_data 2022-01-20 04:38:24 +05:30
MinePlayersPE
426764371f
[iq.com] Add extractors (#2354) 
Closes #704
Authored by: MinePlayersPE
 2022-01-20 03:53:55 +05:30
teridon
8bcd404818
[digitalconcerthall] Add extractor (#1931) 
Authored by: teridon
 2022-01-11 03:06:05 +05:30
coletdjnz
f0d785d3ed
[youtube:tab] Extract more playlist metadata (#2069) 
* Add fields modified_date, modified_timestamp
* Add field playlist_count
* [youtube:tab] Extract view_count, playlist_count, modified_date

Authored by: coletdjnz, pukkandan
 2022-01-07 16:33:02 +05:30
chris
f522573787
[extractor] Extract chapters from JSON-LD (#2031) 
Authored by: iw0nderhow, pukkandan
 2022-01-02 02:37:00 +05:30
nixxo
7592749cbe
[extractor] Extract thumbnails from JSON-LD (#2195) 
Authored by: nixxo
 2022-01-02 01:20:27 +05:30
Felix S
4afa3ec4b6
[extractor] Detect more subtitle codecs in MPD manifests (#2174) 
Authored by: fstirlitz
 2022-01-01 01:36:45 +05:30
MinePlayersPE
d43de6821c
[GameJolt] Add extractors (#2036) 
Authored by: MinePlayersPE
 2021-12-25 03:58:57 +05:30
siddharth
774a46c53d
[npr] Make SMIL extraction non-fatal (#2099) 
Closes #1934
Authored by: r5d
 2021-12-24 07:45:48 +05:30
pukkandan
b69fd25c25
[cleanup] Misc cleanup 
Closes #1942 #1976 #2020 #2058 #1984
 2021-12-23 07:12:46 +05:30
The Hatsune Daishi
adbc4ec4bb
[dash,youtube] Download live from start to end (#888) 
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes #1521
Authored by: nao20010128nao, pukkandan
 2021-12-20 11:36:46 +05:30
Zenon Mousmoulas
d5c3254889
[extractor] Support default implicit graph in JSON-LD (#1983) 
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
 2021-12-17 02:16:30 +05:30
pukkandan
a8549f19e7
[tiktok] Fix 53dad39e30 2021-12-15 22:18:01 +05:30
pukkandan
39ca3b5c7f
[extractor] Standardize _live_title 2021-12-15 22:09:07 +05:30
pukkandan
19188702ef
[FormatSort] Prevent incorrect deprecation warning 
Closes #1981
 2021-12-15 01:33:15 +05:30
The Hatsune Daishi
66f4c04e50
[extractor] Add _search_nuxt_data (#1921) 
Authored by: nao20010128nao
 2021-12-07 22:08:50 +05:30
pukkandan
d2b2fca53f
[extractor] Ignore errors in comment extraction when -i is given 
Closes #1787
 2021-12-03 03:46:04 +05:30
pukkandan
2c4aaaddc9
[lazy_extractors] Fix for search IEs 
Closes #1851
 2021-12-01 23:23:59 +05:30
pukkandan
ee8dd27a73
[cleanup] Add deprecation warnings 2021-11-29 23:34:33 +05:30
pukkandan
f304da8a29
[cleanup] Misc cleanup 
Closes #1805, closes #1800
 2021-11-29 23:34:33 +05:30
pukkandan
f2ebc5c7be
Option --wait-for-video to wait for scheduled streams 2021-11-29 22:52:01 +05:30
pukkandan
8f122fa070
[extractor] Extract average_rating from JSON-LD 
Eg: Crunchyroll
 2021-11-23 13:14:06 +05:30
pukkandan
234416e4bf
[downloader/ffmpeg] Fix for direct videos inside mpd manifests 
Closes #1751
 2021-11-23 01:29:10 +05:30
nyuszika7h
6b993ca765
[hls] Better FairPlay DRM detection (#1661) 
Authored by: nyuszika7h
 2021-11-19 07:19:51 +05:30
pukkandan
9ac24e235e
[curiositystream] Add more metadata 
Closes #1568
 2021-11-13 23:49:14 +05:30
Lauren Liberda
f98709af31
[extractor] Add _search_nextjs_data (#1386) 
Authored by: selfisekai
 2021-11-10 06:11:05 +05:30
pukkandan
34921b4345
[utils] Add join_nonempty 2021-11-06 07:53:55 +05:30
pukkandan
aeb2a9ad27
[FormatSort] eac3 is better than ac3 2021-11-05 20:40:45 +05:30
pukkandan
0930b11fda
[docs,cleanup] Improve docs and minor cleanup 
Closes #1387, #1404, #1408, #1485, #1415, #1450, #1492
 2021-10-31 14:47:33 +05:30
pukkandan
10beccc980
[FormatSort] Fix some fields' defaults 
Closes #1479
 2021-10-30 01:14:14 +05:30
pukkandan
0db3bae879
[extractor] Fix some errors being converted to ExtractorError 2021-10-26 20:27:09 +05:30
pukkandan
96565c7e55
[cleanup] Add keyword automatically to SearchIE descriptions 
and some minor cleanup of docs
 2021-10-23 21:20:19 +05:30
pukkandan
ec11a9f4a2
[minicurses] Add more colors 2021-10-23 05:23:38 +05:30
pukkandan
49a57e70a9
[cleanup] misc 2021-10-23 02:09:10 +05:30
pukkandan
176f1866cb
Add HDR information to formats 2021-10-18 18:35:02 +05:30
pukkandan
e820fbaa6f
Do not verify thumbnail URLs by default 
Partially reverts cca80fe611 and 0ba692acc8

Unless `--check-formats` is specified, this causes yt-dlp to return incorrect thumbnail urls.
See https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-877909966, #402

But the overhead in general use is not worth it

Closes #694, #725
 2021-10-18 15:44:47 +05:30
pukkandan
ec3f6640c1
[crunchyroll] Add season to flat-playlist 
Closes #1319
 2021-10-17 17:39:23 +05:30
pukkandan
a0c716bb61
[instagram] Show appropriate error when login is needed 
Closes #1264
 2021-10-14 14:44:29 +05:30
pukkandan
6993f78d1b
[extractor,utils] Detect more codecs/mimetypes 
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29943
 2021-10-13 05:05:29 +05:30
pukkandan
a2160aa45f
[extractor] Generalize getcomments implementation 2021-10-12 15:21:30 +05:30
pukkandan
cc16383ff3
[extractor] Simplify search extractors 2021-10-12 15:21:30 +05:30
pukkandan
ba10757412 [extractor] Detect EXT-X-KEY Apple FairPlay 2021-10-11 17:09:21 +05:30
pukkandan
b5ae35ee6d
[cleanup] Misc cleanup 2021-10-09 22:32:00 +05:30
pukkandan
819e05319b
Improved progress reporting (See desc) (#1125) 
* Separate `--console-title` and `--no-progress`
* Add option `--progress` to show progress-bar even in quiet mode
* Fix and refactor `minicurses`
* Use `minicurses` for all progress reporting
* Standardize use of terminal sequences and enable color support for windows 10
* Add option `--progress-template` to customize progress-bar and console-title
* Add postprocessor hooks and progress reporting

Closes: #906, #901, #1085, #1170
 2021-10-09 00:41:59 +05:30
Felix S
9359f3d4f0
[extractor] Extract storyboards from SMIL manifests (#1128) 
Authored by: fstirlitz
 2021-10-03 00:13:42 +05:30
pukkandan
e6f21b3d92
[docs,cleanup] Some minor refactoring and improve docs 2021-09-30 03:32:52 +05:30
ChillingPepper
3cf4b91dc5
[SovietsCloset] Add duration from m3u8 (#908) 
Authored by: ChillingPepper
 2021-09-28 02:30:41 +05:30
pukkandan
1813a6ccd4
[youtube] Fix --mark-watched with --cookies-from-browser 
Closes #1019
 2021-09-24 05:14:16 +05:30
pukkandan
bd6f722de8
dump files should obey --trim-filename (#1043) 
Authored by: sulyi
 2021-09-22 05:25:17 +05:30
DigitalDJ
f9cc0161e6
[extractor] Fix root-relative URLs in MPD (#1006) 
Authored by: DigitalDJ
 2021-09-19 14:07:57 +05:30
pukkandan
0001fcb586
Add option --netrc-location 
Closes #792, #963
 2021-09-16 01:28:55 +05:30
pukkandan
198e3a04c9
[FormatSort] Remove priority of lang 2021-08-26 08:08:33 +05:30
pukkandan
6251555f1c
[downloader/ffmpeg] Support for DASH manifests (experimental) 
Closes #159
 2021-08-24 05:52:00 +05:30
pukkandan
1151c4079a
[extractor] Show video id in error messages if possible 2021-08-23 02:49:07 +05:30
pukkandan
88acdbc269
[extractor] Better error message for DRM (#729) 
Closes #636
 2021-08-23 01:38:38 +05:30
pukkandan
3fb4e21b38
[lazy_extractors] Fix suitable and add flake8 test 2021-08-23 01:04:29 +05:30
pukkandan
5ad28e7ffd
[extractor] Common function _match_valid_url 2021-08-23 00:50:40 +05:30
pukkandan
a8731fcc1d minor bugfixes 
bugs due to be2fc5b212, e9f4ccd19e
 2021-08-11 20:27:30 +05:30
pukkandan
be2fc5b212
[extractor] Detect sttp as subtitles in MPD 
Closes #656
Solution by: fstirlitz
 2021-08-10 04:46:48 +05:30
pukkandan
b868936cd6 [cleanup] Misc 2021-08-07 21:17:07 +05:30
pukkandan
28f436bad0 [extractor] Reset non-repeating warnings per video 2021-08-07 21:17:05 +05:30
MinePlayersPE
3dbb2a9dcb
[RCTIPlus] Support events and TV (#625) 
Authored by: MinePlayersPE
 2021-08-04 18:42:15 +05:30
LE
68f5867cf0
[CBS] Add fallback (#579) 
Related: https://github.com/ytdl-org/youtube-dl/issues/29564
Authored-by: llacb47, pukkandan
 2021-08-02 07:46:12 +05:30
pukkandan
dbf5416a20 [cleanup] Refactor some code 2021-08-01 12:38:05 +05:30
pukkandan
f5510afef0
[FormatSort] Fix bug for audio with unknown codec 2021-08-01 12:13:40 +05:30
pukkandan
ae30b84072
Add field live_status 2021-07-21 20:50:58 +05:30
pukkandan
0ba692acc8
[youtube] Extract more thumbnails 
* The thumbnail URLs are hard-coded and their actual existence is tested lazily
* Added option `--no-check-formats` to not test them

Closes #340, Related: #402, #337, https://github.com/ytdl-org/youtube-dl/issues/29049
 2021-07-20 02:42:11 +05:30
Felix S
da1c94ee45
[generic] Extract previously missed subtitles (#515) 
* [generic] Extract subtitles in cases missed previously
* [common] Detect discarded subtitles in SMIL manifests
* [generic] Extract everything in the SMIL manifest

Authored by: fstirlitz
 2021-07-16 19:52:56 +05:30
felix
198f7ea89e
[extractor] Allow extracting multiple groups in _search_regex 
From #497, Authored by: fstirlitz
 2021-07-14 05:02:42 +05:30
pukkandan
6606817a86
[utils] Add variadic 2021-07-11 04:46:51 +05:30
pukkandan
4bb6b02f93
Improve extractor_args parsing 2021-07-08 21:22:35 +05:30
pukkandan
46890374f7
[extractor] Minor improvements (See desc) 
1. Allow removal of login hint - extractors can set their own login hint as part of `msg`
2. Cleanup `_merge_subtitles` signature
 2021-07-07 02:27:53 +05:30
pukkandan
60755938b3
[extractor] Prevent unnecessary download of hls manifests 
and refactor `hls_split_discontinuity` code
 2021-07-07 02:24:58 +05:30
pukkandan
5d3a0e794b
Add --extractor-args to pass extractor-specific arguments 2021-06-25 20:10:28 +05:30
pukkandan
e36d50c5dd
[websockets] Add WebSocketFragmentFD (#399) 
Necessary for #392

Co-authored by: nao20010128nao, pukkandan
 2021-06-21 22:56:36 +05:30
pukkandan
d0fb4bd16f
[pornhub] Extract cast 
Closes #406, https://github.com/ytdl-org/youtube-dl/pull/27384
 2021-06-13 21:38:08 +05:30
felix
cdb19aa4c2
[downloader/mhtml] Add new downloader (#343) 
This downloader is intended to be used for streams that consist of a
timed sequence of stand-alone images, such as slideshows or thumbnail
streams

This can be used for implementing:

https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762
https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231
https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239

https://github.com/ytdl-org/youtube-dl/issues/9868
https://github.com/ytdl-org/youtube-dl/pull/14951


Authored by: fstirlitz
 2021-06-13 20:36:40 +05:30
pukkandan
8326b00aab
Allow images formats 
Necessary for #343.

* They are identified by `vcodec=acodec='none'`
* These formats show as the worst in `-F`
* Any postprocessor that expects audio/video will be skipped
* `b*` and all related selectors will skip such formats
* This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when #389 is resolved
 2021-06-13 03:45:53 +05:30