pukkandan
ff2751ac9c
[youtube] Always extract `maxresdefault` thumbnail
...
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29049
2021-05-18 19:31:17 +05:30
pukkandan
abcdd12b26
[youtube:tab] Support youtube music `MP` pages
2021-05-18 19:31:08 +05:30
pukkandan
18db754858
[youtube:tab] Redirect `UC` channels that doesn't have a `videos` tab
...
Many topic URLs don't have a videos tab, but has an equivalent `UU` playlist.
If there is no playlist, fallback to using channel page
2021-05-18 19:31:07 +05:30
pukkandan
fe03a6cdc8
[youtube:tab] Support youtube music `VL` and `browse` pages
2021-05-18 19:31:06 +05:30
pukkandan
cd684175ad
[youtube:tab] Support channel search
...
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29071
2021-05-18 19:30:21 +05:30
pukkandan
da692b7920
[cleanup] youtube tests
2021-05-18 18:10:15 +05:30
pukkandan
95c01b6c16
[youtube:tab] Show alerts only from the final webpage
2021-05-18 18:09:04 +05:30
pukkandan
a06916d98e
[extractor] Add `write_debug` and `get_param`
2021-05-17 18:59:51 +05:30
coletdjnz
9297939ec3
[Youtube] Extract more formats for `music.youtube` URLs ( #311 )
...
Based on: https://github.com/ytdl-org/youtube-dl/pull/28778 , https://github.com/ytdl-org/youtube-dl/pull/26160
Co-authored-by: craftingmod, colethedj, pukkandan
2021-05-15 20:08:47 +05:30
pukkandan
774d79cc4c
[youtube] Add language names
...
Co-authored by: nixxo, tpikonen
Based on: https://github.com/ytdl-org/youtube-dl/pull/26112
Closes : #310
2021-05-15 19:27:53 +05:30
pukkandan
2412044c90
Add field `name` for subtitles
...
Co-authored by: pukkandan, tpikonen
Based on: #310 , https://github.com/ytdl-org/youtube-dl/pull/26112
2021-05-15 19:27:52 +05:30
pukkandan
120916dac2
[youtube] multiple subtitles in same language
...
Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164
Related: #310 , https://github.com/ytdl-org/youtube-dl/pull/26112
2021-05-15 19:27:48 +05:30
pukkandan
0fb983f62d
[youtube] Extract audio language
2021-05-14 13:15:48 +05:30
pukkandan
0760b0a7e2
Standardize `write_debug`
2021-05-14 13:15:29 +05:30
pukkandan
d908aa636a
[cleanup] Fix typos
2021-05-11 23:34:40 +05:30
pukkandan
3d89341b47
[common] bugfix for when `compat_opts` is not given
2021-05-11 23:29:26 +05:30
pukkandan
d8ec40b39f
[rmcdecouverte] Generalize `_VALID_URL`
...
Closes #291
2021-05-11 18:57:55 +05:30
pukkandan
fac988053f
Release 2021.05.11
...
* and some documentation improvements
2021-05-11 13:35:05 +05:30
pukkandan
61241abbb0
[generic] Respect the encoding in manifest
2021-05-11 13:32:03 +05:30
pukkandan
53ed7066ab
Option `--compat-options` to revert some of yt-dlp's changes
...
* Deprecates `--list-formats-as-table`, `--list-formats-old`
2021-05-11 13:30:48 +05:30
pukkandan
2f567473c6
[Plugins] Prioritize plugins over standard extractors
...
and prevent plugins from overwriting the standard extractor classes
Closes #304
2021-05-09 04:22:27 +05:30
pukkandan
41d1cca328
Update to ytdl-commit-a726009
...
[blinkx] Remove extractor
a726009987
2021-05-06 21:31:20 +05:30
pukkandan
12e73423f1
[plutotv] Fix format extraction for some urls
...
* And fallback to the first urls if ad-free urls can't be found
Closes #299
2021-05-06 20:28:57 +05:30
pukkandan
7700b37f39
[plutotv] Extract subtitles from manifests
2021-05-06 20:28:56 +05:30
Ashish
c28cfda81f
[SonyLiv] Fix `title` and `series` extraction ( #301 )
...
Authored by: Ashish0804
2021-05-06 20:27:43 +05:30
pukkandan
3158150cb7
[utils] Add `network_exceptions`
2021-05-04 22:36:18 +05:30
pukkandan
06425e9621
[blinkx] Minor fix
...
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941
2021-05-04 22:27:44 +05:30
pukkandan
1815d1028b
[zee5] Fix py2 compatibility
2021-05-03 22:49:03 +05:30
The Hatsune Daishi
0fa9a1e236
[whowatch] Add extractor #292
...
closes #223
Authored by: nao20010128nao
Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py
2021-05-02 19:43:37 +05:30
pukkandan
80185155a1
[ukcolumn] Add Extractor
...
Closes #287
2021-05-02 13:57:50 +05:30
pukkandan
c755f1901f
[CBS] Improve `_VALID_URL` to support movies
...
Closes #290
Tested by: BeeMuffins
2021-05-01 21:32:14 +05:30
pukkandan
68b91dc905
[youtube] Add `oembed` to reserved names
2021-05-01 21:24:31 +05:30
pukkandan
88f06afc0c
[rmcdecouverte] Improve `_VALID_URL`
...
Closes #291
2021-05-01 21:24:31 +05:30
CXwudi
40078a55e2
[niconico] Fix bug in thumbnail extraction #289
...
Bug from: 6b1d8c1e30
Authored by: CXwudi
2021-05-01 19:35:47 +05:30
pukkandan
07e4a40a9a
[crackle] Improve extraction (See desc)
...
Closes #282
* Refactor authorization as an extension to `_download_json`
* Better error messages and warnings
* Respect `--ignore-no-formats-error`
* Extract subtitles from manifests
* Try with crackle's geo-location service if all hard-coded countries fail
2021-04-29 05:20:16 +05:30
pukkandan
e28f1c0ae8
[cleanup] Fix linter and some typos
...
* Also remove inconsistent use of `"` in setup.py
2021-04-28 19:59:40 +05:30
pukkandan
ef39f8600a
[curiositystream] Fix collections
...
Closes #277
* A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721 > but cannot be tested without an account
2021-04-28 19:29:33 +05:30
pukkandan
2291dbce2a
[niconico] Fix HLS formats
...
Closes #171
* The structure of the API JSON was changed
* Smile Video seems to be no longer available. So remove the warning
* Move ping to downloader
* Change heartbeat interval to 40sec
* Remove unnecessary API headers
Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan
Tested by: tsukumijima
2021-04-28 19:18:29 +05:30
pukkandan
895b0931e5
[youtube:tab] Detect playlists inside community posts
2021-04-28 19:18:06 +05:30
pukkandan
1ad047d0f7
[nebula] Move to nebula.app
...
Closes #272
Tested by: Lamieur
2021-04-28 19:18:06 +05:30
pukkandan
be6202f12b
Subtitle extraction from streaming media manifests #247
...
Authored by fstirlitz
Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144
Closes : #73
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/6106
https://github.com/ytdl-org/youtube-dl/issues/14977
https://github.com/ytdl-org/youtube-dl/issues/21438
https://github.com/ytdl-org/youtube-dl/issues/23609
https://github.com/ytdl-org/youtube-dl/issues/28132
Might also fix (untested):
https://github.com/ytdl-org/youtube-dl/issues/15424
https://github.com/ytdl-org/youtube-dl/issues/18267
https://github.com/ytdl-org/youtube-dl/issues/23899
https://github.com/ytdl-org/youtube-dl/issues/24375
https://github.com/ytdl-org/youtube-dl/issues/24595
https://github.com/ytdl-org/youtube-dl/issues/27899
Related:
https://github.com/ytdl-org/youtube-dl/issues/22379
https://github.com/ytdl-org/youtube-dl/pull/24517
https://github.com/ytdl-org/youtube-dl/pull/24886
https://github.com/ytdl-org/youtube-dl/pull/27215
Notes:
* The functions `extractor.common._extract_..._formats` are still kept for compatibility
* Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles`
* Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats
* AES support is untested
* The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players
* Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`.
Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file
* The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit >
* Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools
* Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg`
* The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac >
* But validity of the those extracted from ISM are untested
2021-04-28 19:02:43 +05:30
Felix S
e8f834cd8d
[threeqsdn] Extract subtitles from streaming manifests
2021-04-28 17:24:50 +05:30
Felix S
e0e624ca7f
[canvas] Extract subtitles from streaming manifests
2021-04-28 17:24:19 +05:30
Felix S
ec4f374c05
[wat] Extract subtitles from streaming manifests
2021-04-28 17:24:08 +05:30
Felix S
c811e8d8bd
[atresplayer] Extract subtitles from streaming manifests
2021-04-28 17:23:56 +05:30
Felix S
b2cd5da460
[francetv] Extract subtitles from the HLS manifest
2021-04-28 17:23:47 +05:30
Felix S
2de3b21e05
[uplynk] Extract subtitles from HLS manifests
2021-04-28 17:23:37 +05:30
Felix S
4bed436371
[twitter] Extract subtitles from HLS manifests
2021-04-28 17:23:27 +05:30
Felix S
efe9dba595
[srgssr] Extract subtitles from HLS manifests
2021-04-28 17:23:16 +05:30
Felix S
47f4203dd3
[nytimes] Extract subtitles from HLS manifests
2021-04-28 17:23:05 +05:30
Felix S
015c10aeec
[roosterteeth] Use common code for subtitle extraction
2021-04-28 17:22:56 +05:30
Felix S
a00d781b73
[elonet] Use common code for subtitle extraction
2021-04-28 17:22:45 +05:30
Felix S
0c541b563f
[tv4] Extract subtitles from streaming manifests
2021-04-28 17:22:36 +05:30
Felix S
64a5cf7929
[byutv] Extract subtitles from streaming manifests
2021-04-28 17:22:27 +05:30
Felix S
7a450a3b1c
[generic] Extract subtitles from direct SSTR manifest links
2021-04-28 17:22:18 +05:30
Felix S
7de27caf16
[generic] Extract subtitles from direct DASH manifest links
2021-04-28 17:22:07 +05:30
Felix S
c26326c1be
[generic] Extract subtitles from direct HLS manifest links
2021-04-28 17:21:55 +05:30
Felix S
66a1b8643a
[downloader/ism] Support muxing TTML subtitles
2021-04-28 17:21:45 +05:30
Felix S
4a2f19abbd
[downloader/hls] Assemble single-file WebVTT subtitles from HLS segments
2021-04-28 17:21:14 +05:30
Felix S
f6a1d69a87
[extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks
2021-04-28 17:20:29 +05:30
Felix S
fd76a14259
[extractor/common, downloader/ism] Extract SSTR subtitle tracks
...
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.
The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
2021-04-28 17:20:20 +05:30
Felix S
171e59edd4
[extractor/common] Extract DASH subtitle tracks
...
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
2021-04-28 17:20:11 +05:30
Felix S
a0c3b2d5cf
[extractor/common] Extract HLS subtitle tracks
...
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.
_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
2021-04-28 17:19:57 +05:30
Felix S
19bb39202d
[extractor/common] Generalise _merge_subtitles
...
This allows modifying a subtitles dictionary in-place.
2021-04-28 17:19:46 +05:30
Hadi0609
db9a564b6a
[zee5] Fix extraction for some URLs ( #279 )
...
Closes : #278
2021-04-28 14:51:54 +05:30
Felix S
c72967d5de
[mediasite] Generalize URL pattern ( #275 )
...
Authored by: fstirlitz
2021-04-26 17:23:20 +05:30
pukkandan
b982cbdd0e
[limelight] Obey `allow_unplayable_formats`
2021-04-26 10:56:55 +05:30
pukkandan
6a04a74e8b
[FormatSort] Fix for when some formats have quality and others don't
2021-04-26 10:56:54 +05:30
CXwudi
6b1d8c1e30
[niconico] Fix title and thumbnail extraction ( #273 )
...
Authored by: CXwudi
2021-04-26 08:23:57 +05:30
Ashish
87c3d06271
[Mxplayer] Add MxplayerShowIE ( #270 )
...
Authored by: Ashish0804
2021-04-26 08:12:51 +05:30
pukkandan
cf9d6cfb0c
[tubi] Raise "no video formats" error when video url is empty
...
Related: #266
2021-04-24 17:52:33 +05:30
pukkandan
bbed5763f1
[francetvinfo] Improve video id extraction
...
Closes #261
2021-04-23 00:01:09 +05:30
pukkandan
1bdae7d312
Update to ytdl-commit-7e8b3f9
...
[youtube] Remove unused code
7e8b3f9439
2021-04-22 16:54:07 +05:30
Felix S
a471f21da6
[mildom] Remove proxy ( #260 )
...
Closes #251
Makes 2cff495997
, ab406a1c0e
, #252 obsolete
Authored by: fstirlitz
2021-04-22 16:52:22 +05:30
pukkandan
6efb071135
[BilibiliChannel] Fix pagination
...
Closes #222
ccca21d7f5
Coauthored by: nao20010128nao, pukkandan
2021-04-22 04:19:33 +05:30
pukkandan
3b4775e021
[go] Fix `_VALID_URL`
...
Closes #255
2021-04-21 15:43:53 +05:30
pukkandan
ab406a1c0e
[mildom] Warn user of proxy
2021-04-21 15:43:22 +05:30
pukkandan
8c54a3051d
[youtube] Bugfix in `_extract_ytcfg`
2021-04-21 10:37:24 +05:30
pukkandan
3097d9e512
[mildom:user:vod] Download only necessary amount of pages
2021-04-19 11:41:49 +05:30
pukkandan
c1df120eda
[mildom:vod] Remove proxy
...
* Proxy is needed only for live videos
2021-04-19 11:41:40 +05:30
pukkandan
2cff495997
[mildom] Change proxy
...
Related: #251
Closes #252
2021-04-19 11:41:33 +05:30
pukkandan
d0491a1ebe
[twitcasting] Fix extractor
...
* `Origin: https://twitcasting.tv ` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502`
* Fix regex for when `data-movie-playlist` is a dict containing the needed list
* media initialization is fully supported; so change downloader to native
Closes #220
2021-04-18 17:57:46 +05:30
nixxo
b9d68c199b
[rai] Add support for http formats ( #208 )
...
Authored by: nixxo
2021-04-17 22:42:28 +05:30
pukkandan
201c145953
Update to ytdl-commit-9f6c03
...
[cbsnews] Fix extraction for python <3.6
9f6c03a006
2021-04-17 08:40:31 +05:30
pukkandan
5d34200268
[youtube:tab] Reload with unavailable videos for all playlists
...
If the unavailable video is in a later page, the warning and button are not shown in the initial webpage
So we force all playlists' initial page to reload with the correct params
2021-04-17 08:40:30 +05:30
pukkandan
b7da73eb19
Add option `--ignore-no-formats-error`
...
* Ignores the "no video format" and similar errors
* Experimental - Some extractors may still throw these errors
2021-04-17 08:40:30 +05:30
pukkandan
6a39ee13f7
Fix inconsistent use of `report_warning`
2021-04-17 04:16:41 +05:30
coletdjnz
358de58c4d
[youtube:tab] Show unavailable videos in playlists ( #242 )
...
Closes #231
Authored by: colethedj
2021-04-17 04:09:08 +05:30
pukkandan
a7191c6f57
Fix some linter and typos
2021-04-16 05:31:47 +05:30
lkho
baa5873942
[viu:ott] Fix extractor (see desc)
...
* add language_flag_id query param
* add support for premium account (untested since I dont have a premium account)
* support entire series
Code from:
https://github.com/blackjack4494/youtube-dlc/pull/211
https://github.com/ytdl-org/youtube-dl/pull/15182
https://github.com/ytdl-org/youtube-dl/pull/26775
Fixes:
https://github.com/yt-dlp/yt-dlp/issues/219
https://github.com/ytdl-org/youtube-dl/issues/27946
https://github.com/ytdl-org/youtube-dl/issues/27863
https://github.com/ytdl-org/youtube-dl/issues/27812
https://github.com/ytdl-org/youtube-dl/issues/27464
https://github.com/ytdl-org/youtube-dl/issues/26788
https://github.com/blackjack4494/yt-dlc/issues/136
Possibly also fixes (untested):
https://github.com/ytdl-org/youtube-dl/issues/16992
https://github.com/ytdl-org/youtube-dl/issues/26701
Co-authored by: lkho, pukkandan
2021-04-16 05:19:46 +05:30
coletdjnz
79360d99d3
[youtube] Standardize API calls for tabs, mixes and search ( #245 )
...
Authored by: colethedj
2021-04-15 16:52:59 +05:30
pukkandan
46fff7105e
[youtube] Ignore invalid stretch ratio
...
Closes #244
2021-04-14 15:22:17 +05:30
Ashish
b5be6dd504
[TubiTv] Add TubiTvShowIE ( #243 )
...
Authored by: Ashish0804
2021-04-14 12:22:28 +05:30
coletdjnz
8ea3f7b909
[youtube] Improve channel syncid extraction to support ytcfg ( #241 )
...
Authored by: colethedj
2021-04-14 10:37:03 +05:30
pukkandan
b31fdeedfd
[documentation] Improvements
2021-04-12 02:36:06 +05:30
coletdjnz
f4f751af40
[youtube] Parse API parameters from initial webpage ( #230 )
...
* Obtain innertube_context, api_key and x-goog-visitor-id from webpage
* Generalize the header & Innertube_context extraction across YouTube extractors
Related: 1b0a13f33c
Authored by: colethedj
2021-04-12 01:53:04 +05:30
pukkandan
1988fab7e3
[youtube] Fix thumbnail URL
...
Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023
2021-04-11 06:06:13 +05:30
pukkandan
f7ad71607d
Update to ytdl-commit-4fb25ff
...
[maoritv] Add new extractor
4fb25ff5a3
Except:
[vimeo] improve extraction 3ae9c0f410
[youtube:tab] Pass innertube context... 1b0a13f33c
2021-04-10 22:19:54 +05:30
pukkandan
f37468c41f
Fix default of `dynamic_mpd`
2021-04-10 20:57:53 +05:30
pukkandan
3ffc7c89b0
[youtube] Fix _extract_alerts
...
* Sometimes one warning is split between multiple runs
* Also simplified code
2021-04-10 20:57:27 +05:30