coletdjnz
eb5bdbfa70
[ie/youtube] Raise a warning for Incomplete Data instead of an error ( #8238 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/8206
Adds `raise_incomplete_data` extractor arg to revert this behaviour and raise an error.
Authored by: coletdjnz
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2023-10-03 06:42:30 +00:00
bashonly
5ca095cbcd
[cleanup] Misc ( #8182 )
...
Closes #7796 , Closes #8028
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
2023-09-23 20:00:31 +00:00
coletdjnz
378ae9f9fb
[ie/youtube] Fix consent cookie ( #7774 )
...
Fixes #7594
Authored by: coletdjnz
2023-08-12 04:26:08 +00:00
coletdjnz
546b2c28a1
[ie/youtube] Fix player_params arg being converted to lowercase
...
Fix bug in ba06d77a31
2023-07-30 10:50:25 +12:00
coletdjnz
ba06d77a31
[ie/youtube] Add player_params extractor arg ( #7719 )
...
Authored by: coletdjnz
2023-07-29 06:20:42 +00:00
coletdjnz
3d2623a898
[compat, networking] Deprecate old functions ( #2861 )
...
Authored by: coletdjnz, pukkandan
2023-07-15 16:18:35 +05:30
coletdjnz
1ba6fe9db5
[ie/youtube:tab] Detect looping feeds ( #6621 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/5555
Note: the first page may still be repeated, however this is better than nothing.
Authored by: coletdjnz
2023-07-15 03:20:24 +00:00
pukkandan
94ed638a43
[ie/youtube] Avoid false DRM detection ( #7396 )
...
Some master manifests contain a mix of DRM and non-DRM formats
2023-07-06 21:40:07 +05:30
pukkandan
337734d4a8
[cleanup] Misc
2023-07-06 21:39:55 +05:30
coletdjnz
90db9a3c00
[extractor/youtube:stories] Remove ( #7459 )
...
YouTube killed them
https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
2023-07-06 19:02:41 +05:30
coletdjnz
4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default ( #7475 )
...
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.
Closes https://github.com/yt-dlp/yt-dlp/issues/7474
Authored by: coletdjnz
2023-07-03 10:47:10 +00:00
coletdjnz
fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists ( #7425 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
2023-06-29 23:26:27 +00:00
pukkandan
d949c10c45
[extractor/youtube] Process post_live over 2 hours
2023-06-26 07:25:52 +05:30
pukkandan
58786a10f2
[extractor/youtube] Add extractor-arg formats
...
Closes #7417
2023-06-25 20:14:37 +05:30
Simon
89bed01374
[extractor/youtube] Fix comments' is_favorited ( #7390 )
...
Authored by: bbilly1
Closes #7389
2023-06-22 23:38:42 +05:30
pukkandan
cd810afe2a
[extractor/youtube] Improve nsig function name extraction
2023-06-22 13:27:18 +05:30
Berkan Teber
71dc18fa29
[extractor/youtube] Improve description parsing performance ( #7315 )
...
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads
Authored by: pukkandan, berkanteber
2023-06-22 12:57:54 +05:30
pukkandan
1e75d97db2
[extractor/youtube] Add ios to default clients used
...
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
2023-06-22 01:36:06 +05:30
pukkandan
81ca451480
[extractor/youtube] Workaround 403 for android formats
...
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
2023-06-22 00:15:22 +05:30
pukkandan
ad54c9130e
[cleanup] Misc
...
Closes #6288 , Closes #7197 , Closes #7265 , Closes #7353 , Closes #5773
Authored by: mikf, freezboltz, pukkandan
2023-06-21 09:21:20 +05:30
pukkandan
97afb093d4
[extractor/youtube] Ignore wrong fps of some formats
2023-06-21 06:10:39 +05:30
pukkandan
51a07b0dca
[extractor/youtube] Prioritize premium formats
...
Closes #7283
2023-06-21 06:10:38 +05:30
pukkandan
ff9b0e071f
[extractor/youtube] Determine audio language using automatic captions
2023-06-17 01:43:03 +05:30
coletdjnz
8213ce28a4
[extractor/youtube] Extract channel_is_verified ( #7213 )
...
Authored by: coletdjnz
2023-06-08 19:15:39 +05:30
pukkandan
14a14335b2
[extractor/youtube] Misc cleanup
...
Authored by: coletdjnz
2023-06-08 19:14:57 +05:30
coletdjnz
2fb35f6004
[extractor/youtube] Support shorter relative time format ( #7191 )
...
See: https://github.com/TeamNewPipe/NewPipeExtractor/issues/1067
Authored by: coletdjnz
2023-06-03 06:33:51 +00:00
coletdjnz
c35448b7b1
[extractor/youtube] Extract more metadata for comments ( #7179 )
...
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments
Closes https://github.com/yt-dlp/yt-dlp/issues/5411
Authored by: coletdjnz
2023-06-01 08:43:32 +00:00
coletdjnz
18f8fba7c8
[extractor/youtube] Fix continuation loop with no comments ( #7148 )
...
Deep check the response for incomplete data.
Authored by: coletdjnz
2023-05-31 07:08:28 +00:00
coletdjnz
93e12ed76e
[extractor/youtube] Extract uploader metadata for feed/playlist items
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/7104
Authored by: coletdjnz
2023-05-28 11:31:45 +12:00
Audrey
5caf30dbc3
[extractor/youtube] Extract heatmap data ( #7100 )
...
Closes #3888
Authored by: tntmod54321
2023-05-26 17:54:39 +05:30
pukkandan
4823ec9f46
Update to ytdl-commit-d1c6c5
...
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6https://github.com/ytdl-org/youtube-dl/issues/30641
* e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
* We plan to implement this differently
2023-05-24 23:30:43 +05:30
kangalio
69a40e4a7f
[extractor/youtube:music:search_url] Extract title ( #7102 )
...
Authored by: kangalio
Closes #7095
2023-05-22 17:17:06 +05:30
coletdjnz
447afb9eaa
[extractor/youtube] Support podcasts and releases tabs
...
Closes https://github.com/yt-dlp/yt-dlp/issues/6893
Authored by: coletdjnz
2023-05-20 19:11:03 +12:00
coletdjnz
7666b93604
[extractor/youtube] Define strict uploader metadata mapping ( #6384 )
...
New mapping:
```
channel -> channel name
channel_id -> UCID
channel_url -> UCID channel url
uploader -> channel name (same as channel field)
uploader_id -> @handle
uploader_url -> @handle channel url
```
Authored by: coletdjnz
2023-04-14 07:58:36 +00:00
pukkandan
c6786ff3ba
[extractor/youtube] Revert default formats to https
2023-04-11 21:43:31 +05:30
coletdjnz
141a8dff98
[extractor/youtube] Fix comment loop detection for pinned comments ( #6714 )
...
Pinned comments may repeat a second time - this is expected.
Fixes https://github.com/yt-dlp/yt-dlp/issues/6712
Authored by: coletdjnz
2023-04-06 07:44:22 +00:00
Nicholas Defranco
071670cbea
[extractor/youtube] Fix parsing comment_count ( #6523 )
...
Closes #5849
Authored by: nick-cd
2023-03-15 04:51:14 +05:30
coletdjnz
607510b9f2
[extractor/youtube] Handle incomplete initial data from watch page ( #6510 )
...
Authored by: coletdjnz
2023-03-13 01:43:37 +00:00
pukkandan
e389d172b6
Fix 2a23d92d9e
...
Closes #6517
2023-03-12 14:47:05 +05:30
pukkandan
2a23d92d9e
[extractor/youtube] Construct fragment list lazily
...
Building fragment list for all formats take significant time for large videos
2023-03-11 22:46:47 +05:30
pukkandan
86cb922118
[extractor/youtube] Add extractor-arg include_duplicate_formats
2023-03-11 22:34:13 +05:30
Lesmiscore
c795c39f27
[extractor/youtube] Add client name to format_note when -v ( #6254 )
...
Authored by: Lesmiscore, pukkandan
2023-03-11 22:33:23 +05:30
pukkandan
c9abebb851
[extractor/youtube] Bypass throttling for -f17
...
and related cleanup
Thanks @AudricV for the finding
2023-03-09 22:13:03 +05:30
pukkandan
392389b7df
[cleanup] Misc
2023-03-05 03:34:55 +05:30
mushbite
22ccd5420b
[extractor/rutube] Extract chapters from description ( #6345 )
...
Authored by: mushbite
2023-03-04 19:03:17 +05:30
coletdjnz
7f51861b18
[extractor/youtube] Detect and break on looping comments ( #6301 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/6290
Authored by: coletdjnz
2023-03-01 07:56:53 +00:00
pukkandan
5b28cef72d
[cleanup] Misc
2023-02-28 23:51:06 +05:30
pukkandan
31e183557f
[extractor/youtube] Extract channel view_count when /about tab is passed
2023-02-28 23:51:03 +05:30
pukkandan
f34804b2f9
[extractor/youtube] Fix 5038f6d713
...
* [fragment] Fix `request_data`
* [youtube] Don't use POST for now. It may be easier to break in future
Authored by: bashonly, coletdjnz
2023-02-28 23:34:43 +05:30
pukkandan
5038f6d713
[extractor/youtube] Construct dash formats with range query
...
Closes #6369
2023-02-28 23:14:37 +05:30
pukkandan
a538772969
[cleanup] Misc
...
Closes #5897
2023-02-17 17:52:22 +05:30
bashonly
c61cf091a5
[extractor/youtube] uploader_id includes @ with handle
...
Authored by: bashonly
2023-02-17 02:14:45 -06:00
bashonly
149eb0bbf3
[extractor/youtube] Fix uploader_id extraction
...
Closes #6247
Authored by: bashonly
2023-02-16 08:51:45 -06:00
Bruno Guerreiro
78a78fa74d
[extractor/youtube] Add hyperpipe instances ( #6020 )
...
Authored by: Generator
2023-02-12 14:03:45 +05:30
Roland Hieber
05799a48c7
[extractor/youtube] Update invidious and piped instances ( #6030 )
...
Authored by: rohieb
2023-02-12 13:22:07 +05:30
Simon Sawicki
6839ae1f6d
[utils] traverse_obj: Fix more bugs
...
and cleanup uses of `default=[]`
Continued from b1bde57bef
2023-02-10 19:36:55 +05:30
pukkandan
b032ff0f03
[extractor/youtube] Handle consent.youtube
2023-02-03 23:53:42 +05:30
pukkandan
dad2210c0c
[extractor/youtube] Support /live/ URL
2023-02-03 23:53:41 +05:30
mzhou
253ac4ba6a
[extractor/youtube] Retry manifest refresh for live-from-start ( #5670 )
...
Avoids ending download early when live stream is temporarily offline.
Best used with somewhat large `--retry-sleep extractor:` and `--extractor-retries`
Authored by: mzhou
2023-01-07 01:00:42 +05:30
pukkandan
08e29b9f1f
[cleanup] Misc
...
Closes #5576 , closes #5887
2023-01-02 19:40:15 +05:30
pukkandan
9bb856998b
[extractor/youtube] Extract DRC formats
2022-12-30 15:50:17 +05:30
Matthew
c733555106
[extractor/youtube:tab] Extract metadata from channel items ( #5569 )
...
Authored by: coletdjnz
2022-12-12 23:08:14 +00:00
pukkandan
71eb82d1b2
[extractor/youtube] Subtitles cannot be translated to und
...
Closes #5674
2022-11-30 05:18:18 +05:30
Bnyro
bc87dac75f
[extractor/youtube] Add piped.video ( #5571 )
...
Closes #5518
Authored by: Bnyro
2022-11-17 18:45:38 +05:30
pukkandan
9f14daf22b
[extractor] Deprecate _sort_formats
2022-11-17 11:40:17 +05:30
pukkandan
6368e2e639
[cleanup] Misc
...
Closes #5541
2022-11-16 06:57:07 +05:30
pukkandan
a4894d3e25
[extractor/youtube] Consider language in format de-duplication
2022-11-15 05:23:46 +05:30
pukkandan
171a31dbe8
[extractor] Add a way to distinguish IEs that returns only videos
2022-11-13 10:56:04 +05:30
pukkandan
a8c754cc00
[extractor/youtube] Fix bug in handling of music URLs
...
Bug in bd7e919a75Closes #5502
2022-11-12 00:02:13 +05:30
pukkandan
08270da5c3
[extractor/youtube] Fix ytuser:
2022-11-11 16:29:52 +05:30
pukkandan
bd7e919a75
[extractor/youtube:tab] Improvements to tab handling ( #5487 )
...
* Better handling of direct channel URLs - See https://github.com/yt-dlp/yt-dlp/pull/5439#issuecomment-1309322019
* Prioritize tab id from URL slug - Closes #5486
* Add metadata for the wrapping playlist
* Simplify redirect for music playlists
2022-11-11 13:52:40 +05:30
Matthew
e72e48c53f
[extractor/youtube] Ignore incomplete data error for comment replies ( #5490 )
...
When --ignore-errors is used.
Closes https://github.com/yt-dlp/yt-dlp/issues/4669
Authored by: coletdjnz
2022-11-10 06:35:22 +00:00
Matthew
0cf643b234
[extractor/youtube] Differentiate between no and disabled comments ( #5491 )
...
`comments` and `comment_count` will be set to None, as opposed to
an empty list and 0, respectively.
Fixes https://github.com/yt-dlp/yt-dlp/issues/5068
Authored by: coletdjnz, pukkandan
2022-11-10 03:33:03 +00:00
Matthew
4dc23a8051
[extractor/youtube:tab] Fix video metadata from tabs ( #5489 )
...
Closes #5488
Authored by: coletdjnz
2022-11-10 08:14:12 +05:30
Matthew
86973308cd
[extractor/youtube:tab] Update tab handling for redesign ( #5439 )
...
Closes #5432 , #5430 , #5419
Authored by: coletdjnz, pukkandan
2022-11-09 14:28:44 +05:30
Bruno Guerreiro
e14ea7fbd9
[extractor/youtube] Update piped instances ( #5441 )
...
Closes #5286
Authored by: Generator
2022-11-06 23:12:23 +05:30
Matthew
6141346d18
[extractor/youtube] Update playlist metadata extraction for new layout ( #5376 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/5373
Authored by: coletdjnz
2022-11-06 05:25:31 +00:00
pukkandan
2e30b46fe4
[extractor/youtube] Improve chapter parsing from description
...
Closes #5448
2022-11-05 15:34:53 +05:30
nosoop
9da6612b0f
[extractor/youtube] Fix duration for premieres ( #5382 )
...
Closes #5378
Authored by: nosoop
2022-10-29 00:00:33 +05:30
coletdjnz
e63faa101c
[extractor/youtube] Fix live_status extraction for playlist videos
...
Regression in 867c66ff97
2022-10-27 17:36:54 +13:00
bsun0000
5318156f1c
[extractor/youtube] Mark videos as fully watched
...
Closes #2555
Authored by: bsun0000
2022-10-19 00:07:47 +05:30
pukkandan
d5d1df8afd
[cleanup Misc
...
Closes #5162
2022-10-18 23:52:44 +05:30
pukkandan
6678a4f0b3
[extractor/youtube] Fix live_status
...
Bug in 4d37720a0c
2022-10-14 07:41:53 +05:30
pukkandan
5225df50cf
[extractor/youtube:tab] Let approximate_date return timestamp
2022-10-13 15:30:15 +05:30
pukkandan
0468a3b325
[jsinterp] Improve separating regex
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1273974909
2022-10-11 08:02:26 +05:30
Matthew
867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams ( #5152 )
...
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843
Authored by: coletdjnz
2022-10-07 07:00:40 +00:00
Lesmiscore
4d37720a0c
[extractor/youtube] Download post_live videos from start ( #5091 )
...
* The fragments are generated as a `LazyList`. So only the required formats are expanded during download, but all fragment lists are printed/written in infojson.
* The m3u8 formats which cannot be downloaded from start are not extracted by default, but can be enabled with an extractor-arg. The extractor-arg `include_live_dash` is renamed to `include_incomplete_formats` to account for this new use-case.
Closes #1564
Authored by: Lesmiscore, pukkandan
2022-10-04 08:18:31 +05:30
pukkandan
a057779d5e
[cleanup] Minor fixes
...
Closes #5129 , Closes #4982
2022-10-04 01:48:14 +05:30
pukkandan
7a32c70d13
[cleanup] Fix flake8 and minor refactor
...
Issues from ab029d7e921fb53b946c
2022-09-27 08:32:57 +05:30
pukkandan
709ee21417
[extractor/youtube] Do not warn on duplicate chapters
...
Eg: vYbaM8w8yzw
2022-09-27 08:26:26 +05:30
pukkandan
1fb53b946c
[extractor/youtube:tab] Improve continuation items extraction
2022-09-27 04:44:54 +05:30
pukkandan
1dd18a8808
[extractor/YoutubeShortsAudioPivot] Support source URLs
...
`ytshortsap:` is no longer needed
2022-09-27 04:44:50 +05:30
pukkandan
0a5095fe8d
[extractor/youtube:tab] Support reporthistory page
...
Closes #4929
2022-09-27 04:44:50 +05:30
coletdjnz
0ca0f88121
[extractor/heise] Fix extractor ( #5029 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/1520
Authored by: coletdjnz
2022-09-26 00:58:06 +00:00
coletdjnz
80eb0bd9b9
[extractor/youtube] Add support for Shorts audio pivot feed ( #4932 )
...
This feed shows Shorts using the audio of a given video.
ytshortsap: prefix can be used as a shortcut until YouTube
implements an official view.
Closes #4911
Authored by: coletdjnz
2022-09-22 05:39:02 +00:00
coletdjnz
c26f9b991a
[extractor/youtube] Support changing extraction language ( #4470 )
...
Adds `--extractor-args youtube:lang=<supported lang code>` extractor arg to prefer translated fields (e.g. title and description) of that language, if available, for all YouTube extractors. See README or error message for list of supported language codes.
Closes https://github.com/yt-dlp/yt-dlp/issues/387
Authored by: coletdjnz
2022-09-09 05:16:46 +00:00
coletdjnz
3ffb2f5bea
[extractor/youtube] Fix video like count extraction
...
Support new combined button layout
Authored by: coletdjnz
2022-09-09 12:34:39 +12:00
pukkandan
17ffed1842
[docs] Improvements
...
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853 , Closes #4855 , Closes #4852
* Improve some error messages
2022-09-07 17:38:05 +05:30
pukkandan
7c6eb424d3
[extractor/youtube] Detect lazy-load-for-videos embeds
...
Closes #4812
2022-09-02 02:01:57 +05:30
pukkandan
05deb747bb
[jsinterp] Fix escape in regex
2022-09-01 16:46:32 +05:30
