Jaime Marquínez Ferrándiz
9908e03528
Merge pull request #4076 from ghedo/direct_type
...
[generic] indicate when a direct video has been extracted
2014-11-06 22:23:14 +01:00
Naglis Jonaitis
37aab27808
[brightcove] Extract m3u8 formats ( #3541 )
2014-11-06 00:14:33 +02:00
Naglis Jonaitis
bdf9701729
[generic/brightcove] Add a new test case for kijk.nl ( #3541 )
2014-11-03 23:13:46 +02:00
Philipp Hagemeister
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
2014-11-02 11:23:42 +01:00
Alessandro Ghedini
ccdd0ffb80
[generic] indicate when a direct video has been extracted
...
Fixes #4052 .
2014-11-01 15:34:00 +01:00
Sergey M․
5263cdfcf9
[generic] Improve MLB iframe regex
2014-11-01 04:01:58 +07:00
Philipp Hagemeister
ac645ac7d0
[generic] Allow soundcloud embeds with additional attributes
2014-10-29 20:27:58 +01:00
Philipp Hagemeister
48a24ab746
[generic] Fix HTML5 video regexp
2014-10-28 10:41:24 +01:00
Philipp Hagemeister
d6d9186f0d
[generic] Fix test title
2014-10-27 00:45:15 +01:00
Philipp Hagemeister
37d66e7f1e
[generic] Correct call to _webpage_read_full_content
2014-10-26 20:58:09 +01:00
Philipp Hagemeister
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
2014-10-26 20:49:51 +01:00
Philipp Hagemeister
23be51d8ce
[generic] Handle audio streams that do not implement HEAD ( Fixes #4032 )
2014-10-26 17:05:44 +01:00
Philipp Hagemeister
a7e97f6db1
[generic] Allow new SWFObject()-style imports
...
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
2014-10-26 14:15:49 +01:00
Philipp Hagemeister
f2f2c0c2c6
[generic] Allow --default-search without colon
2014-10-23 21:13:45 +02:00
Sergey M․
281d3f1d68
[generic/wistia] Improve regex
2014-10-23 23:03:07 +07:00
dinesh
85d7b76586
[thoughtworks] wistia regex modified
2014-10-23 21:23:56 +05:30
dinesh
52cffcb186
[thoughtworks] wistia support added
2014-10-23 20:28:39 +05:30
Naglis Jonaitis
9471c44405
[generic] Make sure Wistia embed URLs contain the protocol ( Closes #3977 )
...
Also, improve detection (Addresses #3662 )
2014-10-18 01:55:21 +03:00
Philipp Hagemeister
09a42738fc
[generic] Correct handling of embedded vimeo players ( #3955 )
2014-10-15 13:50:53 +02:00
Sergey M․
1419fafd36
[condenast] Add support for embedded videos ( Closes #3929 )
2014-10-13 19:59:35 +07:00
Sergey M․
ced659bb4d
[generic] Ignore some non-video file extensions during generic extraction ( Closes #3900 )
2014-10-09 19:26:23 +07:00
Naglis Jonaitis
8489578df4
[generic] Support embedded Dailymotion playlists ( fixes #3822 )
2014-10-02 21:42:45 +03:00
Philipp Hagemeister
07e764439a
[generic] Delete test case
...
The page is not available any more.
2014-10-01 00:08:19 +02:00
Philipp Hagemeister
761e1645e0
[generic] Remove unstable test checksum
2014-09-29 05:18:45 +02:00
Philipp Hagemeister
a8eb5a8e61
[generic] Fix testcases
2014-09-29 05:12:57 +02:00
Philipp Hagemeister
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
2014-09-28 12:14:16 +02:00
Philipp Hagemeister
c6e90caaa6
Merge remote-tracking branch 'naglis/wistia'
2014-09-25 02:03:49 +02:00
Philipp Hagemeister
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
2014-09-25 01:59:02 +02:00
Philipp Hagemeister
3b2f933b01
[generic] Allow embedded YoutubePlaylists ( Fixes #3821 )
2014-09-24 11:05:14 +02:00
Naglis Jonaitis
746c67d72f
[wistia] Use API and make more generic
2014-09-20 03:02:11 +03:00
Jaime Marquínez Ferrándiz
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
2014-09-16 22:53:48 +02:00
Sergey M․
1bf5423e82
[generic/youtube] Recognize youtube nocookie embeds ( Closes #3713 )
2014-09-10 18:29:20 +07:00
Sergey M․
1a94ff6865
[mlb] Add support for embedded videos ( Closes #3653 )
2014-09-02 20:19:28 +07:00
Philipp Hagemeister
b759a0d4d2
fix up imports
2014-08-28 01:00:59 +02:00
Philipp Hagemeister
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
2014-08-28 00:58:24 +02:00
Philipp Hagemeister
aff216edf4
[generic] Prevent <video> search from skipping over empty sources ( #3546 )
2014-08-27 02:09:59 +02:00
Philipp Hagemeister
1cb6dcdbbe
[generic] Do not download images as videos by accident
2014-08-27 02:07:11 +02:00
Philipp Hagemeister
f971dcbba0
Merge branch 'master' of github.com:rg3/youtube-dl
2014-08-25 18:36:42 +02:00
Philipp Hagemeister
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
2014-08-25 18:03:01 +02:00
Jaime Marquínez Ferrándiz
bcc069a937
[generic] Remove debug statement
2014-08-25 17:21:58 +02:00
Philipp Hagemeister
5f90042bd6
[generic] remove unused imports
2014-08-24 14:28:58 +02:00
Philipp Hagemeister
ebab4520ff
[generic] Use default opener for HEAD request ( Fixes #3528 )
2014-08-24 06:58:11 +02:00
Philipp Hagemeister
4d805e063c
[generic] Automatic detection of flow player and age_limit ( Fixes #3576 )
2014-08-24 05:31:32 +02:00
Philipp Hagemeister
4d54ef20a2
[ministrygrid] Add extractor ( Fixes #2900 )
2014-08-24 04:47:28 +02:00
Philipp Hagemeister
1f8b6af773
[bip.tv] Allow underscore in lookup ids ( Fixes #3573 )
2014-08-24 03:20:31 +02:00
Philipp Hagemeister
10eaeb20c5
[generic] Require og:video URLs to contain a dot
2014-08-24 02:29:56 +02:00
Philipp Hagemeister
fa8deaf38b
[generic] Prevent from downloading a .swf as a video
...
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
2014-08-24 02:24:49 +02:00
Philipp Hagemeister
c8e9a235d9
[generic] Add support for camtasia videos ( Fixes #3574 )
2014-08-24 02:02:17 +02:00
Philipp Hagemeister
2ef6fcb5d8
[sbs] Add new extractor ( Fixes #3566 )
2014-08-23 15:20:56 +02:00
Philipp Hagemeister
ed2d6a1960
[generic] Simplify playlist support ( #2948 )
2014-08-22 18:19:56 +02:00
Philipp Hagemeister
c71dfccc98
Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-08-22 17:40:36 +02:00
Sergey M․
49807b4ac6
[yahoo] Add support for embedded videos ( Closes #3525 )
2014-08-16 13:56:22 +07:00
Philipp Hagemeister
1f7ccb9014
[generic] Add --default-search fixup_error
...
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
2014-07-29 17:17:46 +02:00
Anthony J. Bentley
eef4a7a304
Fix typo: “ytseach” → “ytsearch”
2014-07-20 18:37:44 -06:00
Philipp Hagemeister
7571c02c8a
[generic] Set default-search to error
...
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
2014-07-06 11:22:44 +02:00
Sergey M․
0364fa8b65
[generic] Add support for ivi.ru embedded player
2014-06-29 20:18:23 +07:00
Jaime Marquínez Ferrándiz
c5cd249e41
[generic] Extract mtvservices embedded videos
2014-06-22 21:39:36 +02:00
Philipp Hagemeister
826ec77fb2
[Vulture] Add support for vulture.com
2014-06-09 23:06:39 +02:00
Philipp Hagemeister
2b88feedf7
[generic] Add support for <embed YouTube
2014-06-09 22:06:45 +02:00
anovicecodemonkey
37e3cbe22e
Move duplicate check to generic.py
2014-06-01 01:16:35 +09:30
anovicecodemonkey
610134730a
Add a _TEST_
2014-05-21 19:25:37 +09:30
Philipp Hagemeister
0e67ab0d8e
[generic] Abort if user passes in URL "url" ( #2942 )
2014-05-19 17:10:11 +02:00
anovicecodemonkey
3442b30ab2
[generic] Support data-video-url for YouTube embeds ( Fixes #2862 )
2014-05-18 23:15:09 +09:30
Sergey M․
8dfa187b8a
[generic] Support pagespeed_iframe for NovaMov embeds
2014-05-17 18:12:12 +07:00
Sergey M․
a5a45015ba
[generic] Fix redirect
2014-05-16 20:32:53 +07:00
Philipp Hagemeister
2099125333
[soundcloud/generic] Add support for playlists
2014-05-05 03:15:17 +02:00
Sergey M․
669f0e7cda
[generic] Fix wrong entries index
2014-05-01 16:28:37 +07:00
Philipp Hagemeister
b30b8698ea
[generic] Allow multiple matches for generic hits ( Fixes #2818 )
2014-04-30 02:23:51 +02:00
Philipp Hagemeister
ebd3c7b370
[generic] Add support for protocol-independent URLs ( Fixes #2810 )
2014-04-30 01:46:06 +02:00
Philipp Hagemeister
c0292e8ab7
[generic] Improve jwplayer detection ( Fixes #2731 )
2014-04-21 16:16:53 +02:00
Philipp Hagemeister
48099643cc
[generic] Be more relaxed when looking for aparat embeds ( Fixes #2784 )
2014-04-21 12:37:41 +02:00
Philipp Hagemeister
fa35cdad02
[condenast|generic] Add support for condenast embeds ( Fixes #2783 )
2014-04-21 05:47:52 +02:00
Sergey M․
fd50bf623c
[generic] Modernize tests
2014-04-14 18:56:29 +07:00
Sergey M․
d360a14678
[generic] Update test
2014-04-14 18:51:46 +07:00
Sergey M․
15c0e8e7b2
[generic] Generalize novamov based embeds
2014-04-05 17:20:05 +07:00
Sergey M․
7cd3bc5f99
[nowvideo] Support more domains
2014-04-05 16:38:57 +07:00
Sergey M․
50f566076f
[generic] Add support for videoweed embeds
2014-04-05 15:49:45 +07:00
anovicecodemonkey
ca6aada48e
Fix _TEST for Ustream embed URLs
2014-04-05 03:26:29 +10:30
anovicecodemonkey
5c38625259
[UstreamIE] [generic] Added support for Ustream embed URLs ( Fixes #2694 )
2014-04-05 00:53:09 +10:30
Philipp Hagemeister
9ad400f75e
[generic] Remove test case that has become a 404
2014-04-04 01:47:17 +02:00
Sergey M․
0479c625a4
[brightcove] Encode object_str with utf-8
2014-04-01 20:17:35 +07:00
Philipp Hagemeister
9c1fc022ae
[generic] Warn before fallback to automatic search
2014-03-30 15:57:35 +02:00
Sergey M․
cb3ac1c610
[smotri] Modernize and add support for emdebbed videos ( Closes #2585 )
2014-03-28 19:58:49 +07:00
Philipp Hagemeister
893f8832b5
[arte] Add support for embedded videos ( Fixes #2620 )
2014-03-24 22:01:47 +01:00
Jaime Marquínez Ferrándiz
7e2ede9891
[generic] Run TED detection before JW Player detection
...
Otherwise it overwrittes the `mobj` variable.
2014-03-22 10:20:44 +01:00
Jaime Marquínez Ferrándiz
0f2a2ba14b
Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-21 22:14:24 +01:00
Jaime Marquínez Ferrándiz
750f9020ae
[generic] Recognize more Ooyala embedded videos ( #2569 )
2014-03-21 21:51:33 +01:00
Philipp Hagemeister
aab74fa106
[ted] Simplify embed code ( #2587 )
2014-03-20 16:33:23 +01:00
anovicecodemonkey
8d7c0cca13
[generic] Add support for embeded TED videos
2014-03-20 00:56:32 +10:30
Jaime Marquínez Ferrándiz
ecbe1ad207
[generic] Fix access to removed function in python 3.4
...
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
`origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host .
2014-03-17 21:59:21 +01:00
Sergey M․
93d020dd65
[generic] Add support for embedded rutv player
2014-03-17 02:00:31 +07:00
Sergey M․
15fd51b37c
[generic] More generic support for embedded vimeo player ( #1602 )
2014-03-16 00:47:04 +07:00
Sergey M․
d95e35d659
[generic] Add nowvideo test hidden behind percent encoding
2014-03-15 04:39:53 +07:00
Sergey M․
1439073049
[generic] Add comment for unescaping webpage contents
2014-03-15 04:38:49 +07:00
Sergey M
1f7659dbe9
[generic] Unescape webpage contents
2014-03-15 04:21:17 +07:00
Philipp Hagemeister
60cc4dc4b4
[generic/funnyordie] Add support for funnyordie embeds ( Fixes #2546 )
2014-03-11 16:51:36 +01:00
Philipp Hagemeister
bcf89ce62c
[generic] Suppress warning about doctypes in RSS parser
2014-03-10 17:31:32 +01:00
Philipp Hagemeister
0a5bce566f
[generic] Add all test attributes for embedly ( #2447 )
...
In the future, we may want to not only print something, but throw an error for untested properties.
2014-03-05 14:05:50 +01:00
Philipp Hagemeister
8012bd2424
[generic] Get a better ID
2014-03-05 14:02:14 +01:00
Philipp Hagemeister
f55a1f0a88
Merge remote-tracking branch 'rzhxeo/embedly'
...
Conflicts:
youtube_dl/extractor/generic.py
2014-03-05 14:01:53 +01:00
Sergey M.
ca97a56e4b
[vk] Add support for embedded videos ( Closes #2473 )
2014-02-28 23:51:54 +07:00
rzhxeo
1b86cc41cf
Add support for embed.ly
2014-02-27 08:14:28 +01:00
Philipp Hagemeister
89ef304bed
[generic] Add support for <meta redirect>
...
Fixes #413
2014-02-27 07:22:02 +01:00
Sergey M.
b1c6c32f78
[generic] Add support for nowvideo embedded videos
2014-02-24 23:37:42 +07:00
Jaime Marquínez Ferrándiz
f7300c5c90
[generic] Fix on python 2.6
...
`ParseError` is not available, it raises `xml.parsers.expat.ExpatError`.
The webpage needs to be encoded.
2014-02-21 16:59:10 +01:00
Philipp Hagemeister
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
2014-02-20 13:14:09 +01:00
Philipp Hagemeister
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
2014-02-03 15:19:40 +01:00
Philipp Hagemeister
ab083b08ab
[generic] remove testcase
...
The video seems to have been removed from the site.
2014-01-30 06:10:57 +01:00
Philipp Hagemeister
9f8928d032
[generic] Match JWPlayerOptions
...
This adds support for The Guardian, among others
Closes #2271 , fixes #2267
2014-01-30 05:29:10 +01:00
dst
c3f51436bf
Improve some regexes for embedded players
2014-01-30 04:26:46 +07:00
Philipp Hagemeister
17ab4d3b5e
[brightcove] Move test to generic
2014-01-28 03:35:32 +01:00
Philipp Hagemeister
db1f388878
[huffpost] Add support
2014-01-27 05:47:38 +01:00
Philipp Hagemeister
04b4d394d9
Add new --default-search option ( #2193 )
2014-01-22 14:16:43 +01:00
Philipp Hagemeister
9834872bf6
[facebook] Add support for embeds
...
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
2014-01-21 18:10:17 +01:00
Philipp Hagemeister
3486df383b
[generic] Improve testcase
2014-01-21 01:40:34 +01:00
Philipp Hagemeister
2f21eb2db6
[generic] Do not fetch XML URLs ( Fixes #2162 )
2014-01-17 02:13:00 +01:00
Philipp Hagemeister
3fabeaa1f4
[vimeo] Support protocol-relative URLs
2014-01-08 22:42:52 +01:00
dst
5f59ee7942
[novamov] Remove superfluous tabs
2014-01-08 08:11:46 +07:00
dst
8f89e68781
[novamov] Add embedded player support
2014-01-08 08:09:13 +07:00
Philipp Hagemeister
42e4fcf23a
[generic] Fix regexes
2014-01-07 11:04:27 +01:00
Philipp Hagemeister
c93c2ab1c3
[mpora] Add support ( Fixes #2096 )
2014-01-07 08:07:46 +01:00
Philipp Hagemeister
79f8295303
Use original Referer URL in Brightcove requests ( Fixes #2110 )
2014-01-07 05:34:14 +01:00
Philipp Hagemeister
796495886e
[generic] Use unicode_literals instead of duplicating the u'
2014-01-06 01:47:52 +01:00
Philipp Hagemeister
fc9713a1d2
[youtube] Support jwplayer with YouTube URLs ( Closes #2075 )
2014-01-06 01:42:58 +01:00
Philipp Hagemeister
d981cef6b9
[generic] Support gorillavid.in
...
Previously, we were a little bit over-eager and got a random swf file.
Fixes #2084 .
2014-01-05 05:34:08 +01:00
Philipp Hagemeister
aff24732b9
Merge remote-tracking branch 'rzhxeo/blip'
...
Conflicts:
youtube_dl/extractor/bliptv.py
2014-01-05 03:48:45 +01:00
rzhxeo
19dab5e6cc
[GenericIE] Outsource embedded blip.tv player video id extraction to BlipTVIE and fix minor errors in RegEx
2013-12-30 06:15:02 +01:00
Philipp Hagemeister
c1d1facd06
[generic] Output something before making network requests
2013-12-27 08:38:42 +01:00
Philipp Hagemeister
7115ca84aa
[vimeo/generic] Add support for embedded SWF vimeo videos
2013-12-22 03:34:13 +01:00
Philipp Hagemeister
aa94a6d315
[aparat] Add support ( Fixes #2012 )
2013-12-20 17:05:39 +01:00
Philipp Hagemeister
1f9da9049b
[generic] Support YouTube swf embed ( Fixes #2010 )
2013-12-19 20:44:30 +01:00
Jaime Marquínez Ferrándiz
c0d0b01f0e
[generic] Detect ooyala videos ( fixes #2013 )
2013-12-19 20:32:12 +01:00
Philipp Hagemeister
3e78514568
[generic] Support application/ogg for direct links
...
Also remove some debugging code.
2013-12-17 16:26:34 +01:00
Philipp Hagemeister
42393ce234
Add support for direct links to a video ( #1973 )
2013-12-17 12:33:55 +01:00
Philipp Hagemeister
cecaaf3f58
[generic] Do not use compatibility result fallback
2013-12-17 12:04:33 +01:00
Philipp Hagemeister
f25571ffbf
Add support for embedded vevo player ( Fixes #1957 )
2013-12-16 21:45:21 +01:00
rzhxeo
ee3e63e477
[GenericIE] Add support for embedded blip.tv
2013-12-16 20:08:23 +01:00
Philipp Hagemeister
ef4fd84857
[wistia] Add extractor
2013-12-06 09:15:04 +01:00
Philipp Hagemeister
355e4fd07e
[generic] Find embedded dailymotion videos ( Fixes #1848 )
2013-12-01 01:21:33 +01:00
Philipp Hagemeister
113577e155
[generic] Improve detection
...
Allow download of http://goo.gl/7X5tOk
Fixes #1818
2013-11-25 03:35:53 +01:00
Jaime Marquínez Ferrándiz
0980426559
[bandcamp] add support for albums (reported in #1270 )
2013-11-22 16:05:14 +01:00
Philipp Hagemeister
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
2013-11-18 13:28:26 +01:00
Jaime Marquínez Ferrándiz
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
2013-11-07 21:06:48 +01:00
Jaime Marquínez Ferrándiz
eeb165e674
[brightcove] Add the extraction of the url from generic
2013-11-06 16:58:03 +01:00
Jaime Marquínez Ferrándiz
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
2013-11-06 16:43:26 +01:00
rzhxeo
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
2013-11-05 02:08:02 +01:00
Jaime Marquínez Ferrándiz
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
2013-10-27 14:40:25 +01:00
Jaime Marquínez Ferrándiz
aa929c37d5
[generic] Fix test video's checksum
2013-10-27 14:21:37 +01:00
Philipp Hagemeister
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
2013-10-18 11:44:57 +02:00
Philipp Hagemeister
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
2013-10-15 12:05:13 +02:00
