Jaime Marquínez Ferrándiz
59188de113
Properly escape ‘.’ in some _VALID_URL properties
2014-01-25 11:48:08 +01:00
Jaime Marquínez Ferrándiz
352d08e3e5
Add an extractor for freespeech.org ( closes #2234 )
2014-01-25 11:31:30 +01:00
Pornophage
bacb5e4f44
Minor fixes
...
Remove empty description
Set correct md5 test
2014-01-25 02:34:08 +01:00
Pornophage
008af8660b
Add cliphunter extractor
2014-01-25 01:46:52 +01:00
Philipp Hagemeister
2c5bae429a
[youtube] Fix new formats
2014-01-24 00:06:26 +01:00
Philipp Hagemeister
1394ce65b4
[youtube] Add new formats ( Fixes #2221 )
2014-01-23 23:54:06 +01:00
Pierre Rudloff
67ccb77197
Removed websurg extractor
2014-01-23 23:42:34 +01:00
Philipp Hagemeister
0b65e5d40f
[youtube] Do not break upon unknown formats
2014-01-23 23:21:42 +01:00
Philipp Hagemeister
975d35dbab
[youtube:truncated_url] Also match mail subscription links ( #2214 )
2014-01-23 16:14:54 +01:00
Jaime Marquínez Ferrándiz
8b769664c4
[sina] Recognize http://video.sina.com.cn/v/b/{id}-*.html urls ( fixes #2212 )
2014-01-23 14:03:14 +01:00
Jaime Marquínez Ferrándiz
76f270a46a
[sina] use unicode_literals
2014-01-23 14:00:29 +01:00
Philipp Hagemeister
924f47f7b6
[rottentomatoes] Use unicode_literals
2014-01-23 04:05:58 +01:00
Philipp Hagemeister
22ff1c4a93
[xhamster] Futher simplification
2014-01-23 04:04:39 +01:00
Philipp Hagemeister
35409e1101
[xhamster] Use unicode_literals
2014-01-23 03:52:59 +01:00
Mike Col
65d781128a
[xhamster] Add support for hd video
...
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
2014-01-23 03:51:09 +01:00
Philipp Hagemeister
066f6a0630
[nowness] Add support
2014-01-23 00:12:47 +01:00
Philipp Hagemeister
12ed57418c
[gamespot] Fix regexp
2014-01-22 22:31:19 +01:00
Philipp Hagemeister
4919603f66
[youtube] Make DASH manifest download conditional for now
...
DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.
2014-01-22 21:56:38 +01:00
Philipp Hagemeister
bd2d82a5d3
[newgrounds] Simplify
2014-01-22 21:41:28 +01:00
Philipp Hagemeister
65697b3bf3
Merge branch 'paged-lists'
...
Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py
2014-01-22 20:00:16 +01:00
Philipp Hagemeister
50317b111d
Merge branch 'youtube-dash-manifest'
...
Conflicts:
youtube_dl/extractor/youtube.py
2014-01-22 19:58:31 +01:00
Philipp Hagemeister
d7975ea287
[xvideos] Simplify
2014-01-22 19:02:48 +01:00
Mike Col
714d709a31
[xvideos] Fix thumbnail extraction
...
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
2014-01-22 19:01:41 +01:00
Philipp Hagemeister
11577ec054
[cspan] Disable test
...
It works fine from all my machines, no matter where, but from travis, we get lots of 403s.
Maybe another project is scraping CSPAN from travis and they're blocking the travis machines?
2014-01-22 15:10:02 +01:00
Philipp Hagemeister
04b4d394d9
Add new --default-search option ( #2193 )
2014-01-22 14:16:43 +01:00
Jaime Marquínez Ferrándiz
130f12985a
[comedycentral] Use the generic _real_extract provided by the base class
2014-01-22 11:44:26 +01:00
Jaime Marquínez Ferrándiz
4ca5d43cd8
Merge pull request #2195 from dstftw/master
...
[space] Add support for mobile URLs
2014-01-22 02:39:17 -08:00
Jaime Marquínez Ferrándiz
4bbf139aa7
[southparkstudios] Use the generic _real_extract provided by the base class
2014-01-22 11:35:17 +01:00
dst
47739636a9
[space] Add support for mobile URLs
2014-01-22 17:25:32 +07:00
Jaime Marquínez Ferrándiz
407ae733ab
[cspan] Make ‘www’ optional and improve the regex for extracting the id ( fixes #2194 )
2014-01-22 11:06:03 +01:00
Jaime Marquínez Ferrándiz
c39f7013e1
[gametrailers] Use the generic _real_extract provided by the base class
2014-01-22 10:51:17 +01:00
Philipp Hagemeister
a4a028323e
[comedycentral] Use unicode_literals
2014-01-22 03:50:49 +01:00
Philipp Hagemeister
780ee4e501
[comedycentral] Adapt testcase
...
In contrast to other sites, ComedyCentral seems to understand how to sensibly use MTV IE, but the additional text shouldn't hurt.
2014-01-22 03:49:17 +01:00
Philipp Hagemeister
d7b51547c0
[imdb:list] Switch to loading the webpage
...
The RSS method seems to be defunct.
2014-01-22 03:41:25 +01:00
Philipp Hagemeister
43030f36db
[d8] typo
2014-01-22 03:10:31 +01:00
Philipp Hagemeister
48c63f1653
[d8] disable test; video got deleted
2014-01-22 03:09:21 +01:00
Philipp Hagemeister
90f479b6d5
[novamov] Skip tests
2014-01-22 03:04:10 +01:00
Philipp Hagemeister
d3a1c71917
[ringtv] Fix and add news extraction
2014-01-22 02:16:40 +01:00
Philipp Hagemeister
af1588c05f
[mtv] Update tests and xpath function for new title extraction
2014-01-22 02:04:51 +01:00
Philipp Hagemeister
2250865fb0
[Wimp] Use new URL relay method
2014-01-22 02:01:39 +01:00
Philipp Hagemeister
99f770caa8
[hotnewhiphop] Retrieve media key
2014-01-22 01:55:50 +01:00
Philipp Hagemeister
a70515c0fd
[servingsys] Do not run test on travis
...
Apparantly, even the advertisers do geoblocking now!?
From the US, this isn't outright blocked, but there are no videos returned.
2014-01-22 00:27:18 +01:00
Philipp Hagemeister
6562df768d
Merge branch 'master' of github.com:rg3/youtube-dl
...
Conflicts:
youtube_dl/extractor/mtv.py
2014-01-22 00:21:27 +01:00
Philipp Hagemeister
06769acd71
[gametrailers] Use unicode_literals
...
Conflicts:
youtube_dl/extractor/gametrailers.py
2014-01-22 00:18:52 +01:00
Philipp Hagemeister
32dac6943d
[mtv] Use unicode_literals
2014-01-22 00:18:09 +01:00
Philipp Hagemeister
90834c78fe
[mtv] Fix title for gametrailers ( Fixes #2188 )
...
We now prefer the title including the category, because that title is what is presented at the actual sites.
2014-01-22 00:17:33 +01:00
Jaime Marquínez Ferrándiz
47917f24c4
[brightcove] Fix extraction of embedded videos
...
There was a leading ‘:’ in the regex.
The ‘flashvars’ parameter is not always available.
2014-01-21 22:04:46 +01:00
Jaime Marquínez Ferrándiz
d614aa40e3
[brightcove] Fix check for url in the result
...
It may have the ‘formats’ field instead of ‘url’.
2014-01-21 21:53:10 +01:00
Jaime Marquínez Ferrándiz
bc4ba05fcb
[mtv] Add an extractor for mtviggy.com ( #2072 )
2014-01-21 20:59:31 +01:00
Jaime Marquínez Ferrándiz
8d9453b9e8
Add an extractor for spike.com ( #2072 )
...
Added a generic _real_extract to MTVServicesInfoExtractor
2014-01-21 20:54:47 +01:00
Jaime Marquínez Ferrándiz
e4f320a4d0
[mtv] Check for geo-blocked videos in the xml document, not in the xml’s string
...
Allows to use the `_download_xml` method
2014-01-21 19:59:02 +01:00
Jaime Marquínez Ferrándiz
ef9f2ba7af
[mtv] Use unicode_literals
2014-01-21 19:58:21 +01:00
Philipp Hagemeister
913f32929b
[vk] Add support for HQ videos ( Fixes #2187 )
2014-01-21 18:21:44 +01:00
Philipp Hagemeister
9834872bf6
[facebook] Add support for embeds
...
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
2014-01-21 18:10:17 +01:00
Philipp Hagemeister
94a23d2a1e
[vk] Use unicode_literals
2014-01-21 17:32:03 +01:00
Philipp Hagemeister
608bf69880
[vk] avoid built-in names
2014-01-21 17:29:04 +01:00
Philipp Hagemeister
032b3df5af
[redtube] Use unicode_literals
2014-01-21 14:16:44 +01:00
Mike Col
9d11a41fe4
[redtube] Add support for thumbnails
...
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
2014-01-21 14:14:55 +01:00
Philipp Hagemeister
7b0817e8e1
[servingsys] Add support
...
This also adds support for brightcove advertisements.
Fixes #2181
2014-01-21 02:09:51 +01:00
Philipp Hagemeister
9d4288b2d4
[extractor/common] Clarify when and when not we generate the filename
2014-01-21 01:41:13 +01:00
Philipp Hagemeister
3486df383b
[generic] Improve testcase
2014-01-21 01:40:34 +01:00
Philipp Hagemeister
b60016e831
Deal with implicitly UTF-16 decoded webpages
...
These webpages don't specify an encoding and rely on the BOM
2014-01-21 01:39:40 +01:00
Philipp Hagemeister
5aafe895fc
Correct XML ampersand fixup
2014-01-20 22:11:34 +01:00
Philipp Hagemeister
b7ab059084
Add infrastructure for paged lists
...
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
2014-01-20 11:36:47 +01:00
Philipp Hagemeister
c91778f8c0
[youtube] Fall back to header if playlist title is not available
...
Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example
2014-01-20 02:45:51 +01:00
Philipp Hagemeister
5016f3eac8
[myspace] More robust mediatype check
2014-01-20 02:44:08 +01:00
Jaime Marquínez Ferrándiz
efb1bb90a0
[myspace] Add support for song urls ( fixes #2040 )
2014-01-19 11:38:48 +01:00
Philipp Hagemeister
4cf393bb4b
[dropbox] Correct test case ( #2171 )
2014-01-19 06:16:40 +01:00
Philipp Hagemeister
ce4e242a6f
[dropbox] PEP8 and simplify ( #2171 )
2014-01-19 06:14:24 +01:00
sahutd
6b79f40c3d
Added support for Dropbox
2014-01-19 10:20:26 +05:30
Philipp Hagemeister
dd27fd1739
[youtube] Download DASH manifest
...
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats.
Fixes #2166
2014-01-19 05:47:20 +01:00
sahutd
2a7c35dd46
added dropbox support
2014-01-18 20:50:42 +05:30
sahutd
8da531359e
Added dropbox support. issue #2055
2014-01-18 20:45:53 +05:30
Philipp Hagemeister
3ec05685f7
[extractor/common] Limit --write-pages filename to 200 chars
...
This avoids problems with very long URLs.
2014-01-17 14:47:47 +01:00
Philipp Hagemeister
877bfd69d1
[cnn] Improve test
2014-01-17 05:06:13 +01:00
Philipp Hagemeister
f68cd00fe3
[kankan] Skip test
2014-01-17 04:21:54 +01:00
Philipp Hagemeister
ca70d215cf
[kankan] Simplify
2014-01-17 04:21:22 +01:00
Philipp Hagemeister
d0390a0c92
[mixcloud] Use unicode_literals
2014-01-17 04:06:18 +01:00
Philipp Hagemeister
dd2535c38a
[mixcloud] Fix URL extraction
2014-01-17 04:05:15 +01:00
Philipp Hagemeister
b78d180170
[mpora] Fix uploader name extraction
2014-01-17 03:59:42 +01:00
Philipp Hagemeister
26dca1661e
[ted] Updated checksums
2014-01-17 03:54:54 +01:00
Philipp Hagemeister
f853f8594d
[ted] Use unicode_literals
2014-01-17 03:52:17 +01:00
Philipp Hagemeister
d0da491e1e
[condenast] Allow multiple formats, and sort centralized
2014-01-17 03:36:03 +01:00
Philipp Hagemeister
6e249060cf
[condenast] Use unicode_literals
2014-01-17 03:32:02 +01:00
Philipp Hagemeister
fbcd7b5f83
[soundcloud] Use unicode_literals and centralized sorting
2014-01-17 03:29:41 +01:00
Philipp Hagemeister
9ac0a67581
[spankwire] Use centralized format sorting and unicode_literals
2014-01-17 03:26:05 +01:00
Philipp Hagemeister
befdc8f3b6
[teamcoco] Use centralized sorting
2014-01-17 03:22:02 +01:00
Philipp Hagemeister
bb198c95e2
[teamcoco] Use unicode_literals
2014-01-17 03:15:09 +01:00
Philipp Hagemeister
c1195541b7
[gamespot] Use unicode_literals
2014-01-17 03:13:40 +01:00
Philipp Hagemeister
26844eb57b
[franceinter] Remove superfluous whitespace
2014-01-17 03:10:54 +01:00
Philipp Hagemeister
677b3ce82f
[franceinter] Minor improvements ( #2152 )
2014-01-17 03:09:07 +01:00
Philipp Hagemeister
fabfe17d5e
[flickr] Use unicode literals
2014-01-17 03:07:01 +01:00
Philipp Hagemeister
82696d5d5d
Merge remote-tracking branch 'sahutd/master'
2014-01-17 03:02:55 +01:00
Philipp Hagemeister
484aaeb204
[everyonesmixtape] Add support ( Fixes #2161 )
2014-01-17 02:56:13 +01:00
Philipp Hagemeister
2f21eb2db6
[generic] Do not fetch XML URLs ( Fixes #2162 )
2014-01-17 02:13:00 +01:00
Jaime Marquínez Ferrándiz
c11529618a
[redtube] Make ‘http:’ not optional ( closes #2160 )
...
If the url doesn’t specify the protocol we can’t directly use it to download the webpage, we would need to build a new url.
Instead, we let the generic extractor add the protocol.
2014-01-16 11:21:33 +01:00
sahutd
c8650f7ecd
Made modification as suggested on https://github.com/rg3/youtube-dl/pull/2151
2014-01-15 16:48:55 +05:30
Saimadhav Heblikar
14e7543a5a
franceinter [Issue #2105 ]
...
Added franceinterIE import to reflect addition of FranceInter support. Issue #2105
2014-01-15 11:51:12 +05:30
Saimadhav Heblikar
bf6705f584
Added franceinter [Issue #2105 ]
2014-01-15 11:49:50 +05:30
Filippo Valsorda
a9f53ce7ea
Add a couple of missing http:// in test URLs
2014-01-14 16:01:31 -05:00
Philipp Hagemeister
5d8683a5cd
[nowvideo] Add support for .sx version ( Fixes #2127 )
2014-01-12 01:26:37 +01:00
dst
7ee40b5d1c
[lynda] Add support for member accounts and paid videos ( Closes #2125 )
2014-01-12 05:31:56 +07:00
Jaime Marquínez Ferrándiz
db22af36ec
[brightcove] The ‘id’ attribute is not always present in the object tag ( fixes #2132 )
...
It looks like the ‘flashId’ parameter is not needed.
2014-01-10 19:39:42 +01:00
Philipp Hagemeister
f8b5ab8cfa
[bandcamp] Make thumbnail and uploader optional
...
Fixes #2129
2014-01-09 23:04:36 +01:00
Jaime Marquínez Ferrándiz
298f16f954
[bandcamp] Fix variable name
2014-01-09 20:23:28 +01:00
Philipp Hagemeister
ce6b9a2dba
[youtube] Add a pseudo format for rtmp videos ( #2123 )
2014-01-09 02:38:50 +01:00
Philipp Hagemeister
c3197e3e5c
[youtube] Correct subtitle URL ( Fixes #2120 )
2014-01-09 01:36:21 +01:00
Philipp Hagemeister
3fabeaa1f4
[vimeo] Support protocol-relative URLs
2014-01-08 22:42:52 +01:00
Jaime Marquínez Ferrándiz
9d6192a5b8
[bloomberg] Fix ooyala url extraction
2014-01-08 18:18:45 +01:00
Jaime Marquínez Ferrándiz
469ec9416a
[francetv] Add extractor for Culturebox ( closes #2117 )
2014-01-08 16:16:34 +01:00
dst
5f59ee7942
[novamov] Remove superfluous tabs
2014-01-08 08:11:46 +07:00
dst
8f89e68781
[novamov] Add embedded player support
2014-01-08 08:09:13 +07:00
Philipp Hagemeister
10bff13a66
[novamov] Simplify
2014-01-08 01:18:47 +01:00
Philipp Hagemeister
166ff8a3c7
Merge remote-tracking branch 'dstftw/novamov'
2014-01-08 01:15:43 +01:00
Philipp Hagemeister
b4622a328b
Use double quotes in error message ( #2112 )
...
On Windows, double quotes are required, because single quotes get served to youtube-dl. (Yes, cmd.exe is crazy like that).
On other system, both double and single quotes are fine, unless the string contains a dollar sign (then you need single quotes).
Since virtually no URLs contain dollar signs, double quotes should do.
2014-01-08 00:05:11 +01:00
dst
cc253000e4
[novamov] Add support for novamov.com ( Fixes #2035 )
2014-01-07 22:18:10 +07:00
Philipp Hagemeister
42e4fcf23a
[generic] Fix regexes
2014-01-07 11:04:27 +01:00
Philipp Hagemeister
9c63128668
[metacritic] Use centralized sorting and unicode_literals
2014-01-07 10:27:35 +01:00
Philipp Hagemeister
9933b57430
[pornhub] Use centralized sorting
2014-01-07 10:25:34 +01:00
Philipp Hagemeister
84c92dc00f
[c56] Add suppot for multiple formats
2014-01-07 10:19:15 +01:00
Philipp Hagemeister
42154ad5bc
[archiveorg] Use centralized sorting
2014-01-07 10:16:22 +01:00
Philipp Hagemeister
3798eadccd
More unicode literals
2014-01-07 10:06:30 +01:00
Philipp Hagemeister
0eecc6a417
[vimeo] Add support for passwords for player. URLs
...
Fixes #2053
2014-01-07 09:52:00 +01:00
Philipp Hagemeister
0dc13f4c4a
Correctly set IE_NAME field
2014-01-07 09:45:58 +01:00
Philipp Hagemeister
f577e0ce15
switch more to unicode_literals
2014-01-07 09:45:40 +01:00
Philipp Hagemeister
ecfef3e5bf
+unicode_literals
2014-01-07 09:41:13 +01:00
Philipp Hagemeister
3d3538e422
[khanacademy] Add support ( Fixes #2066 )
2014-01-07 09:35:34 +01:00
Philipp Hagemeister
c93c2ab1c3
[mpora] Add support ( Fixes #2096 )
2014-01-07 08:07:46 +01:00
Philipp Hagemeister
7b09a4d847
[lynda] Fix download if subtitles were not requested
2014-01-07 07:17:49 +01:00
Philipp Hagemeister
73a25b30ea
[lynda] Remove superfluous space
2014-01-07 07:14:46 +01:00
Philipp Hagemeister
ac260dd81e
[lynda] Remove useless u""
2014-01-07 07:14:12 +01:00
Philipp Hagemeister
48a2034671
[vimeo] Fix playlist URL matching
2014-01-07 07:13:47 +01:00
Philipp Hagemeister
4f81667d76
[orf] Remove unused variable name
2014-01-07 05:51:46 +01:00
Philipp Hagemeister
79f8295303
Use original Referer URL in Brightcove requests ( Fixes #2110 )
2014-01-07 05:34:14 +01:00
Philipp Hagemeister
400e58103d
[brightcove] Use unicode_literals
2014-01-07 05:23:20 +01:00
Philipp Hagemeister
fcee8ee784
[vimeo] Use _search_regex
2014-01-07 05:19:28 +01:00
Philipp Hagemeister
9148eb002b
[vimeo] Use unicode_literals
2014-01-06 23:38:16 +01:00
Philipp Hagemeister
559e370f44
[vimeo] Proper warning when password is required ( Fixes #2053 )
...
In player. URLs, the password warning is different.
2014-01-06 23:35:27 +01:00
Philipp Hagemeister
9a6422a81e
Merge remote-tracking branch 'origin/master'
2014-01-06 17:37:20 +01:00
Philipp Hagemeister
fcea44c6d5
[vimeo] Add support for review pages
...
Since the regexp is already overboarding and review pages have a distinct URL format (with non-trivial stuff after the ID), use a dedicated IE.
Fixes #2106
2014-01-06 17:34:23 +01:00
Philipp Hagemeister
5d73273f6f
[orf] Use new extraction method ( Fixes #2057 )
2014-01-06 17:15:27 +01:00
Philipp Hagemeister
c11a0611d9
[veehd] Send requests twice ( Fixes #2102 )
2014-01-06 12:54:01 +01:00
Philipp Hagemeister
796495886e
[generic] Use unicode_literals instead of duplicating the u'
2014-01-06 01:47:52 +01:00
Philipp Hagemeister
fa27f667c8
Merge pull request #2104 from dstftw/lynda
...
[lynda] Add subtitles extraction
2014-01-05 16:44:21 -08:00
Philipp Hagemeister
fc9713a1d2
[youtube] Support jwplayer with YouTube URLs ( Closes #2075 )
2014-01-06 01:42:58 +01:00
dst
62bcfa8c57
[lynda] Add subtitles extraction
2014-01-05 23:59:33 +07:00
Philipp Hagemeister
a339e5cfb5
Remove unused imports
2014-01-05 05:48:30 +01:00
Philipp Hagemeister
f46f4a995b
[veoh] Simplify
2014-01-05 05:48:12 +01:00
Philipp Hagemeister
4ddba33f78
[veoh] Add support for mobile URLs
...
Fixes #2052
2014-01-05 05:47:50 +01:00
Philipp Hagemeister
d981cef6b9
[generic] Support gorillavid.in
...
Previously, we were a little bit over-eager and got a random swf file.
Fixes #2084 .
2014-01-05 05:34:08 +01:00
