Commit Graph

13340 Commits

Author SHA1 Message Date
kayb94 4d8c4b46d5 [heise] Add support for YouTube embeds 2017-09-17 22:46:52 +07:00
Sergey M․ 9c2a17f2ce
[popcorntv] Add extractor (closes #5914, closes #14211) 2017-09-17 22:19:57 +07:00
Yen Chi Hsuan 4ed2d7b7d1 Fix flake8 issues after #14225 2017-09-17 13:53:04 +08:00
Vijay Singh 8251af63a1 [viki] Update app data (closes #14181) 2017-09-16 22:45:23 +07:00
Windom 790d379e4d [morningstar] Relax _VALID_URL 2017-09-16 22:39:46 +07:00
Yen Chi Hsuan 3869028ffb [utils] Use bytes-like objects in dfxp2srt
This fixes handling of non-UTF8 TTML subtitles

Closes #14191
2017-09-16 12:18:38 +08:00
Yen Chi Hsuan a88d461dff Merge pull request #14225 from Tithen-Firion/openload-phantomjs-method
Openload phantomjs method
2017-09-16 02:28:28 +08:00
Sergey M․ a4245acef8
[noovo] Fix extraction (closes #14214) 2017-09-15 23:12:19 +07:00
Sergey M․ 6be44a50ed
[dailymotion:playlist] Relax _VALID_URL (closes #14219) 2017-09-15 22:25:38 +07:00
Sergey M․ b763e1d68c
[twitch] Add support for go.twitch.tv URLs (closes #14215) 2017-09-15 22:18:38 +07:00
Sergey M․ cbf85239bb
[vgtv] Relax _VALID_URL (closes #14223) 2017-09-15 22:13:30 +07:00
Sergey M․ 159d304a9f
release 2017.09.15 2017-09-15 21:48:06 +07:00
Sergey M․ c46680fb2a
[condenast] Fix extraction (closes #14196, closes #14207) 2017-09-15 02:01:17 +07:00
Philipp Hagemeister fad9fc537d [tv4] fix a test URL 2017-09-14 20:47:23 +02:00
Philipp Hagemeister 0732a90579 [orf] Add new extractor for f4m stories 2017-09-14 20:37:46 +02:00
Sergey M․ 319fc70676
[tv4] Relax _VALID_URL (closes #14206) 2017-09-14 23:50:19 +07:00
Sergey M․ e7c3e33456
[downloader/fragment] Restart inconsistent incomplete fragment downloads (#13731) 2017-09-14 23:19:53 +07:00
Yen Chi Hsuan 757984af90 Merge pull request #12909 from remitamine/raw-sub
[YoutubeDL] write raw subtitle files
2017-09-13 17:36:40 +08:00
Sergey M․ 2f483758bc
[animeondemand] Improve and modernize 2017-09-11 04:32:35 +07:00
Sergey M․ 018cc61549
[animeondemand] Bypass geo restriction 2017-09-11 04:23:42 +07:00
Sergey M․ 2709d9fa28
[animeondemand] Add support for flash videos (closes #9944) 2017-09-11 04:23:42 +07:00
Sergey M․ 7dacceae75
release 2017.09.11 2017-09-11 03:30:33 +07:00
Sergey M․ f12a6e88b2
[rutube:playlist] Fix suitable (closes #14166) 2017-09-11 03:23:00 +07:00
Sergey M․ 806498cf2f
release 2017.09.10 2017-09-10 22:16:55 +07:00
Sergey M․ bf6ec2fea9
[fox] Fix extraction (#14147) 2017-09-10 22:08:32 +07:00
Sergey M․ c3dd44e085
[rutube] Use bool_or_none 2017-09-10 19:09:27 +07:00
Sergey M․ c7e327c4d4
[utils] Introduce bool_or_none 2017-09-10 19:08:39 +07:00
Sergey M․ 48b813748d
[rutube] Rework and generalize playlist extractors (closes #13565) 2017-09-10 18:40:33 +07:00
luceatnobis debed8d759
[rutube:playlist] Add extractor (closes #13534) 2017-09-10 18:40:33 +07:00
Olivier Bilodeau 931edb2ada [radiocanada] Add fallback for title extraction 2017-09-08 21:53:24 +07:00
Sergey M․ 5113b69124
[abcnews,chilloutsoze,cracked,vice,vk] Use dedicated YouTube embeds extraction routines 2017-09-06 00:50:25 +07:00
Sergey M․ 66c9fa36c1
[youtube] Separate methods for embeds extraction 2017-09-06 00:48:37 +07:00
Sergey M․ c5c9bf0c12
[YoutubeDL] Ensure dir existence for each requested format (closes #14116) 2017-09-05 23:31:34 +07:00
Sergey M․ 880fa66f4f
[redtube] Fix formats extraction (closes #14122) 2017-09-05 22:45:49 +07:00
Sergey M․ 6348671c4a
[arte] Relax unavailability check (closes #14112) 2017-09-04 23:08:40 +07:00
Sergey M․ efc57145c1
[manyvids] Improve (closes #14059) 2017-09-03 17:32:23 +07:00
John D e9b865267a
[manyvids] Add support for preview videos (closes #14053) 2017-09-03 17:31:53 +07:00
Sergey M․ bc35f07537
[vidme:user] Make tests only matching (closes #14054) 2017-09-03 17:03:51 +07:00
theychx 0b4a8eb3ac
[vidme:user] Relax _VALID_URLs 2017-09-03 17:03:45 +07:00
Sergey M․ c1c1585b31
[bpb] Improve (closes #14086) 2017-09-03 16:43:33 +07:00
Timendum 0cbb841ba9
[bpb] Fix extraction (closes #14043) 2017-09-03 16:39:12 +07:00
Sergey M d7c7100e3d
[soundcloud] Simplify and add test (closes #14093) 2017-09-03 16:29:58 +07:00
Tatsuyuki Ishi 73602bcd0c
[soundcloud] Fix download URL with private tracks 2017-09-03 16:28:34 +07:00
Sergey M․ 23b2df82c7
[aliexpress:live] Fix issues (closes #13698, closes #13707) 2017-09-03 16:05:31 +07:00
dubber0 503115540d
[aliexpress:live] Add extractor 2017-09-03 16:05:00 +07:00
Sergey M․ 64f0e30b93
[viidea] Capture and output lecture error message (#14099) 2017-09-02 15:44:49 +07:00
Sergey M․ a3431e1224
[radiocanada] Skip unsupported platforms (closes #14100) 2017-09-02 15:33:54 +07:00
Sergey M․ a2022b0c40
release 2017.09.02 2017-09-02 01:08:32 +07:00
Sergey M․ 8d81f3e36d
[youtube] Force old layout for each webpage (closes #14083) 2017-09-02 00:58:19 +07:00
Sergey M․ 7998520933
[youtube] Fix upload date extraction (closes #14065) 2017-08-31 00:47:58 +07:00
Sergey M․ 5b4bfbfc3b
[charlierose] Add support for episodes (closes #14062) 2017-08-30 23:50:33 +07:00
Sergey M․ 53647dfd0a
[bbccouk] Add support for w-prefixed ids (closes #14056) 2017-08-30 05:27:56 +07:00
Sergey M․ 1b41da488d
[googledrive] Extend _VALID_URL (closes #9785) 2017-08-28 00:50:41 +07:00
Sergey M․ fea82c1780
[googledrive] Add support for source format (closes #14046) 2017-08-28 00:39:22 +07:00
Sergey M․ 3902cdd0e3
[pornhd] Fix extraction (closes #14005) 2017-08-27 22:37:26 +07:00
Sergey M․ 2cfa7cbdd0
release 2017.08.27.1 2017-08-27 06:09:29 +07:00
Sergey M․ 1c9c8de29e
[youtube] Fix extraction with --youtube-skip-dash-manifest enabled (closes #14037) 2017-08-27 06:06:39 +07:00
Sergey M․ f031b76065
release 2017.08.27 2017-08-27 04:28:04 +07:00
Sergey M․ ff17be3ac9
[extractor/generic] Extract from LD-JSON last of all
Previous sources may contain several formats, e.g. http://tamasha.com/v/PgGZ
2017-08-27 03:31:40 +07:00
Sergey M․ 1ed4549942
[extractor/common] Extract format id from label attribute of source tag for HTML5 videos (#14034) 2017-08-27 03:27:05 +07:00
Sergey M․ dd121cc1ca
[extractor/common] Extract height from res attribute of source tag for HTML5 videos (closes #14034) 2017-08-27 03:12:56 +07:00
Sergey M․ a3c3a1e128
[http] Rework HTTP downloader
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506, closes #809, closes #2849, closes #4240, closes #6023, closes #8625, closes #9483
2017-08-27 02:22:30 +07:00
Sergey M․ 085d9dd9be
[rai] Fix audio formats extraction (closes #14024) 2017-08-26 22:02:49 +07:00
Vijay Singh 151978f38a [mixcloud] Fix extraction (closes #14020) 2017-08-26 19:32:57 +07:00
Sergey M․ c7121fa7b8
[youtube] Fix controversy videos extraction (closes #14027, closes #14029) 2017-08-26 15:38:38 +07:00
Vijay Singh 745968bc72 [mixcloud] Fix extraction (closes #14015) 2017-08-24 22:28:44 +07:00
Sergey M․ df235dbba8
release 2017.08.23 2017-08-23 23:23:13 +07:00
Sergey M․ 5bae33485c
[toutv] PEP 8 2017-08-23 22:50:00 +07:00
Sergey M․ 0830f3e048
[cbc:watch] Bypass geo-restriction (closes #13993) 2017-08-23 22:45:45 +07:00
Sergey M․ 8d7a24aff6
[toutv] Relax DRM check (closes #13994) 2017-08-23 22:28:09 +07:00
Sergey M․ 37d9af306a
[googledrive] Simplify and carry long lines (#13638) 2017-08-23 00:33:53 +07:00
Sergey M․ e01c3d2ef7
[extractor/common] Introduce _parse_xml 2017-08-23 00:32:41 +07:00
Parmjit Virk 05915e379a [googledrive] Add support for subtitles (fixes #13619) 2017-08-22 23:48:59 +07:00
Sergey M․ 8d9c2a681a
[pornhub] Relax uploader regex (closes #13906, closes #13975) 2017-08-21 23:06:27 +07:00
Luca Steeb 8239c6791a [bandcamp:album] Extract track titles 2017-08-20 23:32:33 +07:00
Sergey M․ b359e977b9
[extractor/common] Make HLS and DASH extraction non fatal in _parse_html5_media_entries (closes #13970) 2017-08-20 14:16:58 +07:00
Sergey M․ d3d45e0a45
[bbccouk] Add support for events URLs (closes #13893) 2017-08-19 23:54:15 +07:00
Yen Chi Hsuan 381ad4f309
[liveleak] Support multi-video pages (closes #6542) 2017-08-19 22:48:00 +08:00
Yen Chi Hsuan 09747ba766
[liveleak] Support another liveleak embedding pattern (closes #13336) 2017-08-19 22:28:13 +08:00
Yen Chi Hsuan f8f18f332f
[cda] Fix extraction (closes #13935) 2017-08-19 21:44:47 +08:00
Yen Chi Hsuan 95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a"" (#13935) 2017-08-19 21:40:53 +08:00
Sergey M․ f5469da9e6
[laola1tv] Add support for tv.ittf.com (closes #13965) 2017-08-19 19:48:20 +07:00
Sergey M․ d14d9d8903
[mixcloud] Fix extraction (closes #13958) 2017-08-18 23:31:42 +07:00
Sergey M․ ea004d34f8
release 2017.08.18 2017-08-18 01:05:27 +07:00
Sergey M․ 4a91910365
[qqmusic:toplist] PEP 8 2017-08-18 01:00:07 +07:00
Sergey M․ c0892b2b46
[arte] Detect unavailable videos (closes #13945) 2017-08-18 00:58:23 +07:00
Sergey M․ a5ac0c4755
[YoutubeDL] Sanitize byte string format URLs (#13951) 2017-08-17 23:59:12 +07:00
Sergey M․ 5551d7714d
[generic] Convert redirect URLs to unicode strings (closes #13951) 2017-08-17 23:58:01 +07:00
Sergey M․ 5f5c7b92dd
[udemy] Fix paid course detection (#13943) 2017-08-17 23:14:46 +07:00
Sergey M․ 93d0583e34
[pluralsight] Use RPC API for course extraction (closes #13937) 2017-08-17 22:45:40 +07:00
Genki Sky bfabd17b33 Add new extractor 2017-08-17 16:56:06 +08:00
Yen Chi Hsuan 25a6e769a1 [qqmusic] Fix tests and cleanup 2017-08-17 16:39:57 +08:00
Yen Chi Hsuan d22b67f356 Merge pull request #13805 from gam2046/master
Fix QQ Music url changed
2017-08-17 16:11:35 +08:00
Sergey M․ a1aa659662
[periscope] Renew HLS extraction (closes #13917) 2017-08-16 23:03:42 +07:00
Sergey M․ 4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats (closes #13919) 2017-08-15 23:58:00 +07:00
forDream 134d85a7bd [qqmusic] review 2017-08-15 13:14:35 +08:00
forDream 5c037c0d1f [qqmusic]support QQMusicSingerIE 2017-08-15 13:14:35 +08:00
forDream 5d1bd3b907 [qqmusic]update valid url 2017-08-15 13:14:34 +08:00
forDream 19ada898dc fix QQ Music Url changed 2017-08-15 13:14:34 +08:00
Sergey M․ da20951a57
[mixcloud] Extract decrypt key 2017-08-14 22:39:05 +07:00
Sergey M․ 16393d6535
release 2017.08.13 2017-08-13 08:58:30 +07:00
Sergey M․ 475bcb225f
[pornhub:playlistbase] Skip videos from drop-down menu for all playlists (closes #12819, closes #13902) 2017-08-13 07:53:02 +07:00
Sergey M․ b3c6515365
[fourtube] Add support for other sites (closes #6022, closes #7859, closes #13901) 2017-08-13 07:23:29 +07:00
Sergey M․ eb02940cc7
[generic] Add test for #13895 2017-08-13 01:11:27 +07:00
Sergey M․ 4ef9152428
[limelight] Improve embeds detection (closes #13895) 2017-08-13 00:58:39 +07:00
Sergey M․ 0c43a481b9
[reddit] Add extractors (closes #13847) 2017-08-12 23:43:51 +07:00
Sergey M․ 868f79db41
[extractor/common] Fix _media_formats 2017-08-12 19:24:26 +07:00
Sergey M․ 70851a95c3
[aparat] Extract all formats (closes #13887) 2017-08-12 17:18:23 +07:00
Sergey M․ e74e3b63e3
[YoutubeDL] Make sure format id is not empty 2017-08-12 17:14:11 +07:00
Sergey M․ ac8491fcca
[extractor/common] Make _family_friendly_search optional 2017-08-12 17:11:35 +07:00
Sergey M․ 82889d4ae5
[extractor/common] Respect source's type attribute for HTML5 media (closes #13892) 2017-08-12 16:48:11 +07:00
Sergey M․ 92a5c41532
[mixcloud] Fix play info decryption (closes #13885) 2017-08-12 16:30:50 +07:00
Sergey M․ 1663bd6e1c
[generic] Replace vzaar embed test 2017-08-11 22:02:00 +07:00
tetra-eder 41918eaa5c [generic] Add support for vzaar embeds 2017-08-11 22:00:39 +07:00
Sergey M․ 6ed99754bb
release 2017.08.09 2017-08-09 23:52:22 +07:00
Sergey M․ baba5f4d1d
[xxxymovies] Fix title extraction (closes #13868) 2017-08-09 23:46:49 +07:00
Sergey M․ dee04d24a4
[nick] Add support for nick.com.pl (closes #13860) 2017-08-09 23:12:02 +07:00
Sergey M․ 5b3ddadcc3
[mixcloud] Fix play info decryption (closes #13867) 2017-08-09 22:55:13 +07:00
Sergey M․ 5b232f46dc
[utils] Skip missing params in cli_bool_option (closes #13865) 2017-08-09 22:28:19 +07:00
Alex Seiler 4bf22f7a10 [20min] Fix embeds extraction 2017-08-08 05:41:38 +07:00
Sergey M․ 15d1e8a23d
[dplayit] Fix extraction (closes #13851) 2017-08-07 22:43:42 +07:00
Yen Chi Hsuan ee6a611665
[niconico] Support videos with multiple formats (closes #13522) 2017-08-07 00:19:46 +08:00
Yen Chi Hsuan 463e7216c8
[niconico] Support HTML5-only videos (closes #13806) 2017-08-06 23:07:28 +08:00
Sergey M․ 903a183b6a
release 2017.08.06 2017-08-06 09:05:36 +07:00
Sergey M․ fac188c695
[pluralsight] Fix format selection 2017-08-06 08:44:28 +07:00
Sergey M․ 16afce174e
[mpora] Remove extractor (closes #13826) 2017-08-06 08:18:16 +07:00
Sergey M․ e2b4808fd8
[voot] Improve extraction (#10255, closes #11814) 2017-08-06 08:05:29 +07:00
Ashutosh Chaudhary daaaf5f594
[voot] Add extractor 2017-08-06 08:05:24 +07:00
Sergey M․ f172c86dcd
[vlive:channel] Limit number of videos per page to 100 (closes #13830) 2017-08-05 21:17:55 +07:00
Sergey M․ 1d5472290f
[podomatic] Extend _VALID_URL (closes #13827) 2017-08-05 08:28:12 +07:00
Sergey M․ c983cc3b71
[cinchcast] Extend _VALID_URL 2017-08-05 08:17:01 +07:00
Sergey M․ 1141e9104b
Use relative paths for DASH fragments (closes #12990)
10x reduced JSON size
refs #13810
2017-08-05 07:40:29 +07:00
Sergey M․ 8519b88f67
[yandexdisk] Relax _VALID_URL (closes #13824) 2017-08-05 00:59:07 +07:00
Sergey M․ bbbe1cebfc
[mlb] Update test (closes #13777) 2017-08-05 00:09:36 +07:00
Sergey M․ f31fd0693b
[vidme] Extract DASH and HLS formats 2017-08-05 00:00:21 +07:00
Sergey M․ 799802f368
[teamfour] Remove extractor (closes #13782)
Now covered with generic extractor
2017-08-04 23:54:28 +07:00
Sergey M․ b3b5870cba
[pornhd] Fix extraction (closes #13783) 2017-08-04 23:51:03 +07:00
Sergey M․ 57a38a38c3
[udemy] Fix subtitles extraction (closes #13812) 2017-08-04 23:45:13 +07:00
Matt Crupi 11a6793f80 [mlb] Extend _VALID_URL (closes #13740) 2017-08-04 22:46:54 +07:00
Sergey M․ 183062a4ab
[pbs] Add support for new URL schema (closes #13801) 2017-08-03 23:19:59 +07:00
Tithen-Firion feee8d32e4 [phantomjs] add exe version to debug info 2017-08-03 14:17:25 +02:00
Sergey M․ 9118c9f18a
[nrktv] Update API host (closes #13796) 2017-08-01 05:21:00 +07:00
Sergey M․ 5c9ea67bc0
release 2017.07.30.1 2017-07-30 20:47:31 +07:00
Sergey M․ 8b9f50d7cb
[watchbox] Add extractor (#13739) 2017-07-30 19:09:44 +07:00
Sergey M․ 0ed4758023
[clipfish] Remove extractor 2017-07-30 19:08:44 +07:00
Sergey M․ a0a477b885
[youjizz] Fix extraction (closes #13744) 2017-07-30 15:48:22 +07:00
Grzegorz Ruciński 198d4cb40c [generic] Add support for another ooyala embed pattern (closes #13727) 2017-07-30 01:30:04 +07:00
Sergey M․ ca127ab2c1
[ard] Add support for lives (closes #13771) 2017-07-29 23:07:28 +07:00
Sergey M․ e445850e69
[soundcloud] Update client id 2017-07-29 18:45:57 +07:00
Sergey M․ 836ef26486
[soundcloud:trackstation] Add extractor (closes #13733) 2017-07-29 18:41:42 +07:00