ANNOUNCE: YouTube Plugin (API v3)

[hubertbanas]

It don’t think there is a clear option but you can erase the files in /var/lib/squeezeboxserver/cache (not the subdirectories!). It’s not an ‘elegant’ advice but I don’t think it will screw up your LMS :-)

Deleting the files located in '/var/lib/squeezeboxserver/cache/' did not fix the issues in itself. Here is what fixed it for me (I'm writing it as mini tutorial to hopefully help others as well)

using LMS Web UI cleanup YouTube plugin information (this is found under 'Server settings > Plugins > YouTube' when using 'Material Skin')

• delete YouTube API access key
• delete Client ID and Client Secret (if previously configured)

using LMS Web UI remove (un-check) 'YouTube plugin' (this is found under 'Server settings > Plugins > Plugins' when using 'Material Skin')

stop running LMS

$ sudo systemctl stop logitechmediaserver.service

delete files located in /var/lib/squeezeboxserver/cache/

$ sudo rm -rf /var/lib/squeezeboxserver/cache/*.*

reboot the server

$ sudo shutdown -r now

LMS will start 'Music Collection Re-scan' after the reboot. Let it finish.

Install and configure 'YouTube plugin' from scratch (I didn't have to generate new 'YouTube API access key' since the one I previously generated worked for me)

Unfortunately I come to no conclusion regarding the real cause or trigger. Could stepping up from LMS 7.9.3 to 7.9.4 nightly be the reason? I'm not sure. I would appreciate if any of you share your thoughts and theories. I hope the above information will help 'morph84' and possibly others as well.

Thank you all for sticking around and helping out with this issue. Thanks to 'slartibartfast', 'Man in a van', and 'scala' for sharing ideas and suggestions. Special thanks to 'philippe_44' for improving and maintaining the plugin as well as helping debugging it here with me.

[gitasse]

Hello,

Hope this is the good place to post my questions and obviously my problem. And please accept my apologizes for my 'bad' English which I use here.

I encoutered a problem with the YouTube plugin these last days. In fact some songs are played well and others not... and I don't find the problem myself, even if I read a lot of threads of discussions about LMS and this plugin.

I use LMS server v.7.9.2 on a Synology Drive DS218j.
The Youtube Plugin version is v0.123.0

And below, you have the last lines of the log file I get after pushing "read" button of a Video that not plays at all:

-10-23 21:37:25.8326] Plugins::YouTube::ProtocolHandler::getNextTrack (353) next track id: xNhn1KOqq8g url: http://www.youtube.com/watch?v=xNhn1KOqq8g master: youtube://www.youtube.com/v/xNhn1KOqq8g
[20-10-23 21:37:27.1528] Plugins::YouTube::ProtocolHandler::__ANON__ (379) trying regular streams
[20-10-23 21:37:27.1534] Plugins::YouTube::ProtocolHandler::__ANON__ (384) no stream found, trying MPD/DASH
[20-10-23 21:37:27.1556] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 137
[20-10-23 21:37:27.1561] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 248
[20-10-23 21:37:27.1565] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 399
[20-10-23 21:37:27.1570] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 136
[20-10-23 21:37:27.1574] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 247
[20-10-23 21:37:27.1578] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 398
[20-10-23 21:37:27.1583] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 135
[20-10-23 21:37:27.1587] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 244
[20-10-23 21:37:27.1591] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 397
[20-10-23 21:37:27.1596] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 134
[20-10-23 21:37:27.1600] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 243
[20-10-23 21:37:27.1604] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 396
[20-10-23 21:37:27.1608] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 133
[20-10-23 21:37:27.1613] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 242
[20-10-23 21:37:27.1617] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 395
[20-10-23 21:37:27.1621] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 160
[20-10-23 21:37:27.1626] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 278
[20-10-23 21:37:27.1630] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 394
[20-10-23 21:37:27.1635] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 140
[20-10-23 21:37:27.1639] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 249
[20-10-23 21:37:27.1643] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 250
[20-10-23 21:37:27.1647] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 251
[20-10-23 21:37:27.1654] Plugins::YouTube::ProtocolHandler::__ANON__ (422) no stream/DASH found

Thanks for your help,

Guillaume

[dawansv]

** UPDATE: Ignore this post and go directly to the one below **

Unfortunately I come to no conclusion regarding the real cause or trigger. Could stepping up from LMS 7.9.3 to 7.9.4 nightly be the reason? I'm not sure. I would appreciate if any of you share your thoughts and theories. I hope the above information will help 'morph84' and possibly others as well.

Suddenly (as in within the last 10 days) a lot of my youtube links are not working either and I am getting the same message in the log. I have already tried resetting everything using hubertanas' advice.

[20-10-23 15:21:02.8369] Plugins::YouTube::ProtocolHandler::getStreamJSON (523) candidate ops sig D=D=Q7Kt1_v7hVFmHGiY_ZjjLvuv0KfZ=RU1YpQBIk8LrTwAiATGeiVXu7MBABqFFKm6lS-tM7WzbABC_f-8Ib92sksyPAhIQRw8JQ0qOA encrypted 1
[20-10-23 15:21:02.8375] Plugins::YouTube::ProtocolHandler::getSignature (731) no player url to unobfuscate signature

I am running on Ubuntu server 20.04 with all updates. I have already upgraded to 7.9.4 and version 0.123.0 of plugin, and tried cleary cache, recreating keys, making sure SSL libraries are installed, etc. Tried different players as well.

Example of items that don't work (and some that do) from this official playlist from a concert by Vladimir Cosma
https://www.youtube.com/playlist?lis...jV95DkLK1WT1An

Most items will not play except for #15 (Cantale) and #18 (salut l'artiste) that will play fine; for instance:
Cantale (plays fine): https://www.youtube.com/watch?v=F2i0MCRD_xI
As des As (doesn't): https://www.youtube.com/watch?v=WtRRo4wIcU0

Edit: I am on the US west coast.

Log when running item 1 WtRRo4wIcU0 that doesn't work

[20-10-23 15:21:01.9698] Plugins::YouTube::ProtocolHandler::getNextTrack (353) next track id: WtRRo4wIcU0 url: http://www.youtube.com/watch?v=WtRRo4wIcU0 master: youtube://www.youtube.com/v/WtRRo4wIcU0
[20-10-23 15:21:02.8334] Plugins::YouTube::ProtocolHandler::__ANON__ (379) trying regular streams
[20-10-23 15:21:02.8336] Plugins::YouTube::ProtocolHandler::__ANON__ (384) no stream found, trying MPD/DASH
[20-10-23 15:21:02.8341] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 136
[20-10-23 15:21:02.8342] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 247
[20-10-23 15:21:02.8344] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 135
[20-10-23 15:21:02.8345] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 244
[20-10-23 15:21:02.8346] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 134
[20-10-23 15:21:02.8347] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 243
[20-10-23 15:21:02.8348] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 133
[20-10-23 15:21:02.8350] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 242
[20-10-23 15:21:02.8351] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 160
[20-10-23 15:21:02.8352] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 278
[20-10-23 15:21:02.8353] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 140
[20-10-23 15:21:02.8354] Plugins::YouTube::ProtocolHandler::getStreamJSON (494) matching format 140
[20-10-23 15:21:02.8357] Plugins::YouTube::ProtocolHandler::getStreamJSON (522) candidate itag: 140, url/cipher: s=C%3DC%3DwYFrvw5x1blFU6_uEQyKxnijHXgq%3DKCBVhnmyTuMir0CQICwJmXd307eSxdrSZZU_DORyepbvBOM3IOb1e71ZM4sEWgIQRw8JQ0qOA&sp=sig&url=https://r5---sn-nx5s7n7s.googlevideo.com/videoplayback%3Fexpire%3D1603513262%26ei%3DTleTX6qJCoPMkgaI2LmwBg%26ip%3D24.21.229.119%26id%3Do-ANmwQ39cX4dQgqnVUsx0SqY86KzwyuAh-QTvJwA8oj8x%26itag%3D140%26source%3Dyoutube%26requiressl%3Dyes%26mh%3DOS%26mm%3D31%252C26%26mn%3Dsn-nx5s7n7s%252Csn-a5meknzl%26ms%3Dau%252Conr%26mv%3Dm%26mvi%3D5%26pl%3D15%26initcwndbps%3D2153750%26vprv%3D1%26mime%3Daudio%252Fmp4%26gir%3Dyes%26clen%3D6408033%26dur%3D403.423%26lmt%3D1514560906781914%26mt%3D1603491512%26fvip%3D5%26keepalive%3Dyes%26c%3DWEB%26sparams%3Dexpire%252Cei%252Cip%252Cid%252Citag%252Csource%252Crequiressl%252Cvprv%252Cmime%252Cgir%252Cclen%252Cdur%252Clmt%26lsparams%3Dmh%252Cmm%252Cmn%252Cms%252Cmv%252Cmvi%252Cpl%252Cinitcwndbps%26lsig%3DAG3C_xAwRQIgWYvOfI0EKx5ZVhjTI99lfr8uB1jRzZ6cPxgxk_pqbQgCIQC5xh43paHnj8FPZitf3ivnJh9qGg9vWEG59wQI9fuyLw%253D%253D
[20-10-23 15:21:02.8358] Plugins::YouTube::ProtocolHandler::getStreamJSON (523) candidate aac sig C=C=wYFrvw5x1blFU6_uEQyKxnijHXgq=KCBVhnmyTuMir0CQICwJmXd307eSxdrSZZU_DORyepbvBOM3IOb1e71ZM4sEWgIQRw8JQ0qOA encrypted 1
[20-10-23 15:21:02.8359] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 249
[20-10-23 15:21:02.8360] Plugins::YouTube::ProtocolHandler::getStreamJSON (494) matching format 249
[20-10-23 15:21:02.8362] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 250
[20-10-23 15:21:02.8363] Plugins::YouTube::ProtocolHandler::getStreamJSON (494) matching format 250
[20-10-23 15:21:02.8364] Plugins::YouTube::ProtocolHandler::getStreamJSON (489) found itag: 251
[20-10-23 15:21:02.8365] Plugins::YouTube::ProtocolHandler::getStreamJSON (494) matching format 251
[20-10-23 15:21:02.8367] Plugins::YouTube::ProtocolHandler::getStreamJSON (522) candidate itag: 251, url/cipher: s=D%3DD%3DQ7Kt1_v7hVFmHGiY_ZjjLvuv0KfZ%3DRU1YpQBIk8LrTwAiATGeiVXu7MBABqFFKm6lS-tM7WzbABC_f-8Ib92sksyPAhIQRw8JQ0qOA&sp=sig&url=https://r5---sn-nx5s7n7s.googlevideo.com/videoplayback%3Fexpire%3D1603513262%26ei%3DTleTX6qJCoPMkgaI2LmwBg%26ip%3D24.21.229.119%26id%3Do-ANmwQ39cX4dQgqnVUsx0SqY86KzwyuAh-QTvJwA8oj8x%26itag%3D251%26source%3Dyoutube%26requiressl%3Dyes%26mh%3DOS%26mm%3D31%252C26%26mn%3Dsn-nx5s7n7s%252Csn-a5meknzl%26ms%3Dau%252Conr%26mv%3Dm%26mvi%3D5%26pl%3D15%26initcwndbps%3D2153750%26vprv%3D1%26mime%3Daudio%252Fwebm%26gir%3Dyes%26clen%3D6683596%26dur%3D403.381%26lmt%3D1514562109446091%26mt%3D1603491512%26fvip%3D5%26keepalive%3Dyes%26c%3DWEB%26sparams%3Dexpire%252Cei%252Cip%252Cid%252Citag%252Csource%252Crequiressl%252Cvprv%252Cmime%252Cgir%252Cclen%252Cdur%252Clmt%26lsparams%3Dmh%252Cmm%252Cmn%252Cms%252Cmv%252Cmvi%252Cpl%252Cinitcwndbps%26lsig%3DAG3C_xAwRgIhAJ1IuiDowpYnUUaMcIQoiYIiTRQdtpLzcrArezs60N5AAiEA7xCw8z7x1sHMM-ChC-R_UwJLbRuE_KbY-CS8cg84-As%253D
[20-10-23 15:21:02.8369] Plugins::YouTube::ProtocolHandler::getStreamJSON (523) candidate ops sig D=D=Q7Kt1_v7hVFmHGiY_ZjjLvuv0KfZ=RU1YpQBIk8LrTwAiATGeiVXu7MBABqFFKm6lS-tM7WzbABC_f-8Ib92sksyPAhIQRw8JQ0qOA encrypted 1
[20-10-23 15:21:02.8375] Plugins::YouTube::ProtocolHandler::getSignature (731) no player url to unobfuscate signature

Log running item 15 F2i0MCRD_xI that does work

[20-10-23 15:21:42.6260] Plugins::YouTube::ProtocolHandler::getNextTrack (353) next track id: F2i0MCRD_xI url: http://www.youtube.com/watch?v=F2i0MCRD_xI master: youtube://www.youtube.com/v/F2i0MCRD_xI
[20-10-23 15:21:43.4974] Plugins::YouTube::ProtocolHandler::__ANON__ (379) trying regular streams
[20-10-23 15:21:43.4976] Plugins::YouTube::ProtocolHandler::__ANON__ (384) no stream found, trying MPD/DASH
[20-10-23 15:21:43.9259] Plugins::YouTube::ProtocolHandler::__ANON__ (555) found matching format 139
[20-10-23 15:21:43.9261] Plugins::YouTube::ProtocolHandler::__ANON__ (555) found matching format 140
[20-10-23 15:21:43.9263] Plugins::YouTube::ProtocolHandler::__ANON__ (567) selected 140
[20-10-23 15:21:43.9264] Plugins::YouTube::ProtocolHandler::__ANON__ (593) MPD update period 0, timeshift 0, duration 275.156
[20-10-23 15:21:43.9266] Plugins::YouTube::M4a::setProperties (106) using initialize url range/0-591
[20-10-23 15:21:44.0737] Plugins::YouTube::M4a::__ANON__ (131) found moov (in 592 bytes) and set properties abr: 128065 sr:44100 ch:2
[20-10-23 15:21:44.0749] Plugins::YouTube::ProtocolHandler::new (126) url: https://r3---sn-nx5s7n7d.googlevideo.com/videoplayback/expire/1603513302/ei/dleTX8WkLsuSkga-6oOYBg/ip/24.21.229.119/id/1768b4302443ff12/itag/140/source/youtube/requiressl/yes/mh/GW/mm/31,26/mn/sn-nx5s7n7d,sn-a5mekney/ms/au,onr/mv/m/mvi/3/pl/15/initcwndbps/2257500/vprv/1/ratebypass/yes/mime/audio%2Fmp4/otfp/1/gir/yes/clen/4369719/lmt/1514568846426962/dur/275.086/mt/1603491512/fvip/3/keepalive/yes/sparams/expire,ei,ip,id,itag,source,requiressl,vprv,ratebypass,mime,otfp,gir,clen,lmt,dur/sig/AOq0QJ8wRAIgHwqZAN_u5Vjvbo3U5pLMFPsaWaf5W30io0FzQ_sVL0MCIAqjtgV4HHR8jqUhtD16xjWgaoQyc3kPDdofzUiTiGan/lsparams/mh,mm,mn,ms,mv,mvi,pl,initcwndbps/lsig/AG3C_xAwRQIhAOD4EttLF7PETfe0Sj3QHcmQkyfHSo1yXpyZo_-G1V0oAiB9AlWuCg4YS5Tp7C6cdUneB7JBq080KTA3d7dsDfKNdg%3D%3D/ offset: 0
[20-10-23 15:21:44.0753] Plugins::YouTube::ProtocolHandler::__ANON__ (147) starting from offset 0
[20-10-23 15:25:39.4217] Plugins::YouTube::ProtocolHandler::sysread (316) end streaming

Edit 2: I remembered I have the song long enabled. So I know that it worked last on 10/13, then failed next time I used it (same songs) on 10/22. So something happenned between these 2 dates I suppose. I looked at my dpgk.log to see if anything with ssl in it had been updated since but no. But I do have a lot of updates in there since security updates install automatically. But I see mostly kernell stuff along with php, mysql, apache, etc. See my edit 3 below...

Edit 3: I tried on another ubuntu 20.04 install that was last updated 10/8 and it doesn't work there either. So that seems to put aside the theory of a recent update in Ubuntu 20.04.

[dawansv]

It's bizarre, there is a whole set of information missing in the webpage content that is being returned: "assets": (with " and : included). I ave no idea why, but this is where the url to get the js code for signature decoding is found. When I use the same track Id, I have this "assets": piece of information. So IDK if this is due to your localization, something with your project ID where you have not set the key/project type. I recommend deleting the whole project on the console and restarting from absolute scratch.

I missed this comment originally but that's the clue we needed! For one thing, it proves it has nothing to do with API key or Linux installation. A simple WGET on the video url show indeed that this "assets": section is not there in the files that fails. If from another location you get the asset tag with a simple WGET then it must mean YouTube is pushing some new stuff that is location aware (probably based on server with hit or something like that). So for instance for me here on the US West Coast this simple WGET "http://www.youtube.com/watch?v=WtRRo4wIcU0" doesn't return the assets: section.

The missing assets info makes it indeed clear why it fails when you look inside ProtocoleHandler.pm that relies on it to get the player url.

        # get the player's url
        my ($player_url) = ($content =~ /"assets":.+?"js":\s*("[^"]+")/);

        if ( !$player_url ) {
                $log->error("no player url to unobfuscate signature");
                $cb->();
                return;

It's extacting that js string that follows the assets section, and fails in that case. But then by comparing both files (one that works and has the assets tag and one that hasn't), I also noticed that both files have a jsUrl: (in fact several) that seem to return the exact same thing. So I just replaced your code above with the following (I had to refresh my regex knowledge a bit to be honnest):

        # get the player's url
        my ($player_url) = ($content =~ /"jsUrl":\s*("[^"]+")/);

And now it works, seemingly on both "old" and "new" versions. So maybe some gradual changes that are hitting some files but not others?

Of course, I am really not familiar with youtube format, so whether we should replace it in all case, I do not know. Alternatively you could keep the first version and if it fails try the second?

[dad33]

I use the newest Youtube app plugin, but since Tuesday 90% of my tracks didn't work anymore.
Living in germany.
What a bug is this now?
I have nothing changed. I have two raspberry pi with the newest LMS with picoreplayer, same bug on both Player!!

Gesendet von meinem LM-G810 mit Tapatalk

[philippe_44]

I will work on that but it’s more complicated than it seems

[hubertbanas]

... I also noticed that both files have a jsUrl: (in fact several) that seem to return the exact same thing ...

Nice find! Let's hope philippe_44 will work this out.

[dad33]

I will work on that but it’s more complicated than it seems

Thank you philippe!

Gesendet von meinem LM-G810 mit Tapatalk

[gitasse]

I will work on that but it’s more complicated than it seems

Thanks Philippe, I think I got the same issue(s) like others users. Don't hesitate to reply me if you need help or information.
Guillaume

[dawansv]

I will work on that but it’s more complicated than it seems

Thank you Philippe. I am unclear whether you actually experience the missing assets information from your location (or just saw it in the debug info from hubertbanas), so if that helps here are 2 html content files from 2 youtube videos downloaded from my US West Coast location, one with the assets and one without (stated in file names within the zip): https://drive.google.com/file/d/1SCu...Oi2C1gPxU/view

If others want to test whether replacing the reference to "assets... js" with "jsUrl" works for them, the file to edit is ProtocolHandler.pm. On Debian/Ubuntu it is located here:

/var/lib/squeezeboxserver/cache/InstalledPlugins/Plugins/YouTube/ProtocolHandler.pm

You need to update line 72 from

my ($player_url) = ($content =~ /"assets":.+?"js":\s*("[^"]+")/);

to

my ($player_url) = ($content =~ /"jsUrl":\s*("[^"]+")/);

You need to restart LMS after the update for the cache to be reloaded and the change to take effect.

Please only do this if you are somewhat familiar with updating text files with admin right and know how to revert your changes. This is not a fully tested fix and it might create other problems with some videos.