Home of the Squeezebox™ & Transporter® network music players.
Page 11 of 13 FirstFirst ... 910111213 LastLast
Results 101 to 110 of 125
  1. #101
    Senior Member
    Join Date
    Jan 2010
    Posts
    144
    What happened to this plugin? It's now commented out in the test.xml file. Does it no longer work with 7.9?

  2. #102
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,526

    Plugin to test database tweaks

    > What happened to this plugin? It's now commented out in the test.xml
    > file. Does it no longer work with 7.9?


    The insights we gathered using it are now built in to 7.9. What exactly
    are you looking for?

    --

    Michael

  3. #103
    Quote Originally Posted by mherger View Post
    > What happened to this plugin? It's now commented out in the test.xml
    > file. Does it no longer work with 7.9?


    The insights we gathered using it are now built in to 7.9. What exactly
    are you looking for?

    --

    Michael
    sorry, for digging out this old thred, but i have extreme problems with sql queries from custom browse menues. I have 80.000 tracks and some menues are stuck for 5 (!) minutes and the music stops.

    As i have enough power (4 core, 2.1 Ghz, 32 GB RAM) i would ask for tweaks to speed up the sql queries.

  4. #104
    Senior Member erland's Avatar
    Join Date
    Dec 2005
    Location
    Sweden
    Posts
    11,260
    Quote Originally Posted by mamema View Post
    sorry, for digging out this old thred, but i have extreme problems with sql queries from custom browse menues. I have 80.000 tracks and some menues are stuck for 5 (!) minutes and the music stops.

    As i have enough power (4 core, 2.1 Ghz, 32 GB RAM) i would ask for tweaks to speed up the sql queries.
    Would you be willing to install Database Query plugin and run the ďCustom Scan StatisticsĒ query to give us a better understanding of your Custom Scan data.
    It would also help to get more information about which SQL statements or Custom Browse menu levels that are extremely slow.

    I suspect the issue is that Custom Scan/Browse isnít optimized for really large libraries but itís hard to say for sure without more information regarding your setup.
    Erland Isaksson (My homepage)
    Developer of many plugins/applets
    Starting with LMS 8.0 I no longer support my plugins/applets (see here for more information )

  5. #105
    Quote Originally Posted by erland View Post
    Would you be willing to install Database Query plugin and run the ďCustom Scan StatisticsĒ query to give us a better understanding of your Custom Scan data.
    It would also help to get more information about which SQL statements or Custom Browse menu levels that are extremely slow.

    I suspect the issue is that Custom Scan/Browse isnít optimized for really large libraries but itís hard to say for sure without more information regarding your setup.
    it's already installed. Where are the statistics to find?

  6. #106
    Senior Member erland's Avatar
    Join Date
    Dec 2005
    Location
    Sweden
    Posts
    11,260
    Quote Originally Posted by mamema View Post
    it's already installed. Where are the statistics to find?
    You should find a "Custom Scan Statistics" query under Extras/Database Query in LMS web interface, click on the CSV link on the "Custom Scan Statistics" row and post the result.
    Erland Isaksson (My homepage)
    Developer of many plugins/applets
    Starting with LMS 8.0 I no longer support my plugins/applets (see here for more information )

  7. #107
    Quote Originally Posted by erland View Post
    You should find a "Custom Scan Statistics" query under Extras/Database Query in LMS web interface, click on the CSV link on the "Custom Scan Statistics" row and post the result.
    parameter;value
    Number of song attributes;1095931
    Number of artist attributes;6821
    Number of album attributes;0
    Number of songs with attributes;69464
    Number of songs without attributes;0
    Number of artists with attributes;4934
    Number of artists without attributes;7755
    Number of albums with attributes;0
    Number of albums without attributes;5683
    Number of songs with attributes from customtag;69443
    Number of songs with attributes from mixedtag;69464
    Number of songs with attributes from ratingtag;7567
    Number of song attributes from customtag;293655
    Number of song attributes from mixedtag;794370
    Number of song attributes from ratingtag;7906
    Number of songs without attributes from customtag;4909
    Number of songs without attributes from mixedtag;4888
    Number of albums without attributes from csamazon;5683
    Number of artists without attributes from cslastfm;7755
    Number of artists with attributes from cslastfm;4934
    Number of artist attributes from cslastfm;6821
    Number of artists without attributes from cslastfm;8
    Number of artists with cslastfm attributes of type retrieved;4942
    Number of songs with customtag attributes of type BPM;69403
    Number of songs with customtag attributes of type COMMENT;19253
    Number of songs with customtag attributes of type LYRICS;41393
    Number of songs with customtag attributes of type MOOD;50172
    Number of songs with customtag attributes of type RATING;7624
    Number of songs with customtag attributes of type STYLE;7509
    Number of songs with mixedtag attributes of type ALBUM;69464
    Number of songs with mixedtag attributes of type ALBUMARTIST;69464
    Number of songs with mixedtag attributes of type ARTIST;69464
    Number of songs with mixedtag attributes of type BAND;361
    Number of songs with mixedtag attributes of type BPM;69403
    Number of songs with mixedtag attributes of type COMMENT;19253
    Number of songs with mixedtag attributes of type COMPOSER;37270
    Number of songs with mixedtag attributes of type CONDUCTOR;1552
    Number of songs with mixedtag attributes of type GENRE;69464
    Number of songs with mixedtag attributes of type LYRICS;41393
    Number of songs with mixedtag attributes of type MOOD;50172
    Number of songs with mixedtag attributes of type RATING;7624
    Number of songs with mixedtag attributes of type STYLE;7509
    Number of songs with mixedtag attributes of type TRACKARTIST;63758
    Number of songs with mixedtag attributes of type YEAR;69464
    Number of songs with ratingtag attributes of type RATING;7567

  8. #108
    Senior Member erland's Avatar
    Join Date
    Dec 2005
    Location
    Sweden
    Posts
    11,260
    Quote Originally Posted by mamema View Post
    Number of song attributes;1095931
    Ok as I suspected you have an extremely large LMS database. In particular these numbers means that one of the Custom Scan tables have 1 095 931 rows and queries uses this table extensively in Custom Scan based menus.

    I suspect the issue is that Custom Scan data structures simply isnít designed for this amount of data. Iím guessing pretty much all menus that uses Custom Tag or Mixed Tag scanning modules are slow ? Or does some menus actually work fast and you are only seeing the issues in some menus ? In that case which ones ?

    Not sure if COMMENT and LYRICS can be long texts in your setup ? Do you use these when browsing ?

    Maybe someone reading this has some knowledge regarding how to optimize performance in really large SQLite databases ?

    Iím afraid I canít help much more other than recommending that you ensure to only scan attributes you actually need with Custom Scan. With this amount of music files a scanned tag that isnít used is likely going to have an impact on performance.
    Erland Isaksson (My homepage)
    Developer of many plugins/applets
    Starting with LMS 8.0 I no longer support my plugins/applets (see here for more information )

  9. #109
    Senior Member
    Join Date
    Nov 2010
    Location
    Hertfordshire, UK
    Posts
    3,230
    As a comparison, my library is somewhat less than half the size, but I have no problems at all. I have no artists with attributes (I'm not sure which those are in that system), nor any attributes retrieved from lastfm. For what it's worth, here are my stats. Maybe something will stand out as making a difference?

    parameter value
    Number of song attributes 671711
    Number of artist attributes 0
    Number of album attributes 0
    Number of songs with attributes 31976
    Number of songs without attributes 0
    Number of artists with attributes 0
    Number of artists without attributes 3808
    Number of albums with attributes 0
    Number of albums without attributes 1598
    Number of songs with attributes from customtag 31976
    Number of songs with attributes from mixedtag 31976
    Number of songs with attributes from ratingtag 8430
    Number of song attributes from customtag 218592
    Number of song attributes from mixedtag 444689
    Number of song attributes from ratingtag 8430
    Number of songs without attributes from customtag 0
    Number of songs without attributes from mixedtag 0
    Number of albums without attributes from csamazon 1598
    Number of artists without attributes from cslastfm 3808
    Number of songs with customtag attributes of type CREATED 31976
    Number of songs with customtag attributes of type MOVEMENT 23308
    Number of songs with customtag attributes of type RATING 8430
    Number of songs with customtag attributes of type SETID 31976
    Number of songs with customtag attributes of type SOURCE 31976
    Number of songs with customtag attributes of type WORK 28680
    Number of songs with customtag attributes of type WORKARTIST 28687
    Number of songs with customtag attributes of type WORKORMOVEMENT 28680
    Number of songs with mixedtag attributes of type ALBUM 31976
    Number of songs with mixedtag attributes of type ALBUMARTIST 31976
    Number of songs with mixedtag attributes of type ARTIST 31917
    Number of songs with mixedtag attributes of type BAND 16720
    Number of songs with mixedtag attributes of type COMPOSER 28865
    Number of songs with mixedtag attributes of type CONDUCTOR 15755
    Number of songs with mixedtag attributes of type GENRE 31976
    Number of songs with mixedtag attributes of type MOVEMENT 23308
    Number of songs with mixedtag attributes of type RATING 8430
    Number of songs with mixedtag attributes of type TRACKARTIST 31917
    Number of songs with mixedtag attributes of type WORK 28680
    Number of songs with mixedtag attributes of type WORKARTIST 28687
    Number of songs with mixedtag attributes of type WORKORMOVEMENT 28680
    Number of songs with mixedtag attributes of type YEAR 31976
    Number of songs with ratingtag attributes of type RATING 8430
    LMS 8.1 on PC, Xubuntu 20.04, FLACs 16->24 bit, 44.1->192kbps. 2 Touches & EDO.
    LMS plugin UPnP/DLNA Bridge to MF M1 CLiC (A308CR amp & ESLs) & Marantz CR603 UPnP renderers.
    Also Minimserver & Upplay to same & to upmpdcli/mpd PC renderers.
    Squeezelite to Meridian USB Explorer DAC to PC speakers/headphones.
    Wireless Xubuntu 20.04 laptop firefox/upplay or Android mobile with Squeeze-Ctrl/BubbleUPnP controls LMS/Minimserver.

  10. #110
    Senior Member erland's Avatar
    Join Date
    Dec 2005
    Location
    Sweden
    Posts
    11,260
    Quote Originally Posted by PasTim View Post
    As a comparison, my library is somewhat less than half the size, but I have no problems at all. I have no artists with attributes (I'm not sure which those are in that system), nor any attributes retrieved from lastfm. For what it's worth, here are my stats. Maybe something will stand out as making a difference?
    I donít think the artist attributes from lastfm is the issue since these are stored in a separate table thatís reasonable small.

    The obvious difference (except the library size) which I spot is that you donít scan tags like COMMENT and LYRICS which potentially can contain really long texts. As mentioned in my previous post Iím not sure if these might cause performance issues.
    Erland Isaksson (My homepage)
    Developer of many plugins/applets
    Starting with LMS 8.0 I no longer support my plugins/applets (see here for more information )

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •