Home of the Squeezebox™ & Transporter® network music players.
Page 8 of 11 FirstFirst ... 678910 ... LastLast
Results 71 to 80 of 102
  1. #71
    Senior Member
    Join Date
    Nov 2010
    Location
    Hertfordshire, UK
    Posts
    3,007
    Quote Originally Posted by mherger View Post
    > Will any missing indices (possibly removed using the tweak plugin, now
    > uninstalled) get rebuilt automatically?


    No, the indices are not touched currently.

    --

    Michael
    Apologies if I wasn't clear and/or I'm being thick.

    My question is as follows. I removed the tweak plugin whilst the indices had been cut back. I then installed the latest 7.9 and did a full scan. Will this recreate any missing indices or not?
    LMS 7.9.3 on PC, Xubuntu 18.04, FLACs 16->24 bit, 44.1->192kbps. 2 Touchs & EDO.
    LMS plugin UPnP/DLNA Bridge to MF M1 CLiC (A308CR amp & ESLs) & Marantz CR603 UPnP renderers.
    Also Minimserver & Upplay to same & to upmpdcli/mpd PC renderers.
    Squeezelite to Meridian USB Explorer DAC to PC speakers/headphones.
    Wireless Xubuntu 18.04 laptop firefox/upplay or Android 'phone with Squeeze-Commander/BubbleUPnP controls LMS/Minimserver.

  2. #72
    Senior Member
    Join Date
    Nov 2010
    Location
    Hertfordshire, UK
    Posts
    3,007
    Quote Originally Posted by JJZolx View Post
    ...if everything in LMS worked as it should (i.e. if there were no scanning bugs or bugs that cause the database to become inconsistent or corrupted) users should never have to run a full rescan. ....
    I quite often change the tags on my FLACS, to ensure consistency across multiple performances of classical works.

    I have to do a full rescan each time I do this because changes (rather than additions) to the library often result in errors in the menus. Further, because I make extensive use of custom scan, and this scan always takes quite a long time whether for a change scan or full scan, the shorter scan doesn't save much time over all.
    LMS 7.9.3 on PC, Xubuntu 18.04, FLACs 16->24 bit, 44.1->192kbps. 2 Touchs & EDO.
    LMS plugin UPnP/DLNA Bridge to MF M1 CLiC (A308CR amp & ESLs) & Marantz CR603 UPnP renderers.
    Also Minimserver & Upplay to same & to upmpdcli/mpd PC renderers.
    Squeezelite to Meridian USB Explorer DAC to PC speakers/headphones.
    Wireless Xubuntu 18.04 laptop firefox/upplay or Android 'phone with Squeeze-Commander/BubbleUPnP controls LMS/Minimserver.

  3. #73
    Senior Member JJZolx's Avatar
    Join Date
    Apr 2005
    Location
    Colorado
    Posts
    11,531
    Quote Originally Posted by PasTim View Post
    I quite often change the tags on my FLACS, to ensure consistency across multiple performances of classical works.

    I have to do a full rescan each time I do this because changes (rather than additions) to the library often result in errors in the menus. Further, because I make extensive use of custom scan, and this scan always takes quite a long time whether for a change scan or full scan, the shorter scan doesn't save much time over all.
    Relatively few people using LMS use the custom scan plugin. If you're stuck having to do full rescans that take hours to correctly pick up minor tagging changes, that's your choice.

    What I'm saying is that scanning has gotten and continues to get much better in 7.8.1 and 7.9, and requiring a full rescan is much less common these days. I very seldom have to do one when making tagging changes in my library now. Pretty much the only reason I run a full wipe and rescan these days is to test scanning speed.

  4. #74
    Senior Member
    Join Date
    Nov 2010
    Location
    Hertfordshire, UK
    Posts
    3,007
    Quote Originally Posted by JJZolx View Post
    Relatively few people using LMS use the custom scan plugin. If you're stuck having to do full rescans that take hours to correctly pick up minor tagging changes, that's your choice.

    What I'm saying is that scanning has gotten and continues to get much better in 7.8.1 and 7.9, and requiring a full rescan is much less common these days. I very seldom have to do one when making tagging changes in my library now. Pretty much the only reason I run a full wipe and rescan these days is to test scanning speed.
    Fair enough.

    However, without custom tags I really couldn't use LMS, so I don't feel I have much choice. The people (Microsoft?) who invented the standard tags seem to have had no idea of the various types of music and their requirements
    LMS 7.9.3 on PC, Xubuntu 18.04, FLACs 16->24 bit, 44.1->192kbps. 2 Touchs & EDO.
    LMS plugin UPnP/DLNA Bridge to MF M1 CLiC (A308CR amp & ESLs) & Marantz CR603 UPnP renderers.
    Also Minimserver & Upplay to same & to upmpdcli/mpd PC renderers.
    Squeezelite to Meridian USB Explorer DAC to PC speakers/headphones.
    Wireless Xubuntu 18.04 laptop firefox/upplay or Android 'phone with Squeeze-Commander/BubbleUPnP controls LMS/Minimserver.

  5. #75
    Senior Member Mnyb's Avatar
    Join Date
    Feb 2006
    Location
    Vństerňs Sweden
    Posts
    16,525
    Quote Originally Posted by PasTim View Post
    Fair enough.

    However, without custom tags I really couldn't use LMS, so I don't feel I have much choice. The people (Microsoft?) who invented the standard tags seem to have had no idea of the various types of music and their requirements
    Schedule the scans when not listening , You can live without you latest tag change a day or two
    --------------------------------------------------------------------
    Main hifi: Rasbery PI digi+ MeridianG68J MeridianHD621 MeridianG98DH 2 x MeridianDSP5200 MeridianDSP5200HC 2 xMeridianDSP3100 +Rel Stadium 3 sub.
    Bedroom/Office: Boom
    Loggia: Raspi hifiberry dac + Adams
    Bathroom : Radio (with battery)
    iPad with iPengHD & SqueezePad
    (spares Touch, SB3, reciever ,controller )
    server Intel NUC Esxi VM Linux mint 18 LMS 7.9.2

    http://people.xiph.org/~xiphmont/demo/neil-young.html

  6. #76
    Senior Member
    Join Date
    Nov 2010
    Location
    Hertfordshire, UK
    Posts
    3,007
    Quote Originally Posted by Mnyb View Post
    Schedule the scans when not listening , You can live without you latest tag change a day or two
    I do I kick them off when I go to bed, and then Server Power Control shuts the system down later on.
    LMS 7.9.3 on PC, Xubuntu 18.04, FLACs 16->24 bit, 44.1->192kbps. 2 Touchs & EDO.
    LMS plugin UPnP/DLNA Bridge to MF M1 CLiC (A308CR amp & ESLs) & Marantz CR603 UPnP renderers.
    Also Minimserver & Upplay to same & to upmpdcli/mpd PC renderers.
    Squeezelite to Meridian USB Explorer DAC to PC speakers/headphones.
    Wireless Xubuntu 18.04 laptop firefox/upplay or Android 'phone with Squeeze-Commander/BubbleUPnP controls LMS/Minimserver.

  7. #77
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,353

    Plugin to test database tweaks

    > Do you turn on auto_vacuum during the scan, do a vacuum before scanning,
    > or do a vacuum after scanning? Why not also do the remaining databases?


    auto_vacuum is off for these two files. The auto_vacuum is mostly about
    not wasting disk space, but it doesn't help the fragmentation. If you
    want best performance, then you'll have to run a full VACUUM. As these
    two files don't see that many changes the waste of disk space should be
    negligible.

    It's a different story for the cache files which change every minute if
    you listen to some online source. This is the reason why I did not
    enable auto_vacuum on library and persist, but on the cache files.

    Initially I set vacuum to be run right after the scanner had wiped all
    tables, as I expected this to be the quickest. Unfortunately the DB is
    slightly slower if it has to constantly grow the file. Plus at the end
    of the scan there would be a certain amount of fragmentation already.
    Therefore I decided to run it in the optimize step.

    > The thing I dislike about this approach is that if everything in LMS
    > worked as it should (i.e. if there were no scanning bugs or bugs that
    > cause the database to become inconsistent or corrupted) users should
    > never have to run a full rescan.


    We still have a long way to go :-).

    > Having to do so to maximize performance
    > is not the best strategy, IMO. For the users for whom this will do the
    > most good, that full rescan may take hours due to very large libraries
    > or very slow hardware.


    Another change I just committed: the VACUUM is read during a new &
    changed scan, too, if no player is active. The problem is that VACUUM
    can break playback. If you use the rescan plugin to run scans at night,
    you should be on the save side.

    > Is the max buffer size per SQLite database or is there just one buffer
    > for the entire LMS application?


    It's per database connection, to be accurate. Eg. the scanner can use a
    different buffer size than the server (which makes sense, as the scanner
    doesn't profit as much from the larger buffer to its mostly writing nature).

    Currently only persist and library use that maximum setting. Caches
    don't. I probably have to tweak this further, as caches are accessed
    quite often, while persist is rather simple (unless you're using one of
    Erland's plugins). But I'd like to get some data from you first.

    Keep in mind that in most cases LMS would be using a fraction of that
    maximum cache_size only anyway. Eg. my server process is currently
    running at around 200MB memory usage. Before the buffer change it was
    around 140MB. It's far from using 500MB times two cache_size.
    Unfortunately I haven't figured out a way yet to determine how much
    sqlite is actually using.

    --

    Michael

  8. #78
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,353

    Plugin to test database tweaks

    > My question is as follows. I removed the tweak plugin whilst the
    > indices had been cut back. I then installed the latest 7.9 and did a
    > full scan. Will this recreate any missing indices or not?


    No, it does not re-create them. The only way to do so without the plugin
    is to delete the library.db file, which would cause LMS to start from
    scratch.

    --

    Michael

  9. #79
    Senior Member erland's Avatar
    Join Date
    Dec 2005
    Location
    Sweden
    Posts
    11,042
    Quote Originally Posted by mherger View Post

    > The thing I dislike about this approach is that if everything in LMS
    > worked as it should (i.e. if there were no scanning bugs or bugs that
    > cause the database to become inconsistent or corrupted) users should
    > never have to run a full rescan.


    We still have a long way to go :-).
    Just keep in mind that there might be more important to improve browsing functionality than improve scanning speed :-)
    Especially since scanning speed already is acceptable for at least 95% of all LMS users, IMHO.

    Quote Originally Posted by mherger View Post
    Currently only persist and library use that maximum setting. Caches
    don't. I probably have to tweak this further, as caches are accessed
    quite often, while persist is rather simple (unless you're using one of
    Erland's plugins). But I'd like to get some data from you first.
    I plan to experiment a bit with reordering the WHERE criterias in my plugins in case SQLite works as you indicated earlier in the thread and its optimiser prefers if the most limiting criteria comes first in the WHERE statement. Just have to be able to find some time to experiment with it...
    Not sure if this affects anything regarding the buffer size choices you offer, I'm just mentioning it in case it does.
    Erland Isaksson (My homepage)
    Developer of many plugins/applets

  10. #80
    Senior Member
    Join Date
    Jan 2006
    Location
    South Coast, NSW, Australia
    Posts
    1,256
    OK, back down the coast after a few days at the farm, VPN'd into my Sydney server as I had left it doing a Clear & rescan.

    7.8.0 with Tweak DB.
    Logitech Media Server Version: 7.8.0 - 1395409907 @ Thu Mar 27 20:19:17 CUT 2014

    Hostname: Gladstone
    Total Tracks: 144,947
    Total Albums: 11,302
    Total Artists: 3,133
    Total Genres: 104
    Total Playing Time: 10038:39:14
    Clear & Rescan
    Discovering files/directories: F:\Music 1 (73783 of 73783) Complete 00:00:57
    Scanning new music files: F:\Music 1 (66439 of 66439) Complete 00:28:54
    Discovering files/directories: G:\Music 2 (86041 of 86041) Complete 00:01:25
    Scanning new music files: G:\Music 2 (78509 of 78509) Complete 01:13:21
    Discovering playlists: C:\Users\Johno\Music\Playlists (14 of 14) Complete 00:00:00
    Scanning new playlists: C:\Users\Johno\Music\Playlists (13 of 13) Complete 00:00:08
    MusicIP Import (144949 of 144949) Complete 00:19:16
    Album cover lookup (8 of 8) Complete 00:00:15
    Artist picture lookup (3134 of 3134) Complete 01:49:05
    Pre-caching Artwork (11182 of 11182) Complete 00:05:46
    The server has finished scanning your media library.

    Bugger, just noticed I didn't get the total time ! - Added it up to 3:59:07


    Removed Tweak DB plugin, upgraded to LMS 7.9.0 , Settings / Performance / DB Mem Config set to Max.
    Logitech Media Server Version: 7.9.0 - 1399474655 @ Thu May 8 03:04:57 CUT 2014
    Hostname: Gladstone
    Memory use after startup
    SQUEEZ~3.EXE 0 - 173,128 - 192,900 - 22,252 - 170,648
    After a few lookups
    SQUEEZ~3.EXE 0 - 547,800 - 569,108 - 24,576 - 544,532

    Now for a clear & rescan.
    SQUEEZ~3.EXE 0 - 417,108 - 439,948 - 26,092 - 413,856

    Clear & Rescan
    Discovering files/directories: F:\Music 1 (73783 of 73783) Complete 00:01:15
    Scanning new music files: F:\Music 1 (66439 of 66439) Complete 00:25:03
    Discovering files/directories: G:\Music 2 (86041 of 86041) Complete 00:01:43
    Scanning new music files: G:\Music 2 (78509 of 78509) Complete 00:30:59
    Discovering playlists: C:\Users\Johno\Music\Playlists (14 of 14) Complete 00:00:00
    Scanning new playlists: C:\Users\Johno\Music\Playlists (13 of 13) Complete 00:00:02
    MusicIP Import (144949 of 144949) Complete 00:19:43
    Album cover lookup (8 of 8) Complete 00:00:18
    Artist picture lookup (3133 of 3133) Complete 01:37:14
    Pre-caching Artwork (11182 of 11182) Complete 00:05:42
    The server has finished scanning your media library.
    Total Time: 03:01:59 (Friday, May 9, 2014 / 11:19 AM)

    Saved about 1 hour, just have to get the Artist Picture Lookup going faster - but that is a topic for a different thread.
    Also, my earlier observation that memory was not returned is wrong. The amount of memory used by the server goes up and down like a yo-yo - current memory allocation -

    SQUEEZ~3.EXE 0 - 240,188 - 259,476 - 22,664 - 236,812
    A camel is a racehorse designed by a committee.

    Seen sprayed on the outside wall of the local library -
    Three things I hate in life :
    1. Vandalism
    2. Irony
    3. Lists

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •