Home of the Squeezebox™ & Transporter® network music players.
Page 3 of 13 FirstFirst 12345 ... LastLast
Results 21 to 30 of 130
  1. #21
    Senior Member
    Join Date
    Jun 2009
    Posts
    439
    Quote Originally Posted by mherger View Post
    Unfortunately I only have Erland's 100k library to test with. I'll let
    you know what I get there.
    If there is anything/any details I can provide to help You, please let me know.

    Quote Originally Posted by mherger View Post
    Oh, and you do use the "maximum" memory preference in Settings/Advanced/Performance?
    We're talking about the "High (recommended for Computers with 1GB RAM or more)" (or someting like that, I'm using the German Version)-option? Yes, I do...

  2. #22
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    > Unfortunately I only have Erland's 100k library to test with. I'll let
    > you know what I get there.


    Ok, with Erland's 100k library plus some k of mine:

    [14-10-23 23:27:28.5785]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (177) Starting
    fulltext index build...
    [14-10-23 23:27:28.5815]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (183) Initialize
    fulltext table...
    [14-10-23 23:27:28.5831]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (189) Create
    fulltext index for tracks...
    [14-10-23 23:27:55.6936]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (215) Create
    fulltext index for albums...
    [14-10-23 23:28:02.4535]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (236) Create
    fulltext index for contributors...
    [14-10-23 23:28:02.9775]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (252) Create
    fulltext index for playlists...
    [14-10-23 23:28:02.9881]
    Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (283) Fulltext index
    build done!

    34s for all of it on a 5yrs old MacMini with 3GB of RAM...

    Could you please send me a copy of your library.db from a regular,
    successful scan (with the FulltextSearch plugin disabled)? It would
    allow me to run the queries against the library even without the actual
    files on disk.

    --

    Michael

  3. #23
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    >> Oh, and you do use the "maximum" memory preference in
    >> Settings/Advanced/Performance?

    >
    > We're talking about the "High (recommended for Computers with 1GB RAM or
    > more)" (or someting like that, I'm using the German Version)-option?
    > Yes, I do...


    Use "Maximum". Though, your "out of memory" message seems as if that
    wouldn't help...

    --

    Michael

  4. #24
    Senior Member
    Join Date
    Jun 2009
    Posts
    439
    Quote Originally Posted by mherger View Post
    Use "Maximum". Though, your "out of memory" message seems as if that
    wouldn't help...
    Ah, ok, sorry, I didn't recognize this third option, only knew the other two. I changed to maximum and will do another scan.
    If it fails once again I'll re-produce a "successful" db for You. Thanks in advance for letting me know about this option.

  5. #25
    Senior Member
    Join Date
    Jun 2009
    Posts
    439
    Another thing I recognized (and I know see again while it restarts):
    r-1414070955 takes MUCH longer to start the server. Usually it takes about 15 seconds - know it takes some 10 minutes

    So I downgraded to r-1413907472 - it's up in 15 seconds again

    upgrade to r-1414070955 once more - 5 minutes ago and it's still "starting" in progress...

    Maybe this helps You to locate the issue?

    Sever.log seems to be the same:

    [14-10-23 23:53:53.1442] main::init (370) Starting Logitech Media Server (v7.9.0, 1413907472, Wed Oct 22 04:05:14 CUT 2014) perl 5.014001
    [14-10-23 23:53:53.8945] Slim::Utils::Misc::msg (1343) Warning: [23:53:53.8942] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /<C:\PROGRA~2\SQUEEZ~1\server\SQUEEZ~3.EXE>Slim/Schema.pm line 1876

    [14-10-23 23:55:38.6684] main::init (370) Starting Logitech Media Server (v7.9.0, 1414070955, Thu Oct 23 13:56:44 CUT 2014) perl 5.014001
    [14-10-23 23:55:39.3874] Slim::Utils::Misc::msg (1343) Warning: [23:55:39.3872] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /<C:\PROGRA~2\SQUEEZ~1\server\SQUEEZ~3.EXE>Slim/Schema.pm line 1876

  6. #26
    Senior Member JJZolx's Avatar
    Join Date
    Apr 2005
    Location
    Colorado
    Posts
    11,582
    FWIW, it took 1:06 to index 42,000 FLAC tracks and a handful of small playlists on my server during a full library scan. I have few comments and no lyrics in the metadata. Total scan time went from about 14 to 15 minutes.

    At this time (v38612, updated via SVN just a few minutes ago), search appears to still be broken.

  7. #27
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    > At this time (v38612, updated via SVN just a few minutes ago), search
    > appears to still be broken.


    Broken in what way? Anything in the log file?

    --

    Michael

  8. #28
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    > Another thing I recognized (and I know see again while it restarts):
    > r-1414070955 takes MUCH longer to start the server. Usually it takes
    > about 15 seconds - know it takes some 10 minutes
    >
    > So I downgraded to r-1413907472 - it's up in 15 seconds again
    >
    > upgrade to r-1414070955 once more - 5 minutes ago and it's still
    > "starting" in progress...


    LMS would re-build the index if it was absent or outdated. As you've had
    serious problems with your scan I wouldn't be surprised if it was
    re-building it upon the startup.

    --

    Michael

  9. #29
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    > Yes, thanks - after 55 minutes it finished full text search (for 420k
    > mp3-files). I will now test the feature and report if it was only the
    > initial scan that took so "long" or if it's the same with every
    > (update-) scan. Great idea, by the way! :-)


    I knew FTS might be heavy on your server. But ahm... it's a massive hog
    with a large collection. I just tried with ~400k tracks:

    Dateien/Verzeichnisse werden erkannt:
    /Users/mh/Documents/SqueezeZeugs/Massive Music Library (431973 von
    431973) Beendet 00:02:25
    Neue Musikdateien werden durchsucht:
    /Users/mh/Documents/SqueezeZeugs/Massive Music Library (398652 von
    398652) Beendet 00:52:23
    Volltext Index erstellen (5 von 5) Beendet 00:12:19
    Musiksammlungs-Ansichten erstellen (4 von 4) Beendet 00:01:25
    Nach aktualisierten Plattenhüllen suchen (32304 von 32304) Beendet
    00:06:03
    Datenbank Optimierung (2 von 2) Beendet 00:08:31
    Der Server hat das Durchsuchen Ihrer Medienbibliothek abgeschlossen.
    Laufzeit: 01:23:06 (Freitag 24. Oktober 2014 / 12:21)

    Building the index was pretty quick (compared to what you reported). 12
    minutes is nowhere near the 55 minutes you experienced. I could imagine
    that disk IO is becoming an issue again: the resulting library.db weighs
    a whopping 1.1GB. With the temporary .wal file it created about 2.5GB at
    peak times. The fulltext index accounts for about 500MB of the 1.1GB.

    Now scan times are one issue. But unfortunately searches are useless
    with this large a library. The web UI would constantly time out, while
    the server was eating up to 800MB of memory.

    I'll see what I can do about this...

    --

    Michael

  10. #30
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,624

    New in 7.9: Fulltext search

    > Yes, thanks - after 55 minutes it finished full text search (for 420k
    > mp3-files). I will now test the feature and report if it was only the
    > initial scan that took so "long" or if it's the same with every
    > (update-) scan. Great idea, by the way! :-)


    How many stored playlists do you have? And how many tracks are in there
    (approximately)? I think indexing playlists is brutally slow right now.
    There definitely is some room for improvement in many places...

    --

    Michael

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •