Scan taking hours instead of minutes on recent nightlies

[Ade_AV]

> [20-09-25 18:29:07.5107] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (479) Create fulltext index for playlists
> [20-09-25 18:29:10.5696] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db do failed: malformed MATCH expression: [file:///Volumes/Ade_iTunes/iTunes/iTunes Media/Music/Metz/Metz/11 --))--.m4a] [for Statement "

What LMS build is this?

--

Michael

[20-09-25 17:56:17.1967] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1600976618, Thu Sep 24 22:15:54 CEST 2020) perl 5.018004
[20-09-25 17:56:17.3779] Slim::Schema::forceCommit (2157) Warning: Trying to commit transactions before DB is initialized!

[mherger]

> --------------------
> [20-09-25 17:56:17.1967] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1600976618, Thu Sep 24 22:15:54 CEST 2020) perl 5.018004
> [20-09-25 17:56:17.3779] Slim::Schema::forceCommit (2157) Warning: Trying to commit transactions before DB is initialized!

Thanks. Would you mind sharing your library.db with me?

https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a



--

Michael

[mherger]

I think I finally nailed the issue with the help of kidstypike's
library.db. Please give the next build another try...
--

Michael

[kidstypike]

I think I finally nailed the issue with the help of kidstypike's
library.db. Please give the next build another try...

Success!

[mherger]

> Success!

Ok, 15s for the playlist FTS index look much more reasonable :-). Does
it work? Can you search for tracks in a playlist?


--

Michael

[kidstypike]

> Success!

Ok, 15s for the playlist FTS index look much more reasonable :-). Does
it work? Can you search for tracks in a playlist?l

Searching from the top search box doesn't bring up anything in playlists. (top pic below)

Searching by clicking on the spyglass brings up playlists that contain the search criteria, I'm not sure I see the value in that. But then it wasn't me who asked for "search within playlists".

[Ade_AV]

Still taking a long time for me:

[20-09-26 08:09:47.0649] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1601033329, Fri Sep 25 13:53:32 CEST 2020) perl 5.018004
[20-09-26 08:27:31.4928] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan
[20-09-26 08:27:31.4933] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (445) Starting fulltext index build
[20-09-26 08:27:31.4934] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (449) Initialize fulltext table
[20-09-26 08:27:31.5326] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (462) Create fulltext index for tracks
[20-09-26 08:27:36.0543] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (472) Create fulltext index for albums
[20-09-26 08:27:37.9209] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (481) Create fulltext index for contributors
[20-09-26 08:27:38.0669] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (491) Create fulltext index for playlists
[20-09-26 10:41:00.4914] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (506) Optimize fulltext index
[20-09-26 10:41:00.9810] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (521) Fulltext index build done!
[20-09-26 10:41:00.9812] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 8009 seconds.

[mherger]

> Still taking a long time for me:

The please answer my questions about library size, number of playlists,
number of tracks in those playlists, and share library.db and full
scanner.log.zip with me.

https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a

It's hard to give advice when I lack any information...

--

Michael

[mherger]

> Still taking a long time for me:

Thanks for your file! So... you have 10 playlists with 10k+ tracks? One
with close to 30k tracks. Do you really use those? They seem to be
imported from iTunes. Unless you're serious about using them I suggest
you add them to the ignore list in the iTunes plugin settings. This
should speed up the import considerably.

--

Michael

[Ade_AV]

> Still taking a long time for me:

Thanks for your file! So... you have 10 playlists with 10k+ tracks? One
with close to 30k tracks. Do you really use those? They seem to be
imported from iTunes. Unless you're serious about using them I suggest
you add them to the ignore list in the iTunes plugin settings. This
should speed up the import considerably.

--

Michael

Thanks, looks like I need a tidy up!