Scan taking hours instead of minutes on recent nightlies

[mherger]

> That brings the scan time down to 50 minutes.

That sounds like a decent improvement :-). Could you please post the
server.log content?

--

Michael

[testmatch]

That sounds like a decent improvement :-). Could you please post the
server.log content?

Sure Michael. What logging levels would you like? Just debug for plugin.fulltext? Or anything else?

John

[mherger]

> Sure Michael. What logging levels would you like? Just debug for
> plugin.fulltext? Or anything else?

Yes, FTS is all I'm interested in at this point. Thanks!

--

Michael

[testmatch]

Yes, FTS is all I'm interested in at this point. Thanks!

OK. There's nothing about FTS in the server.log, but the scanner.log has:

[20-09-15 09:56:32.0525] Slim::Music::Import::runImporter (577) Starting Slim::Media::MediaFolderScan scan
[20-09-15 09:56:32.0530] Slim::Music::Import::endImporter (709) Completed Slim::Media::MediaFolderScan Scan in 0 seconds.
[20-09-15 09:56:32.0536] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::iTunes::Importer scan
[20-09-15 09:59:25.9270] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::iTunes::Importer Scan in 173 seconds.
[20-09-15 09:59:25.9320] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan
[20-09-15 09:59:25.9327] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build
[20-09-15 09:59:25.9329] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table
[20-09-15 09:59:26.0628] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks
[20-09-15 09:59:34.9338] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums
[20-09-15 09:59:37.4522] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors
[20-09-15 09:59:37.7953] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists
[20-09-15 10:50:16.4258] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (503) Optimize fulltext index
[20-09-15 10:50:16.7703] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (518) Fulltext index build done!
[20-09-15 10:50:16.7706] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 3050 seconds.
[20-09-15 10:50:16.7709] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::ExtendedBrowseModes::Libraries scan
[20-09-15 10:50:16.7710] Slim::Music::Import::runImporter (577) Starting Slim::Music::VirtualLibraries scan
[20-09-15 10:50:17.6517] Slim::Music::Import::endImporter (709) Completed Slim::Music::VirtualLibraries Scan in 0 seconds.
[20-09-15 10:50:17.7767] Slim::Music::Artwork::updateStandaloneArtwork (234) Starting updateStandaloneArtwork for 1549 albums
[20-09-15 10:50:18.2655] Slim::Music::Artwork::__ANON__ (349) updateStandaloneArtwork finished in 0.483903884887695
[20-09-15 10:50:18.2843] Slim::Music::Artwork::precacheAllArtwork (659) Starting precacheArtwork for 0 albums
[20-09-15 10:50:18.2846] Slim::Music::Import::endImporter (709) Completed precacheArtwork Scan in 0 seconds.
[20-09-15 10:50:18.2852] Slim::Music::Import::runScanPostProcessing (479) Starting Database optimization.
[20-09-15 10:50:23.0222] Slim::Music::Import::endImporter (709) Completed dbOptimize Scan in 4 seconds.

[kbeast]

[20-09-22 10:55:51.5580] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build
[20-09-22 10:55:51.5583] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table
[20-09-22 10:56:00.1459] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks
[20-09-22 10:57:12.6994] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums
[20-09-22 10:57:34.6155] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors
[20-09-22 10:57:36.5095] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists

I'm getting stuck at the playlists one. at times over an hour and a half

[kidstypike]

[20-09-22 10:55:51.5580] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build
[20-09-22 10:55:51.5583] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table
[20-09-22 10:56:00.1459] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks
[20-09-22 10:57:12.6994] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums
[20-09-22 10:57:34.6155] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors
[20-09-22 10:57:36.5095] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists

I'm getting stuck at the playlists one. at times over an hour and a half

Same here with the playlists, it got so bad I uninstalled the FullTextSearch plugin.

[mherger]

> I'm getting stuck at the playlists one. at times over an hour and a
> half

What exact LMS version are you using? How many playlists? How large? How
many tracks overall in playlists?

--

Michael

[kidstypike]

Logitech Media Server Version: 8.0.0 - 1600604030 @ Sun Sep 20 14:55:17 CEST 2020
Hostname: musicbox5
Server IP Address: 192.168.1.4
Server HTTP Port Number: 9000
Operating system: piCore - EN - utf8
Platform Architecture: armv7l-linux
Perl Version: 5.28.0 - arm-linux-gnueabihf-thread-multi-64int
Audio::Scan: 1.02
IO::Socket::SSL: 2.060
Database Version: DBD::SQLite 1.58 (sqlite 3.22.0)
Total Players Recognized: 4


Re-installed FTS, ran a clear and rescan, scan got stuck on FST playlists, after about 15 minutes it crashed the Pi, (Pi4/4GB) knocked it off the network.

This has always worked fine up until the last couple of nightlies.

25 playlists, 2 about 500/600 tracks, the rest all less than 100 tracks.

Nothing in the server logs from before my reboot of the Pi.

Uninstalled FTS, running full scan ATM.

[kbeast]

Same here with the playlists, it got so bad I uninstalled the FullTextSearch plugin.

I'm up to 3 hours and 38 minutes, something tells me this isn't going to finish

[slartibartfast]

I'm up to 3 hours and 38 minutes, something tells me this isn't going to finish

So how many and what size are the playlists?

Sent from my Pixel 3a using Tapatalk