I have rebuilt my Ubuntu 20.04 LTS server after hardware crash and reinstalled everyting from scratch. Initial indexing ran without any issues and rescans have been running without problems up till today.
Now artwork indexing fails (and continue to do so after rebooting)
Discovering files/directories: /media/knut/Music10TB/0_Audio (172716 of 172716) Complete 00:01:29
Building full text index (7 of 7) Complete 00:00:11
Find updated coverart files (1 of 9752) Complete 00:00:06
Media scan terminated unexpectedly (Scanning Progress)
Total Time: 00:01:46 (Friday, February 12, 2021 / 12:51 PM)
[21-02-12 12:51:16.5301] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan
[21-02-12 12:51:16.5303] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (453) Starting fulltext index build
[21-02-12 12:51:16.5304] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (457) Initialize fulltext table
[21-02-12 12:51:17.8464] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (470) Create fulltext index for tracks
[21-02-12 12:51:24.9857] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (480) Create fulltext index for albums
[21-02-12 12:51:26.9222] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (489) Create fulltext index for contributors
[21-02-12 12:51:26.9941] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (499) Create fulltext index for playlists
[21-02-12 12:51:27.0024] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (514) Optimize fulltext index
[21-02-12 12:51:27.3313] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (529) Fulltext index build done!
[21-02-12 12:51:27.3314] Slim::Music::Import::endImporter (710) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 10 seconds.
[21-02-12 12:51:27.3315] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::OnlineLibrary::Importer::VirtualLibr ariesCleanup scan
[21-02-12 12:51:27.3329] Slim::Music::Import::endImporter (710) Completed Slim::Plugin::OnlineLibrary::Importer::VirtualLibr ariesCleanup Scan in 0 seconds.
[21-02-12 12:51:27.5841] Slim::Music::Artwork::updateStandaloneArtwork (234) Starting updateStandaloneArtwork for 9752 albums
[21-02-12 12:51:31.2136] Slim::Music::Artwork::__ANON__ (349) updateStandaloneArtwork finished in 3.62664389610291
[21-02-12 12:51:31.2598] Slim::Music::Artwork:recacheAllArtwork (659) Starting precacheArtwork for 24 albums
knut@knut-Media:/var/log/squeezeboxserver$
The new music tab in server window shows status from last successful indexing.
Any suggestions welcomed. I dont want to run a complete reindex (if i can avoid it..) as it takes 1,5 hr to complete.
Artwork is a comination of .jpg and .png tiles.
Results 1 to 10 of 10
-
2021-02-12, 05:07 #1
- Join Date
- Nov 2014
- Posts
- 21
Media scan terminated unexpectedly (Scanning Progress)
-
2021-02-12, 05:32 #2
Media scan terminated unexpectedly(Scanning Progress)
> Any suggestions welcomed. I dont want to run a complete reindex (if i
> can avoid it..) as it takes 1,5 hr to complete.
I'd start by shutting down LMS. Then delete artwork.db and re-run a
scan. You could enable logging for artwork before you run the scan. It
might give you a hint about where it crashes (if it still does).
If that doesn't help, then I'd still suggest you delete library.db, too,
to trigger a full re-build of the library. You might not like it, but it
could fix your issue :-).
-
2021-02-12, 06:47 #3
- Join Date
- Nov 2014
- Posts
- 21
First I deleted artwork.db to no avail.
2.nd attempt : deleted library.db and tried again. It crashed with same messages.
Now I did a complete rescan from the "basic settings" tab and it ran a complete scan with no hickups. (50:21 so it was a bit faster than what it uses to be)
thanks for pointing me in the correct direction.
btw, do you know if there are any limitations to how big the .db files can be ? the artwork.db is 720MB and the library.db is 390MB. the files were smaller than the ones I deleted so it seems that a complete rescan every now and then is a good thing to do.
-
2021-02-12, 07:52 #4
Media scan terminated unexpectedly(Scanning Progress)
> btw, do you know if there are any limitations to how big the .db files
> can be ? the artwork.db is 720MB and the library.db is 390MB. the files
> were smaller than the ones I deleted so it seems that a complete rescan
> every now and then is a good thing to do.
I've heard of users with 600k+ tracks in their library. No idea how bit
the .db files were in those cases, but you're certainly far from any
known limitation wrt. file size.
-
2021-02-24, 09:58 #5
- Join Date
- Nov 2014
- Posts
- 21
Indexing started to fail again but now it is audio files, not artwork..
My indexing problem has returned. :-(
I have attempted all of the above to no avail.
Information screen shows the following :
Discovering files/directories: /media/knut/Music10TB/0_Audio (172609 of 172609) Complete 00:01:29
Scanning new music files: /media/knut/Music10TB/0_Audio (59327 of 159873) Complete 00:10:54
Media scan terminated unexpectedly (Scanning Progress)
Total Time: 00:12:23 (Wednesday, February 24, 2021 / 5:48 PM)
It no longer fails on indexing artwork, now it is the music files themselves that make it crash. I have done a cleanup in the audio files removing all files mentioned in previous log files. (some .cue files and incomplete .flac files etc)
Media server status :
Logitech Media Server Version: 8.1.1 - 1610364019 @ Thu Jan 14 06:22:21 CET 2021
Hostname: knut-Media
Server IP Address: 127.0.0.1
Server HTTP Port Number: 9000
Operating system: Debian - EN - utf8
Platform Architecture: x86_64-linux
Perl Version: 5.30.0 - x86_64-linux-gnu-thread-multi
Audio::Scan: 1.02
IO::Socket::SSL: 2.067
Database Version: DBD::SQLite 1.58 (sqlite 3.22.0)
Total Players Recognized: 2
Scanner log files :
[21-02-24 17:36:14.0473] main::main (206) Starting Logitech Media Server scanner (v8.1.1, 1610364019, Thu Jan 14 06:22:21 CET 2021) perl 5.030000
[21-02-24 17:36:14.0994] Carp::Clan::__ANON__ (216) Warning: DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /usr/share/perl5/Slim/Schema.pm line 1899
[21-02-24 17:36:14.0996] Slim::Schema::forceCommit (2171) Warning: Trying to commit transactions before DB is initialized!
[21-02-24 17:36:15.7552] Slim::Music::Import::runImporter (577) Starting Slim::Media::MediaFolderScan scan
[21-02-24 17:36:15.7554] Slim::Utils::Scanner::Local::rescan (179) Discovering audio files in /media/knut/Music10TB/0_Audio
[21-02-24 17:37:44.7550] Slim::Utils::Scanner::Local::__ANON__ (191) Start processing found tracks
[21-02-24 17:37:44.7552] Slim::Utils::Scanner::Local::__ANON__ (199) Connect do DB
[21-02-24 17:37:44.7552] Slim::Utils::Scanner::Local::__ANON__ (202) Get latest ID
[21-02-24 17:37:44.7554] Slim::Utils::Scanner::Local::__ANON__ (224) Delete temporary table if exists
[21-02-24 17:37:44.7554] Slim::Utils::Scanner::Local::__ANON__ (227) Re-build temporary table
[21-02-24 17:37:44.8919] Slim::Utils::Scanner::Local::__ANON__ (276) Get deleted tracks count
[21-02-24 17:37:44.8920] Slim::Utils::Scanner::Local::__ANON__ (283) Get new tracks count
[21-02-24 17:37:44.8926] Slim::Utils::Scanner::Local::__ANON__ (288) Get changed tracks count
[21-02-24 17:37:44.8926] Slim::Utils::Scanner::Local::deleteTracks (519) Removing deleted audio files (0)
[21-02-24 17:37:44.8927] Slim::Utils::Scanner::Local::__ANON__ (301) Scanning new audio files (159873)
[21-02-24 17:39:37.6765] Audio::Scan::scan (64) Warning: Error: Unable to read at least 4 bytes from file.
[21-02-24 17:46:35.0283] Audio::Scan::scan (64) Warning: Error: Unable to read at least 10 bytes from file.
[21-02-24 17:46:35.0517] Audio::Scan::scan (64) Warning: Error: Unable to read at least 10 bytes from file.
Server log file :
2021-02-24 17:34:50 squeezeboxserver_safe stopped.
2021-02-24 17:35:29 squeezeboxserver_safe started.
[21-02-24 17:35:30.5203] main::init (388) Starting Logitech Media Server (v8.1.1, 1610364019, Thu Jan 14 06:22:21 CET 2021) perl 5.030000 - x86_64-linux-gnu-thread-multi
[21-02-24 17:35:30.6192] Slim::Utils::IPDetect::_init (138) Warning: Couldn't call connect() - falling back to 127.0.0.1
[21-02-24 17:35:30.6390] Slim::Utils::SQLiteHelper:ostConnect (377) Optimizing DB because of missing or empty sqlite_stat1 table
[21-02-24 17:35:32.3635] Slim::Schema::forceCommit (2171) Warning: Trying to commit transactions before DB is initialized!
[21-02-24 17:35:33.5543] Slim::Utils::Misc::msg (1266) Warning: [17:35:33.5542] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /usr/share/perl5/Slim/Schema.pm line 1899
[21-02-24 17:35:33.6902] Slim::Plugin::FullTextSearch::Plugin::_initPopular Terms (556) Fulltext index missing or outdated - re-building
[21-02-24 17:35:33.6903] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (453) Starting fulltext index build
[21-02-24 17:35:33.6904] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (457) Initialize fulltext table
[21-02-24 17:35:33.6907] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (470) Create fulltext index for tracks
[21-02-24 17:35:36.3237] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (480) Create fulltext index for albums
[21-02-24 17:35:37.1229] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (489) Create fulltext index for contributors
[21-02-24 17:35:37.1514] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (499) Create fulltext index for playlists
[21-02-24 17:35:37.1572] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (514) Optimize fulltext index
[21-02-24 17:35:37.2745] Slim::Plugin::FullTextSearch::Plugin::_rebuildInde x (529) Fulltext index build done!
[21-02-24 17:48:38.6621] Slim::Utils::Misc::msg (1266) Warning: [17:48:38.6620] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /usr/share/perl5/Slim/Schema.pm line 1899
[21-02-24 17:48:38.6663] Slim::Plugin::FullTextSearch::Plugin::_initPopular Terms (556) Fulltext index missing or outdated - re-building
[21-02-24 17:48:38.6666] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db selectcol_arrayref failed: no such table: fulltext_terms [for Statement "
SELECT term, d FROM (
SELECT term, SUM(documents) d
FROM fulltext_terms
WHERE NOT col IN ('*', 1, 0) AND LENGTH(term) > 1
GROUP BY term
ORDER BY d DESC
)
WHERE d > 500
"]
[21-02-24 17:48:38.6666] Slim::Schema::Storage::throw_exception (121) Backtrace:
frame 0: Slim::Utils::Log::logBacktrace (/usr/share/perl5/Slim/Schema/Storage.pm line 121)
frame 1: Slim::Schema::Storage::throw_exception (/usr/share/squeezeboxserver/CPAN/DBIx/Class/Storage/DBI.pm line 1007)
frame 2: DBIx::Class::Storage:BI::__ANON__ (/usr/share/perl5/Slim/Plugin/FullTextSearch/Plugin.pm line 563)
frame 3: Slim::Plugin::FullTextSearch::Plugin::_initPopular Terms (/usr/share/perl5/Slim/Plugin/FullTextSearch/Plugin.pm line 137)
frame 4: Slim::Plugin::FullTextSearch::Plugin::__ANON__ (/usr/share/perl5/Slim/Control/Request.pm line 2058)
frame 5: (eval) (/usr/share/perl5/Slim/Control/Request.pm line 2058)
frame 6: Slim::Control::Request::notify (/usr/share/perl5/Slim/Control/Request.pm line 859)
frame 7: Slim::Control::Request::checkNotifications (/usr/sbin/squeezeboxserver line 709)
frame 8: main::idle (/usr/sbin/squeezeboxserver line 678)
frame 9: main::main (/usr/sbin/squeezeboxserver line 1211)
[21-02-24 17:48:38.6667] Slim::Control::Request::notify (2060) Error: Failed notify: Carp::Clan::__ANON__(): DBI Exception: DBD::SQLite::db selectcol_arrayref failed: no such table: fulltext_terms [for Statement "
SELECT term, d FROM (
SELECT term, SUM(documents) d
FROM fulltext_terms
WHERE NOT col IN ('*', 1, 0) AND LENGTH(term) > 1
GROUP BY term
ORDER BY d DESC
)
WHERE d > 500
"] at /usr/share/perl5/Slim/Schema/Storage.pm line 125
-
2021-02-24, 10:35 #6
- Join Date
- Nov 2014
- Posts
- 21
Did just discover that version 8.2.0 was available. Installed this. Same result.
Now running on
Logitech Media Server Version: 8.2.0 - 1614180387 @ Wed Feb 24 16:43:09 CET 2021
Hostname: knut-Media
Server IP Address: 192.168.1.11
Server HTTP Port Number: 9000
Operating system: Debian - EN - utf8
Platform Architecture: x86_64-linux
Perl Version: 5.30.0 - x86_64-linux-gnu-thread-multi
Audio::Scan: 1.02
IO::Socket::SSL: 2.067
Database Version: DBD::SQLite 1.58 (sqlite 3.22.0)
Total Players Recognized: 2
-
2021-02-24, 14:36 #7
Media scan terminated unexpectedly(Scanning Progress)
> My indexing problem has returned. :-(
Did you add any new music? Enable INFO logging for the server, and see
whether the scanner.log tells you the last file it tried to scan.
-
2021-02-25, 03:43 #8
- Join Date
- Nov 2014
- Posts
- 21
It seems that I managed to pinpoint the problem. Between my new audiofiles there were some huuuge ones.
3 large files in a row. (huge 192KHz / 24 bit , 1/2 hour orchestral work)
a) 764,3MB
b) 1,1 GB
c) 718,3MB
When these were removed indexing went without any hickups.
Could there be a file-size limit of 1 GB in the code ??
knut
-
2021-02-25, 03:49 #9
Media scan terminated unexpectedly(Scanning Progress)
> Could there be a file-size limit of 1 GB in the code ??
I don't know. What platform are you on, and what Audio::Scan version are
you using (see Settings/Information in LMS)?
-
2021-02-25, 04:07 #10
- Join Date
- Nov 2014
- Posts
- 21
I´m running Ubuntu 20.04 LTS.
Logitech Media Server Version: 8.2.0 - 1614180387 @ Wed Feb 24 16:43:09 CET 2021
Hostname: knut-Media
Server IP Address: 192.168.1.11
Server HTTP Port Number: 9000
Operating system: Debian - EN - utf8
Platform Architecture: x86_64-linux
Perl Version: 5.30.0 - x86_64-linux-gnu-thread-multi
Audio::Scan: 1.02
IO::Socket::SSL: 2.067
Database Version: DBD::SQLite 1.58 (sqlite 3.22.0)
Total Players Recognized: 2