How does new&changed scanner detect what files to scan?

[frank1969]

Argh... how much free disk space would you have, in particular on the
drive where your TEMP folder lives?

Free space on "temp"-device is 136 GB (temp folder right now uses about 300 MB)

Could you please run the inner SELECT in the above statement in SQLite
directly, to get the total number of rows for that query?

Execution finished without errors.
Result: 7313 rows returned in 13175ms

[frank1969]

Just did another scan (same beta) that ended (seemingly) regularly:

[22-02-13 16:32:58.8166] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: progress:1644766286||importer||updateStandaloneArt work||16104||16104||1644766378.81439
[22-02-13 16:33:00.3092] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: progress:1644766379.52718||importer||precacheArtwo rk||1||159||
[22-02-13 16:33:03.5565] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: progress:1644766379||importer||precacheArtwork||15 9||159||1644766383.55449
[22-02-13 16:33:09.4125] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: progress:1644766383.61973||importer||dboptimize||1 ||2||
[22-02-13 16:33:46.5057] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: progress:1644766383||importer||dboptimize||2||2||1 644766426.47187
[22-02-13 16:33:46.5113] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: end
[22-02-13 16:33:46.5183] Slim::Utils::SQLiteHelper::_notifyFromScanner (581) Notify from scanner: exit
[22-02-13 16:33:46.8074] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:46.8078] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:46.8094] Slim::Utils::Misc::msg (1343) Warning: [16:33:46.8093] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /<C:\PROGRA~2\SQUEEZ~1\server\SQUEEZ~3.EXE>Slim/Schema.pm line 1905
[22-02-13 16:33:46.8250] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:50.8535] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:50.8545] Slim::Music::Import::nextScanTask (801) remaining scans in queue)
[22-02-13 16:33:58.8082] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:58.8085] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:33:58.8092] Slim::Utils::Misc::msg (1343) Warning: [16:33:58.8092] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /<C:\PROGRA~2\SQUEEZ~1\server\SQUEEZ~3.EXE>Slim/Schema.pm line 1905
[22-02-13 16:33:58.8208] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:34:02.5976] Slim::Schema::wipeCaches (2130) Wiped all in-memory caches.
[22-02-13 16:34:02.5979] Slim::Music::Import::nextScanTask (801) remaining scans in queue)
[22-02-13 16:37:43.8553] Slim::Utils::Misc::msg (1343) Warning: [16:37:43.8553] DBIx::Class::ResultSet::update_or_create(): Query returned more than one row. SQL that returns multiple rows is DEPRECATED for ->find and ->single at /<C:\PROGRA~2\SQUEEZ~1\server\SQUEEZ~3.EXE>Slim/Schema.pm line 1905

[mherger]

How does new&amp;changed scanner detect whatfiles to scan?

Your crash happened when the FTS plugin tried to create the list of
popular terms. I don't know how any of the recent changes would have
added any additional effort this. So... while I don't like that, let's
consider this a random crash :-/.

OTOH: could you please check how many lines you have in
Prefs/plugin/fulltext.prefs?

[frank1969]

OTOH: could you please check how many lines you have in
Prefs/plugin/fulltext.prefs?

It's 7.317 (so for the first 4 seem to be headlines (see below), it makes sense):
---
_ts_popularTerms: 1644766442
_version: 1
popularTerms:

Anyway, I keep it as "incidentally" too and watch it...

[frank1969]

Not surprisingly that's a lot. Does the fulltext search still provide
some value to you? All those 7k popular terms would only be searched for
in titles, but eg. not in comments.

I'm not saying "turn off FTS" to work around that crash. But I believe
some of the FTS plugin implementation doesn't scale well with larger
libraries.

Yes. I'll keep this in mind and watch this closely.
Till 3 or 4 months ago I had FTS deactivated, but it's really of use for it's more comfortable to type "beatles need love" if I'm looking for albums with "All You Need Is Love" by the Beatles than to call extended search and type "need is love" (need love wouldn't work) in "tyle" field and artist "beatles" in artist field. So FTS is especially more practical if you don't know the exact title but only two words (but maybe not as an exact combination).

[slartibartfast]

> In my experience tagging changes aren't always picked up properly in a
> new and changed scan anyway. I always remove and replace the affected
> albums doing a new and changed scan twice.

I've fixed a few of those issues in the past week. Please give it
another try.

In general "new and changed" scans are much improved. I did find something that trips them up though. If an album folder contains a folder.jpg and the tracks also contain the same embedded artwork, if I remove the embedded artwork and perform a new and changed scan then the album artwork disappears even though the folder.jpg is still there.

Sent from my Pixel 3a using Tapatalk

[slartibartfast]

In general "new and changed" scans are much improved. I did find something that trips them up though. If an album folder contains a folder.jpg and the tracks also contain the same embedded artwork, if I remove the embedded artwork and perform a new and changed scan then the album artwork disappears even though the folder.jpg is still there.

Sent from my Pixel 3a using Tapatalk

Unless it is some kind of caching issue of course. I was clicking on "Artists" then the Artist name to view the album list, I wonder if clicking on "Home" first would have made a difference.

Sent from my Pixel 3a using Tapatalk

[slartibartfast]

Unless it is some kind of caching issue of course. I was clicking on "Artists" then the Artist name to view the album list, I wonder if clicking on "Home" first would have made a difference.

Sent from my Pixel 3a using Tapatalk

Turns out it was a caching issue. The artwork finally appeared.

Sent from my Pixel 3a using Tapatalk

[slartibartfast]

Turns out it was a caching issue. The artwork finally appeared.

Sent from my Pixel 3a using Tapatalk

Hmm the artwork only appears in "New Music" or "Artists/Albums after playing the album so something seems wrong.

Sent from my Pixel 3a using Tapatalk