Scanner problems with Muscip, help please!

[rivrwing]

Have been struggling since getting my duet with lots of bugs, but the killer is the problem scanning my MusicIP library. I purchased my duet exclusively to work with musicip so this hurts:

Every attempt to scan library (full or rescan) results in "scan completed" message with only very small portion of songs actually scanned. Scan stops apparently randomly at different times and tracks). Below is text from email to tech representative, including scan log, which gives more details. Any help immensely appreciated!!

Following up to my last regarding scanner crashing, here are more details that I hope you may find useful:


My scanner has been crashing since the very first attempt to scan music when i installed squeezecenter with 7.3.2
Scanning does not crash if scanning music files directly from the location they are stored (but this is not what I need)
Scanning always crashes when importing from Musicip (importing prescisely the same files as above)
No changes I have been able to make in Musicip changes crahsing behavior
Disabling all antivrus, firewalls etc makes no change, crashing continues
7.3.2 had the same scanning issue for me (as you and I discussed a the time) but suddenly and for no explanation scanned correctly one time only.
7.3.3 was never able to import any changed music/files
When i installed 7.3.4 as you directed i lost my library and have never been able to successfully rescan more than a tiny portion (always random where/when it stops)
I copy here a scan log that may be useful:


[09-07-11 23:45:58.6715] Slim::Schema::Storage::throw_exception (81) Backtrace:
frame 0: Slim::Utils::Log::logBacktrace (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema/Storage.pm line 81)
frame 1: Slim::Schema::Storage::throw_exception (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 773)
frame 2: DBIx::Class::Storage:BI::_execute (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 826)
frame 3: DBIx::Class::Storage:BI::_select (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 852)
frame 4: DBIx::Class::Storage:BI::select_single (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/ResultSet.pm line 511)
frame 5: DBIx::Class::ResultSet::single (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 2448)
frame 6: Slim::Schema::_postCheckAttributes (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1048)
frame 7: Slim::Schema::newTrack (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1210)
frame 8: Slim::Schema::updateOrCreate (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema/ResultSet/Track.pm line 106)
frame 9: Slim::Schema::ResultSet::Track::updateOrCreate (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 454)
frame 10: Slim::Plugin::MusicMagic::Importer:rocessSong (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 251)
frame 11: Slim::Plugin::MusicMagic::Importer::exportSongs (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 189)
frame 12: Slim::Plugin::MusicMagic::Importer::exportFunction (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 160)
frame 13: Slim::Plugin::MusicMagic::Importer::startScan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 494)
frame 14: Slim::Music::Import::runImporter (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 350)
frame 15: Slim::Music::Import::runScan (scanner.pl line 231)
frame 16: (eval) (scanner.pl line 225)
frame 17: main::main (scanner.pl line 371)
[09-07-11 23:45:58.6755] main::main (237) Error: Failed when running main scan: [Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.titlesort, me.contributor, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\ProgramData\SqueezeCenter\Cache\MySQL\#sql_a30 _0.MYD' (Errcode: 13) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 771.
]
[09-07-11 23:45:58.6759] main::main (238) Error: Skipping post-process & Not updating lastRescanTime!
[09-07-11 23:46:35.8106] main::main (122) Starting SqueezeCenter scanner (v7.3.3, r27392, Fri Jul 10 03:01:50 PDT 2009)
[09-07-11 23:47:39.0173] Slim::Schema::Storage::throw_exception (81) Error: Error executing 'SELECT me.id, me.titlesort, me.contributor, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\ProgramData\SqueezeCenter\Cache\MySQL\#sql_a30 _0.MYD' (Errcode: 13) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 771.
[09-07-11 23:47:39.0179] Slim::Schema::Storage::throw_exception (81) Backtrace:
frame 0: Slim::Utils::Log::logBacktrace (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema/Storage.pm line 81)
frame 1: Slim::Schema::Storage::throw_exception (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 773)
frame 2: DBIx::Class::Storage:BI::_execute (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 826)
frame 3: DBIx::Class::Storage:BI::_select (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 852)
frame 4: DBIx::Class::Storage:BI::select_single (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/ResultSet.pm line 511)
frame 5: DBIx::Class::ResultSet::single (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 2448)
frame 6: Slim::Schema::_postCheckAttributes (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1048)
frame 7: Slim::Schema::newTrack (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema.pm line 1210)
frame 8: Slim::Schema::updateOrCreate (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Schema/ResultSet/Track.pm line 106)
frame 9: Slim::Schema::ResultSet::Track::updateOrCreate (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 454)
frame 10: Slim::Plugin::MusicMagic::Importer:rocessSong (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 251)
frame 11: Slim::Plugin::MusicMagic::Importer::exportSongs (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 189)
frame 12: Slim::Plugin::MusicMagic::Importer::exportFunction (C:/PROGRA~1/SQUEEZ~1/server/Slim/Plugin/MusicMagic/Importer.pm line 160)
frame 13: Slim::Plugin::MusicMagic::Importer::startScan (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 494)
frame 14: Slim::Music::Import::runImporter (/<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>Slim/Music/Import.pm line 350)
frame 15: Slim::Music::Import::runScan (scanner.pl line 231)
frame 16: (eval) (scanner.pl line 225)
frame 17: main::main (scanner.pl line 371)
[09-07-11 23:47:39.0193] main::main (237) Error: Failed when running main scan: [Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.titlesort, me.contributor, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\ProgramData\SqueezeCenter\Cache\MySQL\#sql_a30 _0.MYD' (Errcode: 13) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 771.
]
[09-07-11 23:47:39.0196] main::main (238) Error: Skipping post-process & Not updating lastRescanTime!

[Phil Leigh]

Can't create/write to file 'C:\ProgramData\SqueezeCenter\Cache\MySQL\#sql_a30 _0.MYD' (Errcode: 13) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 771.


Your anti-virus software is interfering - exclude *.myi & *.myd files from it.

[Mnyb]

This is interesting:

"[09-07-11 23:45:58.6755] main::main (237) Error: Failed when running main scan: [Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.titlesort, me.contributor, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\ProgramData\SqueezeCenter\Cache\MySQL\#sql_a30 _0.MYD' (Errcode: 13) at /<C:\PROGRA~1\SQUEEZ~1\server\scanner.exe>DBIx/Class/Storage/DBI.pm line 771."

What kind of antivirus program do you have ? McAffe is a known culprit
Search the forum for it as an example.

You have to exclude *.MYI and *.MYD files

[rivrwing]

Thanks for the suggestion to both of you. I have found directions to do this in a post I will copy below, but I am nervous about the warning and note on step 1 (yes this refers to me). I would give it my best shot if i were sure that i am viewing the correct solution, could either of you please confirm this for me please as being what I need to do:

When using McAfee Antivirus, it is necessary to exclude files with the extension MY? in McAfee to be able to scan your library and see long listings in a browser (McAfee sees these files as malicious and automatically deletes them; this is what happens if the right pane takes a long time to load or does not load at all). The home editions of McAfee don't offer the possibility to exclude files. I post the solution I found here:

Apparently, the McAfee home editions internally do use a exclusion list. Only this list is not accessible from within the program. The only way to add MY?-files to the exclusion list is using the registry editor.

!!!Warning: do not change the registry if you are not certain you can do this without harming your computer!!!

The steps:
1. Start the registry editor (I'm not going to explain how to do this; if you don't know that, it's most probably better not to use the editor).
2. Go to this key:
HKEY_LOCAL_MACHINE\SOFTWARE\McAfee\VSCore\On Access Scanner\McShield\Configuration\Default
3. Look at the string entries with the name ExcludedItem_x, where x is a number. See what the highest entry is (most probably it is ExcludedItem_15).
4. Make a new string value with the name ExcludedItem_x, where x is 1 higher than the highest you see in step 3 -- most probably ExcludedItem_16.
5. Doubleclick on the item and enter as value 4|3|MY?
6. Set the value of NumExcludeItems to 1 higher than it is (it is probably 16, in that case set it to 17).

If this does not work, try this alternative for the steps 5 and 6 above:
5. Doubleclick on the item and enter as value 3|2|*.myi
6. Make a new string value with the name ExcludedItem_x, where x is 1 higher than the one you made in step 4 -- most probably ExcludedItem_17.
7. Doubleclick on the item and enter as value 3|2|*.myd
8. Set the value of NumExcludeItems to 2 higher than it is (it is probably 16, in that case set it to 18).

You're done with the registry, so close the editor.

Now to make sure McAfee uses these new values do this:

1. In McAfee make sure to use the Advanced Menu.
2. In the left lower list choose Configure.
3. In the left top list choose Computer & Files
4. In the right list at Virus protection is enabled click on Off.
5. From the popup list choose the standard time (30 or 45 minutes).
6. Wait till the protection warning appears (to make sure the real time scanner is stopped),
7. Set Virus protection is enabled back to On.

That's it: you're done.

PS: I changed this instructions for two reasons:
1. As kesey points out in one of the posts, McAfee has changed the standard entries (there were 5, now there are 16. Note that this means that when SC fails scanning again after this procedure, you have to check if McAfee has changed it's standard setup. If so, you have to do this again with different numbers.
2. I have found that my earlier hack with 4|3|MY? doesn't work always. The above (with 3|2|*.myi and 3|2|*.myd) does always work here, but others have reported that it does not work on their machines. So my recommendation: start with the first procedure; if all works well, that's fine. If it does not work, try the alternative method.

Teus

[rivrwing]

Additionally: Tech support suggests that i have a mysql issue but i do not know what this refers to. Any guidance here appreciated, i wish to get to the bottom of this. Thanks

[Mnyb]

Additionally: Tech support suggests that i have a mysql issue but i do not know what this refers to. Any guidance here appreciated, i wish to get to the bottom of this. Thanks

MySQL is the database aplication that SC 7.3.3 uses in the background.
It is MySQL that is trying to create these MYD and MYI files, so yes this is an issue where McAffe and MySQL clashes.

Another solution would be to ditch McAffe home and get a decent AV that have options to set these exceptions, this is quite a normal function and it is quite unbelievable that McAffe have leaved this out ?

Regarding if this registry change is safe ? I don't know I don't have McAffe and don't actively uses my XP partition for the last 2 years, but can you not backup the registry before medling with it.
And if you are on XP can one not make a restore point of some kind.

[Phil Leigh]

Personally I would remove Macafee and install AVG which is free and works fine.

However, if you follow the instructions you should be able to get it to work

To access the registry in XP, use start - run... - regedit

[Teus de Jong]

Rivrwing,

I wrote these guidelines. Although I give the warning about using the registry editor, it's not that hard to do. The warning is there to remind you that it is your responsibility.

Like Phil says, just start regedit and follow the steps. Several people have done this without problems and SC runs fine.

There are two other ways to solve your problem:

1. Go with the latest sqlite build of SC (7.4). Because no mySQL is involved, this build doesn't have this problem. But of course 7.4 is beta.
2. Change your AV program.

Teus

[rivrwing]

Thansk for the follow ups all, it's clearer to me know.

I'm running vista so i do have a registry backup utility it seems could be good insurance when I do change the registry. Seems very straight forward and the guideline details are excellent Teus!

McAfee came with my dell system. If it had not actually blocked several virus' over the last couple of years I would consider ditching it; additionally i just got an email only yesterday saying that mcAfee just hit me for automatic renewal on my charge card!!

I am going out of town for a few days but will do this registry edit upon return and advise the result. I've had enough bugs that I am nervous about beta upgrade, but will keep it in mind. Thanks again, cheers!

[rivrwing]

Doesn't get much easier than that!! Thanks Teus for the fix!

Thanks as well to the others who replied.

Note to those considering this fix: If this is all new to you fear not, it is easy and works!