PDA

View Full Version : Scanner.exe error, incomplete library



mftech
2007-05-25, 09:48
Here's my problem:
Since the last two days, Slimserver doesn't scan my library properly.
I got around 1070 albums and Slimserver report only 41 albums,
with no albums cover.
Re-Scanning the entire database don't work.
I re-install Slimserver several times with no improvement, only once I get reported 400 albums.
I re-boot several time my pc.
I don't see any *.db file in the Slimserver folder.

Windows report the following error:

Program error:
scanner.exe has generated errors and will be closed by Windows.
You need to restart the program.
An error log is being created.

But I can't see any error reported in the slimserver folder or by the Windows event viewer.

It's clear that the scanning process is interrupted.

Here's more information about my set-up:
>My collection is mostly encoded in Flac
>I'm using a 500G Hard Drive (around 350G used)
>I'm running Slimserver on Windows 2000 SP2
>Slim Tech info report the following:

SlimServer Version: 6.5.2 - 12047 - Windows 2000 - EN - cp1252
Server IP address: 192.168.1.155
Perl Version: 5.8.8 MSWin32-x86-multi-thread
MySQL Version: 5.0.22-community-nt

Any help will be appreciated.
Hoping that new version of Slimserver will be more stable and robust...

Siduhe
2007-05-25, 11:05
If this has only happened in the last couple of days, I would think what else has changed with your set up which could cause this. Or do you mean that you installed 6.5.2 for the first time a couple of days ago?

Have you ripped any new music or made any other changes? The fact it only reports 41 albums suggests it is getting stuck somewhere. You could try enabling the debugging flag D_scan, then doing a full clear and rescan and seeing what comes up in the Slimserver log?

I've seen this kind of behaviour once - the database file seemed to have become corrupt and couldn't be written to. Stopping Slimserver, deleting the entire cache directory, then starting Slimserver back up did the trick for me.

HTH

kdf
2007-05-25, 11:33
Quoting mftech <mftech.2r5ehb1180111801 (AT) no-mx (DOT) forums.slimdevices.com>:


> Windows report the following error:
>
> Program error:
> scanner.exe has generated errors and will be closed by Windows.
> You need to restart the program.
> An error log is being created.
>
It would seem that something in the library is causing the scanner to
fail prematurely. There are known issues that can cause this, some
involving artwork.

Try running the scanner from the command prompt like so:

"c:\program files\slimserver\server\scanner.exe" --wipe --d_scan
--d_import <musicfolder>

replace <musicfolder> with the location you have for your music. This
will spit out a continual update of the scan progress which will
hopefully narrow down which point in the scan is causing the crash.
It may be a single file, which you can remove and then complete the
scan. We can then take a look at what might be causing the problem
from the one file.

-kdf

mudbone
2007-05-25, 12:02
kdf, any idea how to force a scan on a network drive? (\\192.168.1.94\media\)

I have a similar problem to the thread starters.

13,183 songs, scanner stops at 13148.

Dave-

kdf
2007-05-25, 12:50
Quoting mudbone <mudbone.2r5kqb1180119901 (AT) no-mx (DOT) forums.slimdevices.com>:

>
> kdf, any idea how to force a scan on a network drive?
> (\\192.168.1.94\media\)
>
> I have a similar problem to the thread starters.

I should expect it to work like any other path:

c:\program files\slimserver\server\scanner.exe --wipe
\\192.168.1.94\media --d_scan --d_import

If there is a name assigned to that IP, it should also work assuming
permissions are set to allow it. When you run the scanner from a
command line, it is running as the currently logged in user rather
than a system service.

-kdf

mudbone
2007-05-25, 14:18
That didn't work but let me ask another question:

How would one get the file names to spit out in the logfile running a scan?

In Server Settings>Debugging> Options d_scan & d_import?

I seem to have a bad file or tag which I cannot seem to find.

Any help would be greatly appreciated.

Sorry for the threadcrap. Perhaps I should have started my own thread.

kdf
2007-05-25, 14:39
strange that it didn't work. Worked ok finding a file in a test folder I just tried out here.

d_scan will show the files, d_import will show the information about which step in the scanning is active and the results. d_info will show the content of the metadata being gathered.

-kdf

mudbone
2007-05-25, 14:53
Perhaps I'm misunderstanding how to use CLI.

I'm running Win XP SP2. Don't I simply go to a "C:" prompt through Accessories to get there and enter the string?

Anoop M.
2007-05-25, 15:31
To get a better idea what's crashing it, can you try the following:

* Make sure Slimserver is running. (but don't do a rescan.)

* On your PC, open a DOS window. Go to Start > Run, type "cmd" and click Okay.

In the DOS box, change directories to the Slimserver install directory, in particular where the server executable is.

The default is C:\Program Files\Slimserver\Server. So, type:

> cd \

> cd Program Files

> cd Slimserver

> cd server

Next, type in

> scanner.exe --wipe --d_import --d_server --d_scan --logfile=C:\slimserver.log

This starts the scanner manually with text output sent to a file. If it hits an error, the log will reflect it.

Lastly, can you email me that log file?
Send the file to me at support AT slimdevices DOT com. I will see what I can figure out by looking at your log.

mudbone
2007-05-25, 15:38
To get a better idea what's crashing it, can you try the following:

* Make sure Slimserver is running. (but don't do a rescan.)

* On your PC, open a DOS window. Go to Start > Run, type "cmd" and click Okay.

In the DOS box, change directories to the Slimserver install directory, in particular where the server executable is.

The default is C:\Program Files\Slimserver\Server. So, type:

> cd \

> cd Program Files

> cd Slimserver

> cd server

Next, type in

> scanner.exe --wipe --d_import --d_server --d_scan --logfile=C:\slimserver.log

This starts the scanner manually with text output sent to a file. If it hits an error, the log will reflect it.

Lastly, can you email me that log file?
Send the file to me at support AT slimdevices DOT com. I will see what I can figure out by looking at your log.

Thanks!

I had this problem earlier (a month of so ago) and started a thread with little success.

At that time I moved my files to individual folders and scanned each. That worked. When I placed them all in the original folder the scan failed again. I kept removing "newer" files til I got a decent scan. I never moved the "pulled" files back to my music folder. Now it's happened again.

The scan will take 8 hours so it will probably be tomorrow before I have a logfile for you.

Dave-

mudbone
2007-05-25, 16:24
Logfile emailed.

Oddly I noticed this:

on the SS Home page:

Your music library contains 835 albums with 13149 songs by 1608 artists.

On the ALBUMS page:

835 albums with 13148 songs by 1608 artists.

Not the same number of songs.

Thanks again,
Dave-

mftech
2007-05-25, 21:10
To get a better idea what's crashing it, can you try the following:

* Make sure Slimserver is running. (but don't do a rescan.)

* On your PC, open a DOS window. Go to Start > Run, type "cmd" and click Okay.

In the DOS box, change directories to the Slimserver install directory, in particular where the server executable is.

The default is C:\Program Files\Slimserver\Server. So, type:

> cd \

> cd Program Files

> cd Slimserver

> cd server

Next, type in

> scanner.exe --wipe --d_import --d_server --d_scan --logfile=C:\slimserver.log

This starts the scanner manually with text output sent to a file. If it hits an error, the log will reflect it.

Lastly, can you email me that log file?
Send the file to me at support AT slimdevices DOT com. I will see what I can figure out by looking at your log.


Hi Anoop, sorry for the late reply,
it's seems that I'm not able to create the requested log file.
Here's a copy from cmd:


C:\Program Files\SlimServer\server>scanner.exe --wipe --d_import --d_server --d_
scan --logfile=C\slimserver.log
Can't write to >>C\slimserver.log: No such file or directory at /PerlApp/Slim/Ut
ils/Misc.pm line 1121, <DATA> line 164.
2007-05-25 23:56:08.5054 Got to the END.
2007-05-25 23:56:08.5058 Got sigint.
2007-05-25 23:56:08.5075 SlimServer scanner cleaning up.

Thanks for your help.
You could contact directly me at mftech@videotron.ca if necessary.
Regards
Michel

kdf
2007-05-25, 22:29
On 25-May-07, at 9:10 PM, mftech wrote:
>
> C:\Program Files\SlimServer\server>scanner.exe --wipe --d_import
> --d_server --d_
> scan --logfile=C\slimserver.log
> Can't write to >>C\slimserver.log: No such file or directory at
> /PerlApp/Slim/Ut
>
you've missed a colon in the logfile path (c:\slimserver.log, not
c\slimserver.log) :

C:\Program Files\SlimServer\server>scanner.exe --wipe
--d_import--d_server --d_scan --logfile=c:\slimserver.log

-kdf

dweezil
2007-05-26, 06:34
I have the same problem here - ran with the debug as described above and it reports...

2007-05-26 10:33:59.2187 Import: Starting mergeVariousArtistsAlbums().
2007-05-26 10:33:59.9843 ERROR: Error executing 'SELECT me.id, me.url, me.content_type, me.title, me.titlesort, me.titlesearch, me.album, me.tracknum, me.timestamp, me.filesize, me.disc, me.thumb, me.remote, me.audio, me.audio_size, me.audio_offset, me.year, me.secs, me.cover, me.vbr_scale, me.bitrate, me.samplerate, me.samplesize, me.channels, me.block_alignment, me.endian, me.bpm, me.tagversion, me.drm, me.moodlogic_id, me.moodlogic_mixable, me.musicmagic_mixable, me.musicbrainz_id, me.playcount, me.lastplayed, me.lossless, me.lyrics, me.rating, me.replay_gain, me.replay_peak, contributorTracks.role, contributorTracks.contributor, contributorTracks.track FROM tracks me LEFT JOIN contributor_track contributorTracks ON ( contributorTracks.track = me.id ) WHERE ( ( ( contributorTracks.role = ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_15f4_0.MYD' (Errcode: 13) at C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.

2007-05-26 10:33:59.9849 ERROR: Backtrace follows:

2007-05-26 10:33:59.9854 Backtrace:

frame 0: Slim::Schema::Storage::throw_exception (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 773)
frame 1: DBIx::Class::Storage::DBI::_execute (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 826)
frame 2: DBIx::Class::Storage::DBI::_select (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI/Cursor.pm line 79)
frame 3: DBIx::Class::Storage::DBI::Cursor::next (C:\program files\slimserver\server\CPAN/DBIx/Class/ResultSet.pm line 701)
frame 4: DBIx::Class::ResultSet::next (/PerlApp/Slim/Schema.pm line 1210)
frame 5: Slim::Schema::mergeVariousArtistsAlbums (/PerlApp/Slim/Music/Import.pm line 312)
frame 6: Slim::Music::Import::runScanPostProcessing (scanner.pl line 192)
frame 7: main::__ANON__ (/PerlApp/DBIx/Class/Schema.pm line 584)
frame 8: (eval) (/PerlApp/DBIx/Class/Schema.pm line 572)
frame 9: DBIx::Class::Schema::txn_do (scanner.pl line 192)
frame 10: (eval) (scanner.pl line 192)
frame 11: main::main (scanner.pl line 312)

2007-05-26 10:34:00.3614 ERROR: Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.url, me.content_type, me.title, me.titlesort, me.titlesearch, me.album, me.tracknum, me.timestamp, me.filesize, me.disc, me.thumb, me.remote, me.audio, me.audio_size, me.audio_offset, me.year, me.secs, me.cover, me.vbr_scale, me.bitrate, me.samplerate, me.samplesize, me.channels, me.block_alignment, me.endian, me.bpm, me.tagversion, me.drm, me.moodlogic_id, me.moodlogic_mixable, me.musicmagic_mixable, me.musicbrainz_id, me.playcount, me.lastplayed, me.lossless, me.lyrics, me.rating, me.replay_gain, me.replay_peak, contributorTracks.role, contributorTracks.contributor, contributorTracks.track FROM tracks me LEFT JOIN contributor_track contributorTracks ON ( contributorTracks.track = me.id ) WHERE ( ( ( contributorTracks.role = ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_15f4_0.MYD' (Errcode: 13) at C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.

2007-05-26 10:34:00.3620 ERROR: Backtrace follows:

2007-05-26 10:34:00.3624 Backtrace:

frame 0: Slim::Schema::throw_exception (/PerlApp/DBIx/Class/Schema.pm line 606)
frame 1: DBIx::Class::Schema::txn_do (scanner.pl line 192)
frame 2: (eval) (scanner.pl line 192)
frame 3: main::main (scanner.pl line 312)


Any ideas

HELP!!!!!!!!!!!!!!!!!!!!!

mudbone
2007-05-26, 06:38
I will have to send a new logfile.

Seems SS thought scanning was complete. It was not therefore I emailed an incomplete logfile. Task Manager showed it was still running. I had to do another scan overnight.

Everything seemed to work well until the completion when I got this:

2007-05-25 23:28:10.9645 Import: Starting findArtwork().
2007-05-26 08:10:45.4687 Import: Completed findArtwork Scan in 31354 seconds.
2007-05-26 08:10:45.4811 Import: Starting Database optimization.
2007-05-26 08:10:45.4888 Import: Start schema_optimize
Issuing rollback() for database handle being DESTROY'd without explicit disconnect() at C:\Program Files\SlimServer\server/Slim/Schema/Storage.pm line 31.
2007-05-26 08:11:03.6250 Import: End schema_optimize
2007-05-26 08:11:03.6252 Import: Completed dbOptimize Scan in 18 seconds.
2007-05-26 08:11:03.6254 Import: Finished background scanning.
commit ineffective with AutoCommit enabled at C:\Program Files\SlimServer\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.
Commmit ineffective while AutoCommit is on at C:\Program Files\SlimServer\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.
2007-05-26 08:11:03.6263 ERROR: DBD::mysql::db commit failed: Commmit ineffective while AutoCommit is on at C:\Program Files\SlimServer\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.

2007-05-26 08:11:03.6265 ERROR: Backtrace follows:

2007-05-26 08:11:03.6355 Backtrace:

frame 0: Slim::Schema::throw_exception (/PerlApp/DBIx/Class/Schema.pm line 606)
frame 1: DBIx::Class::Schema::txn_do (scanner.pl line 192)
frame 2: (eval) (scanner.pl line 192)
frame 3: main::main (scanner.pl line 312)

2007-05-26 08:11:04.0005 Got to the END.
2007-05-26 08:11:04.0008 Got sigint.
2007-05-26 08:11:04.0010 SlimServer scanner cleaning up.

dweezil
2007-05-26, 06:40
LOG EMAILED TO support AT slimdevices DOT com

mudbone
2007-05-26, 06:49
LOG EMAILED TO support AT slimdevices DOT com

I've rec'd an email from Anoop. These issues won't be looked at til Tuesday due to the US Memorial Day holiday.

I've sent a correct logfile as well.

Dave-

dweezil
2007-05-26, 08:11
From another thread...

"I had the same problem with lost artists and lost albums. Apparently, this is a known problem with the 6.5.2 release. I downloaded yesterday's nightly 6.5.3, installed and rescanned and there were all my missing artists/albums! My guess is that we will see an official 6.5.3 release fairly soon."

Will try it and report back!

mudbone
2007-05-26, 08:15
From another thread...

"I had the same problem with lost artists and lost albums. Apparently, this is a known problem with the 6.5.2 release. I downloaded yesterday's nightly 6.5.3, installed and rescanned and there were all my missing artists/albums! My guess is that we will see an official 6.5.3 release fairly soon."

Will try it and report back!

Thanks! There seem to be many threads on "missing" files.

My experience with 6.5.2 is that I get the backtrace error EVERYTIME I try to use one of the debugging options.

I went back to 6.5.1.

The scan takes 8-9 hours for me.

Look at this time:

2007-05-25 23:28:10.9645 Import: Starting findArtwork().
2007-05-26 08:10:45.4687 Import: Completed findArtwork Scan in 31354 seconds.

I don't even use artwork.

Hopefully, we can get these issues resolved.

Dave-

kdf
2007-05-26, 10:24
On 26-May-07, at 6:34 AM, dweezil wrote:
>
> ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track':
> DBD::mysql::st execute failed: Can't create/write to file
> 'C:\WINDOWS\TEMP\#sql_15f4_0.MYD' (Errcode: 13) at C:\program
> files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.
>

This is usually caused by the database temp files being locked by a
viruscanner. Mysql doesn't like that.
If you do have a virus scanner, set it to exclude scanning on *.MYI and
*.MYD files.

-kdf

kdf
2007-05-26, 10:26
On 26-May-07, at 6:40 AM, dweezil wrote:

>
> Is any one from Slim Devices actually reading this?
>
If Slim Devices people are the only ones you want to communicate with,
then you should use support (AT) slimdevices (DOT) com

This is a user forum, so while SD employees do take part, it is
primarily for user to user support.

-kdf

dweezil
2007-05-26, 10:58
Tried last nights build SlimServer Version: 6.5.3 - 12135 - Windows XP - EN - cp1252 and the missing albums are back. Well some are the VA are still patchy and the log says...

2007-05-26 18:53:32.5781 Import: Starting mergeVariousArtistsAlbums().
2007-05-26 18:53:33.4218 ERROR: Error executing 'SELECT me.id, me.url, me.content_type, me.title, me.titlesort, me.titlesearch, me.album, me.tracknum, me.timestamp, me.filesize, me.disc, me.thumb, me.remote, me.audio, me.audio_size, me.audio_offset, me.year, me.secs, me.cover, me.vbr_scale, me.bitrate, me.samplerate, me.samplesize, me.channels, me.block_alignment, me.endian, me.bpm, me.tagversion, me.drm, me.musicmagic_mixable, me.musicbrainz_id, me.playcount, me.lastplayed, me.lossless, me.lyrics, me.rating, me.replay_gain, me.replay_peak, contributorTracks.role, contributorTracks.contributor, contributorTracks.track FROM tracks me LEFT JOIN contributor_track contributorTracks ON ( contributorTracks.track = me.id ) WHERE ( ( ( contributorTracks.role = ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_bbc_0.MYD' (Errcode: 13) at C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.

2007-05-26 18:53:33.4227 ERROR: Backtrace follows:

2007-05-26 18:53:33.4233 Backtrace:

frame 0: Slim::Schema::Storage::throw_exception (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 773)
frame 1: DBIx::Class::Storage::DBI::_execute (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 826)
frame 2: DBIx::Class::Storage::DBI::_select (C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI/Cursor.pm line 79)
frame 3: DBIx::Class::Storage::DBI::Cursor::next (C:\program files\slimserver\server\CPAN/DBIx/Class/ResultSet.pm line 701)
frame 4: DBIx::Class::ResultSet::next (/PerlApp/Slim/Schema.pm line 1212)
frame 5: Slim::Schema::mergeVariousArtistsAlbums (/PerlApp/Slim/Music/Import.pm line 312)
frame 6: Slim::Music::Import::runScanPostProcessing (scanner.pl line 186)
frame 7: main::__ANON__ (/PerlApp/DBIx/Class/Schema.pm line 584)
frame 8: (eval) (/PerlApp/DBIx/Class/Schema.pm line 572)
frame 9: DBIx::Class::Schema::txn_do (scanner.pl line 186)
frame 10: (eval) (scanner.pl line 186)
frame 11: main::main (scanner.pl line 304)

2007-05-26 18:53:33.8305 ERROR: Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.url, me.content_type, me.title, me.titlesort, me.titlesearch, me.album, me.tracknum, me.timestamp, me.filesize, me.disc, me.thumb, me.remote, me.audio, me.audio_size, me.audio_offset, me.year, me.secs, me.cover, me.vbr_scale, me.bitrate, me.samplerate, me.samplesize, me.channels, me.block_alignment, me.endian, me.bpm, me.tagversion, me.drm, me.musicmagic_mixable, me.musicbrainz_id, me.playcount, me.lastplayed, me.lossless, me.lyrics, me.rating, me.replay_gain, me.replay_peak, contributorTracks.role, contributorTracks.contributor, contributorTracks.track FROM tracks me LEFT JOIN contributor_track contributorTracks ON ( contributorTracks.track = me.id ) WHERE ( ( ( contributorTracks.role = ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_bbc_0.MYD' (Errcode: 13) at C:\program files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.

2007-05-26 18:53:33.8311 ERROR: Backtrace follows:

2007-05-26 18:53:33.8315 Backtrace:

frame 0: Slim::Schema::throw_exception (/PerlApp/DBIx/Class/Schema.pm line 606)
frame 1: DBIx::Class::Schema::txn_do (scanner.pl line 186)
frame 2: (eval) (scanner.pl line 186)
frame 3: main::main (scanner.pl line 304)

dweezil
2007-05-26, 11:00
On 26-May-07, at 6:34 AM, dweezil wrote:
>
> ? ) AND ( me.album = ? ) ) ) ORDER BY contributorTracks.track':
> DBD::mysql::st execute failed: Can't create/write to file
> 'C:\WINDOWS\TEMP\#sql_15f4_0.MYD' (Errcode: 13) at C:\program
> files\slimserver\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.
>

This is usually caused by the database temp files being locked by a
viruscanner. Mysql doesn't like that.
If you do have a virus scanner, set it to exclude scanning on *.MYI and
*.MYD files.

-kdf

Giving it a try with those exclusions...

kdf
2007-05-26, 11:04
no need to cross post log pastes, please. I've answered your other one
and repeated an earlier suggestion.

cheers,
kdf

mftech
2007-05-30, 10:46
I send my log files to support but I didn't get any feedback yet...

In the mean time I un-install and re-install several times the daily build and the current 6.5.2 build.

I un-install and re-install the latest fix for Win2K (KB927891).
none of this operations cure the problem.

The scanning of my music collection was still incomplete.

By creating a main folder and including all my separate folders one by one I was able to get a proper scanning.

Here's what I did:

>Create a main folder call My_Music

>Move my music folder (rock,jazz,blues..) one by one into the main folder call My_Music

>In Slimserver I select the complete re-scan

>Slimserver re-scan properly my Rock music folder

>I did the same process with all the other folder (moving them one at the time)

>I finally end up with the proper amount of albums (about 1020)

It's hard to tell if moving all my music folders inside a common folder solve the problem completely.
I found one of my classic album that was corrupted.
I didn't notice having problems with this particular album before.

Most of my cover album are visible, but some didn't update correctly (no thumbnail)

So far so good...hoping that Slimserver will get more reliable in future release.

Thanks to everyone associated with this thread.