PDA

View Full Version : Missing songs



Justme
2006-12-11, 21:49
Hello,

Well, I recently had a corrupted windows partition, and so I had to reinstall XP again, which means slimserver as well. However, now I have a really really weird problem.

Basically, Slimserver cannot find all my music. When doing a search, it seems to give up at some point, always different than before.

One search brings 220 albums, 2675 songs and 545 artists
Another brings 1 Album, 4 songs from 2 artists
then another time 143 albums, 1660 songs from 451 artists

My music collection is on another physical drive, which I know works fine. JRiver Media Center and Itunes have no problems and find 8838 songs.

What is even more odd is this ??? When I change the location in the server settings for where my music is kept, to a subfolder in the music folder which only has 10 songs, it first found 284 songs and now it's only finding 1 (My music is all in a folder called "Music", where each artist has a subfolder.

It doesn't matter if I do a fresh scan (clearing library and then searching) or search for new and changed music

I am using:
SlimServer Version: 6.5.0 - 9916 - Windows XP - EN - cp1252
Server IP address: 127.0.0.1
Perl Version: 5.8.7 MSWin32-x86-multi-thread
MySQL Version: 5.0.22-community-nt

I have tried many latter versions, the last from the 16th Nov and all have the same problem.

Has anyone else seen this?

mherger
2006-12-11, 22:07
> I have tried many latter versions, the last from the 16th Nov and all
> have the same problem.

Please try the very latest. Then run the scan with d_info and d_files
turned on. The log file than should tell you where it stopped.

Do you have playlists lying around in some of the music folders? Probably
playlists pointing at folders or drives that no longer exist?

--

Michael

-----------------------------------------------------------------
http://www.herger.net/SlimCD - your SlimServer on a CD
http://www.herger.net/slim - AlbumReview, Biography, MusicInfoSCR

Justme
2006-12-11, 23:14
Thanks for the reply. I'll try the very latest nightly download when I get back home.

Actually, I do have a playlist folder in the core "music" folder, and it is likely that some of the links may no longer be accurate, although from memory the only two playlists in there were links to radio streaming.

I'm at work at the moment, but will take this folder out when I get home.

But here is the odd thing. As I mentioned before, I changed the "music" folder to one of it's subfolders, an artist called "Alt". There are 13 tracks in this folder (not 10 as I first wrote above). This time, instead of finding 284, it found only 1 song (no artist or album). I then done a number of rescans (where it looks for new music rather than clearing the library).

Each time the number of songs found increased by 1 until I gave up at 17 tracks (more than the 13 in the folder). However, after finding 17 tracks, it also stated 1 artist and 1 album as well.

When checking what it found, it wasn't the band "Alt" which was stored in the folder, but a song from a completely different folder from a band called "Snow Patrol" ??? How on earth did it find this song when it's not even in the folder designated for searching?

The 2nd odd coincidence, is that I had a problem 6months ago approx, where an older version of slimserver couldn't find all my songs. That time, it was the same number each time, so it sounds like a completely different problem. The odd coincidence was that when I created a bug report, I used the same Snow Patrol song as the example of a track it refused to pick up ;O) What's the odds that in 8800 songs, this time around it found in a folder where the song doesn't exist, the very song I used 6 months ago as an example of one it can't find.

That's rather spooky ;O)

mherger
2006-12-12, 03:37
> I'm at work at the moment, but will take this folder out when I get
> home.

That's a good idea. One more thing you could/should do: disable plugins
which could touch the scan process: iTunes, MoodLogic, MusicIP and third
party plugins like LazySearch etc. Reduce your system to the bare naked
minimum. If you get good results, you can add one component after the
other to isolate the problem.

--

Michael

-----------------------------------------------------------------
http://www.herger.net/SlimCD - your SlimServer on a CD
http://www.herger.net/slim - AlbumReview, Biography, MusicInfoSCR

Justme
2006-12-12, 10:55
Thanks again.

Ok, I've fully uninstalled the previous release, deleted the slimserver folder, and have installed the latested slimserver from last night.

I've removed the folder that had the playlists, and I've made sure iTunes is not set on slimserver. I don't know about Moodlogic and MusicIP (where are the settings for these) and I havn't installed any plugins, just the basic installation.

Still have the same problem, although it's better.

It now picked up 7140 songs, heaps more, and just 1698 songs from the total.

I did the log that was suggested and it came up with this, although I'm not terribly sure what it means:

2006-12-12 18:12:15.4218 Aysnc: No DNS servers responded, you may have trouble with network connections. Please check your network settings.
2006-12-12 18:12:31.9823 commit ineffective with AutoCommit enabled at C:\PROGRA~1\SLIMSE~1\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.
2006-12-12 18:12:31.9824 Commmit ineffective while AutoCommit is on at C:\PROGRA~1\SLIMSE~1\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.
2006-12-12 18:12:31.9860 ERROR: DBD::mysql::db commit failed: Commmit ineffective while AutoCommit is on at C:\PROGRA~1\SLIMSE~1\server\CPAN/DBIx/Class/Storage/DBI.pm line 706.

2006-12-12 18:12:31.9861 ERROR: Backtrace follows:

2006-12-12 18:12:31.9863 Backtrace:

frame 0: Slim::Schema::throw_exception (/PerlApp/DBIx/Class/Schema.pm line 606)
frame 1: DBIx::Class::Schema::txn_do (/PerlApp/Slim/Music/Import.pm line 241)
frame 2: (eval) (/PerlApp/Slim/Music/Import.pm line 233)
frame 3: Slim::Music::Import::setIsScanning (/PerlApp/Slim/Music/Import.pm line 152)
frame 4: Slim::Music::Import::launchScan (/PerlApp/Slim/Control/Commands.pm line 1714)
frame 5: Slim::Control::Commands::rescanCommand (/PerlApp/Slim/Control/Request.pm line 1483)
frame 6: (eval) (/PerlApp/Slim/Control/Request.pm line 1483)
frame 7: Slim::Control::Request::execute (/PerlApp/Slim/Control/Request.pm line 772)
frame 8: Slim::Control::Request::executeRequest (C:\PROGRA~1\SLIMSE~1\server/Plugins/iTunes/Plugin.pm line 76)
frame 9: Plugins::iTunes::Plugin::checker (/PerlApp/Slim/Utils/Timers.pm line 181)
frame 10: Slim::Utils::Timers::checkTimers (slimserver.pl line 495)
frame 11: main::idle (slimserver.pl line 445)
frame 12: main::main (slimserver.pl line 58)
frame 13: PerlSvc::Interactive (perlsvc.pl line 1486)
frame 14: PerlSvc::_interactive (slimserver.pl line 0)
frame 15: (eval) (slimserver.pl line 0)

2006-12-12 18:30:28.1093 cracked: http://localhost:9000/ with [localhost],[9000],[/]
2006-12-12 18:30:30.7959 cracked: http://localhost:9000/setup.html?page=BASIC_SERVER_SETTINGS&player=00%3A04%3A20%3A05%3Aa6%3Aab with [localhost],[9000],[/setup.html?page=BASIC_SERVER_SETTINGS&player=00%3A04%3A20%3A05%3Aa6%3Aab]
2006-12-12 18:30:52.5733 cracked: http://localhost:9000/ with [localhost],[9000],[/]

Justme
2006-12-12, 11:55
Hmmm, I spoke too soon.

I tried another full scan, and now it stops at 154 albums, 1774 songs and 460 artists, and any further rescans just increment the number of songs by one (much like described in my first post)

From the debugging log
2006-12-12 19:22:08.5137 Aysnc: No DNS servers responded, you may have trouble with network connections. Please check your network settings.
2006-12-12 19:51:02.9062 cracked: http://localhost:9000/ with [localhost],[9000],[/]
2006-12-12 19:51:06.2763 cracked: http://localhost:9000/setup.html?page=BASIC_SERVER_SETTINGS&player=00%3A04%3A20%3A05%3Aa6%3Aab with [localhost],[9000],[/setup.html?page=BASIC_SERVER_SETTINGS&player=00%3A04%3A20%3A05%3Aa6%3Aab]
2006-12-12 19:54:28.1406 cracked: http://localhost:9000/home.html?player=00%3A04%3A20%3A05%3Aa6%3Aab with [localhost],[9000],[/home.html?player=00%3A04%3A20%3A05%3Aa6%3Aab]
2006-12-12 19:54:31.5859 cracked: http://localhost:9000/ with [localhost],[9000],[/]

mherger
2006-12-12, 15:10
>> From the debugging log

These logs aren't related to the scanning process at all. You should see
entries for every single file that's found. Search the last of those
entries. It might give an indication why and where it fails.

--

Michael

-----------------------------------------------------------------
http://www.herger.net/SlimCD - your SlimServer on a CD
http://www.herger.net/slim - AlbumReview, Biography, MusicInfoSCR

Justme
2006-12-12, 21:54
Once again, thanks for your assistance in solving this weird problem.

Where do I find these entries for each song? The only place I can see on the debugging page is the one link to a logfile near the top of the screen?

mherger
2006-12-13, 03:34
> Where do I find these entries for each song? The only place I can see
> on the debugging page is the one link to a logfile near the top of the
> screen?

Start the scanner manually as described a little up the thread. You can
then define where exactly you want the log to be. It can be viewed and
searched in any text editor.

--

Michael

-----------------------------------------------------------------
http://www.herger.net/SlimCD - your SlimServer on a CD
http://www.herger.net/slim - AlbumReview, Biography, MusicInfoSCR

Justme
2006-12-13, 10:05
Hi Mherger,

Once again, thanks for your persistent help

I hope you don't get too frustrated with my lack of skills here, but I simply don't follow. I'm not sure where this log should appear as I don't get a prompt or see any field which suggests a location.

Although, I suspect it won't help.

There is something really really bizarre going on here. Let me explain.

First of all, it doesn't stop at any particular folder. I have all my music stored in one general folder called "h:\music"

Within that folder are 576 separate sub folders. Each one contains a single artist.

In other words, "h:\music\coldplay" or "h:\music\led zeppelin" etc.

Now, normally the search is set to look in "h:\music", essentially the root of my music files. In the past, this worked perfectly, then all of a sudden, when trying a new nightly release, these problems arose.

Now, although it doesn't find all my songs, it doesn't seem to stop anywhere in particular. It has songs from folders everywhere from A through to Z, it just misses a load throughout.

In fact, I don't think it even cares where it looks. Let's put it this way, and I think this is the core of the problem.

If I set the music folder to search to be "h:\music\snow patrol", we should assume, it will only look in that folder which has music from the band "snow patrol". (61 songs in total). No other bands are in the snow patrol folder.

However, it finds 480 songs, from 135 artists - none of which are actually snow patrol, and none of the mp3's reside in the folder it was supposed to search.

This is the real problem. I mean, why would it find a song like this example below, when it was set to look in this folder for new songs: h:\music\snow patrol (the song it found below is stored in H:\MUSIC\Cold Play)

Title: Clocks
Artist: , , Album: No Album
Genre: , ,
File Format: MP3
Duration: 5:07
Comment: Media Center / 11.0.314 / 5
File Length: 4,921,472 Bytes
Bitrate: 128kbps CBR
Sample Rate: 44.1 kHz
ID3 Tag Version: ID3v2.3.0
Location: H:\MUSIC\Cold Play\Coldplay - Clocks.mp3
Date Modified: Tuesday, October 11, 2005, 10:49:55 AM

Maybe, somehow there is a registry setting that got corrupted, and when I uninstall slimserver, to reinstall again, it doesn't fix this. Is there a forced uninstaller that clears every slimserver registry setting away?

There has to be something really odd here, for it to look into a totally different folder than where it was told to look.

ceejay
2006-12-13, 10:58
One reason it would find music in another folder would be if you have playlists which refer to that other music. In your server settings - basic page, you have places to specify locations for both music library and playlists. Try clearing the "playlists" entry and just specifying a music library location.

also make sure you are not using MusicIP/MusicMagicMixer or iTunes integration - both of those will cause SS to see other music.

Then make sure you are doing a full clear and rescan, not just a scan for new or changed music.

Michael's advice for getting more logging information was referring to running SS from a command prompt. If you are in Windows, get a Commnad Prompt window (usually in Accessories). You will probably need to change to the SS directory:

> cd c:\Program Files\slimserver\server

Then type

> scanner --help

to see the options. For example

> scanner --d_info --d_scan --logfile c:\logfile.txt

which will create a lofile in the name you specify at the end of the line.

If slimserver is stopped you can also start it from the command line in the same way, specifying debug and other flags.

HTH
Ceejay

Justme
2006-12-13, 13:17
Hi ceejay,

Thanks for that extra bit of information. I have run this, and fortunately, for one of the times where it died after 1 song was found. Too long to post here, but here are some interesting excerts -

2006-12-13 21:07:34.5663 ERROR: Scanner: Failed when running main scan: [Carp::Clan::__ANON__(): Error executing 'SELECT me.id, me.titlesort, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_29c_0.MYD' (Errcode: 17) at C:\Program Files\SlimServer\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.
]

2006-12-13 21:07:34.5664 ERROR: Scanner: Skipping post-process & Not updating lastRescanTime!

2006-12-13 21:08:08.1718 Connected to database dbi:mysql:hostname=127.0.0.1;port=9092;database=sl imserver - schema version: [2]
2006-12-13 21:08:08.4333 loading types config file...
2006-12-13 21:08:08.4582 forceCommit: syncing to the database.
2006-12-13 21:08:08.4596 Executing SQL file C:\Program Files\SlimServer\server\SQL\mysql\schema_clear.sql
2006-12-13 21:08:08.4776 Connected to database dbi:mysql:hostname=127.0.0.1;port=9092;database=sl imserver - schema version: [2]
2006-12-13 21:08:08.4786 Executing SQL file C:\Program Files\SlimServer\server\SQL\mysql\schema_optimize. sql
2006-12-13 21:08:08.6351 Starting music folder scan in H:\MUSIC
2006-12-13 21:08:08.6355 About to look for files in H:\MUSIC
2006-12-13 21:08:08.6363 For files with extensions in: [(?i-xsm:\.(?:ape|wma|shn|wav|wave|mp3|mp2|flc|flac|m4a |mov|m4b|mp4|mp+|mpc|ogg|aif|aiff|lnk|cue)$)]
2006-12-13 21:08:13.1875 Found 8869 files in H:\MUSIC
2006-12-13 21:08:13.1903 mp3 file type for file:///H:/MUSIC/Steve%20Earle/Steve%20Earle%20-%20Once%20You%20Love.mp3
2006-12-13 21:08:13.1905
2006-12-13 21:08:13.1905 newTrack(): New Track: [file:///H:/MUSIC/Steve%20Earle/Steve%20Earle%20-%20Once%20You%20Love.mp3]
2006-12-13 21:08:13.1906 newTrack(): readTags is 1
2006-12-13 21:08:13.1912 mp3 file type for H:\MUSIC\Steve Earle\Steve Earle - Once You Love.mp3
2006-12-13 21:08:13.1913 Trying to load Slim::Formats::MP3
2006-12-13 21:08:13.2515 newTrack(): Created track 'Once You Love' (id: [1])
2006-12-13 21:08:13.2518 -- Track is a local track
2006-12-13 21:08:13.2885 -- Track has genre 'Country Rock'
2006-12-13 21:08:13.3251 -- Track has contributor 'Steve Earle' of role 'ARTIST'
2006-12-13 21:08:13.3252 -- Track has 1 contributor(s)
2006-12-13 21:08:13.3254 -- Track primary contributor is 'Steve Earle' (id: [1])
2006-12-13 21:08:13.3255 -- Checking for discs
2006-12-13 21:08:13.3297 ERROR: Error executing 'SELECT me.id, me.titlesort, me.compilation, me.year, me.artwork, me.disc, me.discc, me.musicmagic_mixable, me.titlesearch, me.replay_gain, me.replay_peak, me.musicbrainz_id, me.title FROM albums me LEFT JOIN tracks tracks ON ( tracks.album = me.id ) WHERE ( me.disc IS NULL AND me.discc IS NULL AND me.title = ? AND tracks.url LIKE ? ) GROUP BY me.id': DBD::mysql::st execute failed: Can't create/write to file 'C:\WINDOWS\TEMP\#sql_29c_0.MYD' (Errcode: 17) at C:\Program Files\SlimServer\server\CPAN/DBIx/Class/Storage/DBI.pm line 771.

2006-12-13 21:08:13.3298 ERROR: Backtrace follows:

2006-12-13 21:08:13.3299 Backtrace:

mherger
2006-12-13, 13:27
> Thanks for that extra bit of information. I have run this, and
> fortunately, for one of the times where it died after 1 song was found.

Yes, but this time we got a reason:

> execute failed: Can't create/write to file
> 'C:\WINDOWS\TEMP\#sql_29c_0.MYD' (Errcode: 17) at C:\Program

This is a known problem with antivirus products (McAfee by chance?): have
it ignore *.MYD files.

--

Michael

-----------------------------------------------------------------
http://www.herger.net/SlimCD - your SlimServer on a CD
http://www.herger.net/slim - AlbumReview, Biography, MusicInfoSCR

Justme
2006-12-13, 21:09
McAfee eh. Interesting, as I recently installed that. Would you know the walk around to this?

stinkingpig
2006-12-13, 22:33
On 12/13/06, Justme
<Justme.2isfan1166069401 (AT) no-mx (DOT) forums.slimdevices.com> wrote:
>
> McAfee eh. Interesting, as I recently installed that. Would you know the
> walk around to this?
>

Tell McAfee to whitelist MySQL.

--
"I spent all me tin with the ladies drinking gin,
So across the Western ocean I must wander" -- traditional

Justme
2006-12-14, 12:43
Many thanks to all those who helped me out on this.

I think I have it fixed, that is, all 8800~ songs can be played now.

On McAfee Security Center, I set the "Specify Types of files to scan" on real time scanning, to program files and documents only. This seemed to work. I would have preferred to nail it down just to MySQL or various extensions, but I couldn't figure out how to do this on McAfee Security Center.

cheers!

SheckieC
2006-12-14, 13:31
I just wanted to chime in on this situation also. I've been pulling my hair out for the past week trying to fix the same exact problem. I also configured McAfee Security Center to scan only documents and programs. Voila, all 7,236 songs finally showed up.

Thanks for all the help.

toeknee
2006-12-29, 22:49
I have to chime in too that this seemingly solved my problems too.

My problem was that I would clear and rescan my 22,xxx song library and when it was complete I could play all of the songs. I then would select an Artist and play all their songs (in this case it was 170 songs). After playing a few songs, the last song would suddenly stop. Then on reinspection of my library I had lots of folders "Empty" according to the SB. I repeated this process 3 times consistently.

Directing McAfee in the advanced settings of Security Center to only scan Programs and Documents has seemed to solve this.

This problem "appeared" in the last few days though McAfee has been installed for about a month or so.