PDA

View Full Version : Songs found through Search but not through Browse



strindberg
2007-04-22, 03:00
Yesterday I switched to using Slimserver on Linux (Kubuntu Feisty Fawn), after having run it on Windows for a while. Since setting everyting up on Linux, I notice that many songs are not found when I Browse, although I can find them through Search.

As an example I will use two albums by the Swedish artist David Sandström, although this problem affects a lot of artists in my music library. I choose Sandström since he has the Swedish character "ö" in his name, and I at first suspected this might have something to do with the problem.

If I use the web interface, I click Browse -> Artists -> D -> David Sandström, I get to a page where it says: "1 album with 8 songs by 1 artist." Below the album "Om det inte händer något innan imorgon så kommer jag" is listed. But I have two albums with Sandström!

If I instead go Search -> Search Music, and write sandström, I get "Artists matching "sandström": 1". When I then click on "David Sandström", I get a listing saying: "2 albums with 21 songs by 1 artist." Below the two albums are listed:
" Go Down
Om det inte händer något innan imorgon så kommer jag"

How can it be that Slimserver knows that the second album exists, but doesn't show me both when I browse? This does not happen when I run Slimserver (6.5.1) on Windows, with exactly the same file collection. On Windows, both albums show up through browse.

I tried running the scanning manually to get som clues:
slimserver-scanner --wipe --rescan --d_info --d_scan --logfile=/root/slimscanner.log /var/music

Below I have pasted the first time a song for each album is found. The only difference seems to be that in the "Go down" album song, "David Sandström" is listed as both "BAND", "ARTIST" and "COMPOSER", whereas in the "Om det inte..." album song he only has the role "ARTIST". But in both cases he is recognised as primary contributor (with id 23), so that shouldn't cause any trouble should it?

Please give me some hints into what I can do to resolve this. It looks very much like a bug in eyes, but is there a workaround or fix?


2007-04-22 10:11:58.7173 mp3 file type for file:///var/music/music3/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m%20-%2007%20-%20Det%20Du%20Vill%20Mest.mp3
2007-04-22 10:11:58.7182 ScanDirectory: Adding file:///var/music/music3/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m%20-%2007%20-%20Det%20Du%20Vill%20Mest.mp3 to database.
2007-04-22 10:11:58.7190
2007-04-22 10:11:58.7196 newTrack(): New Track: [file:///var/music/music3/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m%20-%2007%20-%20Det%20Du%20Vill%20Mest.mp3]
2007-04-22 10:11:58.7202 newTrack(): readTags is 1
2007-04-22 10:11:58.7221 mp3 file type for /var/music/music3/David Sandström/David Sandström/David Sandström - 07 - Det Du Vill Mest.mp3
2007-04-22 10:11:58.7803 newTrack(): Created track 'Det Du Vill Mest' (id: [417])
2007-04-22 10:11:58.7816 -- Track is a local track
2007-04-22 10:11:58.7970 -- Track has genre 'Other'
2007-04-22 10:11:58.8141 -- Track has contributor 'David Sandström' of role 'ARTIST'
2007-04-22 10:11:58.8148 -- Track has 1 contributor(s)
2007-04-22 10:11:58.8161 -- Track primary contributor is 'David Sandström' (id: [23])
2007-04-22 10:11:58.8170 -- Checking for discs
2007-04-22 10:11:58.8243 -- Searching for an album with:
2007-04-22 10:11:58.8256 --- tracks.url : {
like => "file:///var/music/music3/David%20Sandstr%C3%B6m/David%20Sandstr%C3%B6m%",
}
2007-04-22 10:11:58.8265 --- me.disc : undef
2007-04-22 10:11:58.8277 --- me.title : "Om det inte h\xE4nder n\xE5got innan imorgon s\xE5 kommer jag"
2007-04-22 10:11:58.8286 --- me.discc : undef
2007-04-22 10:11:58.8339 -- Created album 'Om det inte händer något innan imorgon så kommer jag' (id: [281])
2007-04-22 10:11:58.8428 -- Updating album 'Om det inte händer något innan imorgon så kommer jag' (id: [281]) with columns:
2007-04-22 10:11:58.8434 --- titlesort : OM DET INTE HÄNDER NÅGOT INNAN IMORGON SÅ KOMMER JAG
2007-04-22 10:11:58.8440 --- titlesearch : OM DET INTE HÄNDER NÅGOT INNAN IMORGON SÅ KOMMER JAG
2007-04-22 10:11:58.8447 --- year : 0
2007-04-22 10:11:58.8453 --- contributor : 23
2007-04-22 10:11:58.8480 -- Track has album 'Om det inte händer något innan imorgon så kommer jag' (id: [281])



2007-04-22 10:10:53.9000 mp3 file type for file:///var/music/music3/David%20Sandstr%C3%B6m/Go%20Down/04%20Move%20Along.mp3
2007-04-22 10:10:53.9006 ScanDirectory: Adding file:///var/music/music3/David%20Sandstr%C3%B6m/Go%20Down/04%20Move%20Along.mp3 to database.
2007-04-22 10:10:53.9011
2007-04-22 10:10:53.9015 newTrack(): New Track: [file:///var/music/music3/David%20Sandstr%C3%B6m/Go%20Down/04%20Move%20Along.mp3]
2007-04-22 10:10:53.9019 newTrack(): readTags is 1
2007-04-22 10:10:53.9034 mp3 file type for /var/music/music3/David Sandström/Go Down/04 Move Along.mp3
2007-04-22 10:10:53.9535 newTrack(): Created track 'Move Along' (id: [25])
2007-04-22 10:10:53.9547 -- Track is a local track
2007-04-22 10:10:53.9755 -- Track has genre 'Pop'
2007-04-22 10:10:53.9973 -- Track has contributor 'David Sandström' of role 'ARTIST'
2007-04-22 10:10:54.0142 -- Track has contributor 'David Sandström' of role 'BAND'
2007-04-22 10:10:54.0313 -- Track has contributor 'David Sandström' of role 'COMPOSER'
2007-04-22 10:10:54.0317 -- Track has 3 contributor(s)
2007-04-22 10:10:54.0328 -- Track primary contributor is 'David Sandström' (id: [23])
2007-04-22 10:10:54.0334 -- Checking for discs
2007-04-22 10:10:54.0406 -- Searching for an album with:
2007-04-22 10:10:54.0416 --- tracks.url : {
like => "file:///var/music/music3/David%20Sandstr%C3%B6m/Go%20Down%",
}
2007-04-22 10:10:54.0423 --- me.disc : undef
2007-04-22 10:10:54.0431 --- me.title : "Go Down"
2007-04-22 10:10:54.0438 --- me.discc : undef
2007-04-22 10:10:54.0489 -- Created album 'Go Down' (id: [23])
2007-04-22 10:10:54.0575 -- Updating album 'Go Down' (id: [23]) with columns:
2007-04-22 10:10:54.0579 --- titlesort : GO DOWN
2007-04-22 10:10:54.0584 --- titlesearch : GO DOWN
2007-04-22 10:10:54.0588 --- year : 0
2007-04-22 10:10:54.0593 --- contributor : 23
2007-04-22 10:10:54.0617 -- Track has album 'Go Down' (id: [23])
2007-04-22 10:10:54.0796 -- Contributor 'David Sandström' (id: [23]) linked to album 'Go Down' (id: [23]) with role: 'BAND'
2007-04-22 10:10:54.1012 -- Contributor 'David Sandström' (id: [23]) linked to album 'Go Down' (id: [23]) with role: 'ARTIST'
2007-04-22 10:10:54.1229 -- Contributor 'David Sandström' (id: [23]) linked to album 'Go Down' (id: [23]) with role: 'COMPOSER'



VERSION INFO

SlimServer Version: 6.5.2 - 11782 - Debian - EN - iso-8859-1
Server IP address: 192.168.1.2
Perl Version: 5.8.8 i486-linux-gnu-thread-multi
MySQL Version: 5.0.38-Ubuntu_0ubuntu1

strindberg
2007-04-25, 10:59
Am I really the only one being hit by this? It sure seems like a pretty bad bug to me.

I have done some more experimenting. First of all, I have made sure that all mp3-tags are ID3v2.3, saved in iso-8859-1. I have also toggled all possible settings regarding the grouping of songs in compilation albums, although I don't think this problem has anything to do with that.

Now I have limited my collection to four files, two mp3-files and two flac-files.

The mp3-files belong to two different albums by David Sandström, the flac-files belong to two different albums by Jacques Brel.

After a wipe and rescan, SS reports "Your music library contains 4 albums with 4 songs by 2 artists." So far so good.

If I brows by album (Browse -> Album in the web interface) I see all four albums. The same if I browse by Artists, and then select All Albums.

BUT: when I browse by Artists, and then select either one of the two artists, only one album each is listed, although it should be two for each artist.

So, to recapitulate: SS is well aware of there being four albums, I can reach them through browsing on albums, or through searching, but if I go through the individual artist, only one album is displayed.

This is still SS 6.5.2 on Kubuntu, upgraded through apt-get this evening.

erland
2007-04-25, 11:16
Is it repeatable for all artists, or is it just albums for these two artists that have the problem ?

The swedish character ö could cause problems if the character encodings settings doesn't match everywhere, it still looks strange that the album would disappear though. However, since "Jacques Brel" had the same problem I suspect this isn't the problem.

Did you use a previous SlimServer version before where it worked correctly ?

I have no problem listing several albums for an artist in the Artists menu. I am using 6.5.1 on Ubuntu Dapper, installed with tar.gz distribution.

strindberg
2007-04-25, 22:05
Yes, it is repeatable in the sense that these are not the only artists for which the problem shows up. But it does not happen for every artist with more than one album.

Quickly looking through some folders, I found more examples:
Les Negresses Vertes
Famille Nombreuse (shown)
Mlah (not shown)
Manu Chao
Clandestino (shown)
Proxima Estacion Esperanza (shown)
Radio Bemba Sound System (not shown)

I understand the problem with different encodings, but as you can see above and from earlier examples, it's not really the names that do have non-ascii characters that don't show up, so I don't really think this is the problem. And furthermore, if it were an encoding problem, I guess I shouldn't be able to find the albums through search. To me, it seems as though SS finds the files and knows to which artists/albums they belong, but that there is a problem in the "display by artist"-codde.

This worked on 6.5.1 on Windows. It's when I switched to Ubuntu and then got 6.5.2 through apt that the problem showed up.

Capricorn
2007-04-25, 22:59
I think I've got a similar problem since yesterday.

After a Rescan I'm missing 317 (!) Artists out of 951 in my database. A Wipe and Rescan increased the number of Artists up to 837. Because of the still missing Artists I rescanned again and got again a number of 634 Artists!

Only the album browse menu still shows: "695 discs with 8669 Songs by 951 Artists".

The result is disappointing: I'm no longer able to search for a huge number of songs "by artist".

And for sure: My harddisk of course contents these 951 Artists!

Anybody there with an idea what to do?

Thanks in advance,

Martin

strindberg
2007-05-08, 10:24
Now I have worked out what causes this problem: it is indeed the "Composer" tag in the files which makes Slimserver not display these albums under their respective artist.

This is what happens: if any file in an album is tagged with a "Composer" which is the same as the "Artist", the album does not show up when browsing by artist. The album shows up under "All albums", and also by searching the the artist.

Unless someone can explain why this bizarre behavior is intended, I will file this as a bug. Although it is easy for me to remove the "Composer" tag from my music, I think it is fair that one should be able to have the tag set without the album disappearing from the listings.

Again, this is on a recently updated 6.5.2 on Kubuntu Feisty Fawn. 6.5.1 on Windows does not exhibit the same problem. It does not have anything to do with encodings, as far as I can tell.

Ur[s]uS
2007-05-08, 23:46
If you set up bug, I will vote. I had same error.

http://forums.slimdevices.com/showthread.php?t=34493

I started to remove composer tag - I never read it or use it.

strindberg
2007-05-09, 00:45
OK, I've filed a bug here:
http://bugs.slimdevices.com/show_bug.cgi?id=4979

I must admit I'm a bit surprised by the lack of interest in this issue by the Slimdevices engineers. It seems like a clear bug to me, and a lot of information was presented by us in both these threads. Some response to such detailed problem descriptions would have been appropriate, in my opinion.

kdf
2007-05-09, 00:55
On 9-May-07, at 12:45 AM, strindberg wrote:

>
> OK, I've filed a bug here:
> http://bugs.slimdevices.com/show_bug.cgi?id=4979
>
> I must admit I'm a bit surprised by the lack of interest in this issue
> by the Slimdevices engineers.

might be because they are busy with bug 4925, among others.
bug reports are welcome, crap about lack of interest is not.

-kdf

strindberg
2007-05-09, 01:11
OK, I see my report is a duplicate of 4925. Sorry about that. A one-line response in any of these threads would have helped avoiding it.

adhawkins
2007-05-09, 02:28
Hi,

In article <a52c08f1108960c58a0c106e120d1f71 (AT) deane-freeman (DOT) com>,
kdf<slim-mail (AT) deane-freeman (DOT) com> wrote:
> might be because they are busy with bug 4925, among others.
> bug reports are welcome, crap about lack of interest is not.

Is this related to the bug I submitted? (4957). I submitted it seperately
because I don't use COMPOSER tags, but the symptoms are the same (I can
search for artists, but lots of them don't appear in the browse list).

I'm tracking Subversion 6.x branch, and the problem seemed to appear a
couple of weeks or so ago. I haven't been playing around with my tags in the
meantime, so I'd be surprised if it was something I have done (although I'm
open to be proved wrong).

Andy

kdf
2007-05-09, 07:12
OK, I see my report is a duplicate of 4925. Sorry about that. A one-line response in any of these threads would have helped avoiding it.

As would a cursory search of bugzilla, as suggested on the front page. Even just the word composer would have done it. If you think it's too much time to do that, then maybe you'll have some idea why the other side of it might be a touch too busy to read 300 posts a day. It's not a battle, just an attempt to spread some awareness.
-kdf

kdf
2007-05-09, 07:25
Is this related to the bug I submitted? (4957). I submitted it seperately
because I don't use COMPOSER tags, but the symptoms are the same (I can
search for artists, but lots of them don't appear in the browse list).

I'm tracking Subversion 6.x branch, and the problem seemed to appear a
couple of weeks or so ago. I haven't been playing around with my tags in the
meantime, so I'd be surprised if it was something I have done (although I'm
open to be proved wrong).

Andy


Since the other two reports specifically mention composer, there is some chance it is different. The difference in this case is that the report specifically mentions NO composer tag, so that is a grey area. It might be a different problem, or might be a symptom of the same problem. Pointing out what makes it different is a very good thing in a report, as you have done in this case. You may want to attach a sample song, however, to help in reproducing the problem. After investigation it might get duped in the end if it is the same issue.

As the composer issues seems to be due to a change at r11662, you might try reverting back on svn and see if you can get the correct results after svn update -r11661. I'll make a note on the reports as well.
-kdf

adhawkins
2007-05-09, 08:11
Hi,

In article <kdf.2qblbz1178721001 (AT) no-mx (DOT) forums.slimdevices.com>,
kdf<kdf.2qblbz1178721001 (AT) no-mx (DOT) forums.slimdevices.com> wrote:
> As the composer issues seems to be due to a change at r11662, you might
> try reverting back on svn and see if you can get the correct results
> after svn update -r11661. I'll make a note on the reports as well.

I've just had a note on my bug to try that revision. I've updated
(down-dated? :) ) and am re-scanning now.

All my music is single album FLAC files, so they're a bit big (the smallest
that is affected is 80 odd meg).

I'll let you know how I get on (here and in the bug report).

Andy

kdf
2007-05-09, 08:29
On 9-May-07, at 8:11 AM, Andy Hawkins wrote:

>
> All my music is single album FLAC files, so they're a bit big (the
> smallest
> that is affected is 80 odd meg).
>
there was a tool posted a long while ago to strip and store headers
from flac files for just this purpose.
I think it was from Robin Bowes, but I don't know the name of the
script. Search may help.

> I'll let you know how I get on (here and in the bug report).
>
good stuff :)
-kdf

adhawkins
2007-05-09, 08:50
Hi,

In article <49e01c0650fbcd5ec29c435b86ac4b33 (AT) deane-freeman (DOT) com>,
kdf<slim-mail (AT) deane-freeman (DOT) com> wrote:
> there was a tool posted a long while ago to strip and store headers
> from flac files for just this purpose.
> I think it was from Robin Bowes, but I don't know the name of the
> script. Search may help.

Well, I can just send you the tags if that's of help?

metaflac --export-tags-to=file file.flac will do that

>> I'll let you know how I get on (here and in the bug report).
>>
> good stuff :)

Hmm...I'm not so sure. Just updated the bug with my findings.

In summary, one of the artists has re-appeared, but there are lots missing
(unless I'm misunderstanding how artists on compilation albums show up).

Hmm...(trying stuff out as I type this). It appears that artists that appear
on compilation albums don't get listed in the artists list.

The only difference between the way Sam Brown's albums are tagged (the
artist that has just re-appeared) is that her albums include an
'ALBUMARTIST' tag, whereas none of my others do (do to another bug I'm
waiting to be fixed - #4582). I have removed the ALBUMARTIST tags from all my other
artists but left them in Sam Brown's albums so that I can tell if that bug
has been fixed or not.

I'll update to the latest SVN again and see if Sam Brown disappears. If she
does, I'll remove the ALBUMARTIST tag from her albums and see if that makes
her re-appear.

Will report back.

Andy

adhawkins
2007-05-09, 09:27
Hi,

In article <slrnf43rf1.917.andy (AT) gently (DOT) org.uk>,
Andy Hawkins<andy (AT) gently (DOT) org.uk> wrote:
> Will report back.

Ok, I've just done some tests, and updated the bug. For information, this is
what I've added:

Ok, I think this is related to the ALBUMARTIST tag. Due to bug #4582, I have
removed ALBUMARTIST tags from all of my albums with the exception of Sam
Brown (so that I can see when this other bug is fixed). It appeared that Sam
Brown was in fact the only artist that was missing (all the others are
artists that only appear in compilation albums, and hence aren't shown).

So, here's what I did:

1. Update to latest subversion - Sam Brown disappears
2. Remove ALBUMARTIST tags from all Sam Brown albums - Sam Brown re-appears
3. Put the ALBUMARTIST tags back in to all Sam Brown albums - Sam Brown
disappears again

This does seem to tie up with the other bug kdf mentioned (#4925), I'm
assuming that ALBUMARTIST is another contributor role, and that is what's
messing up the browse list..

Hopefully the fix for the other bug (once it makes it into Subversion) will
also fix the problem I'm seeing.

Make sense?

Andy

strindberg
2007-05-09, 10:12
As would a cursory search of bugzilla, as suggested on the front page. Even just the word composer would have done it. If you think it's too much time to do that, then maybe you'll have some idea why the other side of it might be a touch too busy to read 300 posts a day. It's not a battle, just an attempt to spread some awareness.
-kdf

I have debated with myself for a couple of hours whether I should reply to this or not. Let me first state that I have no intention of starting a flame war. Squeezebox and Slimserver seem to be terrific products that I am in the process of learning how to use to the best effect. Moreover, the large community of experienced users greatly adds to the attraction. I can also see that kdf is one of the more active and helpful people here.

I also realize that I have made (at least) three mistakes in reporting this bug:

* I should have put my initial post in the Bugs forum, that would probably have been more visible to the Slimdevices engineers. The reason why I didn't was that it wasn't entirely clear to me that this was a bug. The number of options for displaying artists is quite great, and I didn't know if I had set some option the wrong way.

* I should have realized that 6.5.2 is indeed in beta. I didn't, until recently. I just picked up the deb version which seemed most recent, when I configured my new system a couple of weeks ago.

* I should of course have checked for previous bug reports on this issue. The reason why I didn't was that during the three weeks since my initial post, noone had suggested that this was a known issue. When I wrote my first post, I didn't even know there was a public bug report system.

BUT, if I now have stated what I have learned from this, let me also say this:

The initial reports in both these threads were made by people who obviously had put some effort into the issue: both Ur[s]uS and myself included quite a lot of information in our posts, trying to outline what we hade done to explore the problem. Neither one got any reply indicating that this was a known issue, although the first bug report was filed three weeks ago.

When I then (quite politely, IMHO) complained about this lack of response in these forums, which supposedly is the main way of providing support to users, I was met with insults by a senior member.

My only observation is that if users reporting issues in these forums first are ignored, then insulted, SlimDevices do have a problem, whether or not people here feel it is appropriate. Not every (potential) user of Slimdevices' products can be expected to know what it means to file a bug report, or even ask questions in the right way. That even moderately knowledgeable users like myself fail to get help is not good for Slimdevices, even if I made some mistakes in reporting this issue.

kdf
2007-05-09, 10:38
strindberg,

I do not and will not take issue with any of your points. I have no issue with you feeling left out because you didn't get a response. What I do have issue with is the inference that it was due to "lack of interest" as opposed to what you now state as "lack of response". That is an unfair judgment against very hard working people. I chose to assume it was a lack of awareness as opposed to a lack of respect leading to a poor choice of words.

Slim server is open source, and relies on the charity of many to make it happen. I'm still here because I'm stubborn, but not everyone is. An atmosphere of disrespect is also not good for slim devices who, despite now being backed by a large company like Logitech, are still relying on the good will of third party developers. Sometimes miss responding to every thread, but if it's a recurring issue limited time cannot be given to respond to every recurrence.

Sorry that you feel insulted. That is all for me on this thread.
-kdf

Marc Sherman
2007-05-09, 11:24
strindberg wrote:
>
> When I then (quite politely, IMHO) complained about this lack of
> response in these forums, which supposedly is the main way of providing
> support to users, I was met with insults by a senior member.
>

You're mistaken about that. This is not support (AT) slimdevices (DOT) com. This is
a _user_ community forum.

- Marc

Ur[s]uS
2007-05-09, 14:01
strindberg,

I do not and will not take issue with any of your points. I have no issue with you feeling left out because you didn't get a response. What I do have issue with is the inference that it was due to "lack of interest" as opposed to what you now state as "lack of response". That is an unfair judgment against very hard working people. I chose to assume it was a lack of awareness as opposed to a lack of respect leading to a poor choice of words.

Slim server is open source, and relies on the charity of many to make it happen. I'm still here because I'm stubborn, but not everyone is. An atmosphere of disrespect is also not good for slim devices who, despite now being backed by a large company like Logitech, are still relying on the good will of third party developers. Sometimes miss responding to every thread, but if it's a recurring issue limited time cannot be given to respond to every recurrence.

Sorry that you feel insulted. That is all for me on this thread.
-kdf


thanks for responding - i'm a big fan, of the device, how it works and of feedback from people like you

it's a pity there is so much grief on the boards (of late) - it has two consequences in my book: (i) serious contributors get taken for granted and leads to "short" responses; and (ii) well researched queries can fall beneath the radar

i guess its a feature of market penetration

oddly, thought i had checked the bugzilla first - pah!