[Announce] Music Similarity DSTM mixer

[bakker_be]

Well, if you do just Bliss+Musly, you could probably analyse that in about 10-12hrs. Essentia is the really slow one - so hopefully you have cached the Essentia output (in which case the analyser will just read the JSON files). Perhaps I should make caching of this output the default.

Nope, scrapped it all

[cpd73]

Nope, scrapped it all

Oops! Well, in that case I'd be tempted to do just Bliss and Musly, and see how that goes. You can always run Essentia afterwards.

[bakker_be]

Oops! Well, in that case I'd be tempted to do just Bliss and Musly, and see how that goes. You can always run Essentia afterwards.

I did that, been running it with only Bliss & Musly, in a 50/50 "simplemixed" simalgo, while analysing with Essentia in the background. I've got a rather balanced mix out of it (see attached playlist, 351 tracks Simalgo_50-50_B+M.txt), quite like what I would've had with MusicIP & Spicefly SugarCube. I launched it the same way I would have in that previous mixing scenario:

1. Get a random list of albums
2. pick one that suits my current mood
3. set it to play
4. let DSTM pick up after that

In the meantime, I've been running the Essentia Analysis. I'll be playing some with the simalgo, and its different mixing algorithms as well as the mixer ratios.

Correction: I was mistaken about the used algorithm, seems it was running in "default" mode

[Paul Webster]

I haven't tried any of the music similarity stuff yet.
I have a question though ... what would happen if MP3 (or potentially FLAC) with associated .cue (or possibly embedded cue for flac) is part of the source where the audio file has a lot of songs in it and their position is marked by the cue contents?

Image a chart countdown with lots of different sorts of songs in it.

LMS allows individual songs to be selected and played but would the music analysis tools know to split into tracks?

[bakker_be]

I haven't tried any of the music similarity stuff yet.
I have a question though ... what would happen if MP3 (or potentially FLAC) with associated .cue (or possibly embedded cue for flac) is part of the source where the audio file has a lot of songs in it and their position is marked by the cue contents?

Image a chart countdown with lots of different sorts of songs in it.

LMS allows individual songs to be selected and played but would the music analysis tools know to split into tracks?

I'll leave Craig to answer this in detail, but while troubleshooting my installation I've seen that there is code in there to handle CUE-sheets. As I don't have any myself, I'm unable to give you further info.

[cpd73]

I haven't tried any of the music similarity stuff yet.
I have a question though ... what would happen if MP3 (or potentially FLAC) with associated .cue (or possibly embedded cue for flac) is part of the source where the audio file has a lot of songs in it and their position is marked by the cue contents?

Image a chart countdown with lots of different sorts of songs in it.

LMS allows individual songs to be selected and played but would the music analysis tools know to split into tracks?

Yes, if the analyser finds a ".cue" with the exact same name as an audio file (e.g. Album.cue and Album.m4a) then it will query LMS's DB (if set in config.json) for all the tracks contained within. It will then create temporary mp3 files to analyse (and remove afterwards). These files are named (e.g.) "Album.m4a.CUE_TRACK.0-215.44.mp3" - numbers after CUE_TRACK are the start and stop times.

[mruddo]

Perhaps if you could install WSL you could try using bliss instead of musly?

Well that was the plan today... I've installed WSL, extracted the latest music-similarity-master files as required, and used the following config.json:

{
 "paths":{
  "db":"~/music-similarity/",
  "local":"/mnt/m/TestLibrary"
 }
}

With the idea of music-similarity populating the database in the music-similarity folder under my home path. I've done nothing with essentia this time - so as far as I know it should be Bliss only.

But when I attempt to run the analysis I get a total failure of all files. i.e:

mruddo@M:~/music-similarity-master$ ./music-similarity.py --analyse m -l DEBUG
2022-02-13 14:34:53 D (Defaults) musly.lib set to linux/x86-64/libmusly.so
2022-02-13 14:34:53 D (Defaults) essentia.extractor set to /home/mruddo/music-similarity-master/linux/x86-64/essentia_streaming_extractor_music
2022-02-13 14:34:53 D (Defaults) essentia.highlevel set to True
2022-02-13 14:34:53 D (Defaults) bliss.analyser set to /home/mruddo/music-similarity-master/linux/x86-64/bliss-analyse
2022-02-13 14:34:53 D Init DB
2022-02-13 14:34:53 D Analyse /mnt/m/TestLibrary/
2022-02-13 14:34:53 D Looking for old tracks to remove
2022-02-13 14:34:53 D Num old tracks: 0
2022-02-13 14:34:53 I Analysers: ['Bliss']
2022-02-13 14:34:54 D Num tracks to update: 691
2022-02-13 14:34:54 I Have 691 files to analyze
2022-02-13 14:34:54 D [  1/691   0%] Baby Queen/Medicine (EP)/01-Internet Religion.flac
2022-02-13 14:34:54 D [  2/691   0%] Baby Queen/Medicine (EP)/02-Pretty Girl Lie.flac
2022-02-13 14:34:54 D [  3/691   0%] Baby Queen/Medicine (EP)/03-Want Me.flac
2022-02-13 14:34:54 D [  4/691   0%] Baby Queen/Medicine (EP)/04-Buzzkill.flac
2022-02-13 14:34:54 D [  5/691   0%] Baby Queen/Medicine (EP)/05-Medicine.flac
2022-02-13 14:34:54 D [  6/691   0%] Baby Queen/Medicine (EP)/06-Online Dating.flac
2022-02-13 14:34:54 D [  7/691   1%] Baby Queen/The Yearbook/01-Baby Kingdom.flac
2022-02-13 14:34:54 D [  8/691   1%] Baby Queen/The Yearbook/02-Raw Thoughts.flac
2022-02-13 14:34:55 D [  9/691   1%] Baby Queen/The Yearbook/03-You Shaped Hole.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/04-Buzzkill.flac (Bliss)
2022-02-13 14:34:55 D [ 10/691   1%] Baby Queen/The Yearbook/04-American Dream.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/03-Want Me.flac (Bliss)
2022-02-13 14:34:55 D [ 11/691   1%] Baby Queen/The Yearbook/05-Narcissist.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/01-Internet Religion.flac (Bliss)
2022-02-13 14:34:55 D [ 12/691   1%] Baby Queen/The Yearbook/06-Dover Beach.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/06-Online Dating.flac (Bliss)
2022-02-13 14:34:55 D [ 13/691   1%] Baby Queen/The Yearbook/07-Dover Beach Pt. 2.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/05-Medicine.flac (Bliss)
2022-02-13 14:34:55 D [ 14/691   2%] Baby Queen/The Yearbook/08-These Drugs.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/Medicine (EP)/02-Pretty Girl Lie.flac (Bliss)
2022-02-13 14:34:55 D [ 15/691   2%] Baby Queen/The Yearbook/09-Fake Believe.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/The Yearbook/02-Raw Thoughts.flac (Bliss)
2022-02-13 14:34:55 D [ 16/691   2%] Baby Queen/The Yearbook/10-I'm A Mess.flac
2022-02-13 14:34:55 E Failed to analyze Baby Queen/The Yearbook/01-Baby Kingdom.flac (Bliss)
....
2022-02-13 14:37:38 E Failed to analyze Wolf Alice/My Love Is Cool (Deluxe Edition)/26-Leaving You.flac (Bliss)
2022-02-13 14:37:38 D [688/691  99%] Wolf Alice/Visions Of A Life/09-Sadboy.flac
2022-02-13 14:37:38 E Failed to analyze Wolf Alice/Visions Of A Life/01-Heavenward.flac (Bliss)
2022-02-13 14:37:38 D [689/691  99%] Wolf Alice/Visions Of A Life/10-St. Purple & Green.flac
2022-02-13 14:37:38 E Failed to analyze Wolf Alice/Visions Of A Life/02-Yuk Foo.flac (Bliss)
2022-02-13 14:37:39 D [690/691  99%] Wolf Alice/Visions Of A Life/11-After The Zero Hour.flac
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/03-Beautifully Unconventional.flac (Bliss)
2022-02-13 14:37:39 D [691/691 100%] Wolf Alice/Visions Of A Life/12-Visions Of A Life.flac
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/04-Don't Delete The Kisses.flac (Bliss)
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/05-Planet Hunter.flac (Bliss)
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/06-Sky Musings.flac (Bliss)
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/07-Formidable Cool.flac (Bliss)
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/08-Space & Time.flac (Bliss)
2022-02-13 14:37:39 E Failed to analyze Wolf Alice/Visions Of A Life/09-Sadboy.flac (Bliss)
2022-02-13 14:37:40 E Failed to analyze Wolf Alice/Visions Of A Life/10-St. Purple & Green.flac (Bliss)
2022-02-13 14:37:40 E Failed to analyze Wolf Alice/Visions Of A Life/11-After The Zero Hour.flac (Bliss)
2022-02-13 14:37:40 E Failed to analyze Wolf Alice/Visions Of A Life/12-Visions Of A Life.flac (Bliss)
2022-02-13 14:37:40 I Analysed: 0, Failed: 684, Filtered: 7
2022-02-13 14:37:40 D Finished analysis

And I'm at a loss as to why.

I did wonder if for some reason the Bliss library could not be found? Or if the fact the log messages at the start still mention Essentia, when I've not installed it is the issue? (Although I did try running it with essentia enabled set to false in the config and that made no difference.)

If you've any ideas that may help, or can advise how I might get some more useful detail behind the Bliss analysis failing then that would be appreciated.

This is also where my relative inexperience with Linux hampers me, as I'm not best placed to investigate.

[cpd73]

I did wonder if for some reason the Bliss library could not be found? Or if the fact the log messages at the start still mention Essentia, when I've not installed it is the issue? (Although I did try running it with essentia enabled set to false in the config and that made no difference.)

Bliss needs ffmpeg - check you have the libraries installed. The bliss analyser is actually an app you can run, e.g. try:

/home/mruddo/music-similarity-master/linux/x86-64/bliss-analyse /path/to/a/music/file

Does that work?

[cpd73]

Correction: I was mistaken about the used algorithm, seems it was running in "default" mode

So, you have been using just Bliss for mixes? If so, are you happy with them? I'm leaning more towards just using Bliss. I've even written a mixer in Rust with the intention of writing an lms plugin that will start the relevant executable for the host OS. This would make installation easier - just the LMS plugin required, and another Rust-exe to analyse all files (working on this at the moment - but never written Rust before!)

To me, Essentia takes a lot f time and does not add much.

[mruddo]

Bliss needs ffmpeg - check you have the libraries installed. The bliss analyser is actually an app you can run, e.g. try:

/home/mruddo/music-similarity-master/linux/x86-64/bliss-analyse /path/to/a/music/file

Does that work?

Thanks... That I can do, but I get the following errors now:

mruddo@M:~/music-similarity$ /home/mruddo/music-similarity/linux/x86-64/bliss-analyse "~temp-library/Wolf Alice/Visions Of A Life/11-After The Zero Hour.flac"
/home/mruddo/music-similarity/linux/x86-64/bliss-analyse: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.32' not found (required by /home/mruddo/music-similarity/linux/x86-64/bliss-analyse)
/home/mruddo/music-similarity/linux/x86-64/bliss-analyse: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.33' not found (required by /home/mruddo/music-similarity/linux/x86-64/bliss-analyse)
/home/mruddo/music-similarity/linux/x86-64/bliss-analyse: /lib/x86_64-linux-gnu/libc.so.6: version `GLIBC_2.34' not found (required by /home/mruddo/music-similarity/linux/x86-64/bliss-analyse)

Have been Googling ways to resolve this... not quite there yet, but did see this suggestion...

mruddo@M:~/music-similarity$ apt-cache policy libc6
libc6:
  Installed: 2.31-0ubuntu9.2
  Candidate: 2.31-0ubuntu9.2
  Version table:
 *** 2.31-0ubuntu9.2 500
        500 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages
        100 /var/lib/dpkg/status
     2.31-0ubuntu9 500
        500 http://archive.ubuntu.com/ubuntu focal/main amd64 Packages

So if I'm reading that correctly, it seems my libc6 libraries are a little dated.

And yet when I try to update it:

sudo apt-get install glibc-doc

Reading package lists... Done
Building dependency tree
Reading state information... Done
glibc-doc is already the newest version (2.31-0ubuntu9.2).

Also:

ffmpeg is already the newest version (7:4.2.4-1ubuntu0.1).
0 upgraded, 0 newly installed, 0 to remove and 110 not upgraded.

I've since tried manually installing glibc 2.34 using a variation of the instructions found here: https://askubuntu.com/questions/1345...have-glibc2-31

Unfortunately that's not worked either as it seems some dependencies there are also missing.

Maybe Ubuntu 20.04 was not the best starting point... I will revisit this when I have some time.


(*You'll also note from the above detail that I've experimented and renamed/moved a few things - also tried copying some flac files locally in case there was an issue running against the path of the Windows drive mount. It doesn't look like those were problems for me though.)

[cpd73]

Maybe Ubuntu 20.04 was not the best starting point... I will revisit this when I have some time.

Odd, as its not that old. You could try compiling bliss-analyse yourself - its fairly simple. See https://github.com/CDrummond/bliss-analyse

[bakker_be]

So, you have been using just Bliss for mixes? If so, are you happy with them? I'm leaning more towards just using Bliss. I've even written a mixer in Rust with the intention of writing an lms plugin that will start the relevant executable for the host OS. This would make installation easier - just the LMS plugin required, and another Rust-exe to analyse all files (working on this at the moment - but never written Rust before!)

To me, Essentia takes a lot f time and does not add much.

Yes, I'm happy with the Bliss-mixes. They are quite similar to what I had with MusicIP and SugarCube, with a lot less effort in maintenance. I haven't yet had the opportunity to play with different simalgo settings, but it's certainly way better than e.g. the LastMix approach to DSTM, as that is a lot too genre-bound for my eclectic collection and repeats artists/albums way too often.

[bakker_be]

Has anything been changed in either the Essentia Analyser or the write-to-DB routine? I've restarted the full scan several times now and it always hangs at the end with the exact same message on the exact same songs by Аркона. Looking in the DB the actual last written song is "Étienne Daho/Best of Singles/05-Soudain.flac" while all tracks are present in the cache directory.

2022-02-12 13:13:04 D [122219/122297  99%] Étienne Daho/Best of Singles/01-Idéal.flac
2022-02-12 13:13:04 D [122220/122297  99%] Étienne Daho/Best of Singles/02-Le Premier Jour (du reste de ta vie).flac
2022-02-12 13:13:04 D [122221/122297  99%] Étienne Daho/Best of Singles/03-Sur mon cou.flac
2022-02-12 13:13:04 D [122222/122297  99%] Étienne Daho/Best of Singles/04-Au commencement.flac
2022-02-12 13:13:04 D [122223/122297  99%] Étienne Daho/Best of Singles/05-Soudain.flac
2022-02-12 13:13:04 D [122224/122297  99%] Étienne Daho/Best of Singles/06-Jungle pulse.flac
2022-02-12 13:13:04 D [122225/122297  99%] Étienne Daho/Best of Singles/07-Mon manège à moi.flac
2022-02-12 13:13:05 D [122226/122297  99%] Étienne Daho/Best of Singles/08-Comme un igloo.flac
2022-02-12 13:13:05 D [122227/122297  99%] Étienne Daho/Best of Singles/09-Les Voyages immobiles.flac
2022-02-12 13:13:05 D [122228/122297  99%] Étienne Daho/Best of Singles/10-Des attractions désastre.flac
2022-02-12 13:13:05 D [122229/122297  99%] Étienne Daho/Best of Singles/11-Saudade.flac
2022-02-12 13:13:05 D [122230/122297  99%] Étienne Daho/Best of Singles/12-Un homme à la mer.flac
2022-02-12 13:13:05 D [122231/122297  99%] Étienne Daho/Best of Singles/13-Des heures hindoues.flac
2022-02-12 13:13:05 D [122232/122297  99%] Étienne Daho/Best of Singles/14-Bleu comme toi.flac
2022-02-12 13:13:05 D [122233/122297  99%] Étienne Daho/Best of Singles/15-Duel au soleil.flac
2022-02-12 13:13:06 D [122234/122297  99%] Étienne Daho/Best of Singles/16-Epaule tattoo (single remix).flac
2022-02-12 13:13:06 D [122235/122297  99%] Étienne Daho/Best of Singles/17-Tombé pour la France.flac
2022-02-12 13:13:06 D [122236/122297  99%] Étienne Daho/Best of Singles/18-Week end à Rome (feat. Lio).flac
2022-02-12 13:13:06 D [122237/122297  99%] Étienne Daho/Best of Singles/19-Le Grand Sommeil.flac
2022-02-12 13:13:06 D [122238/122297  99%] Étienne Daho/Best of Singles/20-Il ne dira pas (single edit).flac
2022-02-12 13:13:06 D [122239/122297  99%] Аркона/Decade Of Glory/01-Az'.flac
2022-02-12 13:13:06 D [122240/122297  99%] Аркона/Decade Of Glory/02-Arkaim.flac
2022-02-12 13:13:06 D [122241/122297  99%] Аркона/Decade Of Glory/03-Ot Serdca K Nebu.flac
2022-02-12 13:13:06 D [122242/122297  99%] Аркона/Decade Of Glory/04-Goi, Rode, Goi!.flac
2022-02-12 13:13:07 D [122243/122297  99%] Аркона/Decade Of Glory/05-Leshiy.flac
2022-02-12 13:13:07 D [122244/122297  99%] Аркона/Decade Of Glory/06-Zakliatie.flac
2022-02-12 13:13:07 D [122245/122297  99%] Аркона/Decade Of Glory/07-Marena.flac
2022-02-12 13:13:07 D [122246/122297  99%] Аркона/Decade Of Glory/08-Liki Bessmertnykh Bogov.flac
2022-02-12 13:13:07 D [122247/122297  99%] Аркона/Decade Of Glory/09-Nevidal.flac
2022-02-12 13:13:07 D [122248/122297  99%] Аркона/Decade Of Glory/10-Kolo Navi.flac
2022-02-12 13:13:07 D [122249/122297  99%] Аркона/Decade Of Glory/11-Slav'sja, Rus'.flac
2022-02-12 13:13:07 D [122250/122297  99%] Аркона/Decade Of Glory/12-Kupala I Kostroma.flac
2022-02-12 13:13:07 D [122251/122297  99%] Аркона/Decade Of Glory/13-Odna.flac
2022-02-12 13:13:07 D [122252/122297  99%] Аркона/Decade Of Glory/14-Sva.flac
2022-02-12 13:13:07 D [122253/122297  99%] Аркона/Decade Of Glory/15-Kupalets.flac
2022-02-12 13:13:07 D [122254/122297  99%] Аркона/Decade Of Glory/16-Katitsja Kolo.flac
2022-02-12 13:13:08 D [122255/122297  99%] Аркона/Decade Of Glory/17-Kolyada.flac
2022-02-12 13:13:08 D [122256/122297  99%] Аркона/Decade Of Glory/18-Skvoz' Tuman Vekov.flac
2022-02-12 13:13:08 D [122257/122297  99%] Аркона/Decade Of Glory/19-Maslenitsa.flac
2022-02-12 13:13:08 D [122258/122297  99%] Аркона/Decade Of Glory/20-V Tsepiakh Drevney Tainy.flac
2022-02-12 13:13:08 D [122259/122297  99%] Аркона/Decade Of Glory/21-Slovo.flac
2022-02-12 13:13:08 D [122260/122297  99%] Аркона/Decade Of Glory/22-BolNo Mne.flac
2022-02-12 13:13:08 D [122261/122297  99%] Аркона/Decade Of Glory/23-Pamiat.flac
2022-02-12 13:13:08 D [122262/122297  99%] Аркона/Decade Of Glory/24-Arkona.flac
2022-02-12 13:13:08 D [122263/122297  99%] Аркона/Decade Of Glory/25-Po Syroi Zemle.flac
2022-02-12 13:13:08 D [122264/122297  99%] Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac
2022-02-12 13:13:08 D [122265/122297  99%] Аркона/Decade Of Glory/27-Yarilo.flac
2022-02-12 13:13:09 D [122266/122297  99%] Аркона/Decade Of Glory/28-Stenka Na Stenku.flac
2022-02-12 13:13:09 D [122267/122297  99%] Аркона/Decade Of Glory/29-Vyjdu Ja Na Voljushku.flac
2022-02-12 13:13:09 D [122268/122297  99%] Аркона/Decade Of Glory/30-Rus'.flac
2022-02-12 13:13:09 D [122269/122297  99%] Аркона/Decade Of Glory/31-Zov Predkov.flac
2022-02-12 13:13:09 D [122270/122297  99%] Аркона/Goi, Rode, Goi!/01-Goi, Rode, Goi!.flac
2022-02-12 13:13:09 D [122271/122297  99%] Аркона/Goi, Rode, Goi!/02-Tropoiu Nevedannoi.flac
2022-02-12 13:13:09 D [122272/122297  99%] Аркона/Goi, Rode, Goi!/03-Nevidal.flac
2022-02-12 13:13:09 D [122273/122297  99%] Аркона/Goi, Rode, Goi!/04-Na Moey Zemle.flac
2022-02-12 13:13:09 D [122274/122297  99%] Аркона/Goi, Rode, Goi!/05-Pritcha.flac
2022-02-12 13:13:10 D [122275/122297  99%] Аркона/Goi, Rode, Goi!/06-V Tsepiakh Drevney Tainy.flac
2022-02-12 13:13:10 D [122276/122297  99%] Аркона/Goi, Rode, Goi!/07-Yarilo.flac
2022-02-12 13:13:10 D [122277/122297  99%] Аркона/Goi, Rode, Goi!/08-Liki Bessmertnykh Bogov.flac
2022-02-12 13:13:10 D [122278/122297  99%] Аркона/Goi, Rode, Goi!/09-Kolo Navi.flac
2022-02-12 13:13:10 D [122279/122297  99%] Аркона/Goi, Rode, Goi!/10-Korochun.flac
2022-02-12 13:13:10 D [122280/122297  99%] Аркона/Goi, Rode, Goi!/11-Pamiat.flac
2022-02-12 13:13:10 D [122281/122297  99%] Аркона/Goi, Rode, Goi!/12-Kupalets.flac
2022-02-12 13:13:10 D [122282/122297  99%] Аркона/Goi, Rode, Goi!/13-Arkona.flac
2022-02-12 13:13:10 D [122283/122297  99%] Аркона/Goi, Rode, Goi!/14-Nebo Hmuroe Tuchi Mrachniye.flac
2022-02-12 13:13:11 D [122284/122297  99%] Аркона/Zhizn Vo Slavu/01-Intro (Kolomiyka).flac
2022-02-12 13:13:11 D [122285/122297  99%] Аркона/Zhizn Vo Slavu/02-Skvoz Tuman Vekov.flac
2022-02-12 13:13:11 D [122286/122297  99%] Аркона/Zhizn Vo Slavu/03-Po Siroy Zemle.flac
2022-02-12 13:13:11 D [122287/122297  99%] Аркона/Zhizn Vo Slavu/04-Maslenitsa.flac
2022-02-12 13:13:11 D [122288/122297  99%] Аркона/Zhizn Vo Slavu/05-Chernie Debri Voyni.flac
2022-02-12 13:13:11 D [122289/122297  99%] Аркона/Zhizn Vo Slavu/06-Tuman Yarom.flac
2022-02-12 13:13:11 D [122290/122297  99%] Аркона/Zhizn Vo Slavu/07-Gnev Vremen.flac
2022-02-12 13:13:11 D [122291/122297  99%] Аркона/Zhizn Vo Slavu/08-Po Zverinim Tropam.flac
2022-02-12 13:13:11 D [122292/122297  99%] Аркона/Zhizn Vo Slavu/09-Rus.flac
2022-02-12 13:13:11 D [122293/122297  99%] Аркона/Zhizn Vo Slavu/10-Vosstanie Roda.flac
2022-02-12 13:13:12 D [122294/122297  99%] Аркона/Zhizn Vo Slavu/11-Oy To Ne Vecher.flac
2022-02-12 13:13:12 D [122295/122297  99%] Аркона/Zhizn Vo Slavu/12-Kolyada (Bonus Track).flac
2022-02-12 13:13:12 D [122296/122297  99%] Аркона/Zhizn Vo Slavu/13-Solntcevorot (Bonus Track).flac
2022-02-12 13:13:12 D [122297/122297 100%] Аркона/Zhizn Vo Slavu/14-Rus (Bonus Track).flac
2022-02-12 13:13:40 E Failed to parse Essentia output for Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac (JSON failed)
2022-02-12 13:13:40 E Failed to analyze Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac (Essentia)
2022-02-12 13:13:40 E Failed to parse Essentia output for Аркона/Decade Of Glory/22-BolNo Mne.flac (JSON failed)
2022-02-12 13:13:40 E Failed to analyze Аркона/Decade Of Glory/22-BolNo Mne.flac (Essentia)

[bakker_be]

Has anything been changed in either the Essentia Analyser or the write-to-DB routine? I've restarted the full scan several times now and it always hangs at the end with the exact same message on the exact same songs by Аркона. Looking in the DB the actual last written song is "Étienne Daho/Best of Singles/05-Soudain.flac" while all tracks are present in the cache directory.

2022-02-12 13:13:04 D [122219/122297  99%] Étienne Daho/Best of Singles/01-Idéal.flac
2022-02-12 13:13:04 D [122220/122297  99%] Étienne Daho/Best of Singles/02-Le Premier Jour (du reste de ta vie).flac
2022-02-12 13:13:04 D [122221/122297  99%] Étienne Daho/Best of Singles/03-Sur mon cou.flac
2022-02-12 13:13:04 D [122222/122297  99%] Étienne Daho/Best of Singles/04-Au commencement.flac
2022-02-12 13:13:04 D [122223/122297  99%] Étienne Daho/Best of Singles/05-Soudain.flac
2022-02-12 13:13:04 D [122224/122297  99%] Étienne Daho/Best of Singles/06-Jungle pulse.flac
2022-02-12 13:13:04 D [122225/122297  99%] Étienne Daho/Best of Singles/07-Mon manège à moi.flac
2022-02-12 13:13:05 D [122226/122297  99%] Étienne Daho/Best of Singles/08-Comme un igloo.flac
2022-02-12 13:13:05 D [122227/122297  99%] Étienne Daho/Best of Singles/09-Les Voyages immobiles.flac
2022-02-12 13:13:05 D [122228/122297  99%] Étienne Daho/Best of Singles/10-Des attractions désastre.flac
2022-02-12 13:13:05 D [122229/122297  99%] Étienne Daho/Best of Singles/11-Saudade.flac
2022-02-12 13:13:05 D [122230/122297  99%] Étienne Daho/Best of Singles/12-Un homme à la mer.flac
2022-02-12 13:13:05 D [122231/122297  99%] Étienne Daho/Best of Singles/13-Des heures hindoues.flac
2022-02-12 13:13:05 D [122232/122297  99%] Étienne Daho/Best of Singles/14-Bleu comme toi.flac
2022-02-12 13:13:05 D [122233/122297  99%] Étienne Daho/Best of Singles/15-Duel au soleil.flac
2022-02-12 13:13:06 D [122234/122297  99%] Étienne Daho/Best of Singles/16-Epaule tattoo (single remix).flac
2022-02-12 13:13:06 D [122235/122297  99%] Étienne Daho/Best of Singles/17-Tombé pour la France.flac
2022-02-12 13:13:06 D [122236/122297  99%] Étienne Daho/Best of Singles/18-Week end à Rome (feat. Lio).flac
2022-02-12 13:13:06 D [122237/122297  99%] Étienne Daho/Best of Singles/19-Le Grand Sommeil.flac
2022-02-12 13:13:06 D [122238/122297  99%] Étienne Daho/Best of Singles/20-Il ne dira pas (single edit).flac
2022-02-12 13:13:06 D [122239/122297  99%] Аркона/Decade Of Glory/01-Az'.flac
2022-02-12 13:13:06 D [122240/122297  99%] Аркона/Decade Of Glory/02-Arkaim.flac
2022-02-12 13:13:06 D [122241/122297  99%] Аркона/Decade Of Glory/03-Ot Serdca K Nebu.flac
2022-02-12 13:13:06 D [122242/122297  99%] Аркона/Decade Of Glory/04-Goi, Rode, Goi!.flac
2022-02-12 13:13:07 D [122243/122297  99%] Аркона/Decade Of Glory/05-Leshiy.flac
2022-02-12 13:13:07 D [122244/122297  99%] Аркона/Decade Of Glory/06-Zakliatie.flac
2022-02-12 13:13:07 D [122245/122297  99%] Аркона/Decade Of Glory/07-Marena.flac
2022-02-12 13:13:07 D [122246/122297  99%] Аркона/Decade Of Glory/08-Liki Bessmertnykh Bogov.flac
2022-02-12 13:13:07 D [122247/122297  99%] Аркона/Decade Of Glory/09-Nevidal.flac
2022-02-12 13:13:07 D [122248/122297  99%] Аркона/Decade Of Glory/10-Kolo Navi.flac
2022-02-12 13:13:07 D [122249/122297  99%] Аркона/Decade Of Glory/11-Slav'sja, Rus'.flac
2022-02-12 13:13:07 D [122250/122297  99%] Аркона/Decade Of Glory/12-Kupala I Kostroma.flac
2022-02-12 13:13:07 D [122251/122297  99%] Аркона/Decade Of Glory/13-Odna.flac
2022-02-12 13:13:07 D [122252/122297  99%] Аркона/Decade Of Glory/14-Sva.flac
2022-02-12 13:13:07 D [122253/122297  99%] Аркона/Decade Of Glory/15-Kupalets.flac
2022-02-12 13:13:07 D [122254/122297  99%] Аркона/Decade Of Glory/16-Katitsja Kolo.flac
2022-02-12 13:13:08 D [122255/122297  99%] Аркона/Decade Of Glory/17-Kolyada.flac
2022-02-12 13:13:08 D [122256/122297  99%] Аркона/Decade Of Glory/18-Skvoz' Tuman Vekov.flac
2022-02-12 13:13:08 D [122257/122297  99%] Аркона/Decade Of Glory/19-Maslenitsa.flac
2022-02-12 13:13:08 D [122258/122297  99%] Аркона/Decade Of Glory/20-V Tsepiakh Drevney Tainy.flac
2022-02-12 13:13:08 D [122259/122297  99%] Аркона/Decade Of Glory/21-Slovo.flac
2022-02-12 13:13:08 D [122260/122297  99%] Аркона/Decade Of Glory/22-BolNo Mne.flac
2022-02-12 13:13:08 D [122261/122297  99%] Аркона/Decade Of Glory/23-Pamiat.flac
2022-02-12 13:13:08 D [122262/122297  99%] Аркона/Decade Of Glory/24-Arkona.flac
2022-02-12 13:13:08 D [122263/122297  99%] Аркона/Decade Of Glory/25-Po Syroi Zemle.flac
2022-02-12 13:13:08 D [122264/122297  99%] Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac
2022-02-12 13:13:08 D [122265/122297  99%] Аркона/Decade Of Glory/27-Yarilo.flac
2022-02-12 13:13:09 D [122266/122297  99%] Аркона/Decade Of Glory/28-Stenka Na Stenku.flac
2022-02-12 13:13:09 D [122267/122297  99%] Аркона/Decade Of Glory/29-Vyjdu Ja Na Voljushku.flac
2022-02-12 13:13:09 D [122268/122297  99%] Аркона/Decade Of Glory/30-Rus'.flac
2022-02-12 13:13:09 D [122269/122297  99%] Аркона/Decade Of Glory/31-Zov Predkov.flac
2022-02-12 13:13:09 D [122270/122297  99%] Аркона/Goi, Rode, Goi!/01-Goi, Rode, Goi!.flac
2022-02-12 13:13:09 D [122271/122297  99%] Аркона/Goi, Rode, Goi!/02-Tropoiu Nevedannoi.flac
2022-02-12 13:13:09 D [122272/122297  99%] Аркона/Goi, Rode, Goi!/03-Nevidal.flac
2022-02-12 13:13:09 D [122273/122297  99%] Аркона/Goi, Rode, Goi!/04-Na Moey Zemle.flac
2022-02-12 13:13:09 D [122274/122297  99%] Аркона/Goi, Rode, Goi!/05-Pritcha.flac
2022-02-12 13:13:10 D [122275/122297  99%] Аркона/Goi, Rode, Goi!/06-V Tsepiakh Drevney Tainy.flac
2022-02-12 13:13:10 D [122276/122297  99%] Аркона/Goi, Rode, Goi!/07-Yarilo.flac
2022-02-12 13:13:10 D [122277/122297  99%] Аркона/Goi, Rode, Goi!/08-Liki Bessmertnykh Bogov.flac
2022-02-12 13:13:10 D [122278/122297  99%] Аркона/Goi, Rode, Goi!/09-Kolo Navi.flac
2022-02-12 13:13:10 D [122279/122297  99%] Аркона/Goi, Rode, Goi!/10-Korochun.flac
2022-02-12 13:13:10 D [122280/122297  99%] Аркона/Goi, Rode, Goi!/11-Pamiat.flac
2022-02-12 13:13:10 D [122281/122297  99%] Аркона/Goi, Rode, Goi!/12-Kupalets.flac
2022-02-12 13:13:10 D [122282/122297  99%] Аркона/Goi, Rode, Goi!/13-Arkona.flac
2022-02-12 13:13:10 D [122283/122297  99%] Аркона/Goi, Rode, Goi!/14-Nebo Hmuroe Tuchi Mrachniye.flac
2022-02-12 13:13:11 D [122284/122297  99%] Аркона/Zhizn Vo Slavu/01-Intro (Kolomiyka).flac
2022-02-12 13:13:11 D [122285/122297  99%] Аркона/Zhizn Vo Slavu/02-Skvoz Tuman Vekov.flac
2022-02-12 13:13:11 D [122286/122297  99%] Аркона/Zhizn Vo Slavu/03-Po Siroy Zemle.flac
2022-02-12 13:13:11 D [122287/122297  99%] Аркона/Zhizn Vo Slavu/04-Maslenitsa.flac
2022-02-12 13:13:11 D [122288/122297  99%] Аркона/Zhizn Vo Slavu/05-Chernie Debri Voyni.flac
2022-02-12 13:13:11 D [122289/122297  99%] Аркона/Zhizn Vo Slavu/06-Tuman Yarom.flac
2022-02-12 13:13:11 D [122290/122297  99%] Аркона/Zhizn Vo Slavu/07-Gnev Vremen.flac
2022-02-12 13:13:11 D [122291/122297  99%] Аркона/Zhizn Vo Slavu/08-Po Zverinim Tropam.flac
2022-02-12 13:13:11 D [122292/122297  99%] Аркона/Zhizn Vo Slavu/09-Rus.flac
2022-02-12 13:13:11 D [122293/122297  99%] Аркона/Zhizn Vo Slavu/10-Vosstanie Roda.flac
2022-02-12 13:13:12 D [122294/122297  99%] Аркона/Zhizn Vo Slavu/11-Oy To Ne Vecher.flac
2022-02-12 13:13:12 D [122295/122297  99%] Аркона/Zhizn Vo Slavu/12-Kolyada (Bonus Track).flac
2022-02-12 13:13:12 D [122296/122297  99%] Аркона/Zhizn Vo Slavu/13-Solntcevorot (Bonus Track).flac
2022-02-12 13:13:12 D [122297/122297 100%] Аркона/Zhizn Vo Slavu/14-Rus (Bonus Track).flac
2022-02-12 13:13:40 E Failed to parse Essentia output for Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac (JSON failed)
2022-02-12 13:13:40 E Failed to analyze Аркона/Decade Of Glory/26-Oj, Pechal' - Toska.flac (Essentia)
2022-02-12 13:13:40 E Failed to parse Essentia output for Аркона/Decade Of Glory/22-BolNo Mne.flac (JSON failed)
2022-02-12 13:13:40 E Failed to analyze Аркона/Decade Of Glory/22-BolNo Mne.flac (Essentia)

Quoting myself I've just launched another scan, with "-M 10000" as additional parameter (there are around 10000 tracks it doesn't include for some reason or other, most are "Duration", some get "Meta:NONE", and others get "Tags"), and even though again erroring out on the 2 same Аркона songs it has now added all Étienne Daho tracks as well as the Аркона ones to the DB and indicated a finished analysis. I'm guessing giving it ±130K tracks in one go somehow saturates something somewhere

Simalgo doesn't seem to want to work however

./music-similarity/music-similarity.py -c /home/bart/music-similarity/config.json -l DEBUG
2022-02-14 09:45:54 D (Defaults) musly.lib set to linux/x86-64/libmusly.so
2022-02-14 09:45:54 D Init DB
2022-02-14 09:45:54 D Start server
2022-02-14 09:45:54 D Loading essentia attribs from DB
2022-02-14 09:45:56 D Loading bliss from DB
2022-02-14 09:45:57 D Init Musly
2022-02-14 09:45:57 D Using: /home/bart/music-similarity/linux/x86-64/libmusly.so (b'libav')
2022-02-14 09:45:57 D Musly init done
2022-02-14 09:45:57 E DB not initialised, have you analysed all tracks?

config.json:

{
  "paths":{
     "db":"/home/bart/music-similarity/",
     "local":"/mnt/Music/",
     "lms":"/mnt/Music/",
     "cache":"/home/bart/music-similarity/cache/"
  },
  "lmsdb":"/var/lib/squeezeboxserver/cache/library.db",
  "essentia":{
     "enabled":true,
     "highlevel":true
  },
  "musly":{
   "extractlen":360,
   "extractstart":-210
  },
  "simalgo":"mixed",
  "mixed":{
     "essentia":33,
     "bliss":33,
     "musly":34
  }
}

[cpd73]

Simalgo doesn't seem to want to work however

Not that it helps much, but its working for me. I've tried setting simalgo to mixed and using bliss+musly, and also bliss+essentia+musly - both worked. But, the 'mixing' of bliss/essentia/musly was only done for experimentation - not sure how useful it is. My original idea was that Musly (or Bliss) would be used to get 'similar' tracks, and then use Essentia for further filtering. But, I'm heavily leaning towards just Bliss - to the extent that I have written an anlyser (to analyse all tracks) and mixer in Rust (my first Rust apps), and an LMS plugin to call the mixer.

2022-02-14 09:45:57 E DB not initialised, have you analysed all tracks?

My guess would be that there is an issue here.