Home of the Squeezebox™ & Transporter® network music players.
Page 2 of 2 FirstFirst 12
Results 11 to 20 of 20
  1. #11
    Senior Member
    Join Date
    Aug 2012
    Location
    Austria
    Posts
    915
    Quote Originally Posted by jimzak View Post
    It seems to be choking on damaged jpeg image files.
    However, in the meantime, it would be nice if I could get the server to ignore the damaged jpegs and complete the scan.

    Excerpt from scanner log:
    [19-09-15 16:16:43.3792] Slim::Utils::GDResizer::resize (205) Warning: Image::Scale libjpeg error: Corrupt JPEG data: 2 extraneous bytes before marker 0xd9 (K:\T\Two Lone Swordsmen - Wrong Meeting (2007) (FLAC)\09 - Two Lone Swordsmen - Get Out Of My Kingdom.flac)
    It seems that the damaged images are embedded in the music files. If that's the case, it's quite likely the music files are corrupt as well.
    Run e.g.
    Code:
    flac -t K:\T\Two Lone Swordsmen - Wrong Meeting (2007) (FLAC)\09 - Two Lone Swordsmen - Get Out Of My Kingdom.flac
    to check

    Then, try
    Code:
    metaflac --export-picture-to=<some filename>  K:\T\Two Lone Swordsmen - Wrong Meeting (2007) (FLAC)\09 - Two Lone Swordsmen - Get Out Of My Kingdom.flac
    and verify the exported picture

  2. #12
    Senior Member jimzak's Avatar
    Join Date
    May 2008
    Location
    Austin TX
    Posts
    655
    Undoubtedly you are correct. But the damaged music files play (with glitches); however, I cannot get the scanner to complete scanning so I can play them.

    Can you suggest a file scanner so that I can identify the damaged ones from my library of 400k+ files?
    http://zzzone.net
    http://have-a-nice-day.org
    http://www.last.fm/user/zzzoneDOTnet
    http://somethingsomethingsomething.net

    SBS 7.9 - i7 nuc - Win 10 64bit
    5 Booms, 2 Radio, 3 Touch, 1 Duet, 5 piCorePlayers including 3 touchscreen, 1 Avy
    2 controllers, various tablets/phones
    Apps including iPeng, Squeeze Ctrl etc.
    Library: 425,000+ FLAC/MP3 files - 18 TB HD

  3. #13
    Senior Member jimzak's Avatar
    Join Date
    May 2008
    Location
    Austin TX
    Posts
    655

    success?

    So, in the absence of a better short term plan, I looked at the scanner log and simply removed the embedded artwork from the entries that seemed to choke the scanner.

    I then performed a rescan for new and changed files, and the scan was at least able to complete.

    My long term plan is to find a music file scanner and remove all the corrupted files but at least for now, I can play the glitchy ones.

    -----------------------


    Discovering files/directories: J: (235549 of 235549) Complete 00:02:31

    Scanning changed files: J: (25 of 25) Complete 00:00:02

    Discovering files/directories: K: (280089 of 280089) Complete 00:02:51

    Removing deleted files: K: (20 of 20) Complete 00:00:08

    Scanning new music files: K: (10 of 10) Complete 00:00:00

    Scanning changed files: K: (23 of 23) Complete 00:00:02

    Discovering files/directories: K:\V-Z\Various (1 of 1) Complete 00:00:00

    Discovering playlists: C:\Users\user\Music\Playlists (1 of 1) Complete 00:00:00

    Building full text index (7 of 7) Complete 00:01:20

    Find updated coverart files (46441 of 46441) Complete 00:00:16

    Pre-caching Artwork (31398 of 31398) Complete 00:12:21

    Database Optimize (2 of 2) Complete 00:01:23

    The server has finished scanning your media library.
    Total Time: 00:20:54 (Thursday, September 19, 2019 / 5:54 AM)
    http://zzzone.net
    http://have-a-nice-day.org
    http://www.last.fm/user/zzzoneDOTnet
    http://somethingsomethingsomething.net

    SBS 7.9 - i7 nuc - Win 10 64bit
    5 Booms, 2 Radio, 3 Touch, 1 Duet, 5 piCorePlayers including 3 touchscreen, 1 Avy
    2 controllers, various tablets/phones
    Apps including iPeng, Squeeze Ctrl etc.
    Library: 425,000+ FLAC/MP3 files - 18 TB HD

  4. #14
    Senior Member dolodobendan's Avatar
    Join Date
    Dec 2017
    Location
    Braunschweig, Germany
    Posts
    734
    Quote Originally Posted by jimzak View Post
    Very interesting.

    I have displayed the contents of my cache below. Let me know if something sticks out as being strange. My RAM drive is 8 GB (6 was a typo). And deleting library.db is exactly how I initiated the failed rescans.

    Attachment 28065
    Quote Originally Posted by mherger View Post
    > I have displayed the contents of my cache below. Let me know if
    > something sticks out as being strange. My RAM drive is 8 GB (6 was a
    > typo). And deleting library.db is exactly how I initiated the failed
    > rescans.


    Ah, ok. That 3.16GB file is not library.db, but artwork.db. That makes
    sense (as does the size of library.db).

    But still I'd monitor disk space next time you run a full scan.
    Optimizing those files can double the disk space requirement temporarily.

    --

    Michael
    Do I have to worry about my 1GB persist.db? I don't have 400k tracks...
    QLMS 7.9.2@2.04 x64 (digimaster) with perl 5.28 dedicated to me. :D / QNAP 469L QTS 4.3.4

  5. #15
    Senior Member dolodobendan's Avatar
    Join Date
    Dec 2017
    Location
    Braunschweig, Germany
    Posts
    734
    Quote Originally Posted by jimzak View Post
    My long term plan is to find a music file scanner and remove all the corrupted files but at least for now, I can play the glitchy ones.
    You could give AudioTester a try.
    QLMS 7.9.2@2.04 x64 (digimaster) with perl 5.28 dedicated to me. :D / QNAP 469L QTS 4.3.4

  6. #16
    Babelfish's Best Boy mherger's Avatar
    Join Date
    Apr 2005
    Location
    Switzerland
    Posts
    20,298

    Unable to perform full rescan

    > Do I have to worry about my 1GB persist.db? I don't have 400k tracks...

    That sounds like an awful lot. Run

    select count(1) from tracks_persistent;

    to see how many records there are. It shouldn't be much more than the
    number of tracks you have.

    But then I don't know what eg. some of Erland's plugins do. They could
    be blowing it up.

    --

    Michael

  7. #17
    Senior Member
    Join Date
    May 2008
    Location
    United States
    Posts
    11,500
    Quote Originally Posted by dolodobendan View Post
    You could give AudioTester a try.
    or foobar2000 with the "file integrity verifier" component.
    https://www.foobar2000.org/download
    https://www.foobar2000.org/components/view/foo_verifier
    Home: VBA 4TB (2.5)>LMS 7.9.2>Transporter, Touch, Boom, Radio (all ethernet)
    Cottage: VBA 3TB (2.4)>LMS 7.9.1>Touch>Benchmark DAC I, Boom, Radio w/Battery (ethernet, Radio WIFI)
    Office: Win10(64)>LMS 7.9.2>Squeezelite
    The Wild (no internet): PiCorePlayer 4.0 on rPi 3B+, hifiberry Dac+Pro, 4TB USB (LMS & Squeezelite)
    Controllers: iPhone6 & iPadAir2 (iPeng), CONTROLLER, or SqueezePlay 7.8 on Win10(64) laptop
    Files: ripping: dbpa > FLAC; post-rip: mp3tag, PerfectTunes; Streaming: Spotify

  8. #18
    Senior Member dolodobendan's Avatar
    Join Date
    Dec 2017
    Location
    Braunschweig, Germany
    Posts
    734
    Quote Originally Posted by mherger View Post
    That sounds like an awful lot. Run

    select count(1) from tracks_persistent;

    to see how many records there are. It shouldn't be much more than the
    number of tracks you have.
    I don't know where to run that, but I opened the file and had a look at the table "tracks_persistent". It has the same number of entries that LMS reports as total track count.

    Quote Originally Posted by mherger View Post
    But then I don't know what eg. some of Erland's plugins do. They could
    be blowing it up.
    There's also a table "Customscan_track_attributes" with 1.3 million entries. So, yeah.

    Thank you.
    QLMS 7.9.2@2.04 x64 (digimaster) with perl 5.28 dedicated to me. :D / QNAP 469L QTS 4.3.4

  9. #19
    Senior Member
    Join Date
    Aug 2012
    Location
    Austria
    Posts
    915
    Quote Originally Posted by jimzak View Post
    My long term plan is to find a music file scanner and remove all the corrupted files but at least for now, I can play the glitchy ones.
    While the suggested tools may be simple to use, depending on the number of corrupt files they report, it might become quite tedious to manually remove all files.
    Here's a simple bash script to find corrupt flacs:

    Code:
    IFS=$'\n'; for i in $(find . -name \*.flac); do flac -t --totally-silent "$i" || echo "$i"; done
    The output can be redirected to a text file.
    Substituting mv or rm for echo would move or delete the file, automating the whole process.

  10. #20
    Senior Member jimzak's Avatar
    Join Date
    May 2008
    Location
    Austin TX
    Posts
    655
    Now that the scans complete, I am impressed by the scanning speed, especially for a "new or changed music scan".

    It's lightning fast without a RAM drive: all my files in about 7 minutes.

    Next is the arduous process of corrupted file surgery.

    Thanks for the tips above.
    http://zzzone.net
    http://have-a-nice-day.org
    http://www.last.fm/user/zzzoneDOTnet
    http://somethingsomethingsomething.net

    SBS 7.9 - i7 nuc - Win 10 64bit
    5 Booms, 2 Radio, 3 Touch, 1 Duet, 5 piCorePlayers including 3 touchscreen, 1 Avy
    2 controllers, various tablets/phones
    Apps including iPeng, Squeeze Ctrl etc.
    Library: 425,000+ FLAC/MP3 files - 18 TB HD

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •