[Bug 297546] New: Digikam scan thumbnails with duplicate filenames in different directories

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

            Bug ID: 297546
          Severity: normal
           Version: unspecified
          Priority: NOR
          Assignee: [hidden email]
           Summary: Digikam scan thumbnails with duplicate filenames in
                    different directories
    Classification: Unclassified
                OS: Linux
          Reporter: [hidden email]
          Hardware: Other
            Status: UNCONFIRMED
         Component: Thumbnails
           Product: digikam

Digikam seems to be re-scanning (and rebuilding) thumbnails on my pictures even
though these pictures have not been touched.  The pictures that seem to trigger
this behavior are ones that have the same filename, but reside in different
directories and are actually different pictures (digital camera reset count).

Scan to rebuild fingerprints works perfectly and does not seem to have this
problem.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #1 from Gilles Caulier <[hidden email]> ---
Which version of digiKam you use ? Re-sacn is done when exactly ? Do you have
used a tool just before ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #2 from Jim Shipman <[hidden email]> ---
I'm using 2.5.0, but this bug has been present ever since I started using
digikam back in the 1.somthing days.

What I do is to select Tools->Rebuild Thumbnails, then I click on Scan.  I see
the progress window open and I see it rebuilding many files (maybe 100 out of
66,000).  If I then immediately go and do the same thing again.  It rebuild the
same files over again.  When I pick out a bunch of the files that are
rebuilding over and over and find them on my system, then I see that each of
then appears with the same name, but in different directories.  They seem also
to be different photos, but have the same filename because my camera had its
count reset and it generates new photos that have duplicate names for photos
already on my system in different folders.  I don't actually know if this has
anything to do with it, but that is what I noticed.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

Jim Shipman <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Hardware|Other                       |Fedora RPMs
            Version|unspecified                 |2.5.0

--- Comment #3 from Jim Shipman <[hidden email]> ---
Is there a way I can collect some data to help resolve this?  Maybe a list of
the files that are being rebuilt and / or database logs etc?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Marcel Wiesweg]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #4 from Marcel Wiesweg <[hidden email]> ---
If you open digikam and go to the individual albums showing these pictures, and
watch the thumbnail of them: Does digikam also rebuild them? (when rebuilding,
there's usually some output on the console from here and there) Or is it only a
phenomenon of the Rebuild Thumbnails tool?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #5 from Gilles Caulier <[hidden email]> ---
Jim,

This entry still valid using digiKam 3.5.0 ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

Jim Shipman <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|2.5.0                       |3.5.0

--- Comment #6 from Jim Shipman <[hidden email]> ---
I ran the maint->thumbnail utility and then immediately reran it.  It still
takes several (7 or 8) minutes to run and I can see the same thumbnails show up
on the progress window.  I get the same thing no matter how many times I rerun
without any interviening actions.

The same test using the fingerprint utility runs (slowly at first as it
generates new fingerprints), then it runs immediately with no delay when run
the second time.

I ran digikam from a terminal window and only see a couple of messages like
these below:

libpng warning: Unknown iTXt compression type or method
Thread::requestAbort: not running.

I also had the system log window up and don't see any messages generated from
digikam.

I can't tell which files are being re-thumbnailed.  Only that the images on the
progress bar look basically the same as they flash by each time I run it.

Is there a way to find out which files it is re-thumbnailing?

Thanks,
Jim Shipman

Random observation:
Version 3.5.0 seems much buggier than previous versions.  I get hangs if I try
to do anything while a long operation (like tagging a bunch of photos) is
running and have to kill digikam manually.  Also digikam still crashes without
any log info, when I preview a movie file (has always done this since very
early versions -- still does).

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

Jim Shipman <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|3.5.0                       |4.0.0

--- Comment #7 from Jim Shipman <[hidden email]> ---
Tools->Maint->thumnails (only changed) still is rebuilding thumbnails on some
files.  I am not able to tell which files are being rebuilt again but I can
tell from watching the thumbnail pictures as they fly past that digikam is
rebuilding the same thumbnails over and over again each time I run the maint.
task.

Is there some way that I can get a listing of which thumbnails are being
rebuilt?  It would help to be able to identify some of the files that are being
rebuilt each time then I could do more to find out why.

This is the 4.1.0 from git release with compiled source.

Jim Shipman

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #8 from Gilles Caulier <[hidden email]> ---
Hum...

Do you use Sqlite or MySQL ? because here with SQlite, it work as expected...

To print processed file, you can enable debug space using kdebugdialog, and run
digiKam from a console. Items must be printed at processing.

http://www.digikam.org/contrib

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|4.0.0                       |4.1.0

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #9 from Jim Shipman <[hidden email]> ---
Created attachment 86864
  --> https://bugs.kde.org/attachment.cgi?id=86864&action=edit
Script to start digikam with debug support

Script to start digikam with debug support.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[James R. Shipman]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #10 from Jim Shipman <[hidden email]> ---
Sorry, I lost my comment when I attached the script file.

I use SQLite right now, but I used to use MySQL and it had always worked fine
for me.  The reason I changed was because I wanted to put my database into a
ram disk for performance while doing massive metadata updates and MySQL running
on the same machine was slower than SQLite with a database in RAM.

I'll try the kdebugdialog trick to see what I can find.  I'll have to research
that as I've never used that tool.

Jim

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

--- Comment #11 from Gilles Caulier <[hidden email]> ---
I think a RAM disk is not mandatory to have good performance with SQlite. Here
i use a SSD of 500Gb to host DB and photos, and it's very powerfull. I would to
preserve my 16Gb or RAM to process huge photo, as >100Mpx panorama.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=297546

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |DUPLICATE
             Status|UNCONFIRMED                 |RESOLVED

--- Comment #12 from Gilles Caulier <[hidden email]> ---
The problem is due to thumbs database contents is not maintained well when file
are deleted.

Database preserve a trace of old files.

It's explained in bug #317210

Gilles Caulier

*** This bug has been marked as a duplicate of bug 317210 ***

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel