[digikam] [Bug 345045] New: digikam: images not displayed in album

classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] New: digikam: images not displayed in album

Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

            Bug ID: 345045
           Summary: digikam: images not displayed in album
           Product: digikam
           Version: 4.4.0
          Platform: Debian unstable
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: Database
          Assignee: [hidden email]
          Reporter: [hidden email]

Hi,

  Using digikam for a long time, I'm experiencing database corruption from time
to time (this is still going on with 4.4.0, the last Debian packaged version).
I initially reported the problem and my analysis to the Debian Bug Tracker (
https://bugs.debian.org/756512 ) and maintainers just asked me to report it
here. So, here is the copy-paste of my initial bug report (but I confirm the
bug is still present in 4.4.0).

===============================

  I'm using digikam for several years to handle all my photos. Regularly,
some images are present in repository on disk, they are counted into the album
list (for example, I see '8 (221)' that tells me there is 221 images in the
album/directory named '8', and it is indeed what there is on filesystem).
However, they are not displayed in the central part of digikam.
  I looked for lots of thing on Internet about this bug. I read and test
lots of things.
  Eventually, I found the java program DigikamDBValidator. I know it is not
maintain anymore and it is not necessarly fully working with recent version of
digikam, but it allows me to start to look into the digikam database.

  And I found several problems.

  And theses problems come back (with other images) after I first corrected
them. So the bug was present into the 4.0.0 digikam version. Upgrading to the
4.1.0 does not fix the database problems (but I do not know (yet) if 4.1.0 will
corrupt the database again)

  For information, I'm using a mysql database for a long time (nearly when it
has been available in the Debian package)


  First, I found several image related tables that refer to non existing
images. For example, I get several rows with the following request :
SELECT ImageComments.id FROM ImageComments LEFT OUTER JOIN Images ON
Images.id=ImageComments.imageid WHERE Images.name IS NULL
  I correct them with :
DELETE i FROM ImageComments i LEFT OUTER JOIN Images ON Images.id=i.imageid
WHERE Images.name IS NULL;

  And I had this problem in ImageComments, ImageCopyright, ImageInformation,
ImageMetadata, and ImageTags tables (I not sure I cheked all required tables,
there can be more).


  That said, fixing this does not fix my problem with images not displayed.
I found these image with this request :
SELECT id FROM Images WHERE Images.id NOT IN (SELECT ImageInformation.imageid
FROM ImageInformation);
  This are images into the 'Images' table but not into the 'ImageInformation'
table.
  I get the path to these images with the following request :
SELECT Images.id, concat(albumRoot, ":", relativePath, "/" , Images.name) FROM
Images JOIN Albums on Images.album=Albums.id WHERE Images.id NOT IN (SELECT
ImageInformation.imageid FROM ImageInformation);

  And indeed, the listed images where the ones counted into the album list but
not displayed by digikam.

  I fix this by creating empty lines in the ImageInformation table (but this
image ID):
insert into ImageInformation (imageid) SELECT id FROM Images WHERE Images.id
NOT IN (SELECT ImageInformation.imageid FROM ImageInformation);

  Starting digikam just after this 'fix' makes all my missing images displayed!
Looking at the database, I needed to execute 'read metadata from images again'
in the album menu (I'm not sure of the exact english text: my digikam is in
french) in the album where I had missing images in order to got the
ImageInformation fully filled.
  Needless to say that executing this entry menu before creating the lines in
the ImageInformation table did not have any effect. It is something I tried
lots of times.

  So, I'm not sure what leads to this database corruption but it is something I
observe several times. And it happens with the 4.x series (ie, I'm sure I fixed
the database while I was already using digikam 4.x and today I needed to fix it
again).

===============================

  Regards,
    Vincent

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[kdelibs] [Bug 345045] digikam: images not displayed in album

Scott Kitterman
https://bugs.kde.org/show_bug.cgi?id=345045

Scott Kitterman <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Product|digikam                     |kdelibs
          Component|Database                    |general
           Assignee|[hidden email]       |[hidden email]
            Version|4.4.0                       |4.14.0
                 CC|                            |[hidden email]

--- Comment #1 from Scott Kitterman <[hidden email]> ---
This does look like solid is likely reporting the mounts as bad in this case.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] digikam: images not displayed in album

Christoph Feck-2
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

Christoph Feck <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|4.14.0                      |4.4.0
           Assignee|[hidden email]        |[hidden email]
          Component|general                     |Database
            Product|kdelibs                     |digikam

--- Comment #5 from Christoph Feck <[hidden email]> ---
I got no answer to comment #2, reassigning back to digikam developers.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] digikam: images not displayed in album

Gilles Caulier-4
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #6 from Gilles Caulier <[hidden email]> ---
Vincent,

If the database is corrupted, did you tried to rebuild it with a new recent
digiKam release. Last on is 4.11.0 commit with 90 bugs closed since 4.10.0.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] digikam: images not displayed in album

Bugzilla from vdanjean.ml@free.fr
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #7 from Vincent Danjean <[hidden email]> ---
  Hi Gilles,

  I'm not sure to understand the version number you tell me about (4.11.0,
4.10.0). It is digikam version itself ? It is an internal version ?
  More over, do you have a document telling me how to do such a rebuild?
  If the rebuild comes only from on-disk files, I'm relunctant. Indeed, my
current database contains lots of information that is not duplicated into
files. The more obvious is the date of all my films that is only stored into
the current database, not in the films themselves.

  That said, I hope you see that, in my last report, my problem comes from
files I just imported. Perhaps there is another inconsistency in the database
that triggered this behavior but it seems a bit strange to me. If you want that
I look into the current database, just tell me. I know how to explore the mysql
database. I can verify what you want.

For now, my database seems clean wrt the small consistency checks I do :
mysql> use digikamdb
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
mysql> DELETE i FROM ImageComments i LEFT OUTER JOIN Images ON
Images.id=i.imageid WHERE Images.name IS NULL;
Query OK, 0 rows affected (0.02 sec)

mysql> DELETE i FROM ImageCopyright i LEFT OUTER JOIN Images ON
Images.id=i.imageid WHERE Images.name IS NULL;
Query OK, 0 rows affected (0.11 sec)

mysql> DELETE i FROM ImageInformation i LEFT OUTER JOIN Images ON
Images.id=i.imageid WHERE Images.name IS NULL;
Query OK, 0 rows affected (0.10 sec)

mysql> DELETE i FROM ImageMetadata i LEFT OUTER JOIN Images ON
Images.id=i.imageid WHERE Images.name IS NULL;
Query OK, 0 rows affected (0.09 sec)

mysql> DELETE i FROM ImageTags i LEFT OUTER JOIN Images ON Images.id=i.imageid
WHERE Images.name IS NULL;
Query OK, 0 rows affected (0.29 sec)

mysql> select CONCAT(relativePath, '/', name) from Images LEFT OUTER JOIN
ImageInformation on Images.id=ImageInformation.imageid LEFT OUTER JOIN Albums
on Images.album=Albums.id where ImageInformation.imageid is NULL;
Empty set (0.05 sec)


  Regards,
    Vincent

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] digikam: images not displayed in album

Gilles Caulier-4
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #8 from Gilles Caulier <[hidden email]> ---
4.10.0 or 4.11.0 is digiKam version release.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] digikam: images not displayed in album

Bugzilla from vdanjean.ml@free.fr
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #9 from Vincent Danjean <[hidden email]> ---
Ok. Digikam is a software with lots of dependencies. I will wait for its
packaging in Debian (even in experimental) and not try to recompile it myself.
I will report back here if I observe the bug again (such as today) in a more
recent version. That said, it is a bug I observe since a long time and through
several releases.

As a side note (it should probably not be in this bug report), I would very
welcome any information telling me how to regenerate thumbnails for films. The
'Refresh' entry in the 'Albums' menu seems to do it for image but not for
films.

Regards,
   Vincent

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Database                    |Database-Mysql
            Summary|digikam: images not         |MYSQL : images not
                   |displayed in album          |displayed in album

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #10 from [hidden email] ---
Are you still able to reproduce the problem with digiKam5.0.0-Beta7 ?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #11 from [hidden email] ---
This file still valid using last digiKam 5.0.0 ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #12 from Vincent Danjean <[hidden email]> ---
  Hi,

  I install digikam from Debian packages but the 5.0.0 is not packaged yet
(even in experimental). So I will test and report when it will be packaged
(there are too many dependencies for digikam to recompile it locally without
messing my system)

  Regards
    Vincent

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #13 from [hidden email] ---
Vincent,

DigiKam 5.0.0 is out. Please see if you could still reproduce the problem and
provide necessary updates, if any.

Thanks

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #14 from [hidden email] ---
Vincent,

DK 5.0.0 is packaged for Debian in Philips Johnson repository:

https://launchpad.net/~philip5/+archive/ubuntu/extra

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #15 from [hidden email] ---
Swati,

This problem cannot be reproduced with current implementation. I recommend to
close it with 5.1.0 release. What do you think ?

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

--- Comment #16 from [hidden email] ---
Yes. I think this could be closed.  I'll do it.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 345045] MYSQL : images not displayed in album

bugzilla_noreply
In reply to this post by Bugzilla from vdanjean.ml@free.fr
https://bugs.kde.org/show_bug.cgi?id=345045

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
   Version Fixed In|                            |5.1.0
         Resolution|---                         |WORKSFORME

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel