[digiKam-users] "Finding new items" stalls, mysql db keeps stopping

[Matt Wilkie]

digikam 6..0, Win10 x64. MariaDB mysql 10.1

Session 1: Last night Digikam sat on "Finding new items 34%" for 9 or 10 hours (it read 34% when I went to bed and still at 34% when I can back). The first 30% only took about 10 or 15 minutes.

 

I have 2 album on an internal local disk, 150 GB of photos, and 2 albums on a USB SSD drive (200GB, connected by usb v2). I can browse the external drive and create and remove files, so the drive is operating normally.

I decided to try the "cancel operation" button, after  a few moments the status bar changed to "No active processes" so I exited Digikam. In the short pause before DK closed I noticed the Albums panel was completely empty.

Session 2: On restart I get the message "Error while opening the database. digiKam will try to automatically reconnect to the database".  (Maria MySQL, as I'm planning for multiple users on different computers.)

I let it spin for about 5 minutes and then cancelled. There was a succeeding error message that I failed to capture (Windows gave it keyboard focus while I was typing somewhere else). After that the DK splash image showed, and that too appeared to get stalled while "Checking ICC repository…".

 

Control Panel >> Services didn't show the mysql service running so I started it.

Session 3: I force closed digikam.exe, verified mysql service still active, and then started digikam again. It seemed to start normally, showed all my albums, and stated bar reported "Finding new items" process active again. After about 1 minute it jumped from 0 to 35%, and then a minute later to 36%, and 37% two minutes after that.

10 minutes later it was still at 37% so I checked Services: yep, mysql was not running. I restarted the service without touching digikam. Percentage crept up to 38%, and then 39% a few minutes later.

So this where I am now (43%), watching services, prepared to start the mysql service whenever I notice it's stopped again. Clearly this is not a good state to stay in. What should I do to get to a stable place, confident in the integrity of digikam and my photo db?

-matt

[Ronald Orenstein]

Hi to all -

I have been looking for some time for a suitable replacement for Aperture (primarily as a DAM) and Digikam for Mac seems to be it.  I hope you won't mind if I ask a few questions as I am still learning!

1. When I use digikam to store info on offline files it does not (as Aperture does) seem to retain a thumbnail of the offline photo unless the offline disk is mounted.  Is this correct or am I missing something?

2. Is there a way to transfer file adjustments made in Aperture (referenced library), as opposed to IPTC data, to Digikam?

3.  Aside from the advanced search function, is there any way to do a Boolean search on tags (eg if I click two tags now under Browse Tags I get all the files using either tag rather than all the tags using both, or using one but not the other).  Aperture has a great function that allows you to use all sorts of Boolean operators on keywords (as well as on other information such as captions) with a few mouse clicks.  If this can't be done in Digikam could such a feature be added?

Thanks!

[Remco Viëtor]

On lundi 20 avril 2020 18:11:03 CEST Ronald Orenstein wrote:
> Hi to all -
> I have been looking for some time for a suitable replacement for Aperture
> (primarily as a DAM) and Digikam for Mac seems to be it.  I hope you won't
> mind if I ask a few questions as I am still learning!
> 1. When I use digikam
> to store info on offline files it does not (as Aperture does) seem to
> retain a thumbnail of the offline photo unless the offline disk is
> mounted.  Is this correct or am I missing something?
Afaik, Digikam should generate a thumbnail and store it in its database. This
does take some time though (and might depend on the way you set up Digikam).

> 2. Is there a way to
> transfer file adjustments made in Aperture (referenced library), as opposed
> to IPTC data, to Digikam?
File adjustments, other than standard metadata, are very difficult to transfer
from one program to another: there are quite a few differences between the
internal workings of editing programs, like working colour space, and the
exact algorithm used for an operation. This makes it very difficult to reuse
the processing data from program A in program B, and get the same result.

Even things like color labels can be impossible to transfer: Digikam allows
one color label to be aplied, Darktable allows any combination of several
color labels. How are you going to use the darktable labels in digikam?

> 3.  Aside from the advanced search function, is
> there any way to do a Boolean search on tags (eg if I click two tags now
> under Browse Tags I get all the files using either tag rather than all the
> tags using both, or using one but not the other).  Aperture has a great
> function that allows you to use all sorts of Boolean operators on keywords
> (as well as on other information such as captions) with a few mouse
> clicks.  If this can't be done in Digikam could such a feature be added?

Allowing "all sorts of Boolean operators on keywords" and other image
information is the 'raison d'être' of the advanced search tab... As an extra,
it also allows you to save such a search under a user-specified name, for
later reuse. Why would you want to duplicate that functionality just for tags
in another place? Also, unless you are very careful or experienced, simple
ways of combining boolean operators can give unexpected results.

> Thanks!
> Ronald Orenstein
> 1825 Shady Creek Court
> Mississauga, ON L5L 3W2
> Canada
> ronorenstein.blogspot.com
> ronorensteinwriter.blogspot.com

[woenx]

Matt, for some reason, it looks like the database file has been corrupted.
Did you try in removing (or renaming) the database file (digikam4.db) and
restarting digikam?

By the way, do you store the database in your local hard drive or in the
external one?



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[woenx]

Hi Ronald,

Regarding question #1, I think digikam cannot operate if the files are not
present at that moment. Even if it stores the thumbnails in a database, if
files are not accessible it will hide them (and then try to re-scan them
next time they are available).

No idea about transferring the file adjustments from Aperture. Where is that
data stored? In what format?

Regarding the last thing, yes, you can do complex searches using the filter
panel on the right side of the interface. Go to Filters, select the tag you
want, right click, "Must have this tag" or "Must not have this tag". You can
switch from AND to OR using the little button at the bottom right of that
list. Combine that with geolocation, and using a photo selection from the
search panel, and it's quite powerful. I don't think it's currently possible
o manually enter a SQL-like query, though.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[Ronald Orenstein]

Thanks to all who have sent me answers - I hadn't seen the and/or tag.

On Tuesday, April 21, 2020, 11:46:13 a.m. EDT, woenx <[hidden email]> wrote:

Hi Ronald,

Regarding question #1, I think digikam cannot operate if the files are not
present at that moment. Even if it stores the thumbnails in a database, if
files are not accessible it will hide them (and then try to re-scan them
next time they are available).

No idea about transferring the file adjustments from Aperture. Where is that
data stored? In what format?

Regarding the last thing, yes, you can do complex searches using the filter
panel on the right side of the interface. Go to Filters, select the tag you
want, right click, "Must have this tag" or "Must not have this tag". You can
switch from AND to OR using the little button at the bottom right of that
list. Combine that with geolocation, and using a photo selection from the
search panel, and it's quite powerful. I don't think it's currently possible
o manually enter a SQL-like query, though.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[Matt Wilkie]

Hi woenx,

I'm using MySQL (Maria) not sqlite, so would that advice still apply? What
is the consequence of removing the db file?

I do have a digikam4.db file in C:\ProgramData\DigiKam but it's date stamp
is months ago, Feb 1st. That's about the time I installed DigiKam (Well,
upgraded. I had installed a year or so ago but didn't do much with it.)

I searched the external drive for "*digikam*" and didn't find any .db files.

-matt



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[Matt Wilkie]

Matt Wilkie wrote
> So this where I am now (43%), watching services, prepared to start the
> mysql service whenever I notice it's stopped again.

I did that for the rest of the day. In total I think I restarted mysql 5 or
6 times. I kept an eye on Task Manager resources. The system memory
maintained 20 to 30% free (2GB of 10GB total) which is normal for this
machine; CPU usage was low, teens and twenties.

Since then Digikam and Mysql seem stable but I haven't done anything much
besides browse albums.

-matt




--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[woenx]

To be honest, I don't really know the advantages of using MySQL or SQLite in
digikam. I my case I use SQLite, which was the default option.

If you delete the database file, digikam will recreate it from scratch. And
obviously, you'll have to re-scan all the contents of your collection which
can take a while. But in case the database structure has been corrupted or
something, it's the easiest option.



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[leoutation]

On 4/25/20 7:13 PM, woenx wrote:
> To be honest, I don't really know the advantages of using MySQL or SQLite in
> digikam. I my case I use SQLite, which was the default option.
>
> If you delete the database file, digikam will recreate it from scratch. And
> obviously, you'll have to re-scan all the contents of your collection which
> can take a while. But in case the database structure has been corrupted or
> something, it's the easiest option.

Hi
- External Mariadb / mysql  allows to share images with network
- Mariadb  is faster, mainly with many big image files
- in very rare corruption cases, it's easy to repare mariadb, in short
time. No need to recreate db.
- mariadb is safer, easy to backup or clone with integrated tool
"mariabackup"

--
Maderios