[digiKam-users] Performance Tips for Dealing with 1.6M Images?

[DoctorWkt]

Hi all, first time poster here. My wife Deanne, an avid photographer, just
passed away and I've got her 1.6 million photos into a ZFS filesystem. Can
anybody point me at tips for improving/optimising Digikam performance as, at
the moment, sometimes I get hit with delays from 10s to minutes when doing
things.

Here's my setup: 64-bit Debian, Linux 4.19.118, 32G RAM, i5-4570 CPU @
3.20GHz, SSD with mariadb-server-10.3. digikam-7.0.0-x86-64.appimage using
the Maria database (no Sqlite). The images are stored on a ZFS filesystem
with two 8T drives, mirrored.

Are there any logs which I could look at to get clues on the performance
bottlenecks?

Thanks in advance for any suggestions, Warren

P.S. I'm also getting a segfault when doing face detection; I suspect it is
just one image causing the problem. Any pointers on how to capture the
details and report it? Thanks!



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[Rafael Linux]

Hi

My case is with about 300K photos, most of them JPG. I am using using an SSD
hard disk to store Digikam database (internal MySQL experimental one) and
photographies are in a normal, 2TB hard disk, so the slowest part was when
Digikam needed to scan ALL photos.

From Digikam 6, most issues (Digikam took about 5 minutes each time I
launched) were fixed. However, with Digikam 7, in any album, if I change the
"order" (sort) view , it takes an anormal time to each time I need to sort
photos.

Where do you have stored database?



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[DoctorWkt]

Rafael Linux wrote
> Where do you have stored database?

It's on my SSD card in a MySQL database (MariaDB, actually).

Cheers, Warren




--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[woenx]

Hi,

I am sorry for your loss. That is a huge amount of photos. I am using
digikam with less than 1/10 of that.

I'm not sure how digikam will perform with such a library, but I think it
should be usable nevertheless. I'd just let it scan everything and not touch
it until it has imported all pictures into the library. Once everything is
in there, you can start tagging and organising things.

Regarding the face detection, I also encountered crashes when scanning a
large amount of faces, I think it's a bug that has been already reported.
For now, I'd just try to scan one folder at a time (doing right click, Scan
for faces).

If you are using the appimage bundles, you can add "debug" to the end in a
console, and you'll have tons of information so you can report any crashes.
For instance:    ./digikam-7.0.0-x86-64.appimage debug

Good luck!



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html

[Jorge Rosa]

Hi;
Thank you for prompt response.  
It is a new installation in a apple computer.  Starting for the firs time is giving such error.  Apple give the opportunity to change script to solve problem, but do not know anything about it.  
This error is has to do with a missing “lib”?
Please advise.
thank you
jorge

> On Sep 9, 2020, at 3:30 PM, woenx <[hidden email]> wrote:
>
> Hi,
>
> I am sorry for your loss. That is a huge amount of photos. I am using
> digikam with less than 1/10 of that.
>
> I'm not sure how digikam will perform with such a library, but I think it
> should be usable nevertheless. I'd just let it scan everything and not touch
> it until it has imported all pictures into the library. Once everything is
> in there, you can start tagging and organising things.
>
> Regarding the face detection, I also encountered crashes when scanning a
> large amount of faces, I think it's a bug that has been already reported.
> For now, I'd just try to scan one folder at a time (doing right click, Scan
> for faces).
>
> If you are using the appimage bundles, you can add "debug" to the end in a
> console, and you'll have tons of information so you can report any crashes.
> For instance:    ./digikam-7.0.0-x86-64.appimage debug
>
> Good luck!
>
>
>
> --
> Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html