[digiKam-users] Is there a speed advantage if database is on a different drive?

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[digiKam-users] Is there a speed advantage if database is on a different drive?

Chris Green
I was just thinking while watching Digikam scan through a lot of
images, is there any (much?) advantage to be gained by putting
Digikam's database on a different disk drive from the image files?

--
Chris Green
·

Reply | Threaded
Open this post in threaded view
|

Re: Is there a speed advantage if database is on a different drive?

Matthieu
Hi,

Digikam will be faster if the database engine/server is located on the server/desktop which launches digikam: you'll reduce the network latency.
If your pictures are stored on a network storage, no matter of where is located your database, it will be slow: digikam must check the pictures to identify new ones: the bottleneck is your network speed and your NAS performances.
MySQL is by default slower than SQLite but using SQLite does not allow to have an integrity constraint violations and so your database could be corrupted.

My feedback from my NAS storage pictures management with digikam: MySQL is not an option when you have a large number of pictures (when migrating from SQLite to MySQL I've seen that many of my data have to be processed back).
Both CIFS and NFS protocols offered quite the same performances.
After my migration from 5.9 to 6 beta, the average performances increased.
I tuned a bit MySQL to manage my 25k pictures.

hope it can help.

Mat



Le sam. 29 sept. 2018 à 03:03, Chris Green <[hidden email]> a écrit :
I was just thinking while watching Digikam scan through a lot of
images, is there any (much?) advantage to be gained by putting
Digikam's database on a different disk drive from the image files?

--
Chris Green
·

Reply | Threaded
Open this post in threaded view
|

Re: Is there a speed advantage if database is on a different drive?

Chris Green
Matthieu <[hidden email]> wrote:

> [-- text/plain, encoding quoted-printable, charset: UTF-8, 38 lines --]
> Le sam. 29 sept. 2018 à 03:03, Chris Green <[hidden email]> a écrit :
>
> > I was just thinking while watching Digikam scan through a lot of
> > images, is there any (much?) advantage to be gained by putting
> > Digikam's database on a different disk drive from the image files?
> >
>
> Digikam will be faster if the database engine/server is located on the
> server/desktop which launches digikam: you'll reduce the network latency.
> If your pictures are stored on a network storage, no matter of where is
> located your database, it will be slow: digikam must check the pictures to
> identify new ones: the bottleneck is your network speed and your NAS
> performances.
> MySQL is by default slower than SQLite but using SQLite does not allow to
> have an integrity constraint violations and so your database could be
> corrupted.
>
> My feedback from my NAS storage pictures management with digikam: MySQL is
> not an option when you have a large number of pictures (when migrating from
> SQLite to MySQL I've seen that many of my data have to be processed back).
> Both CIFS and NFS protocols offered quite the same performances.
> After my migration from 5.9 to 6 beta, the average performances increased.
> I tuned a bit MySQL to manage my 25k pictures.
>
> hope it can help.
>
By 'on a different disk drive' I meant a different disk drive on the
*same* computer.  So, network speed doesn't come into it at all, I
realise that accessing any part of Digikam's data across a network
will obviouslybe a lot slower than a local disk drive.

--
Chris Green
·

Reply | Threaded
Open this post in threaded view
|

Re: Is there a speed advantage if database is on a different drive?

Rafael Linux
This post was updated on .
I have +300K images on an SATA 3 HD disk and MySQL database in an SATA 3 SSD
disk. Is a fast configuraton, but as I related on my posted bug in  KDE bugs
<https://bugs.kde.org/show_bug.cgi?id=396086>   and here (http://digikam.1695700.n4.nabble.com/digiKam-users-Anyone-with-a-300K-photos-internal-mysql-database-td4706440.html#none), I have a big delay
when Digikam starts and a slow sorting elements problem. So, I think your
hardware configuration is enough to have a good performance, till your
database grow like mine.

I hope this problems will be solved in Digikam 6, cause it's a headache (and
exasperating to use in a day to day workflow)  to wait everytime  Digikam
5.9 is launched.

Regards



--
Sent from: http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html