[digikam] [Bug 324287] New: frequent image scans slow with mysql

[Rainer Lay]

https://bugs.kde.org/show_bug.cgi?id=324287

            Bug ID: 324287
           Summary: frequent image scans slow with mysql
    Classification: Unclassified
           Product: digikam
           Version: 3.2.0
          Platform: Ubuntu Packages
                OS: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: Database
          Assignee: [hidden email]
          Reporter: [hidden email]

on startup, the following sql is executed serveral times, which costs ~5 sec
each.
--
SELECT creationDate FROM ImageInformation  INNER JOIN Images ON
Images.id=ImageInformation.imageid  WHERE Images.status=1;
--
also, when I import pictures, this sql is executed for every imported picture
(5sec each!).

I just wonder, why the creation datefor all pictures (80.000 in thi collection)
is neccesary that much. Since this costs my lots of time, please have a look at
this.

For your information: the sql itselve is very fast, but fetching the 80.000
creationDates costs the 5 sec,even when I fetch them on the server (synology
DS213+).

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Rainer Lay]

https://bugs.kde.org/show_bug.cgi?id=324287

--- Comment #1 from Rainer Lay <[hidden email]> ---
Created attachment 82096
  --> https://bugs.kde.org/attachment.cgi?id=82096&action=edit
log from mysqld-slow.log with queries longer one sec, while importing images

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Marcel Wiesweg]

https://bugs.kde.org/show_bug.cgi?id=324287

--- Comment #2 from Marcel Wiesweg <[hidden email]> ---
So you have the MySQL on a NAS server and the network is the bottleneck?

The query is done to update the timeline view, and is usually relatively fast.
There is a timer defined in AlbumManager that limits this scan to be done not
more frequently than every 5 sec. Unfortunately, as it takes 5 secs for you,
this is ineffective.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Marcel Wiesweg]

https://bugs.kde.org/show_bug.cgi?id=324287

--- Comment #3 from Marcel Wiesweg <[hidden email]> ---
Git commit 145b25c573164111b75c1a8586b5aea50656572c by Marcel Wiesweg.
Committed on 03/09/2013 at 20:08.
Pushed by mwiesweg into branch 'master'.

The DAlbums scan can be costly for some setup as it sends large amounts of data
over the SQL connection.
- reduce the timer limit to one minute
- do not kill the running job if the timer fired again while the job was
running.

M  +13   -2    digikam/album/albummanager.cpp
M  +1    -0    digikam/album/albummanager.h

http://commits.kde.org/digikam/145b25c573164111b75c1a8586b5aea50656572c

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=324287

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]
            Summary|frequent image scans slow   |MySQL : frequent image
                   |with mysql                  |scans slow

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=324287

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|MySQL : frequent image      |SCAN : frequent image scans
                   |scans slow                  |slow

--- Comment #4 from Gilles Caulier <[hidden email]> ---
We need a fresh feedback using a recent digiKam release as last 4.2.0.

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Rainer Lay]

https://bugs.kde.org/show_bug.cgi?id=324287

Rainer Lay <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
             Status|UNCONFIRMED                 |RESOLVED

--- Comment #5 from Rainer Lay <[hidden email]> ---
With digikam 4.2., windows, the query is no longer reported as slow (>1s)
query. So I suggest to close this bug.

Rainer

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=324287

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Version Fixed In|                            |4.4.0

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[bugzilla_noreply]

https://bugs.kde.org/show_bug.cgi?id=324287

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|Database                    |Database-Scan

--
You are receiving this mail because:
You are the assignee for the bug.