[Bug 160966] New: some searches don't work properly with the new sqlite3-3.5.8

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         
           Summary: some searches don't work properly with the new sqlite3-
                    3.5.8
           Product: digikam
           Version: unspecified
          Platform: unspecified
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: normal
          Priority: NOR
         Component: general
        AssignedTo: digikam-devel kde org
        ReportedBy: andi.clemens gmx net


Version:            (using 3.5.9, Arch Linux)
Compiler:          Target: i686-pc-linux-gnu
OS:                Linux (i686) release 2.6.24-ARCH

Yesterday Archlinux updated their version of sqlite3 from 3.5.7 to 3.5.8.
Everything seemed to work fine, but then I found out that that some of may
advanced filters didn't work anymore.
Further investigation brought me to the conclusion that the only filters not
working properly anymore are those filters that look for images with a given
rating. These searches took more then 15 seconds to complete, before that no
images are even shown in the image list window and digikam also does not
respond to any user input.
Because sqlite3 was the only updated package, I strongly assume that no other
reason could be possible for this behavior.
So I checked out the latest digikam KDE3 SVN version, compiled it but still the
same problem.
I updated my other archlinux box with KDE4 installed, compiled the newest SVN
version of digikam for KDE4 and installed it, all the filters work fine here.
So I assume that something in 0.9.4beta4 is incompatible with the sqlite3-3.5.8
package.
I attached a screenshot that shows the filter regions working fine and those
that are not.

Andi
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-18 10:19 -------
Created an attachment (id=24382)
 --> (http://bugs.kde.org/attachment.cgi?id=24382&action=view)
some searches are very slow

the colors in this screenshot represent:

red - those search areas are not working anymore
yellow - the used settings for the search "top rated", it takes up to 15
seconds to display 3 images that have 5 stars
green - those searches / filters work fine
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         
andi.clemens gmx net changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|some searches don't work    |some searches don't work
                   |properly with the new       |properly with the new
                   |sqlite3-3.5.8               |sqlite3-3.5.8



------- Additional Comments From andi.clemens gmx net  2008-04-18 10:21 -------
edit: red in the screenshot doesn't mean that they are not working anymore, but that those filters are VERY slow with the settings shown in the yellow dialog
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         
caulier.gilles gmail com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
          Component|general                     |Database
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From caulier.gilles gmail com  2008-04-18 10:25 -------
Andi,

Are you compiled yourself digiKam or are you used pre-compiled packages ?

Gilles Caulier
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-18 13:16 -------
I compiled from SVN (beta4), I don't use the official packages from archlinux because they don't have digikam-0.9.4beta in it...
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From caulier.gilles gmail com  2008-04-18 13:32 -------
Andi,

Are you some error messages on the console ?

Gilles Caulier
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-18 13:39 -------
No, the only messages I get are written to the console during the startup:

Found dcraw version: 8.83
KIPI (loading): WARNING: KIPI::PluginLoader:: createInstanceFromLibrary returned 0 for JPEGLossless (kipiplugin_jpeglossless) with error number 3
KIPI (loading): WARNING: KLibLoader says: libkdcraw.so.2: cannot open shared object file: No such file or directory
KIPI (loading): WARNING: KIPI::PluginLoader:: createInstanceFromLibrary returned 0 for Viewer (kipiplugin_viewer) with error number 3
KIPI (loading): WARNING: KLibLoader says: libkdcraw.so.2: cannot open shared object file: No such file or directory
KIPI (loading): WARNING: KIPI::PluginLoader:: createInstanceFromLibrary returned 0 for SendImages (kipiplugin_sendimages) with error number 3
KIPI (loading): WARNING: KLibLoader says: libkdcraw.so.2: cannot open shared object file: No such file or directory
KIPI (loading): WARNING: KIPI::PluginLoader:: createInstanceFromLibrary returned 0 for SlideShow (kipiplugin_slideshow) with error number 3
KIPI (loading): WARNING: KLibLoader says: libkdcraw.so.2: cannot open shared object file: No such file or directory
KIPI (loading): WARNING: KIPI::PluginLoader:: createInstanceFromLibrary returned 0 for RawConverter (kipiplugin_rawconverter) with error number 3
KIPI (loading): WARNING: KLibLoader says: libkdcraw.so.2: cannot open shared object file: No such file or directory
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From caulier.gilles gmail com  2008-04-18 13:48 -------
Andi,

No chance for you... your installation is fully broken. I can't understand how digiKam can start as well.

You must uninstall all (libkipi, libkdcraw, likexiv2, kipi-plugins, and digiKam) and re-compile and re-install properlly.

Gilles Caulier
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-18 13:53 -------
Strange... but why did it happen since the upgrade of sqlite3? All the other digikam functions seem to work normal.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-18 14:07 -------
Ok, I reinstalled everything from the archlinux repository, so now I'm running digikam 0.9.3 again. No error messages in the console, BUT the searching for images with a given rating is still messed up!
It must be an issue with sqlite3-3.5.8....
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-24 01:56 -------
I checked with another distribution (sidux): I installed sqlite3-3.5.8 and now all searches for a special rating are very slow... so the issue must be the sqlite upgrade...
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Arnd Baecker]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         
arnd.baecker web de changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |marcel.wiesweg gmx de



------- Additional Comments From arnd.baecker web de  2008-04-24 22:27 -------
I checked with the sqlite experts. They pointed out that
"Version 3.5.8 includes some important new performance optimizations", see
http://www.sqlite.org/news.html, and that it might be possible that
these slow things down for some reason.

One suggestion was to use analyze, http://www.sqlite.org/lang_analyze.html

You could try this in the following way:
a) make a copy of digikam3.db
   (which is in the directory below which all images directories are)
b) Then run
     sqlite3 digikam3.db
   and issue the command
     analyze;
   Quit via
     .quit
 
Does this improve things?
(The change written to the database can be checked by comparing a
string dump:
   sqlite3 digikam3.db_ORIG
   .output before.dump
   .dump
   .quit
and
    sqlite3 digikam3.db
   .output after.dump
   .dump
   .quit
   
So if this analyze thing does not improve speed, we need
to figure out, which searches  are slow in terms of
their sql statements.
For this you would need to modify
   digikam/kioslave/digikamsearch.cpp
by adding a
  kdWarning() << "SQL Query " << sqlQuery << endl;
in the line before each of the two calls to m_db.execSql.

Andy, do you think you can do this?

Best, Arnd
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-24 23:56 -------
Sure... I know some C++, did my diploma thesis in it... so I guess this will be no problem... :-) I will try it tomorrow, now it is too late... I will post my results in here...
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-24 23:57 -------
Oh forgot to ask: Should I use the code for 0.9.3 or the current SVN repository for KDE3?
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From caulier.gilles gmail com  2008-04-25 06:16 -------
Andi,

Please, use the current SVN repository for KDE3. Thanks in advance.
Gilles Caulier
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Arnd Baecker]

Hi Andi,

well, why not go for svn... ;-)
See http://www.digikam.org/?q=download/svn
in particular below "Install digiKam in your Home Directory")

Best, Arnd
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Arnd Baecker]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From arnd.baecker web de  2008-04-25 06:44 -------
Hi Andi,

well, why not go for svn... ;-)
See http://www.digikam.org/?q=download/svn
in particular below "Install digiKam in your Home Directory")

Best, Arnd
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Arnd Baecker]

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From arnd.baecker web de  2008-04-25 07:17 -------
Just to outline the strategy I have in mind to hunt down the problem:
a) isolate one sql statement corresponding to a slow search
b) use the sqlite3 command line tool to reproduce that the search is slow
   (i.e. we would get rid of using digikam itself)
c) then compare on the same machine with the previous version of sqlite3.
d) put the database somewhere to download so that Gilles/Marcel/I can
   try to test/reproduce the problem on our machines
e) report back to the sqlite team

Thanks a lot Andi, that you have a look at this. If there is really
a problem with sqlite, this would strike many digikam users in the near future
if 3.5.8 is installed widely!
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.
         
http://bugs.kde.org/show_bug.cgi?id=160966         




------- Additional Comments From andi.clemens gmx net  2008-04-25 09:22 -------
OK I'll use SVN, I just asked because I recompiled 0.9.3 against the new sqlite3 some days ago so 'make' will run through a lot faster... :-)
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel