[digikam] [Bug 323888] New: Face recognition makes digikam fill all the available memory

classic Classic list List threaded Threaded
123 messages Options
1234567
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

eldk
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #39 from [hidden email] ---
Created attachment 82913
  --> https://bugs.kde.org/attachment.cgi?id=82913&action=edit
Variables when SigFault at dimg.cpp ligne 165

Variables when digikam crash on dimg.cpp line 165 (scanning faces)

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Olivier Becquaert
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Olivier Becquaert <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #40 from Olivier Becquaert <[hidden email]> ---
Hello great Digikam team,

please fix this bug...this is a huge regression since last 2 versions : face
recognition is not usable anymore :-(.

Regards,
Olivier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #41 from Gilles Caulier <[hidden email]> ---
The huge memory leak is already fixed. I miss libPGF memory corruption/leakto
be fixed. I waiting libpgf feedback for that.

Note: libpgf problems already exist in previous versions...

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Olivier Becquaert
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #42 from Olivier Becquaert <[hidden email]> ---
Thank you Gilles for your quick feedback. Hope you'll be able to publish a
release soon :-).

Olivier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #43 from Gilles Caulier <[hidden email]> ---
*** Bug 327197 has been marked as a duplicate of this bug. ***

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #44 from Gilles Caulier <[hidden email]> ---
*** Bug 325712 has been marked as a duplicate of this bug. ***

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #45 from Gilles Caulier <[hidden email]> ---
*** Bug 329651 has been marked as a duplicate of this bug. ***

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Olivier Becquaert
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #46 from Olivier Becquaert <[hidden email]> ---
(In reply to comment #41)
> The huge memory leak is already fixed. I miss libPGF memory
> corruption/leakto be fixed. I waiting libpgf feedback for that.
>
> Note: libpgf problems already exist in previous versions...
>
> Gilles Caulier

Hi Gilles,

I wish you all the best for you & Digikam in 2014 !

is libpgf bug fixed ?

Regards
Olivier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #47 from Gilles Caulier <[hidden email]> ---
Thanks for your 2014 hopes.

libpgf is fixed into digiKam core, but stand alone library is not yet released
with fixes. This is why libpgf still in digiKam core for the moment...

Gilles Caulier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Olivier Becquaert
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #48 from Olivier Becquaert <[hidden email]> ---
Hi Gilles,

you mean it is fixed in digikam core in current version (3.5.0) ? Or in a
version to be published ? because I have this bug in version 3.5.0 (on
archlinux).

regards
Olivier

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

eldk
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #49 from [hidden email] ---
Hello,

You must build digikam 3.5 with internal libpgf (given in digikam 3.5.0
sources).

For this, you must remove the libpgf package from distribution then rebuild
digikam. I will answer you more in detail tomorrow, but if i well remenber, i
think remove lipgf package from dist is enougth.

So remove libpgf, then make an make install for digikam.

Regards,

Eric

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Gilles Caulier-4
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #50 from Gilles Caulier <[hidden email]> ---
*** Bug 331912 has been marked as a duplicate of this bug. ***

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

kde-bugtracking
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |kde-bugtracking@srsoftware.
                   |                            |de

--- Comment #51 from [hidden email] ---
This bug stil occurs in Digikam 4.11.3 within OpenSUSE 13.1, linux
3.11.10-7-desktop.

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Rob Dean
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #52 from [hidden email] ---
I also get this bug in digiKam Version 4.0.0-beta3 (installed from the ppa at
http://ppa.launchpad.net/msylwester/digikam-beta/ubuntu). I use this PPA
because I don't believe that in this day and age I should have to compile the
code myself. Why is there no "official" PPA for Digikam betas? Would this not
help with testing? Is there plans to resolve this bug properly? It seems that
face recognition is a major draw card for Digikam and the fact that it makes
the program grind to a halt isn't a good look. Is there a workaround? With
easily followed instructions?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Scott
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Scott <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #53 from Scott <[hidden email]> ---
I am also still getting this in digikam 4.0.0.beta4 from msylwester's ppa.

is it at all possible to compile the internal libpgf and install this on the
system, or stick it in a ppa somewhere to save having to wait for an update to
a package that has not been updated upstream in 3 years?

I get error after error trying to compile digikam using the flaky instructions
provided on the digikam website and just dont have the time to sort the issues
out, though I do love digikam.

This is a shame that one of the major features that digikam offers is
completely unusable...

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

kaefert@gmail.com
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Thomas Käfer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #54 from Thomas Käfer <[hidden email]> ---
I'm experiencing this bug in digikam 4.0.0.beta4 (compiled it myself)
After killing my "unresponsive" (all changes to face-tags are ignored and
undone) digikam I've found that my recognition.db was 11GB in size. After
deleting (renaming) it the tagging now works brilliantly :)

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Rob Dean
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #55 from [hidden email] ---
(In reply to comment #54)
> I'm experiencing this bug in digikam 4.0.0.beta4 (compiled it myself)
> After killing my "unresponsive" (all changes to face-tags are ignored and
> undone) digikam I've found that my recognition.db was 11GB in size. After
> deleting (renaming) it the tagging now works brilliantly :)

Can anyone else confirm this works? And provide some clear "how to" steps if it
does?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Ritesh Raj Sarraf-3
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

Ritesh Raj Sarraf <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #56 from Ritesh Raj Sarraf <[hidden email]> ---
(In reply to comment #41)
> The huge memory leak is already fixed. I miss libPGF memory
> corruption/leakto be fixed. I waiting libpgf feedback for that.
>
> Note: libpgf problems already exist in previous versions...
>
> Gilles Caulier

@Gilles, I don't think the problem lies with libPGF.

First based on the advise, I recompiled libPGF as was recommended. That did not
help.

Then, I recompiled Digikam (4.0 Beta 4) with internal libPGF support. It still
loses memory at the same insane rate.


digiKam version 4.0.0-beta4
Exiv2 can write to Jp2: Yes
Exiv2 can write to Jpeg: Yes
Exiv2 can write to Pgf: Yes
Exiv2 can write to Png: Yes
Exiv2 can write to Tiff: Yes
Exiv2 supports XMP metadata: Yes
LibCImg: 130
LibEigen: 3.2.1
LibExiv2: 0.23
LibJPEG: 80
LibJasper: 1.900.1
LibKDE: 4.12.4
LibKExiv2: 2.3.1
LibKGeoMap: 2.0.0
LibKdcraw: 2.3.1
LibLCMS: 2060
LibLensFun: 0.2.8-0
LibPGF: 6.13.45 - internal library
LibPNG: 1.2.50
LibQt: 4.8.6
LibRaw: 0.15.3
LibTIFF: LIBTIFF, Version 4.0.3 Copyright (c) 1988-1996 Sam Leffler Copyright
(c) 1991-1996 Silicon Graphics, Inc.
Marble Widget: 0.16.5 (stable version)
Parallelized PGF codec: No
Parallelized demosaicing: No
RawSpeed codec support: No
Database backend: QSQLITE
Kipi-Plugins: 4.0.0-beta4
LibGphoto2: 2.5.4
LibKface: 3.0.0
LibKipi: 2.1.0
LibOpenCV: 2.4.8

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Scott
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #57 from Scott <[hidden email]> ---
I can confirm that this bug has been fixed in libpgf upstream, and therefore
Digikam.  Of course though, the libpgf package still hasn't made it to the
Debian/Ubuntu repo's as yet...

The steps that I took to resolve this (on x64 Ubuntu 13.10, running digikam
from the package maintained by msylwester's ppa), and I am trying to make this
as accessible to the everyday user as possible:

Firstly: Don't uninstall the official package if you installed digikam from a
repository!! It is a dependency of digikam, so you want the system to think it
is there still!  As I am still a reasonably new user to compiling from source,
I know no better way than to fool the system into thinking it has one version,
when it has a newer...

Get the package source from here:
http://sourceforge.net/projects/libpgf/files/libpgf/6.14.12-latest/libpgf-src-6.14.12.tar.gz/download

unpack it in a terminal using:  
tar -xzvf libpgf-src-6.14.12.tar.gz

Get the required essentials for building packages if you havent already:    
sudo apt-get install build-essential checkinstall  

On top of build-essentials etc. you also need libtools and automake.   Get
those too:
sudo apt-get install libtools automake

Once you've got those, cd to the directory where libpgf extracted to, then run
./autogen.sh

Once that has finished, you need to run
./configure

For me, there seemed to be an error in the generated config file due to a
malformed command.  I kept getting the error: ".in'ig.status: error: cannot
find input file: `Makefile".  To resolve this, open the configure file using
your favourite text editor, for me it's:
gedit configure

Search for a line that has "cat >$CONFIG_STATUS <<_ASEOF || as_write_fail=1"
(the easiest way is just to search for ">$C" and it should come up.  Add a
space in between the > and $ so the line then reads: "cat > $CONFIG_STATUS
<<_ASEOF || as_write_fail=1".  Save and close the file and rerun:
./configure

If all goes well, proceed as normal:
make
sudo make install

There is one final step though.  This technique puts the libraries in the wrong
position for digikam.  It puts them in the /usr/local/lib/, while digikam looks
for them in /usr/lib/x86_64-linux-gnu/ but this is easily fixed by copying them
to the correct location running:
sudo cp -f /usr/local/lib/libpgf.so.6.0.11
/usr/lib/x86_64-linux-gnu/libpgf.so.6 && sudo cp -f
/usr/local/lib/libpgf.so.6.0.11 /usr/lib/x86_64-linux-gnu/libpgf.so.6.0.7 &&
sudo cp -f /usr/local/lib/libpgf.so.6.0.11
/usr/lib/x86_64-linux-gnu/libpgf.so.6.0.11

This forces any other programs that may be looking for libpgf.so.6.0.7 to use
libpgf.so.6.0.11 also.  And for those others out there, yes I know I could have
made symlinks, but every time I tried, the links were broken...  I have no idea
what I was doing wrong, but copying worked, so I'm sticking with it...

Once I had done this, the first tag took forever still, but after the first
went much, much quicker than previously.  Good work libpgf team!

Hope this helps a bit for some...  Now just to wait for the official repos to
catch up. :)

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

[digikam] [Bug 323888] Face recognition makes digikam fill all the available memory

Ritesh Raj Sarraf-3
In reply to this post by Alberto Ferrante
https://bugs.kde.org/show_bug.cgi?id=323888

--- Comment #58 from Ritesh Raj Sarraf <[hidden email]> ---
(In reply to comment #57)

> I can confirm that this bug has been fixed in libpgf upstream, and therefore
> Digikam.  Of course though, the libpgf package still hasn't made it to the
> Debian/Ubuntu repo's as yet...
>
> The steps that I took to resolve this (on x64 Ubuntu 13.10, running digikam
> from the package maintained by msylwester's ppa), and I am trying to make
> this as accessible to the everyday user as possible:
>
> Firstly: Don't uninstall the official package if you installed digikam from
> a repository!! It is a dependency of digikam, so you want the system to
> think it is there still!  As I am still a reasonably new user to compiling
> from source, I know no better way than to fool the system into thinking it
> has one version, when it has a newer...
>
> Get the package source from here:
> http://sourceforge.net/projects/libpgf/files/libpgf/6.14.12-latest/libpgf-
> src-6.14.12.tar.gz/download
>
> unpack it in a terminal using:  
> tar -xzvf libpgf-src-6.14.12.tar.gz
>
> Get the required essentials for building packages if you havent already:    
> sudo apt-get install build-essential checkinstall  
>
> On top of build-essentials etc. you also need libtools and automake.   Get
> those too:
> sudo apt-get install libtools automake
>
> Once you've got those, cd to the directory where libpgf extracted to, then
> run
> ./autogen.sh
>
> Once that has finished, you need to run
> ./configure
>
> For me, there seemed to be an error in the generated config file due to a
> malformed command.  I kept getting the error: ".in'ig.status: error: cannot
> find input file: `Makefile".  To resolve this, open the configure file using
> your favourite text editor, for me it's:
> gedit configure
>

I saw this error too. From what it looks, the generated configure file as
invalid characters in it. Given that this file is generated at runtime, it
makes me curious on where lies the bug.

> Search for a line that has "cat >$CONFIG_STATUS <<_ASEOF || as_write_fail=1"
> (the easiest way is just to search for ">$C" and it should come up.  Add a
> space in between the > and $ so the line then reads: "cat > $CONFIG_STATUS
> <<_ASEOF || as_write_fail=1".  Save and close the file and rerun:
> ./configure
>

This alone did not solve the problem. You still get errors like config.h.in not
present etc... Open the configure script and look for many instances of the
word "Makefile". It has some invalid characters in it. Remove them and then the
configure scirpt runs fine..

But.....

> If all goes well, proceed as normal:
> make
> sudo make install
>
> There is one final step though.  This technique puts the libraries in the
> wrong position for digikam.  It puts them in the /usr/local/lib/, while
> digikam looks for them in /usr/lib/x86_64-linux-gnu/ but this is easily
> fixed by copying them to the correct location running:
> sudo cp -f /usr/local/lib/libpgf.so.6.0.11
> /usr/lib/x86_64-linux-gnu/libpgf.so.6 && sudo cp -f
> /usr/local/lib/libpgf.so.6.0.11 /usr/lib/x86_64-linux-gnu/libpgf.so.6.0.7 &&
> sudo cp -f /usr/local/lib/libpgf.so.6.0.11
> /usr/lib/x86_64-linux-gnu/libpgf.so.6.0.11
>
> This forces any other programs that may be looking for libpgf.so.6.0.7 to
> use libpgf.so.6.0.11 also.  And for those others out there, yes I know I
> could have made symlinks, but every time I tried, the links were broken...
> I have no idea what I was doing wrong, but copying worked, so I'm sticking
> with it...
>
> Once I had done this, the first tag took forever still, but after the first
> went much, much quicker than previously.  Good work libpgf team!
>
> Hope this helps a bit for some...  Now just to wait for the official repos
> to catch up. :)

But... The problem remains the same. Digikam still leaks memory. Can you please
double check if it has sorted the problem for you ?

--
You are receiving this mail because:
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
1234567