Status of face detection

classic Classic list List threaded Threaded
87 messages Options
12345
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
Marcel,

Why Face detection progress dialog is modal ? We cannot continue to
work on the rest of digiKam during face processing ?

Gilles Caulier

2010/10/29 Gilles Caulier <[hidden email]>:

> Same problem for me. I just tried to scan all faces. It lock to a mpeg
> video file. No crash...
>
> Gilles Caulier
>
> 2010/10/29 Gert Kello <[hidden email]>:
>> warning: Debug:digikam(1128)/digikam (core)
>> Digikam::BatchFaceDetector::slotItemsInfo: 4
>>
>> [New Thread 1128.0x14c]
>>
>> Could it be that this thread is created for uninitialized or null
>> object? Or that some parameter passed in is not initialized?
>>
>> Gert
>>
>> On 29 October 2010 12:44, Marcel Wiesweg <[hidden email]> wrote:
>>>
>>>
>>> 0x0cfce20a in void cv::cvt_<float, double>(cv::Mat const&, cv::Mat&) () from
>>> C:\KDE\bin\libcxcore210.dll
>>>
>>> Thread 29 (Thread 1128.0x14c):
>>> #0  0x0cfce20a in void cv::cvt_<float, double>(cv::Mat const&, cv::Mat&) ()
>>> from C:\KDE\bin\libcxcore210.dll
>>> #1  0x0cef157c in check_exception_spec(lsda_header_info*, std::type_info
>>> const*, void*, long) () from C:\KDE\bin\libcxcore210.dll
>>>
>>> From this info, seems to be a crash in OpenCV. The backtrace is this short,
>>> which means it is somehow incomplete, and I dont know what
>>> check_exception_spec is, I dont find it in the OpenCV source code.
>>> Something Windows specific?
>>>
>>> I cannot rule out it's a crash related to latest libface changes by Alex, see
>>> report 255520 from yesterday, though that happened when confirming a name.
>>>
>>> Marcel
>>> _______________________________________________
>>> Digikam-devel mailing list
>>> [hidden email]
>>> https://mail.kde.org/mailman/listinfo/digikam-devel
>>>
>> _______________________________________________
>> Digikam-devel mailing list
>> [hidden email]
>> https://mail.kde.org/mailman/listinfo/digikam-devel
>>
>
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Marcel Wiesweg

> Marcel,
>
> Why Face detection progress dialog is modal ? We cannot continue to
> work on the rest of digiKam during face processing ?

No, no problem to continue working. Fixed in SVN. It was not modal
(setModal(false) and dialog->show()), but the main widget was passed as parent
of the dialog. Now it's a separate window, like fingerprint generator.

> Same problem for me. I just tried to scan all faces. It lock to a mpeg
> video file. No crash...

Is this also one of the last files of an album, and the UI is still
responsive, even though the scan does not progress?

I cannot reproduce this problem, but it would be typical to occur at the end
of an album. Probably, the FacePipeline does not emit finished() when it
should. See FacePipeline::FacePipelinePriv::checkFinished(), around line 688.
Can you find out if either packagesOnTheRoad or infosForFiltering is not 0
when locking?

Marcel
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
2010/10/29 Marcel Wiesweg <[hidden email]>:

>
>> Marcel,
>>
>> Why Face detection progress dialog is modal ? We cannot continue to
>> work on the rest of digiKam during face processing ?
>
> No, no problem to continue working. Fixed in SVN. It was not modal
> (setModal(false) and dialog->show()), but the main widget was passed as parent
> of the dialog. Now it's a separate window, like fingerprint generator.
>
>> Same problem for me. I just tried to scan all faces. It lock to a mpeg
>> video file. No crash...
>
> Is this also one of the last files of an album, and the UI is still
> responsive, even though the scan does not progress?

No, the first item from an album.

>
> I cannot reproduce this problem, but it would be typical to occur at the end
> of an album. Probably, the FacePipeline does not emit finished() when it
> should. See FacePipeline::FacePipelinePriv::checkFinished(), around line 688.
> Can you find out if either packagesOnTheRoad or infosForFiltering is not 0
> when locking?

i'm back at home now and collection is not the same here. I will
recompile GoSC branch and try if it's reproducible on my laptop.

Gilles
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

S. Burmeister
In reply to this post by Gert Kello
Am Freitag, 29. Oktober 2010, 12:06:25 schrieb Gert Kello:
> > Does "hang" mean the UI is frozen, or does it mean the progress does not
> > advance after almost finishing one folder, while you can still press
> > buttons etc.?
> > From your backtraces I would expect the latter.
>
> For me it is the latter, "no more advance but dialog can be canceled
> and restarted"

yep, that's it.

Sven
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Jasper
In reply to this post by Gilles Caulier-4
Please excuse my ignorance... THis sounds too exciting not to try.
 I found all the libkface stuff in branches not trunk so I got the graphics dir from trunk and followed the instructions in the GSoC readme... with the adition of copying the cmake modules in libkface and libkmap into the cmake modules dir...

ANyway, digikam build fails with:
digikam/libs/dimg/filters/bw/bwsepiasettings.cpp:120: error: ISO C++ forbids declaration of ‘RExpanderBoxExclusive’ with no type
 (digikam from trunk compiles fine)

Maybe this is the wrong place, I just assume you guys are closer to the GSoC code than the rest of the devs.

cheers.
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
In addition to use libkmap and libkface from GoSC 2010 branch, digiKam
2.0.0 needs kdegraphics/libs from trunk. Your message come from a
class shared by libkdcraw

Gilles Caulier

2010/10/30 Jasper <[hidden email]>:

>
> Please excuse my ignorance... THis sounds too exciting not to try.
>  I found all the libkface stuff in branches not trunk so I got the graphics
> dir from trunk and followed the instructions in the GSoC readme... with the
> adition of copying the cmake modules in libkface and libkmap into the cmake
> modules dir...
>
> ANyway, digikam build fails with:
> digikam/libs/dimg/filters/bw/bwsepiasettings.cpp:120: error: ISO C++ forbids
> declaration of ‘RExpanderBoxExclusive’ with no type
>  (digikam from trunk compiles fine)
>
> Maybe this is the wrong place, I just assume you guys are closer to the GSoC
> code than the rest of the devs.
>
> cheers.
> --
> View this message in context: http://digikam.1695700.n4.nabble.com/Status-of-face-detection-tp3005738p3020071.html
> Sent from the digikam-devel mailing list archive at Nabble.com.
> _______________________________________________
> Digikam-devel mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-devel
>
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Jasper
Thanks as always Giles.
 It was my bad, I thought building from libs would do libkexiv2 and libkdcraw as well.

Builds fine
 Crashes on startup.
Fine after digikam_dbcleanup

Well its scanned alot of images now, and.. well, nothing that I can see. I think I miss the point of what is happening here.
 Aha: ERROR: Could not load classifier cascade.
It doesnt crash, the dialogues all work nicely and whatever it is doing it does quickly. 100imgs ~50sec
 Except the my tags bit, which I assume was meant to be the tag tree, is empty. Right clicking does all the tag things expected (make new etc) and works...

But no faces detected thus far.

 
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

S. Burmeister
Am Samstag, 30. Oktober 2010, 12:51:16 schrieb Jasper:

> Well its scanned alot of images now, and.. well, nothing that I can see. I
> think I miss the point of what is happening here.
>  Aha: ERROR: Could not load classifier cascade.
> It doesnt crash, the dialogues all work nicely and whatever it is doing it
> does quickly. 100imgs ~50sec
>  Except the my tags bit, which I assume was meant to be the tag tree, is
> empty. Right clicking does all the tag things expected (make new etc) and
> works...
>
> But no faces detected thus far.

In the tags tab, so you see the people > unknown tag?

Sven
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Marcel Wiesweg
In reply to this post by Jasper

>  Aha: ERROR: Could not load classifier cascade.

Well that's not supposed to work ;-) The cascades are at the heart of the
whole process.

Nothing in /usr/share/opencv?
Does your OpenCV packages really not contain the cascades?

It seems we also need a runtime sanity check for detection.

Marcel
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Jasper
Sven:
>In the tags tab, so you see the people > unknown tag?
 No.
The  title: People Tags
the button: Scan collection... etc.
The colum heading: My Tags
Then the single entry "My Tags"

Marcel:
ls -a /usr/share/opencv
OpenCVConfig.cmake


So I got opencv from svn, and built this first.

 I have been trying to keep the different versions of digikam separate, i.e putting this one in /opt/svn-branch.... but this failed miserably with libface and all that... so purging the ubuntu versions of libcv, kipi, digikam et.al  and build and running was ok.

 This time face detection (with opencv from svn) doesnt show the "Could not load classifier cascade" error, But, face detection does nothing it seems. It runs, progress bar et, but no result ecept a popup anouncing digikam has updaed the face databse...
  there are a few things that may be of interest:
Cascade directory located as : /usr/share/opencv/haarcascades
Error: Directory Unknown with def3 entries considered invalid; not read.
Scaling with darkness 0, saturation 3968, and
multipliers 2.229557 1.000000 1.356650 1.000000
Converting to sRGB colorspace...
Error: Directory Unknown with def3 entries considered invalid; not read.

and billions of these which I always get...
 Warning: Directory Thumbnail, entry 0x0201: Data area exceeds data buffer, ignoring it.


What is it meant to do?
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
2010/10/31 Jasper <[hidden email]>:

>
> Sven:
>>In the tags tab, so you see the people > unknown tag?
>  No.
> The  title: People Tags
> the button: Scan collection... etc.
> The colum heading: My Tags
> Then the single entry "My Tags"
>
> Marcel:
> ls -a /usr/share/opencv
> OpenCVConfig.cmake
>
>
> So I got opencv from svn, and built this first.
>
>  I have been trying to keep the different versions of digikam separate, i.e
> putting this one in /opt/svn-branch.... but this failed miserably with
> libface and all that... so purging the ubuntu versions of libcv, kipi,
> digikam et.al  and build and running was ok.
>
>  This time face detection (with opencv from svn) doesnt show the "Could not
> load classifier cascade" error, But, face detection does nothing it seems.
> It runs, progress bar et, but no result ecept a popup anouncing digikam has
> updaed the face databse...
>  there are a few things that may be of interest:
> Cascade directory located as : /usr/share/opencv/haarcascades
> Error: Directory Unknown with def3 entries considered invalid; not read.
> Scaling with darkness 0, saturation 3968, and
> multipliers 2.229557 1.000000 1.356650 1.000000
> Converting to sRGB colorspace...
> Error: Directory Unknown with def3 entries considered invalid; not read.
>
> and billions of these which I always get...
>  Warning: Directory Thumbnail, entry 0x0201: Data area exceeds data buffer,
> ignoring it.

These messages come from Exiv2 lib. Using libkexiv2 from trunk, all
these messages are rerouted with KDebug and can be disabled with
kdebugdialog. Just unselect kexiv2 debug namespace.

Gilles Caulier
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Marcel Wiesweg
In reply to this post by Jasper

>
>  This time face detection (with opencv from svn) doesnt show the "Could not
> load classifier cascade" error, But, face detection does nothing it seems.
> It runs, progress bar et, but no result ecept a popup anouncing digikam has
> updaed the face databse...
>   there are a few things that may be of interest:
> Cascade directory located as : /usr/share/opencv/haarcascades

Please ensure you really have the cascades:

ls /usr/share/opencv/haarcascades/
haarcascade_eye_tree_eyeglasses.xml   haarcascade_lefteye_2splits.xml    
haarcascade_mcs_righteye.xml
haarcascade_eye.xml                   haarcascade_lowerbody.xml          
haarcascade_mcs_upperbody.xml
haarcascade_frontalface_alt2.xml      haarcascade_mcs_eyepair_big.xml    
haarcascade_profileface.xml
haarcascade_frontalface_alt_tree.xml  haarcascade_mcs_eyepair_small.xml  
haarcascade_righteye_2splits.xml
haarcascade_frontalface_alt.xml       haarcascade_mcs_lefteye.xml        
haarcascade_upperbody.xml
haarcascade_frontalface_default.xml   haarcascade_mcs_mouth.xml
haarcascade_fullbody.xml              haarcascade_mcs_nose.xml


> Error: Directory Unknown with def3 entries considered invalid; not read.
> Scaling with darkness 0, saturation 3968, and
> multipliers 2.229557 1.000000 1.356650 1.000000
> Converting to sRGB colorspace...
> Error: Directory Unknown with def3 entries considered invalid; not read.
>
> and billions of these which I always get...
>  Warning: Directory Thumbnail, entry 0x0201: Data area exceeds data buffer,
> ignoring it.

As Gilles already pointed out, you can safely ignore all these errors.

If you want debug output from libface, you need to compile it in debug mode
(give  -DCMAKE_BUILD_TYPE=Debug  to cmake), it does not use kDebug.
Then you 'll get console output about parameters, primary detection, face
regions verified, and time needed for all this.

Marcel




_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Jasper
Thanks Marcel,
 
>Please ensure you really have the cascades:
>
>ls /usr/share/opencv/haarcascades/
>haarcascade_eye_tree_eyeglasses.xml   haarcascade_lefteye_2splits.xml    
>haarcascade_mcs_righteye.xml

 All the harracascades are present.
Heres the debug output:
...
Verifying face (131,159 228x228)
extended rect 91 119 308x308
Verifying cascade haarcascade_frontalface_alt.xml gives 0
Verifying cascade haarcascade_frontalface_default.xml gives 1
Verifying cascade haarcascade_frontalface_alt_tree.xml gives 0
Verifying cascade haarcascade_profileface.xml gives 0
Verifying cascade haarcascade_mcs_lefteye.xml gives 2
Verifying cascade haarcascade_mcs_righteye.xml gives 1
Verifying cascade haarcascade_mcs_nose.xml gives 1
Verifying cascade haarcascade_mcs_mouth.xml gives 1
Verification finished in 0.16. Votes: Frontal 1  Features 4. Face verified: 1
Total time : 0.22 sec
...
 (disabling digikam etc. in kdebugdialogue didnt change anything, even on restart... no drama tho)

It looks to me like it found faces 8)  Should a dialogue appear?
 Scanned images are being tagged with "Scanned for Faces"
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
In reply to this post by Marcel Wiesweg
marcel,

I think a libkmap wraaper need to be wrapped for libmap to handle
debug ouput with kdebug.

Look this code :

Exiv2 method handler asignation :

http://dev.exiv2.org/projects/exiv2/repository/entry/trunk/src/error.hpp#L114

llibkexiv2 handler :

http://lxr.kde.org/source/KDE/kdegraphics/libs/libkexiv2/libkexiv2/kexiv2_p.cpp#294
http://lxr.kde.org/source/KDE/kdegraphics/libs/libkexiv2/libkexiv2/kexiv2_p.cpp#51

Gilles
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
2010/10/31 Gilles Caulier <[hidden email]>:
> marcel,
>
> I think a libkmap wraaper need to be wrapped for libmap to handle
> debug ouput with kdebug.

Oups sorry, i want mean libkface and libface of course...

Gilles _______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Marcel Wiesweg
In reply to this post by Gilles Caulier-4

> marcel,
>
> I think a libkmap wraaper need to be wrapped for libmap to handle
> debug ouput with kdebug.
>
> Look this code :
>
> Exiv2 method handler asignation :
>
> http://dev.exiv2.org/projects/exiv2/repository/entry/trunk/src/error.hpp#L1
> 14

I agree, would be good to have. We should ask Alex about this.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Marcel Wiesweg
In reply to this post by Jasper

> Verification finished in 0.16. Votes: Frontal 1  Features 4. Face verified:
> 1
>  (disabling digikam etc. in kdebugdialogue didnt change anything, even on
> restart... no drama tho)
>
> It looks to me like it found faces 8)  Should a dialogue appear?
>  Scanned images are being tagged with "Scanned for Faces"

Yes, a face has been found and verified. So all is fine on the OpenCV/libface
side.
In digikam, you should have a tag "People/Unknown", both words translated,
assigned to this picture.
Maybe the tree is hidden in the People sidebar, did you try a double click on
"My tags"?
The tags will also be accessible from the Tags sidebar, though you dont get
the faces as thumbnails there. Does this tag not exist at all?

Marcel
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

alexjironkin

Is this just a wrapper for errors? I.e. log errors rather than do printfs so the debugger can handle them?

Alex

On 1 Nov 2010 18:15, "Marcel Wiesweg" <[hidden email]> wrote:
>
>> Verification finished in 0.16. Votes: Frontal 1 Features 4. Face verified:
>> 1
>> (disabling digikam etc. in kdebugdialogue didnt change anything, even on
>> restart... no drama tho)
>>
>> It looks to me like it found faces 8) Should a dialogue appear?
>> Scanned images are being tagged with "Scanned for Faces"
>
> Yes, a face has been found and verified. So all is fine on the OpenCV/libface
> side.
> In digikam, you should have a tag "People/Unknown", both words translated,
> assigned to this picture.
> Maybe the tree is hidden in the People sidebar, did you try a double click on
> "My tags"?
> The tags will also be accessible from the Tags sidebar, though you dont get
> the faces as thumbnails there. Does this tag not exist at all?
>
> Marcel
> _______________________________________________
> Digikam-devel mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-devel

_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Jasper
In reply to this post by Marcel Wiesweg
Marcel Wiesweg wrote
In digikam, you should have a tag "People/Unknown", both words translated,
assigned to this picture.
Maybe the tree is hidden in the People sidebar, did you try a double click on
"My tags"?
The tags will also be accessible from the Tags sidebar, though you dont get
the faces as thumbnails there. Does this tag not exist at all?
 No. No people unknown.  No thumbnails.
Could this be a database issue from 1.6 -> 2.0? Saw a few db table not found or sim...
 
Cheers
Reply | Threaded
Open this post in threaded view
|

Re: Status of face detection

Gilles Caulier-4
In reply to this post by alexjironkin
It's a wrapper for error and debug messages.

Gilles

2010/11/1 Alex Jironkin <[hidden email]>:

> Is this just a wrapper for errors? I.e. log errors rather than do printfs so
> the debugger can handle them?
>
> Alex
>
> On 1 Nov 2010 18:15, "Marcel Wiesweg" <[hidden email]> wrote:
>>
>>> Verification finished in 0.16. Votes: Frontal 1 Features 4. Face
>>> verified:
>>> 1
>>> (disabling digikam etc. in kdebugdialogue didnt change anything, even on
>>> restart... no drama tho)
>>>
>>> It looks to me like it found faces 8) Should a dialogue appear?
>>> Scanned images are being tagged with "Scanned for Faces"
>>
>> Yes, a face has been found and verified. So all is fine on the
>> OpenCV/libface
>> side.
>> In digikam, you should have a tag "People/Unknown", both words translated,
>> assigned to this picture.
>> Maybe the tree is hidden in the People sidebar, did you try a double click
>> on
>> "My tags"?
>> The tags will also be accessible from the Tags sidebar, though you dont
>> get
>> the faces as thumbnails there. Does this tag not exist at all?
>>
>> Marcel
>> _______________________________________________
>> Digikam-devel mailing list
>> [hidden email]
>> https://mail.kde.org/mailman/listinfo/digikam-devel
>
> _______________________________________________
> Digikam-devel mailing list
> [hidden email]
> https://mail.kde.org/mailman/listinfo/digikam-devel
>
>
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel
12345