[Bug 293832] New: Digitaglinktree - Multi tag level combination - find any image though directory browsing [patch]

https://bugs.kde.org/show_bug.cgi?id=293832

           Summary: Digitaglinktree - Multi tag level combination - find
                    any image though directory browsing [patch]
           Product: digikam
           Version: 2.1.1
          Platform: Unlisted Binaries
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: wishlist
          Priority: NOR
         Component: Export
        AssignedTo: [hidden email]
        ReportedBy: [hidden email]


Created an attachment (id=68698)
 --> (http://bugs.kde.org/attachment.cgi?id=68698)
First dirty test version to illustrate how result could look like in your image
database

Version:           2.1.1
OS:                Linux

Hi,

the idea is if you have a picture with Peter & Paul in France, you should be
able to find the same image wether you think about:
Peter-> Paul-> France
or
France->Paul->Peter
or
Paul->France->Peter

Reproducible: Didn't try

Steps to Reproduce:
test script
digitaglinktree -l my_directory -d my_database -M


Expected Results:  
any path directory leads to the picture you think independantly of the tag
logic you follow when browsing directories.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[Gilles Caulier-4]

https://bugs.kde.org/show_bug.cgi?id=293832


Gilles Caulier <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]




--- Comment #1 from Gilles Caulier <caulier gilles gmail com>  2012-02-11 13:12:31 ---
Another entry for you Krienke...

Gilles Caulier

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #2 from  <cyril raphanel gmail com>  2012-02-12 03:05:27 ---
Hi,

it should be also possible to include:
-list of keyword/tag that should be excluding (ex: _Digikam type)
-include as tag some other information from either:
-- exif
-- any info managed by digikam at album or image level
-"Date" should be managed as any other tag within this multi-level logic.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #3 from  <cyril raphanel gmail com>  2012-02-12 03:20:31 ---
Or we keep it simple for information not as tagged, it could be managed
up-front by updating the tag list in the image then in digikam database.

in my case it should be possible to manage they year as a tag from the exif
using some tools.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #4 from  <cyril raphanel gmail com>  2012-02-12 03:30:54 ---
Are those tags the ones managed in digikam?
Subject                         :
Tags List                       :
Last Keyword XMP                :
Hierarchical Subject            :

Which ones should I update if I want to create a tag category base on year? For
example:
Tags List: Year/YYYY

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #5 from  <cyril raphanel gmail com>  2012-02-12 17:03:30 ---
Created an attachment (id=68731)
 --> (http://bugs.kde.org/attachment.cgi?id=68731)
Add -e option to exclude some tags

-e option added to enable tag exclusion
"-e Digikam,People" would exclude all images which have the string "Digikam" or
"People" in their tag path.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #6 from  <cyril raphanel gmail com>  2012-02-12 18:40:56 ---
Created an attachment (id=68734)
 --> (http://bugs.kde.org/attachment.cgi?id=68734)
"-Y" working now in with this multilevel option

It would need some code cleansing/optimization.

Hardlink, flat structure & Archive options have not been implemented with the
multilevel option.

Documentation (usage & man page) not updated.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[krienke]

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #7 from  <krienke uni-koblenz de>  2012-02-13 08:12:28 ---
Hello [hidden email],
I still do not understand the need of a fix:
If you have a photo and tag it with tags France, Peter, Paul, where Peter and
Paul are Subtags of eg people and France is a subtag of say countries.

Then digitaglinktree will create a directory structure like

---countries
   --- France
---people
   ---Paul
   ---Peter

In each of the directories Peter, Paul and France you will find a link to the
photo in question. So this is exactly what you described in your initial
request. The photo is accessible via all the tags that have been assigned to
it. What do you think is missing?

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #8 from  <cyril raphanel gmail com>  2012-02-13 09:56:54 ---
hi,

That is more a new feature than a fix.

The orginal purpose of the script is to reflect strictly the structure of the
tags. What I propose here is to translate user thinking which typically combine
many tags structure.

Typically the structure is organized as you describe it:
- Place
-- France

People
-- Peter
-- Paul

Date (even if most of time not manage as tag structure but exif data)

If you are sticking to this logic it is very difficult to find all pictures you
have of Peter & Paul taken in France in 2004 just by browsing independantly if
you thing Paul, Peter, France first.

This is what my patch propose:
People
-- Peter
--- _all => All pictures of Peter
--- Date => All pictures of Peter classified by dates
---- 2004
----- _all => All pictures of Peter in 2004
----- People
------ _all => All pictures of Peter in 2004 with some other People
------ Paul
------- _all => All pictures of Peter in 2004 with Paul
------- Places
------- _all => All pictures of Peter in 2004 with Paul within a specific Place
------- France
-------- _all => All pictures of Peter in 2004 with Paul in France

This way it is straight forward from the hierarchy to generate a jalbum on a
specific topic (here being all pictures of Peter and paul together taken in
France in 2004).

In addtion this is then straight forward to export the structure in a upnp
server that support softlink file system wihtout messing around tag structure
compatible with the upnp server installed.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #9 from  <cyril raphanel gmail com>  2012-02-13 10:00:28 ---
Just to be consistant in my example
People
- Peter
-- _all => All pictures of Peter
-- Date => All pictures of Peter classified by dates
--- 2004
---- _all => All pictures of Peter in 2004
---- People
----- _all => All pictures of Peter in 2004 with some other People
----- Paul
------ _all => All pictures of Peter in 2004 with Paul
------ Places
------- _all => All pictures of Peter in 2004 with Paul within a specific Place
------- France
-------- _all => All pictures of Peter in 2004 with Paul in France

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #10 from  <cyril raphanel gmail com>  2012-02-13 10:36:10 ---
And if the user thinks first about his/her trip in France in 2004 with Paul
where they met Peter the script will also translate this way of thinking in
folder hierarchy and ends up to the same set of files
Place
- France
-- _all => All pictures taken in France
-- Date => All pictures taken in France classified by dates
--- 2004
---- _all => All pictures taken in France in 2004
---- People
----- _all => All pictures taken in France in 2004 with some other People
----- Paul
------ _all => All pictures taken in France in 2004 with Paul
------ People
------- _all => All pictures taken in France in 2004 with Paul and other people
------- Peter
-------- _all => All pictures taken in France in 2004 with Paul and Peter

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #11 from  <cyril raphanel gmail com>  2012-02-13 15:56:42 ---
(In reply to comment #10)

> And if the user thinks first about his/her trip in France in 2004 with Paul
> where they met Peter the script will also translate this way of thinking in
> folder hierarchy and ends up to the same set of files
> Place
> - France
> -- _all => All pictures taken in France
> -- Date => All pictures taken in France classified by dates
> --- 2004
> ---- _all => All pictures taken in France in 2004
> ---- People
> ----- _all => All pictures taken in France in 2004 with some other People
> ----- Paul
> ------ _all => All pictures taken in France in 2004 with Paul
> ------ People
> ------- _all => All pictures taken in France in 2004 with Paul and other people
> ------- Peter
> -------- _all => All pictures taken in France in 2004 with Paul and Peter

And the "pwd" would look like
Place/France/Date/2004/People/Paul/People/Peter

you can play even with standard command like "find" and "grep" together to find
anything from command line and even display your image with console base image
viewer.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832


[hidden email] changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #68698|0                           |1
        is obsolete|                            |
  Attachment #68731|0                           |1
        is obsolete|                            |
  Attachment #68734|0                           |1
        is obsolete|                            |




--- Comment #12 from  <cyril raphanel gmail com>  2012-02-13 17:31:45 ---
Created an attachment (id=68765)
 --> (http://bugs.kde.org/attachment.cgi?id=68765)
"Date" root added

- Add "Date" root
- usage updated with "-e" and "-M" option

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #13 from  <cyril raphanel gmail com>  2012-02-13 17:42:04 ---
(In reply to comment #11)

> (In reply to comment #10)
> > And if the user thinks first about his/her trip in France in 2004 with Paul
> > where they met Peter the script will also translate this way of thinking in
> > folder hierarchy and ends up to the same set of files
> > Place
> > - France
> > -- _all => All pictures taken in France
> > -- Date => All pictures taken in France classified by dates
> > --- 2004
> > ---- _all => All pictures taken in France in 2004
> > ---- People
> > ----- _all => All pictures taken in France in 2004 with some other People
> > ----- Paul
> > ------ _all => All pictures taken in France in 2004 with Paul
> > ------ People
> > ------- _all => All pictures taken in France in 2004 with Paul and other people
> > ------- Peter
> > -------- _all => All pictures taken in France in 2004 with Paul and Peter
>
> And the "pwd" would look like
> Place/France/Date/2004/People/Paul/People/Peter
>
> you can play even with standard command like "find" and "grep" together to find
> anything from command line and even display your image with console base image
> viewer.

example of find command:
find my_directory -path "*Paul*Peter*France*2004*"

and voila :-)

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #14 from  <cyril raphanel gmail com>  2012-02-13 17:52:28 ---

> example of find command:
> find my_directory -path "*Paul*Peter*France*2004*"
>
> and voila :-)

Erratum
find my_directory -path "*Paul*Peter*France*2004*_all"

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

[krienke]

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #15 from  <krienke uni-koblenz de>  2012-02-14 13:49:47 ---
@[hidden email]
Some feedback:
I just tried to run your patched version of digitaglinktree to see what the
results look like (cause I still do not really understand in depth the
semantics of -M for )an arbitrary tag. However the script would not terminate.
After half an hour I killed it (the default digitaglinktree version took 7
minutes to terminate).  

I looked into one of the already created tag directories where the tag is named
"000" and has subtags like blue, blau, colored, coloured and many more. I found
for example this directory path that digitaglinktree had created:

<tagbasedir>/000/blau/000/blue/000/colored/000/coloured/000/

To me this does not seem to make sense.
Another problem is runtime which is too long at the moment.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #16 from  <cyril raphanel gmail com>  2012-02-14 17:56:54 ---
Ok so volum might be a challenge, for your example I guess the tag structure
is:
000->blau
000->blue
000->colored
000->coloured

and you have pictures tags with all of them?

If yes you get the result as expected.

I will do some performance test and introduce a level limitation parameter.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #17 from  <cyril raphanel gmail com>  2012-02-14 18:24:02 ---
The results:
I have in total:
- 44 differents tags
- I have 13 088 of tag/images
- 15123 images have at least one tag
  -- 10676 have one tag + Year
  -- 1042 have 2 tags + Year
  -- 82 have 3 tags + Year
  -- 15 have 4 tags + Year
  -- 6 have 5 tags +Year

I took 1 minute 9 sec to make the complete tree.

Probably my test scenario is not significant enought to test performance.

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #18 from  <cyril raphanel gmail com>  2012-02-14 20:22:08 ---
Ouch ... I managed to generate a test scenario with 10000 images with 10 tags
each and this is a disaster :-(

I am sure there is a way to make it efficient using recursivity ...

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel

https://bugs.kde.org/show_bug.cgi?id=293832





--- Comment #19 from  <cyril raphanel gmail com>  2012-02-14 20:34:59 ---
And I do not know how I have done my math but my results are non-sense!

--
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
_______________________________________________
Digikam-devel mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-devel