digiKam › digikam-users

Mysql/MariaDb database expert needs...

Classic

List

Threaded

50 messages Options

123

Gilles Caulier-4

Mysql/MariaDb database expert needs...

Hi all,

In my huge task of simplification of libraries puzzle, with current 5.0.0-beta implementation, i backported all libkface code in digiKam core, including database. Now digiKam 5.0.0 will not use libkface.

I review all database management code, included recognition database, factorized all when it's possible. I tested Sqlite implementation and schema, and all work fine.

Now recognition database is managed as thumbnails and core database : same place to store DB files, and same Sqlite engine.

As database code is common with other DB engines, this want mean that recognition DB can be managed with Mysql/MariaDB too.

So now, i started a tedious task : review all Mysql bugs, that i sorted this summer. The first task is to look into migration files :

https://bugs.kde.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=CONFIRMED&bug_status=ASSIGNED&bug_status=REOPENED&component=Database-Migration&list_id=1310837&product=digikam&query_format=advanced

And i must admit that i'm not an expert with MySql/MariaDB. So i need external expertise and help here.

The code from git/master is now fixed to reproduce 4.x mysql support, with same bugs of course.

There are 2 solutions to use MySql/MariaDb : internal or external (remote) server.

In a first step, i would to start with the first one, which will be more simpler to test and run.

But before to continue, i would to know if there is somebody in this room who can help me in this task.

Thanks in advance

Best

Gilles Caulier

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

Piter Dias

Re: Mysql/MariaDb database expert needs...

I use digikam under Windows and mysql as database (in a Linux box).

What do you need? Someone to test?

Enviado por TypeMail

Em 11 de nov de 2015, pelo 08:07, Gilles Caulier <[hidden email]> escrito:

Hi all,

In my huge task of simplification of libraries puzzle, with current 5.0.0-beta implementation, i backported all libkface code in digiKam core, including database. Now digiKam 5.0.0 will not use libkface.

I review all database management code, included recognition database, factorized all when it's possible. I tested Sqlite implementation and schema, and all work fine.

Now recognition database is managed as thumbnails and core database : same place to store DB files, and same Sqlite engine.

As database code is common with other DB engines, this want mean that recognition DB can be managed with Mysql/MariaDB too.

So now, i started a tedious task : review all Mysql bugs, that i sorted this summer. The first task is to look into migration files :

https://bugs.kde.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=CONFIRMED&bug_status=ASSIGNED&bug_status=REOPENED&component=Database-Migration&list_id=1310837&product=digikam&query_format=advanced

And i must admit that i'm not an expert with MySql/MariaDB. So i need external expertise and help here.

The code from git/master is now fixed to reproduce 4.x mysql support, with same bugs of course.

There are 2 solutions to use MySql/MariaDb : internal or external (remote) server.

In a first step, i would to start with the first one, which will be more simpler to test and run.

But before to continue, i would to know if there is somebody in this room who can help me in this task.

Thanks in advance

Best

Gilles Caulier
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

Gilles Caulier-4

Re: Mysql/MariaDb database expert needs...

2015-11-11 12:58 GMT+01:00 Piter Dias <[hidden email]>:

I use digikam under Windows and mysql as database (in a Linux box).

What do you need? Someone to test?

More than testing.

The main problem is the first step of migration from sqlite (the initial DB set at first run) to a local mysql (using internal server).

Currently the migration stop in the middle due to strange error reported by mysql (Mariadb here) :

[gilles@localhost database]$ mysql --version

mysql Ver 15.1 Distrib 10.0.21-MariaDB, for Linux (x86_64) using readline 5.1

I suppose some ImmoDb incompatibilities with digiKam sql statements to create indexes (tables are created).

[gilles@localhost data]$ digikam

digikam.general: AlbumWatch use QFileSystemWatcher

digikam.general: DatabaseParameters: [ Type "QMYSQL", Name "digikam" (Thumbnails Name "digikam"); (Face Name "digikam"); ConnectOptions: "UNIX_SOCKET=/home/gilles/.local/share/digikam/db_misc/mysql.socket", Using an Internal Server; Username and Password: "root", ""]

digikam.databaseserver: Waiting 10 seconds...stop: [ false ]

digikam.database: Loading SQL code from config file "/usr/share/digikam/database/dbconfig.xml"

digikam.database: Checking XML version ID: false "3" 3 3

digikam.database: ConnectOptions "UNIX_SOCKET=/home/gilles/.local/share/digikam/db_misc/mysql.socket"

digikam.databaseserver: Failed to use database "digikam"

digikam.databaseserver: Query error: "Unknown database 'digikam' QMYSQL: Unable to execute query"

digikam.databaseserver: Database error: "Can't connect to local MySQL server through socket '/home/gilles/.local/share/digikam/db_misc/mysql.socket' (2 \"No such file or directory\") QMYSQL: Unable to connect"

digikam.databaseserver: Trying to create database now...

digikam.databaseserver: Database was successfully created

digikam.database: Loading SQL code from config file "/usr/share/digikam/database/dbconfig.xml"

digikam.database: Checking XML version ID: false "3" 3 3

digikam.database: SchemaUpdater update

digikam.database: No database file available

digikam.database: Failure executing query:

Error messages: "QMYSQL: Unable to execute query" "Table 'mysql.proc' doesn't exist" 1146 2

Bound values: ()

digikam.database: Error while executing DBAction [ "CreateIndices" ] Statement [ "\n DROP PROCEDURE IF EXISTS create_index_if_not_exists;\n " ]

digikam.databaseserver: At least service [ "org.kde.digikam.startup-8291" ] is using the database server

digikam.databaseserver: Waiting 10 seconds...stop: [ false ]

Can you reproduce this problem to a fresh account ?

Gilles Caulier

_______________________________________________
Digikam-users mailing list
[hidden email]
https://mail.kde.org/mailman/listinfo/digikam-users

Piter Dias

Re: Mysql/MariaDb database expert needs...

I created a new album in the linux box in order to reproduce the error. The internal server gave the same error messages that you got.

Then I created the databases in my MySQL server and tried to migrate. It worked like a charm. I don't know what the "Internal Server" is, but for sure it doesn't behave the same way a "regular" MySQL instance behaves.

What else could I do to help?

piterdias@microserver:~$ digikam -v

Qt: 4.8.6

KDE Development Platform: 4.13.3

digiKam: 4.14.0

piterdias@microserver:~$ mysql --version

mysql Ver 14.14 Distrib 5.5.46, for debian-linux-gnu (x86_64) using readline 6.3

------------------------------------------- MIGRATION TO INTERNAL SERVER -------------------------------------------------

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::run: Waiting 10 seconds...stop: [ false ]

digikam(29920)/digikam (core) Digikam::DatabaseParameters::defaultParameters: ConnectOptions "UNIX_SOCKET=/home/piterdias/.kde/share/apps/digikam/db_misc/mysql.socket"

digikam(29920)/digikam (core) Digikam::SchemaUpdater::update: SchemaUpdater update

digikam(29920)/digikam (core) Digikam::SchemaUpdater::startUpdates: No database file available

digikam(29920)/digikam (core) Digikam::DatabaseCoreBackendPrivate::debugOutputFailedQuery: Failure executing query:

Error messages: "QMYSQL: Unable to execute query" "Table 'mysql.proc' doesn't exist" 1146 2

Bound values: ()

digikam(29920)/digikam (core) Digikam::DatabaseCoreBackend::execDBAction: Error while executing DBAction [ "CreateIndices" ] Statement [ "

DROP PROCEDURE IF EXISTS create_index_if_not_exists;

" ]

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::checkDigikamInstancesRunning: At least service [ "org.kde.digikam-29920" ] is using the database server

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::run: Waiting 10 seconds...stop: [ false ]

digikam(29920)/kdeui (KNotification) KNotificationManager::notificationClosed: 3

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::checkDigikamInstancesRunning: At least service [ "org.kde.digikam-29920" ] is using the database server

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::run: Waiting 10 seconds...stop: [ false ]

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::checkDigikamInstancesRunning: At least service [ "org.kde.digikam-29920" ] is using the database server

digikamdatabaseserver(29985)/digikam (database server) Digikam::PollThread::run: Waiting 10 seconds...stop: [ false ]

----------------------------------------------------- MIGRATION TO REGULAR MYSQL DATABASE --------------------

digikam(29920)/khtml (caret) DOM::Selection::moveTo: Selection[ Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) 1 ] Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 )

digikam(29920)/khtml (caret) DOM::Selection::validate: Selection[ Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) 1 ] 0

digikam(29920)/khtml (caret) DOM::Selection::validate: [character:baseIsStart] true Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 )