View Issue Details

IDProjectCategoryView StatusLast Update
0005744SOGoBackend Calendarpublic2023-07-31 08:47
Reporterarisd Assigned Tosebastien  
PrioritynormalSeveritymajorReproducibilityalways
Status closedResolutionfixed 
Platform[Client] MicrosoftOSWindowsOS Version8
Product Version5.8.2 
Summary0005744: MySQL4Exception: Incorrect string value: '\xF0\x9F\x98\x8A\x0A\x0A...' for column sogo.sogo_quick_appointment.`c_description
Description

We are facing repeated mysql-errors upon caldav-synchronization Outlook-ClaDavSynchronizer to Sogo:
Apr 17 07:04:50 sogod [127121]: <0x0x555c500e3680[GCSFolder]> ERROR(-[GCSFolder writeContent:fromComponent:container:toName:baseVersion:]): cannot insert content : <MySQL4Exception: 0x555c5013a420> NAME:ExecutionFailed REASON:Incorrect string value: '\xF0\x9F\xA4\xBAMa...' for column sogo.sogo_quick_appointment.c_title at row 1
Apr 17 07:04:50 sogod [127121]: [ERROR] <0x555c4fab1410[SOGoAppointmentObject]:de41621d-1caf-41ce-983c-4d7e878650c2.ics> write failed: <MySQL4Exception: 0x555c5013a420> NAME:ExecutionFailed REASON:Incorrect string value: '\xF0\x9F\xA4\xBAMa...' for column sogo.sogo_quick_appointment.c_title at row 1

I enabled debug and got detailed error:
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f8ec220] connection=0x0x555c4f8ee090> SQL: INSERT INTO sogo_quick_appointment (c_iscycle, c_orgmail, c_uid, c_nextalarm, c_name, c_category, c_priority, c_cycleinfo, c_sequence, c_folder_id, c_isallday, c_title, c_cycleenddate, c_description, c_status, c_classification, c_startdate, c_participants, c_partmails, c_partstates, c_component, c_location, c_isopaque, c_enddate) VALUES (0, '', 'de41621d-1caf-41ce-983c-4d7e878650c2', 0, 'de41621d-1caf-41ce-983c-4d7e878650c2.ics', null, 5, null, 0, 14, 0, '�Martin Mazur � � { �️ Please Don’t Kill me �️ }', null, 'For full details, including the address, and to RSVP see: https://www.meetup.com/1337-Tech-Ljubljana/events/267714472

As we continue with a busy pace of knowledge events for 2020, we start the year by inviting the tret...', 1, 0, 1580403600, '', '', '', 'vevent', 'tretton37 d.o.o. - Slovenska cesta 28 - Ljubljana, si', 1, 1580410800);
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f8ec220] connection=0x0x555c4f8ee090> ERROR: Incorrect string value: '\xF0\x9F\xA4\xBAMa...' for column sogo.sogo_quick_appointment.c_title at row 1
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f9984f0] connection=0x0x555c4ffc6d90> SQL: ROLLBACK;
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f9984f0] connection=0x0x555c4ffc6d90> query has no results.
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f8ec220] connection=0x0x555c4f8ee090> SQL: ROLLBACK;
2023-04-17 07:04:50.343 sogod[127121:127121] <MySQL4Channel[0x0x555c4f8ec220] connection=0x0x555c4f8ee090> query has no results.

Our environment:
RHEL-8
10.3.35-MariaDB
sogo 5.8.2
Client: Microsoft Outlook 365 (installed CalDavSynchronizer latest version 4.4.1)

I don't know the right cause for this behaviour, but it seems it could be due to "STRANGE-CHARACTERS" in title of sogo_quick_appointment CalDavSynchronizer tries to write (I attached image so special characters are vissible from error log).

MartiaDB-server is configured (my.ini):
[mysqld]
port = 3306
character-set-server = utf8mb4
collation-server = utf8mb4_unicode_ci

show create table sogo_quick_appointment;
CREATE TABLE sogo_quick_appointment (
c_folder_id int(11) NOT NULL,
c_name varchar(255) NOT NULL,
c_uid varchar(255) NOT NULL,
c_startdate int(11) DEFAULT NULL,
c_enddate int(11) DEFAULT NULL,
c_cycleenddate int(11) DEFAULT NULL,
c_title varchar(1000) NOT NULL,
...
c_description text DEFAULT NULL,
PRIMARY KEY (c_folder_id,c_name)
) ENGINE=InnoDB DEFAULT CHARSET=utf8

SELECT * FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME LIKE 'sogo_quick_appo%';
| TABLE_CATALOG | TABLE_SCHEMA | TABLE_NAME | COLUMN_NAME | ORDINAL_POSITION | COLUMN_DEFAULT | IS_NULLABLE | DATA_TYPE | CHARACTER_MAXIMUM_LENGTH | CHARACTER_OCTET_LENGTH | CHARACTER_SET_NAME | COLLATION_NAME | COLUMN_TYPE |
| def | sogo | sogo_quick_appointment | c_title | 7 | NULL | NO | varchar | 1000 | 3000 | utf8 | utf8_general_ci | varchar(1000) |

I'm not database expert but perhaps tables shouldn't be created using utf8 but utf8mb4 (https://www.sogo.nu/support/faq/how-do-i-configure-sogo-to-use-mysql.html)?

Any help would be appreciated.

Steps To Reproduce

Every time Outlook-CalDavSynchrnoizer tries to resync this caledar-event the error pops-up.

TagsCalDAV, caldavsynchronizer, MariaDB, MySQL4Exception

Activities

arisd

arisd

2023-04-17 11:36

reporter  

sebastien

sebastien

2023-04-18 07:07

administrator   ~0016843

Hi,

You can try utf8mb4 according to this : 0005630
Let me know if this solve your issue I will update documentation if that's the case

Sebastien

arisd

arisd

2023-04-19 13:40

reporter   ~0016853

Hi,

@Sebastien thank you for help and confirming our suspicion - after changing utf8 -> utf8mb4 and restarting mariadb, sogod the problem was gone and sync was done.

It would be great if someone changed FAQ tutorial of creating database for sogo:
https://www.sogo.nu/support/faq/how-do-i-configure-sogo-to-use-mysql.html

Only one thing I noticed after this action - synchronization works, but on sogo-webmail "special-characters" are shown as "??????" - I have attached the sample picture. It's a cosmetic glitch, main thing is MySQL-Exception was solved and synhronization works again.

You can mark ticket as resolved.

Thanks and br,
Aris.

caledar-sogo-webmail.png (5,782 bytes)   
caledar-sogo-webmail.png (5,782 bytes)   
sebastien

sebastien

2023-04-19 14:23

administrator   ~0016855

Hi Aris,

I have updated documentation at https://www.sogo.nu/support/faq/how-do-i-configure-sogo-to-use-mysql.html
Regarding the ???? can you provide the special(s) character(s) ?

Sebastien

arisd

arisd

2023-04-20 06:20

reporter   ~0016856

Hi,

Just uploaded screenshot from Outlook and also a screenshot from Webmail if it helps...

"Emojis" shortcuts I took are random and selected from this website (Alt + 6-numbers):
https://www.webnots.com/alt-code-shortcuts-to-insert-smileys-and-emoticons/

If you perhaps also need this info

PS C:\Users\aris.dizdarevic> Get-WinSystemLocale
LCID Name DisplayName


1060 sl-SI Slovenian (Slovenia)

Br, Aris.

webmail-appointment.png (12,793 bytes)   
webmail-appointment.png (12,793 bytes)   
outlook-appointment.png (9,081 bytes)   
outlook-appointment.png (9,081 bytes)   
sebastien

sebastien

2023-04-22 09:53

administrator   ~0016859

Did you tried to change also the collate ?

Sebastien

sebastien

sebastien

2023-07-31 08:46

administrator   ~0017146

Closed due to inactivity

Issue History

Date Modified Username Field Change
2023-04-17 11:36 arisd New Issue
2023-04-17 11:36 arisd Tag Attached: CalDAV
2023-04-17 11:36 arisd Tag Attached: caldavsynchronizer
2023-04-17 11:36 arisd Tag Attached: MariaDB
2023-04-17 11:36 arisd Tag Attached: MySQL4Exception
2023-04-17 11:36 arisd File Added: sogo_quick_appointment-error.png
2023-04-18 07:07 sebastien Note Added: 0016843
2023-04-18 07:08 sebastien Assigned To => sebastien
2023-04-18 07:08 sebastien Status new => feedback
2023-04-19 13:40 arisd Note Added: 0016853
2023-04-19 13:40 arisd File Added: caledar-sogo-webmail.png
2023-04-19 13:40 arisd Status feedback => assigned
2023-04-19 14:23 sebastien Note Added: 0016855
2023-04-20 06:20 arisd Note Added: 0016856
2023-04-20 06:20 arisd File Added: webmail-appointment.png
2023-04-20 06:20 arisd File Added: outlook-appointment.png
2023-04-22 09:53 sebastien Note Added: 0016859
2023-04-23 20:28 sebastien Status assigned => feedback
2023-07-31 08:46 sebastien Note Added: 0017146
2023-07-31 08:47 sebastien Status feedback => closed
2023-07-31 08:47 sebastien Resolution open => fixed