View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0005553 | SOGo Connector | with SOGo | public | 2022-07-08 10:28 | 2023-08-02 08:25 |
Reporter | Colmar0 | Assigned To | sebastien | ||
Priority | normal | Severity | minor | Reproducibility | sometimes |
Status | closed | Resolution | duplicate | ||
Summary | 0005553: MS Outlook 2016 with active Sync stops synchronizing and shows status disconnected | ||||
Description | Client: Windows 10 MS Outlook with active sync stops synchronization when approximately 90% emails are down loaded Problem seems to stop in the version 5.6.0. In all Sogo versions before the problem could be solved mostly by recreating the complete active sync account in Outlook. Sogo server syslog show following error message: It's unclear where is coming this error message and if this error message is related with the problem or not. | ||||
Tags | active sync | ||||
has duplicate | 0005555 | closed | sebastien | MS Outlook 2016 with active Sync stops synchronizing and shows status disconnected |
has duplicate | 0005556 | closed | sebastien | MS Outlook 2016 with active Sync stops synchronizing and shows status disconnected |
has duplicate | 0005557 | new | MS Outlook 2016 with active Sync stops synchronizing and shows status disconnected |
The "/var/log/sogo/sogo.log" shows following error message: Oct 06 10:01:55 sogod [300679]: <0x0x558b7bc4d3b0[SOGoActiveSyncDispatcher]> Cache cleanup needed for device 93E59085674644A1B75134B006E68485 - user: unsername syncKey: 3177-7914 cache: 3197-7914 After reseting the ActiveSync Cache with sogo.conf (4,172 bytes)
{ SOGoEASDebugEnabled = NO; MySQL4DebugEnabled = NO; OCSFolderManagerSQLDebugEnabled = NO; GCSFolderManagerSQLDebugEnabled = NO; GCSFolderStoreDebugEnabled = NO; WOListenQueueSize = 60; WOWorkersCount = 100; WOWatchDogRequestTimeout = 59; SOGoMaximumSyncWindowSize = 60; SOGoMaximumSyncResponseSize = 5172; SxVMemLimit = 512; MySQL4Encoding = "utf8mb4"; OCSEMailAlarmsFolderURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_alarms_folder"; OCSFolderInfoURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_folder_info"; OCSCacheFolderURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_cache_folder"; OCSStoreURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_store"; OCSAclURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_acl"; OCSSessionsFolderURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_sessions_folder"; SOGoMaximumPingInterval = 1140; SOGoMaximumSyncInterval = 1140; SOGoInternalSyncInterval = 120; SOGoCacheCleanupInterval = 900; SOGoFailedLoginBlockInterval = 120; SOGoACLsSendEMailNotifications = NO; SOGoAppointmentSendEMailNotifications = YES; SOGoDraftsFolderName = Drafts; SOGoEnableEMailAlarms = YES; SOGoEnablePublicAccess = YES; SOGoFirstDayOfWeek = 1; SOGoFoldersSendEMailNotifications = NO; SOGoForwardEnabled = YES; SOGoIMAPAclConformsToIMAPExt = YES; SOGoIMAPServer = "imaps://mail.domain.de:993"; SOGoLanguage = German; SOGoMailAuxiliaryUserAccountsEnabled = "="; SOGoMailDomain = "domain.de"; SOGoMailShowSubscribedFoldersOnly = YES; SOGoMailingMechanism = smtp; SOGoMemcachedHost = "sogo1.subdomain.domain.de"; SOGoPageTitle = "Rechenzentrum"; SOGoProfileURL = "mysql://sogo:Bla@mysql1-int.subdomain.domain.de:3306/sogo/sogo_user_profile"; SOGoSMTPServer = "smtp.domain.de"; SOGoSentFolderName = Sent; SOGoSieveScriptsEnabled = YES; SOGoSieveServer = "sieve://localhost:4190"; SOGoSieveFolderEncoding = "UTF-8"; SOGoTimeZone = "Europe/Berlin"; SOGoTrashFolderName = Trash; SOGoHideSystemEMail = YES; SOGoSuperUsernames = ("asmobil"); SOGoCalendarDefaultRoles = ("PublicDAndTViewer", "ConfidentialDAndTViewer"); SOGoFirstWeekOfYear = "First4DayWeek"; SOGoUserSources = ( { CNFieldName = cn; IDFieldName = uid; MailFieldNames = ( mail, mailLocalAddress ); SearchFieldNames = ( sn, cn ); UIDFieldName = uid; baseDN = "ou=people,dc=domain.de,dc=de"; scope = "SUB"; MultipleBookingsFieldName = "Multiplebookings"; bindAsCurrentUser = YES; canAuthenticate = YES; displayName = "Adressen Rechnzentrum"; encryption = SSL; hostname = "ldaps://ldap.domain.de:636"; id = public; isAddressBook = NO; passwordPolicy = NO; type = ldap; }, { CNFieldName = cn; IDFieldName = uid; MailFieldNames = ( mail, ); SearchFieldNames = ( sn, cn ); UIDFieldName = uid; baseDN = "ou=people,dc=domain.de,dc=de"; scope = "SUB"; MultipleBookingsFieldName = "Multiplebookings"; bindAsCurrentUser = YES; canAuthenticate = NO; displayName = "Adressen Rechnzentrum"; encryption = SSL; hostname = "ldaps://ldap.domain.de:636"; id = public_addr; isAddressBook = YES; passwordPolicy = NO; type = ldap; }, { CNFieldName = cn; IDFieldName = cn; SearchFieldNames = ( cn ); UIDFieldName = cn; baseDN = "ou=group,dc=domain.de,dc=de"; bindDN = "uid=sogo,ou=ldap-user,ou=rz,dc=domain.de,dc=de"; bindPassword = "bla"; canAuthenticate = YES; bindAsCurrentUser = YES; displayName = "Gruppen Rechnzentrum"; encryption = SSL; hostname = "ldaps://ldap.domain.de:636"; id = Rechnzentrum_groups; isAddressBook = YES; passwordPolicy = NO; type = ldap; } ); SOGoVacationEnabled = YES; } |
|
We need a fast solution! |
|
Still no response. |
|
You need to provide a backtrace according to https://www.sogo.nu/support/faq/how-do-i-debug-sogo.html otherwise this is not debuggable Sebastien |
|
The problem is that this error only occurs with isolated users. An installation in the production environment is not so easily not possible. Isn't there some other compromise for debugging? Would it be possible that there are table locks in the database, because e.g. certain "database commits" are executed too late, not at all or with a delay? The combination of Sogo server, Dovecot server and database server is implemented on three physically (virtual machines) separated servers. Has the Sogo application been designed or optimized and tested for the separation between Sogo, the email server (Dovecot) and the database server Same text in German: Eine Installation in der Produktivumgebung ist nicht so ohne weiteres nicht möglich. Gibt es nicht irgendeinen andern Kompromiß für die Fehlersuche? Wäre es möglich, daß es hier zu Table-Locks in der Datenbank kommt, da z.B. bestimmte „Datenbank-Commitments“ zu spät, gar nicht oder verzögert ausgeführt werden? Kommt es zu Latenzzeiten in der Netzwerkübertragung zwischen diesen Servern, Ist denn die Sogo-Anwendung überhaupt für die Auftrennung zwischen Sogo, E-Mail-Server (Dovecot) und Datenbank-Server auf verschiedene physikalisch installierten Servern, in verschiedenen Netzen befindenden Servern ausgelegt worden bzw. ist es optimiert und getestet worden für ein solches Szenario? |
|
Of course SOGo is designed to work with separated components (ie on several servers). This is mostly the case. If it is always the same user, maybe you can provide another sogo instance with the same configuration (database, user source, smtp, dovecot) but with only 1 process (WOWorkersCount = 1), start in debugging mode and give the new url only to this sogo user. |
|
We will try to run this test and provide the results. But to elaborate on my question, how robust is the above constellation when there are unexpected delays of the three mentioned servers regarding Same text in German: Aber um meine Frage noch zu vertiefen, wie Robust ist die oben genannte Konstellation, wenn es zu unerwarteten Verzögerungen der drei genannten Server bezüglich der Ausführungszeit ihrer Aufgaben kommt oder wenn es zu unplanmäßigen kurzeitigen fehlerhaften Netzwerk Aussetzern oder Latenzen kommt? |
|
As far as I know, db and imap request are synchronous. Your database (postegresql or mariadb) is transactionnal and no concurrency access can occured. |
|
We monitor the Sogo, Dovecot and database servers via Zabbix. Same text in German: |
|
Now we have created a server clone for further error analysis, with different hostname u. IP address. Currently I have the problem that when installing the debugging components via "apt-get install libgnustep-base-dbg sogo-dbg sope4.9-dbg gdb" the "libgnustep-base-dbg" installation package is not found. Same text in German: |
|
The solution described here: Same text in German: |
|
The installation of the "libgnustep-base" package has now worked with Debian 11 via The installed package looks like this I will find out the further debugging results with it. Same text in German: Das installierte Paket sieht dann so aus: Die weiteren Debugging Ergebnisse damit werde ich noch ermitteln. |
|
Here are the debugging results: Breakpoint 1, -[NSException raise] (self=0x55555617c370, _cmd=0x7ffff770fa40 <_OBJC_SELECTOR_TABLE+512>) at NSException.m:1574 Breakpoint 1, -[NSException raise] (self=0x5555567f0490, _cmd=0x7ffff770fa40 <_OBJC_SELECTOR_TABLE+512>) at NSException.m:1574 After entering "bt", the process does not continue and following message appears: (gdb) bt The synchronization stops after reaching the breakpoint with the error message "NSException". In the latter "baseDN" also the specified user "bidmon" exists many users also only in the "baseDN = "ou=people,dc=domain.de,dc=de" to find. Same text in German: In der letztgenannten "baseDN" existiert auch der angegebene Benutzer "bidmon" vielen Benutzern auch nur in der "baseDN = "ou=people,dc=domain.de,dc=de"" zu finden sind. |
|
However, for the most ActiveSync users works this binding for LDAP for the LDAP user search. |
|
Addendum: After the error occurred, the process could not be continued via "(gdb) c" and is terminated. Same text in German: Actual Sogo Processes /aktuelle Sogo Prozesse: sogo@sogo-debug:~$ ps auxw Possible causes for the behavior: LDAP users are stored in "baseDN = "ou=people,dc=domain.de,dc=de". Same text in German: LDAP-Benutzer werden in "baseDN = "ou=people,dc=domain.de,dc=de" gespeichert. |
|
Important additional information: Same text in German: |
|
MS Outlook (2016) synchronization has now stopped completely and Outlook shows the status "Disconnected". The essential error messages are: “Jan 16 12:07:21 sogod [3431]: 141.82.146.66 "GET /SOGo/so/bidmon/Mail/view HTTP/1.1" 200 24607/0 0.055 94660 74% 3M - 13 An excerpt from the “/var/log/sogo/sogo.log” file. /var/log/sogo/sogo.log: Jan 16 00:41:59 sogod [839]: 107.174.172.167 "GET /SOGo HTTP/1.1" 302 0/0 0.003 - - 0 - 11 |
|
You have a segfault :
When starting with gdb with breakpoints described in https://www.sogo.nu/support/faq/how-do-i-debug-sogo.html you should have break in Procedure :
Sebastien |
|
I type the following: systemctl stop sogo |
|
I hope this was correct. |
|
The first breakpoint shows following error message and MS Outlook shows the status "Connection attempt" and nothing happens: Same text in German: Breakpoint 1, -[NSException raise] (self=0x555555e1ce00, _cmd=0x7ffff770fa40 <_OBJC_SELECTOR_TABLE+512>) at NSException.m:1574 (gdb) bt |
|
My current problem is that MS Outlook stopped syncing yesterday and today after reopening Outlook it resumes syncing, With MS Outlook synchronization still running, how do I get back into this "(gdb)" debugging console for the currently running process? Because it is aggravating that constantly new processes with a new process ID are started to continue the synchronization after each "NSException". Same text in German: Wie komme ich bei noch laufender MS Outlook Synchronisation wieder in diese „(gdb)“ Debugging Konsole für den gerade laufenden Prozeß hinein? Denn es kommt erschwerend hinzu, daß ja ständig neue Prozesse mit einer neuen Prozeß-ID zur Fortsetzung der Synchronisation nach jeder „NSException“ gestartet werden. |
|
It seems that SOGo could not bind LDAP. This is usually caused by error in configuration,
Sebastien |
|
Is the LDAP configuration, as it can be seen in the attached sogo.conf file, correct or do I have to change or improve something? Same text in German: su -s /bin/bash - sogo extended LDIF# LDAPv3base <ou=people,dc=Domain,dc=de> with scope subtreefilter: uid=bidmonrequesting: ALL# bidmon, People, Domain.dedn: uid=bidmon,ou=People,dc=Domain,dc=de If you perform a general LDAP query on the user "Sogo" with the determination of the runtime using the command "time", it will look like this: Same text in German: time ldapsearch -x -H ldaps://ldap.Domain -b ou=people,dc=Domain,dc=de '(&(objectclass=dfneduperson)(employeetype=angestellte))' dn extended LDIF# LDAPv3base <ou=people,dc=Domain,dc=de> with scope subtreefilter: (&(objectclass=dfneduperson)(employeetype=angestellte))requesting: dn... bidmon, People, Domain.dedn: uid=bidmon,ou=People,dc=Domain,dc=de search resultsearch: 2 numResponses: 665numEntries: 664real 0m0.069s |
|
While further searching the Sogo log files, I noticed the following error: Feb 07 18:16:47 sogod [4513]: [WARN] <0x0x7f3329f01f60[WOxElemBuilder]> could not locate builders: WOxExtElemBuilder,WOxExtElemBuilder What does the error "[WOContext]> could not construct NSURL for uri '/SOGo?a=fetch&content=<php>die%28@md5%28HelloThinkCMF%29%29</php>'" mean? Same text in German: |
|
Date Modified | Username | Field | Change |
---|---|---|---|
2022-07-08 10:28 | Colmar0 | New Issue | |
2022-07-08 10:28 | Colmar0 | Tag Attached: active sync | |
2022-07-14 10:02 | Christian Mack | Relationship added | has duplicate 0005555 |
2022-07-14 10:03 | Christian Mack | Relationship added | has duplicate 0005556 |
2022-07-14 10:03 | Christian Mack | Relationship added | has duplicate 0005557 |
2022-10-07 07:09 | Colmar0 | Note Added: 0016267 | |
2022-10-07 07:09 | Colmar0 | File Added: sogo.conf | |
2022-10-07 07:15 | Colmar0 | Note Added: 0016268 | |
2022-12-01 06:28 | Colmar0 | Note Added: 0016447 | |
2022-12-01 07:44 | sebastien | Note Added: 0016448 | |
2022-12-01 10:12 | Colmar0 | Note Added: 0016449 | |
2022-12-01 10:48 | sebastien | Note Added: 0016450 | |
2022-12-01 10:48 | sebastien | Note Edited: 0016450 | |
2022-12-01 12:31 | Colmar0 | Note Added: 0016451 | |
2022-12-01 13:21 | sebastien | Note Added: 0016452 | |
2022-12-02 06:01 | Colmar0 | Note Added: 0016453 | |
2022-12-12 11:13 | Colmar0 | Note Added: 0016481 | |
2022-12-13 14:59 | Colmar0 | Note Added: 0016496 | |
2022-12-14 06:57 | Colmar0 | Note Added: 0016499 | |
2023-01-12 11:07 | Colmar0 | Note Added: 0016541 | |
2023-01-12 11:12 | Colmar0 | Note Added: 0016542 | |
2023-01-13 11:54 | Colmar0 | Note Added: 0016546 | |
2023-01-16 08:03 | Colmar0 | Note Added: 0016548 | |
2023-01-16 11:40 | Colmar0 | Note Added: 0016552 | |
2023-01-17 08:39 | sebastien | Note Added: 0016554 | |
2023-01-17 08:56 | Colmar0 | Note Added: 0016557 | |
2023-01-17 08:56 | Colmar0 | Note Added: 0016558 | |
2023-01-17 12:16 | Colmar0 | Note Added: 0016559 | |
2023-01-18 09:39 | Colmar0 | Note Added: 0016564 | |
2023-01-18 09:55 | sebastien | Note Added: 0016565 | |
2023-01-18 10:34 | Colmar0 | Note Added: 0016566 | |
2023-02-13 15:56 | Colmar0 | Note Added: 0016656 | |
2023-08-02 08:25 | sebastien | Assigned To | => sebastien |
2023-08-02 08:25 | sebastien | Status | new => closed |
2023-08-02 08:25 | sebastien | Resolution | open => duplicate |