View Issue Details
ID | Project | Category | View Status | Date Submitted | Last Update |
---|---|---|---|---|---|
0001872 | SOGo | OpenChange backend | public | 2012-07-12 13:03 | 2012-10-04 20:32 |
Reporter | gyurco | Assigned To | |||
Priority | normal | Severity | crash | Reproducibility | always |
Status | resolved | Resolution | fixed | ||
Target Version | 2.0.1 | Fixed in Version | 2.0.1 | ||
Summary | 0001872: scalability: the sync process uses too much memory at once, leading to crashes with large mailboxes | ||||
Description | Samba4 always crashing when downloading INBOX at the first time: Program received signal SIGSEGV, Segmentation fault. Backtrace with gdb: | ||||
Tags | No tags attached. | ||||
Try again with the version that will be available next week. |
|
Try again with RC5 and reopen if necessary. |
|
Tried with latest nighly build (2.0_20120917), re-creted the samba domain, createad a brand new mailbox in Outlook 2007, dropped the socfs_admin table in postgres, still crashes. It's a big mailbox, with about 1 gigabytes of mail, if I reduce it to 50-60 megabytes, then the crash is gone. [2012/09/21 13:47:24, 5] MAPIStoreSOGo.m:905(sogo_message_get_attachment_table) |
|
Can you produce a stack trace? |
|
Seems not much difference from the previous version (20120926 runs now): ndr_push_error(12): Failed to push_expand to 271431372 Program received signal SIGSEGV, Segmentation fault. |
|
Does the mailbox have many mails? Perhaps there's a culprit mail in there that triggers this bug. If it's a small mailbox, do you think we could have a copy for our own testing? |
|
It's a rather large one, with about 1 gigabytes of mail, I'll try to reduce it to the minimum which triggers the crash, then compress. Where should I send/upload the compressed file? |
|
This is expected for now as the synchronisation process puts everything in memory before sending it to the client. The code is quite complex already with that mechanism and I did not think at first that such large mailboxes would be used. This certainly can be fixed but it will require to keep a state of the synchronization between invocations of FastTransferGetBuffer. |
|
Ahh, that explains why it's not possible to pinpoint one mail which causes the crash. The limit (I guess it depends on the hardware, too) for me is about 200 MB for a folder. |
|
Solved in svn commit 4169 |
|
gyurco: this should be solve, please give it a try with the next nigthlies if you can. Otherwise this will simply be part of 2.0.1 |
|
Date Modified | Username | Field | Change |
---|---|---|---|
2012-07-12 13:03 | gyurco | New Issue | |
2012-07-25 20:08 | ludovic | Target Version | => 2.0 |
2012-08-16 18:44 | ludovic | Note Added: 0004341 | |
2012-08-16 18:44 | ludovic | Product Version | trunk => |
2012-08-16 18:44 | ludovic | Target Version | 2.0 => |
2012-09-05 15:13 | ludovic | Note Added: 0004435 | |
2012-09-05 15:13 | ludovic | Status | new => closed |
2012-09-05 15:13 | ludovic | Resolution | open => unable to reproduce |
2012-09-21 11:43 | gyurco | Note Added: 0004528 | |
2012-09-21 11:43 | gyurco | Status | closed => feedback |
2012-09-21 11:43 | gyurco | Resolution | unable to reproduce => reopened |
2012-09-24 19:08 | ludovic | Note Added: 0004535 | |
2012-09-26 12:09 | gyurco | Note Added: 0004551 | |
2012-09-26 12:50 | ludovic | Note Added: 0004556 | |
2012-09-26 14:09 | gyurco | Note Added: 0004563 | |
2012-09-26 19:09 |
|
Summary | Samba4 crashing when downloding INBOX => Samba4 crashing when downloding large mailboxes |
2012-09-26 19:11 |
|
Note Added: 0004572 | |
2012-09-27 08:26 | gyurco | Note Added: 0004578 | |
2012-10-03 15:09 |
|
Project | SOGo Native Outlook Compatibility (obsolete) => SOGo |
2012-10-03 15:12 |
|
Category | => OpenChange backend |
2012-10-03 15:20 |
|
Summary | Samba4 crashing when downloding large mailboxes => The sync process uses too much memory at once, leading to crashes with large mailboxes |
2012-10-03 15:20 |
|
Target Version | => 2.0.1 |
2012-10-03 15:31 |
|
Summary | The sync process uses too much memory at once, leading to crashes with large mailboxes => scalability: the sync process uses too much memory at once, leading to crashes with large mailboxes |
2012-10-03 17:05 |
|
Status | feedback => assigned |
2012-10-03 17:05 |
|
Assigned To | => wsourdeau |
2012-10-04 20:22 |
|
Note Added: 0004612 | |
2012-10-04 20:22 |
|
Status | assigned => resolved |
2012-10-04 20:22 |
|
Fixed in Version | => 2.0.1 |
2012-10-04 20:22 |
|
Resolution | reopened => fixed |
2012-10-04 20:32 |
|
Note Added: 0004613 |