0000791: archiving huge mail folders - show progress indicator - SOGo

ID	Project	Category	View Status	Date Submitted	Last Update

0000791	SOGo	Web Mail	public	2010-08-31 14:00	2010-09-02 16:23

Reporter	wimmer	Assigned To
Priority	normal	Severity	feature	Reproducibility	always
Status	new	Resolution	open

Summary	0000791: archiving huge mail folders - show progress indicator
Description	I found problem by archiving huge mail folders. I'm using dovecot IMAP server, Maildir format. When I try to archive folder including 0000020:0000011,000 messages (1.2 GB total disk space), SOGo does not finish this job. It is terminated with error: Proxy Error The proxy server received an invalid response from an upstream server. The proxy server could not handle the request GET /SOGo/so/user/Mail/0/folder-INBOX/exportFolder. Reason: Error reading from remote server In sogo log I see that messages are still added after displaying that warning. Maybe session has timed out or some time limit has been reached? Archiving of smaller (normal) folders works without problem.
Tags	No tags attached.

~~wsourdeau~~ 2010-08-31 14:01 viewer ~0001403	Hi Milos, Indeed this is likely due to a timeout, either on the front proxy side, either on the side of the SOGo master process. How much time does it take before the error occurs?

wimmer 2010-08-31 14:13 reporter ~0001404	I measured it just now - it is exactly 5 min. I'm using apache2 with proxy modul and default setting (without special timeout definitions), memcached, without imapproxy on that box.

~~wsourdeau~~ 2010-08-31 14:16 viewer ~0001405	This seems to be due to mod_proxy then. The timeout for the SOGo master process is 10 minutes and when it's triggered, the message "safety belt -- sending KILL signal to pid XXX" appears in the SOGo logs. The "ProxyTimeout" Apache directive does indeed default to 300 seconds. Could you try with a value of 600?

wimmer 2010-08-31 17:00 reporter ~0001406	Ok, I insert ProxyTimeout 600 into SOGo.conf and process of archiving huge mail folder was completed. So it is fine for me now ;-) Maybe SOGo could send any "I'm live and in progress" data back to the browser for elimination that long "quiet" time? It would be nice when SOGo would display some message like "Archiving in progress", because users are not sure if backup works when they do archiving of huge folders and nothing visual happens... Thanks

ludovic 2010-09-02 16:23 administrator ~0001410	Should also be extended when importing large calendars or address books

Date Modified	Username	Field	Change
2010-08-31 14:00	wimmer	New Issue
2010-08-31 14:01	~~wsourdeau~~	Note Added: 0001403
2010-08-31 14:13	wimmer	Note Added: 0001404
2010-08-31 14:16	~~wsourdeau~~	Note Added: 0001405
2010-08-31 17:00	wimmer	Note Added: 0001406
2010-09-01 22:43	ludovic	Severity	minor => feature
2010-09-01 22:43	ludovic	Summary	archiving huge mail folders => archiving huge mail folders - show progress indicator
2010-09-02 16:22	ludovic	Relationship added	has duplicate 0000801
2010-09-02 16:23	ludovic	Note Added: 0001410

I found problem by archiving huge mail folders.
I'm using dovecot IMAP server, Maildir format.
When I try to archive folder including 0000020:0000011,000 messages (1.2 GB total disk space), SOGo does not finish this job. It is terminated with error: