I just checked: Amazon did this in every delivery notification they sent me in december. So this is really serious for me.

Can you attach the full message source? Thanks.

I have created a message with the web interface and saved it in the drafts folder. Now my draft folder appears to be empty.

I have attached the source as it is accessible in thunderbird and as it resides in /var/spool/cyrus/mail/d/user/daniel/Drafts.

By the way: The XHR response in the web interface is not empty. But somehow, it does not display:

[["To", "Attachment", "Flagged", "Subject", "From", "Unread", "Priority", "Date", "Size", "rowClasses", "labels", "rowID", "uid"], ["test@test.com", "", "<img src=\"\/SOGo.woa\/WebServerResources\/dot.png?lm=1357682453\">", "<span>Bestellung Cast Marble<\/span>", "Daniel Flassak", "<img src=\"\/SOGo.woa\/WebServerResources\/dot.png?lm=1357682453\" class=\"mailerReadIcon\" title=\"Als ungelesen markieren\" title-markread=\"Als gelesen markieren\" title-markunread=\"Als ungelesen markieren\" id=\"readdiv_38\"\/>", "", "Montag, 14. Januar 2013 17:11 CET", "0.4 KB", "mailer_readmailsubject", "", "row_38", 38]]

I have the same problem since December.
Please see my attached amazon-mail in Bug 2079.

My system is: Ubuntu 12.04
dovecot 2.0.19
sogo 2.0.3a-1

Best regards,
Bernhard

I don't have an issue with the mail above (38).

I have uploaded another mail with this problem: badmail_amazon2.eml
The bug is easy reproducibly at my machine.

I'm guessing: It has something to do with dovecot or with German settings.

What can i do (special logging?) to provide more informations?

I don't think it has something to do with German settings. If I change the language to English, I have the same problem.

Also, I am using cyrus and not dovecot.

What can I do to provide more information? Since I only have my private server, I could give one of you admins an account so you can take a look at it from the web frontend side.
I think the problem is on the web frontend side, because the mail list XHR response comes through, but is not displayed.

The SUB character is not escaped in any way in the XHR response. I think it's supposed to be JSON.
Here's the relevant part:
3], ["foo@test.test", "", "<img src=\"\/SOGo.woa\/WebServerResources\/dot.png?lm=1357682453\">", "<span>Bestellung Cast Marble<\/span>",

Just in case the Bugtracker software filters it: It's "Bestellung <SUB>Cast Marble"

In correct JSON encoding, it should be:
"Bestellung \u001aCast Marble"

Maybe that's the problem.

I just checked by inserting a Unicode RLO mark for changing the writing direction. It is escaped properly:
from the response from
https://*/SOGo/so/daniel/Mail//0/folderINBOX/folderDrafts/unseenCount

So i guess that the list of unicode characters that should be escaped id is incomplete and missing SUB.

PS: The bugtracker seems to have a problem with this post. When I edit it, I edit backwards text instead of seeing the escaped text. Funny how UTF8 is confusing in so many places. :-)

I have added the response's text as an attachment. I can't insert it correctly anymore.

Just tried badmail_amazon2.eml and it also works for me.

If you compiled things from source, have a look at:

SOPE/sope-json/SBJson/Classes/SBJsonWriter.m - more specifically, the -appendString:into: method.

You could also install the debug symbols and set a breakpoint and see if it encodes the output properly.

I downloaded the file 38 as 38.eml and could reproduce the problem of waschmittel on my machine.

Sorry, I have not compiled from source. I am using the official Ubuntu repository on 12.04.

BTW, the output is definitely not encoded properly. It's probably not in the range of kEscapeChars.

SUB is U+001A according to http://en.wikipedia.org/wiki/List_of_Unicode_characters

I don't think I understand the code, because I am not even familiar with the language.

I have now reproduced this with Firefox 18, IE 9 and Chrome 24.

That is a nonprintable control character.

It should never be part of a subject or body in the first place.
But if it is, then SOGo should ignore it.

I agree that it should not be part of a subject or body. Unfortunately, Amazon has been sending me several of these mails. And I can't make them stop.

Additionaly, anyone knowing this could mailciously break my webmailer.

I have the same problem with this character in the subject
U+001C File Separator FS

Thanks.

Fixed. Please try the next nightly build tomorrow.

See https://github.com/inverse-inc/sogo/commit/0408415c61f572ab859c58f44c1d5a028b3fbef7