0004692: No body displayed for UTF8 HTML messages with invalid characters - SOGo

ID	Project	Category	View Status	Date Submitted	Last Update
0004692	SOGo	Web Mail	public	2019-02-27 11:36	2019-07-06 15:25

Reporter	schmirl	Assigned To	francis
Priority	normal	Severity	minor	Reproducibility	always
Status	resolved	Resolution	fixed
Product Version	4.0.6
Fixed in Version	4.0.8

Summary	0004692: No body displayed for UTF8 HTML messages with invalid characters
Description	No body will be shown for a text/html MIME part with charset=UTF-8 which contains invalid UTF8 like e.g. an iso-8859-1 encoded character. Usually the problem are just a few characters, so it would be great if invalid UTF8 sequences could be removed or replaced with some sort of placeholder. Message will display ok when flagged as text/plain
Steps To Reproduce	create a html message in utf8 format and place e.g. an iso-8859-1 encoded character in it view it in SOGo web UI
Additional Information	Problem showed up with SOGo BTS activities mail from 2019-02-26, containing an "ä" in iso8859-1 encoding (hex e4). Attached a stripped down hand crafted mail plus the SOGo BTS activities mail.
Tags	No tags attached.

schmirl 2019-02-27 11:36 reporter	iso8859-1_in_utf8.msg (212 bytes)

schmirl 2019-02-27 11:37 reporter	sogo_bts.eml (6,210 bytes)

schmirl 2019-06-17 11:17 reporter ~0013637	I can confirm that the fix for 0004513 resolves this issue. Thanks!

Date Modified	Username	Field	Change
2019-02-27 11:36	schmirl	New Issue
2019-02-27 11:36	schmirl	File Added: iso8859-1_in_utf8.msg
2019-02-27 11:37	schmirl	File Added: sogo_bts.eml
2019-06-17 11:17	schmirl	Note Added: 0013637
2019-06-17 12:22	francis	Relationship added	duplicate of 0004513
2019-06-17 12:22	francis	Status	new => resolved
2019-06-17 12:22	francis	Fixed in Version	=> 4.0.8
2019-06-17 12:22	francis	Resolution	open => fixed
2019-06-17 12:22	francis	Assigned To	=> francis