Email problem in log

[tothewine]

This is on freshly installed 5.9.0. I got a very big log file full of this errors:

[2020-05-21 07:32:05] Espo.ERROR: InboundEmail 5ec62d64308ea00fd (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:32:05] Espo.ERROR: InboundEmail 5ec62d64308ea00fd (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:32:07] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:33:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:34:03] Espo.ERROR: InboundEmail 5ec62d64308ea00fd (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:34:07] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:35:01] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:36:07] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:37:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:38:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA92019 ...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:38:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Prim...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:38:04] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:39:01] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:40:01] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 1998...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:40:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 2019...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:40:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:41:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:42:03] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:42:03] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:42:03] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:43:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:44:01] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 2005...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:44:01] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 2005...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:44:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 2019...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:44:02] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:45:01] Espo.DEBUG: BPM: processPendingFlows [] []
[2020-05-21 07:46:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA92019 ...' for column 'body_plain' at row 1 [] []
[2020-05-21 07:46:03] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366
Incorrect string value: '\xA9 Moto...' for column 'body_plain' at row 1 [] []

[yuri]

Was it installed over an existing old DB?

[tothewine]

no, it was installed fresh on a empty db. I only copied some parts of custom folder but nothing related to emails.
I did delete the log, done some rebuild and cache cleaning and now it has stopped. very hard to investigate with big log...
maybe we could use rotation by file size too

[yuri]

Could you check what collation is set for 'body_plain' column in 'email' table. It can be seen in phpmyadmin.

[tothewine]

I see utf8mb4_unicode_ci everywhere... i took a screenshot to make as much info available

[yuri]

Is it possible that you provide an original of any of these emails?

[yuri]

I could not reproduce it yet. The email you provided was imported well.

[yuri]

Please check what charset set in data/config.php -> database.

[tothewine]

The original text of these email had emojis in the subject line, maybe that was it but I remember having emails with emoji in espo previously.

here is my config.php

[tothewine]

I spotted two instances of this again:

[2020-05-27 15:30:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366 Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []
[2020-05-27 16:22:02] Espo.ERROR: InboundEmail 5ec626e012afe5a27 (Import Message w/ MailMimeParser): [HY000] SQLSTATE[HY000]: General error: 1366 Incorrect string value: '\xA9 Subi...' for column 'body_plain' at row 1 [] []

I am trying to add some additional logging so I can print the email text

[yuri]

This fix might help: https://github.com/espocrm/espocrm/issues/1723

[tothewine]

Thanks, I applied the pathc. I'm testing

[tothewine]

For now I did find no new such errors in log so I say it is probbly fixed