Incorrect processing of bounced emails

[MatLudlam]

Hi yuri - in post 14.3 above are steps to re-produce the problem along with sample email addresses.  Can you test these on the new version?

You also do not say anywhere above that you have fixed it. I have asked many times for feedback, but it was never given.

You are correct, I am not on 7.1 yet, happy to have that conversation.  We are on the ESPO Cloud, so if your collages there want to contact me, happy to do it.

[yuri]

> I have provided what is needed for you to re-product it.

Sorry but it's not true. I didn't get an email original from you. I made some fixes that potentially could fix the problem. These fixes are in v7.1, not sure if your instance is upgraded.

[MatLudlam]

Hi Taras and yuri can I get your feedback please. This is incorrect functionality; I have provided what is needed for you to re-product it.

It would be great to get some feedback one way or another.

Thanks.

[MatLudlam]

Hi yuri I now have an easy way for you to reproduce this at your end.

Create 2 new contacts, with the email addresses david.wise@nationwide.co.uk and paul.shaw@barclays.com (I can provide many other examples).

Put them into a Target List.

Create a Marketing Campaign, to that Target List.

They will both bounce as they are now invalid.

Check the "Group Email Account" and you will see that it has picked the emails up, but it has not recognised them as bounced.

When I look at the statistics for the Marketing Campaign it shows as 2 sent, 0 bounced.

When I run my mail debug tool over the bounced messages, they all have a part of type "message/delivery-status", and within that they have a "Final-recipient:" header which correctly specifies the incorrect email address. I am happy to provide the delivery-status details in text files if you want them.

I look forward to your feedback.

[esforim]

Hi Mat,

Just a suggestion that may help; (1) is the bounced reproducible easily? (2) if so, perhaps creating a new account that can be provide to Yuri for testing may help... but not sure if he will use it.

[MatLudlam]

Hi yuri can I get your feedback on this please?

[MatLudlam]

Hi yuri I am still having issues with this. My questions above still stand:

• How do you want me to share the emails that are not correctly processed with you?
• Where can I see the source for BouncedRecognizer?

One thing I could do is create a new Hotmail account, put the bounced emails in it, then share the details with you so that you can connect directly to the mailbox from your ESPO instance and see what is happening. I would not want to post the access details here though.

Thoughts?

[MatLudlam]

Yuri - thanks for this. Do you have what you need on the above share? If not, what can I provide you?

Separately, where is the source for BouncedRecognizer? I have tried looking through the Git repository, but cannot find it (not very good at Git!!). Thanks

[yuri]

I wrote a test that checks bounced emails recognition. Any not recognized bounced email can be added as a test-case and it will be easy to fix. All is needed is a raw contents of such emails.

https://github.com/espocrm/espocrm/blob/fix/tests/unit/Espo/Core/Mail/Account/BouncedRecognizerTest.php

[MatLudlam]

I have put both a PST and MSG format files on this share: https://1drv.ms/f/s!AiQ6JPOdP3xck7VCSmfcnfug9RPrzg

The issue is that messages have multiple parts embedded within each other. So when viewed in Outlook that email just presents an error message in an HTML page. Everything is there, but as the HTML is built for someone to read, it is not easy to process. In the email are another 3 (actually more if you include the wrappers) parts that are:
* A plain text version of the error message
* The original HTML message
* A "message/delivery-status" which has a very specific format, and it machine readable.

Outlook only shows the 1st of those parts (the error message) but the other 3 parts are there. When creating a MSG file, Outlook simplifies things and removes some of the other parts.

I have tools that I am happy to show working that I have put together to illustrate this. They are written in Java (my preferred language) rather than PHP.

[esforim]

I'm guessing it need to be some plaintext format for Yuri to be able to open it, something that can be open with Notepad.. I think .msg is the standard format that can do just that. PST or EML is outlook locked?

Don't quote me on this though, I tried searching the difference in format but internet slow and I want to read next thread...

EDIT: Here you go: https://www.shoviv.com/blog/how-to-s...-and-msg-file/
EML is the plain text format.

[MatLudlam]

The question is, what do I upload? If I take the mail out of Outlook, it destroys the data within it (that is what I did originally). Apart from a PST, the only other way that I can send it, without destroying the content, is to forward as an attachment.

Actually try the ZIP version of an MSG file which is on that share above because it is too big to attach. I am not sure how you will open the MSG, but the attachment (which is what you are interested in) is ok.

As a different idea, this is in our Cloud Instance of ESPO, so you can log into that and look at it if you want.

[yuri]

Maybe try to upload on the customer portal? As an attachment of a case.

[MatLudlam]

Unfortunately, I don't have Outlook to open PST files.

Is there an email account I can forward it to as an attachment?

[yuri]

Unfortunately, I don't have Outlook to open PST files.