Links in emails not working

[abetts]

For a couple of weeks now the links included in emails are just dropping members to the forum homepage, eg topic/message notifications, even the 'forgot my password' link which is a real pain! 

Any ideas where I need to start checking? I use Sendgrid and that's all ok from what I can tell?

[Jim M]

If you use SendGrid's link tracking, disable that and test again. Likely, it may be malforming the URLs.

[abetts]

Thanks Jim, I've turned that off. If it helps, this is an example of a link from a PM to me recently...

http://url9376.thelotusforums.com/ls/click?upn=BBzVdn2vzgbvzfhZx9vzPzJeXaL-2FWcITQ3e7zMYRy8vRi-2Bk6IZkQVzgwXqC6kJbLYSryj6-2BUivoiznYu06X6eF-2BgVVCn-2Fnx-2BQ2EdUWSQvMSazbgzKGmB4N9mv58qbWlWNVLJiZaS0kbjY3TV-2F2kmULCbv9lpPQJY18-2BLuwHG5qsl3uqtO6VpTfvANq9RHK-2Fe-2FgBfnDKaRP0ZIWh4PRkGOiqtU7GOpkSC4mSrgRCANldKbvc1Fzcond46-2BEOHDgOeI9rNc05TLGl882qpzUm-2BRIvqXw5ceNnKX7wJwgoQ9aF0wkAl1PFYO3U7cWPA8cyx9b9DaHmRFIbRJcULrNRL0Gu76fTrg8JJSVcGpxsEkfs-3DdrhC_nwmWHbQklCPBoSpUsdblirzT5dMS50f48-2FhV4DH6NoJ7T-2FYvUsE097UkL6aDk1MX8uKAQEhYIlp6flbqn0-2B6zCHUbHJViqxi6b2XZZQF0X-2F4Nn0BGTxTRzzAwXCVaVVtG6CY30Kmm6hjm5LzO-2Fi8D0K-2FqeHGPdjpIweiVCfx2t4FOjBy3D3bR5XbqV3cCSZtoO35pHtKdMMIatK02-2BE-2BHyMu57YQMe21WBmKfLAHkDU-3D

[Jim M]

14 minutes ago, abetts said:

Thanks Jim, I've turned that off. If it helps, this is an example of a link from a PM to me recently...

http://url9376.thelotusforums.com/ls/click?upn=BBzVdn2vzgbvzfhZx9vzPzJeXaL-2FWcITQ3e7zMYRy8vRi-2Bk6IZkQVzgwXqC6kJbLYSryj6-2BUivoiznYu06X6eF-2BgVVCn-2Fnx-2BQ2EdUWSQvMSazbgzKGmB4N9mv58qbWlWNVLJiZaS0kbjY3TV-2F2kmULCbv9lpPQJY18-2BLuwHG5qsl3uqtO6VpTfvANq9RHK-2Fe-2FgBfnDKaRP0ZIWh4PRkGOiqtU7GOpkSC4mSrgRCANldKbvc1Fzcond46-2BEOHDgOeI9rNc05TLGl882qpzUm-2BRIvqXw5ceNnKX7wJwgoQ9aF0wkAl1PFYO3U7cWPA8cyx9b9DaHmRFIbRJcULrNRL0Gu76fTrg8JJSVcGpxsEkfs-3DdrhC_nwmWHbQklCPBoSpUsdblirzT5dMS50f48-2FhV4DH6NoJ7T-2FYvUsE097UkL6aDk1MX8uKAQEhYIlp6flbqn0-2B6zCHUbHJViqxi6b2XZZQF0X-2F4Nn0BGTxTRzzAwXCVaVVtG6CY30Kmm6hjm5LzO-2Fi8D0K-2FqeHGPdjpIweiVCfx2t4FOjBy3D3bR5XbqV3cCSZtoO35pHtKdMMIatK02-2BE-2BHyMu57YQMe21WBmKfLAHkDU-3D

This would be their link tracking.

[abetts]

Excellent, thank you 🙂

 

[abetts]

Still not working with it turned off (I've turned off 'click tracking' which I assume is what they call it!). 

Edited October 4, 2022 by abetts

[Jim M]

2 minutes ago, abetts said:

Still not working with it turned off (I've turned off 'click tracking' which I assume is what they call it!). 

This would only work moving forward with new emails sent out. Older emails will still have their click tracking on it so you can't change that.

[abetts]

I just got a notification... still looks like this...

http://url9376.thelotusforums.com/ls/click?upn=BBzVdn2vzgbvzfhZx9vzPzJeXaL-2FWcITQ3e7zMYRy8vRi-2Bk6IZkQVzgwXqC6kJbLYSryj6-2BUivoiznYu06X6eF-2BgVVCn-2Fnx-2BQ2EdUWSQvMSazbgzKGmB4N9mv58qbWlWNVLJiZaS0kbjY3TV-2F2kmULCbv9lpPQJY18-2BLuwHG5qsdDCge9w6zGSc9gGqCX3938mEh89ShpOkMFTf7F63nceZYSHI4bdgnSvKr3F-2BOp3Q-2BM9JqKAo2sDkkYh1k6ULiAqDekFzBYs1hb1JpC5bGG89zadxFkTrbPT0V3kBWTafbVwabFsO7iiwYXdHnQpX9TuLgcum-2B3XkbWYnJIH-2FwRE1OOH3mqown9hdKmAuGL6rLfs6rcD8jidacpmvPWj-2FU0OjJ95Y25n5ALQzzEdyxA7acniUO7zpadq76JeK81BU-3DpCY__nwmWHbQklCPBoSpUsdblirzT5dMS50f48-2FhV4DH6NoIU4Sjst5Se-2FjgOuwablw0gMJUVBHSkUAnkSA8IMR8bDouJO3y9HAExH8uV9oIecz4W-2BFmlVxGULipNqpdZIaMJe3f-2FAYuNYxJPlpa-2F2srxEZelRtlCxDVpZBlQ0M1FDEOCphqhVnZR1A1iiSUmDqxIK-2BQiAffGqF019uUIyMDThSuHfxeN84gsDt-2FFA8cI00s-3D

This is our monthly volume through Sendgrid, should I move to PHP or SMTP instead or is SendGrid the best option (when it works!)?

[Jim M]

You would need to reach out to SendGrid for assistance here. They are experts in their product and can confirm if you have it disabled correctly. It could be there is a lag also in disabling.

[abetts]

Will do, thanks Jim 👍

[abetts]

Sendgrid have been looking into this and have sent this - It appears there's a redirect in the uncoded url the forum is sending out... Is this correct and how it should work? Looks like the link I sent was for a new report notification.

I'm so sorry to hear that you are having problems of this type. I took the links provided by you and decoded them and I saw that for both of them, there is a redirect url.
 
For example, for this link:
 
http://url9376.thelotusforums.com/ls/click?upn=BBzVdn2vzgbvzfhZx9vzPzJeXaL-2FWcITQ3e7zMYRy8vRi-2Bk6IZkQVzgwXqC6kJbLYSryj6-2BUivoiznYu06X6eF-2BgVVCn-2Fnx-2BQ2EdUWSQvMSazbgzKGmB4N9mv58qbWlWNVLJiZaS0kbjY3TV-2F2kmULCbv9lpPQJY18-2BLuwHG5qsl3uqtO6VpTfvANq9RHK-2Fe-2FgBfnDKaRP0ZIWh4PRkGOiqtU7GOpkSC4mSrgRCANldKbvc1Fzcond46-2BEOHDgOeI9rNc05TLGl882qpzUm-2BRIvqXw5ceNnKX7wJwgoQ9aF0wkAl1PFYO3U7cWPA8cyx9b9DaHmRFIbRJcULrNRL0Gu76fTrg8JJSVcGpxsEkfs-3DdrhC_nwmWHbQklCPBoSpUsdblirzT5dMS50f48-2FhV4DH6NoJ7T-2FYvUsE097UkL6aDk1MX8uKAQEhYIlp6flbqn0-2B6zCHUbHJViqxi6b2XZZQF0X-2F4Nn0BGTxTRzzAwXCVaVVtG6CY30Kmm6hjm5LzO-2Fi8D0K-2FqeHGPdjpIweiVCfx2t4FOjBy3D3bR5XbqV3cCSZtoO35pHtKdMMIatK02-2BE-2BHyMu57YQMe21WBmKfLAHkDU-3D
 
The decoded link is: 

https://www.thelotusforums.com/forums/index.php?app=core&module=system&controller=redirect&url=https://www.thelotusforums.com/forums/modcp/reports/1045/&key=8fc1730eefe92416c37b61ed68c4be34caef5ffb520d1440ca1ed79fd3e74203&email=1&type=notification_report_center

From the above link I am able to see that there is a redirect url which is redirecting again your link. 
Could you please confirm that this is the right link with that redirect?

[Jim M]

Correct. There is meant to be a redirect there.

[abetts]

Thank you, I've let them know 🙂

 

[abetts]

They want to know if this link is correct as well, sorry!! 

 

Thank you for the follow-up!

For the second link: http://url9376.thelotusforums.com/ls/click?upn=BBzVdn2vzgbvzfhZx9vzPzJeXaL-2FWcITQ3e7zMYRy8vRi-2Bk6IZkQVzgwXqC6kJbLYSryj6-2BUivoiznYu06X6eF-2BgVVCn-2Fnx-2BQ2EdUWSQvMSazbgzKGmB4N9mv58qbWlWNVLJiZaS0kbjY3TV-2F2kmULCbv9lpPQJY18-2BLuwHG5qsdDCge9w6zGSc9gGqCX3938mEh89ShpOkMFTf7F63nceZYSHI4bdgnSvKr3F-2BOp3Q-2BM9JqKAo2sDkkYh1k6ULiAqDekFzBYs1hb1JpC5bGG89zadxFkTrbPT0V3kBWTafbVwabFsO7iiwYXdHnQpX9TuLgcum-2B3XkbWYnJIH-2FwRE1OOH3mqown9hdKmAuGL6rLfs6rcD8jidacpmvPWj-2FU0OjJ95Y25n5ALQzzEdyxA7acniUO7zpadq76JeK81BU-3DpCY__nwmWHbQklCPBoSpUsdblirzT5dMS50f48-2FhV4DH6NoIU4Sjst5Se-2FjgOuwablw0gMJUVBHSkUAnkSA8IMR8bDouJO3y9HAExH8uV9oIecz4W-2BFmlVxGULipNqpdZIaMJe3f-2FAYuNYxJPlpa-2F2srxEZelRtlCxDVpZBlQ0M1FDEOCphqhVnZR1A1iiSUmDqxIK-2BQiAffGqF019uUIyMDThSuHfxeN84gsDt-2FFA8cI00s-3D
 
When we decoded it here is the link:
 

https://www.thelotusforums.com/forums/index.php?app=core&module=system&controller=redirect&url=https://www.thelotusforums.com/forums/messenger/75493/?do=findComment%26comment=184602&key=8bad71d34e1a6094be7db4d55273f8b2f30de212d082e99b59fc6a41818ccaf9&email=1&type=notification_new_private_message

 
Could you please confirm if those links that we decoded go where they should?
 
Also, could you please do a test and disable click tracking to see how the links are sent and if there are any problems?
 
Thank you for your patience. I am looking forward to your response.

When I click on the link directly it take me to the forum homepage and not the PM...

[Jim M]

The redirect being there is correct, however, the encoding of SendGrid seems to be the problem as it was not decoded properly and looks to be broken.

[abetts]

If the redirect is correct, how come when I click it I'm not being taken to the PM if refers to, but the forum homepage?

[Randy Calvert]

5 minutes ago, abetts said:

If the redirect is correct, how come when I click it I'm not being taken to the PM if refers to, but the forum homepage?

Because it was not encoded by Sendgrid properly.   This is a garbage in/garbage out scenario.  

The redirect SHOULD exist.  The problem is because it was encoded incorrectly it does not take you to the right spot when unencoded.  

Try turning off Sendgrid and sending via SMTP or PHP...  I'll bet you then find those links work correctly.  I had this problem with Sendgrid myself as well with certain links.  It's one of the reasons I switched to AWS SES for sending email instead of Sendgrid.  

Edited October 6, 2022 by Randy Calvert

[abetts]

Thanks, I think I will move away from SendGrid and look into an alternative. Sending around 13-14k emails a month, it AWS SES easy enough to set up?

[Randy Calvert]

It requires a third party plugin:

There is also some setup work on the AWS side to setup things like the feedback loop to automatically handle bounces, etc.  But @Jon Erickson is very helpful and responsive if you run into problems.  I also found SES to be much more reliable for delivery of mail (around 20% of mail was marked as spam by major ISPs such as Yahoo and Comcast with their non-dedicated IPs).  

[opentype]

7 minutes ago, abetts said:

AWS SES easy enough to set up?

[abetts]

I've changed to PHP mail so we can eliminate SendGrid here. 

I just had an email for a PM, this is the link in the email and it sends me to the forum index page...

https://www.thelotusforums.com/forums/index.php?app=core&module=system&controller=redirect&url=https://www.thelotusforums.com/forums/messenger/75500/?do=findComment%26comment=184645&key=e2bdf6e5792048c3d8eadd55fd0439ef37ed7ee085d53fa96c7828b8194bfccf&email=1&type=notification_new_private_message

[Marc Stridgen]

Are you logged in as the person you are getting that notification from?

[abetts]

It's a message to me and I'm logged in as me. 

[Marc Stridgen]

Do you have anything in your htaccess file other than what we provide as default?

[abetts]

<IfModule mod_rewrite.c>
Options -MultiViews
RewriteEngine On
RewriteBase /forums/
Redirect 301 /forums/new-content/ http://www.thelotusforums.com/forums/discover/unread/
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /forums/index.php [L]
</IfModule>
<IfModule mod_security.c>
SecFilterEngine Off
SecFilterScanPOST Off
</IfModule>
## Begin - Expires caching
<IfModule mod_expires.c>

## This rule will create an ETag for files based only on the modification timestamp and their size. 
## Note: It may cause problems on your server and you may need to remove it
FileETag MTime Size

SetOutputFilter DEFLATE
Header set Expires "max-age=29030400, public"
Header unset ETag
FileETag None

# Enable expiration control
ExpiresActive On

# Default expiration: 1 hour after request
ExpiresDefault "now plus 1 hour"

# CSS and JS expiration: 1 week after request
ExpiresByType text/css "now plus 1 week"
ExpiresByType application/javascript "now plus 1 week"
ExpiresByType application/x-javascript "now plus 1 week"

# Image files expiration: 1 month after request
ExpiresByType image/bmp "now plus 1 month" 
ExpiresByType image/gif "now plus 1 month"
ExpiresByType image/jpg "now plus 1 month"
ExpiresByType image/jpeg "now plus 1 month"
ExpiresByType image/jp2 "now plus 1 month"
ExpiresByType image/pipeg "now plus 1 month"
ExpiresByType image/png "now plus 1 month"
ExpiresByType image/svg+xml "now plus 1 month"
ExpiresByType image/tiff "now plus 1 month"
ExpiresByType image/vnd.microsoft.icon "now plus 1 month"
ExpiresByType image/x-icon "now plus 1 month"
ExpiresByType image/ico "now plus 1 month"
ExpiresByType image/icon "now plus 1 month"
ExpiresByType text/ico "now plus 1 month"
ExpiresByType application/ico "now plus 1 month"
ExpiresByType image/vnd.wap.wbmp "now plus 1 month"
ExpiresByType application/vnd.wap.wbxml "now plus 1 month"

# Other optimizations
ExpiresByType application/x-gzip "access plus 1 month"
ExpiresByType application/x-shockwave-flash "access plus 1 month"

</IfModule>
## End - Expires caching