Uploaded image for project: 'Observium'
  1. Observium
  2. OBS-3931

Alerting email graphs : Graphics are not always shown

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • None
    • CE-21.10
    • Alerting
    • I'm running OB on a dedicated Ubuntu 20.04 VMWare Virtual Machine

    Description

      Hi there

      When I get email alerts from the system, the graph is not always shown...

      I just had some issues with some fans ramping up, so I got 4 alerts (one for each fan), and three of them had no graph but just the little "?" signifying that the graphics is gone or broken...

      I use an MS Outlook client on MacOS, but is it also apparent if I use the Office365 web version...

      I have attached two examples that shows one of each...

      I have not tried to alter the alerting in anyway... pretty default setup that has been running for just about a year...

       

      /Beardmann

      Attachments

        Activity

          [OBS-3931] Alerting email graphs : Graphics are not always shown

          This is what the syslog looks like while the emails from OB is triggered... (this is via SMTP to localhost)...

          First they go into SMTP localhost, and are then relayed to o365 where we have the "concurrent" issue..  yet all 4 emails are sent and received.. yet only one of them have the graph working.. 

          Nov  4 17:55:10 observium postfix/smtpd[2262214]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: connect from localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: 450AE1E0017: client=localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/cleanup[2262218]: 450AE1E0017: message-id=<6a94f1727bb7342355356f8e989cbaba@observium.bbaas.local>
          Nov  4 17:55:10 observium postfix/qmgr[2260983]: 450AE1E0017: from=<hw@beardmann.dk>, size=5666, nrcpt=1 (queue active)
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: connect from localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: 4CFD31E001A: client=localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/cleanup[2262218]: 4CFD31E001A: message-id=<92c83e0f4ea7c44f3d5cee66e71317f0@observium.bbaas.local>
          Nov  4 17:55:10 observium postfix/qmgr[2260983]: 4CFD31E001A: from=<hw@beardmann.dk>, size=5666, nrcpt=1 (queue active)
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: connect from localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: 551511E001B: client=localhost[127.0.0.1]
          Nov  4 17:55:10 observium postfix/cleanup[2262218]: 551511E001B: message-id=<0b099b0d6940f139cbae63e94f900b64@observium.bbaas.local>
          Nov  4 17:55:10 observium postfix/smtpd[2262214]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
          Nov  4 17:55:10 observium postfix/qmgr[2260983]: 551511E001B: from=<hw@beardmann.dk>, size=5666, nrcpt=1 (queue active)
          Nov  4 17:55:10 observium postfix/relay/smtp[2262225]: 4CFD31E001A: host smtp.office365.com[52.97.201.114] said: 432 4.3.2 Concurrent connections limit exceeded. Visit https://aka.ms/concurrent_sending for more information. [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com] (in reply to end of DATA command)
          Nov  4 17:55:11 observium postfix/relay/smtp[2262222]: 450AE1E0017: to=<hw@beardmann.dk>, relay=smtp.office365.com[52.97.201.114]:587, delay=0.9, delays=0.01/0.02/0.51/0.36, dsn=2.0.0, status=sent (250 2.0.0 OK <6a94f1727bb7342355356f8e989cbaba@observium.bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com])
          Nov  4 17:55:11 observium postfix/qmgr[2260983]: 450AE1E0017: removed
          Nov  4 17:55:11 observium postfix/relay/smtp[2262219]: 387241E0005: to=<hw@beardmann.dk>, relay=smtp.office365.com[52.97.179.194]:587, delay=0.96, delays=0.01/0.02/0.55/0.38, dsn=2.0.0, status=sent (250 2.0.0 OK <6fbe188eff21fd71374d3a0cd556b3e9@observium.bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com])
          Nov  4 17:55:11 observium postfix/qmgr[2260983]: 387241E0005: removed
          Nov  4 17:55:11 observium postfix/relay/smtp[2262226]: 551511E001B: to=<hw@beardmann.dk>, relay=smtp.office365.com[52.97.201.114]:587, delay=0.9, delays=0/0.02/0.49/0.38, dsn=2.0.0, status=sent (250 2.0.0 OK <0b099b0d6940f139cbae63e94f900b64@observium.bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com])
          Nov  4 17:55:11 observium postfix/qmgr[2260983]: 551511E001B: removed
          Nov  4 17:55:11 observium postfix/relay/smtp[2262225]: 4CFD31E001A: to=<hw@beardmann.dk>, relay=smtp.office365.com[40.101.12.98]:587, delay=1.3, delays=0/0.02/1/0.27, dsn=2.0.0, status=sent (250 2.0.0 OK <92c83e0f4ea7c44f3d5cee66e71317f0@observium.bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com])
          Nov  4 17:55:11 observium postfix/qmgr[2260983]: 4CFD31E001A: removed 

          Beardmann Heino Walther added a comment - This is what the syslog looks like while the emails from OB is triggered... (this is via SMTP to localhost)... First they go into SMTP localhost, and are then relayed to o365 where we have the "concurrent" issue..  yet all 4 emails are sent and received.. yet only one of them have the graph working..  Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: disconnect from localhost[ 127.0 . 0.1 ] ehlo= 1 mail= 1 rcpt= 1 data= 1 quit= 1 commands= 5 Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: connect from localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: 450AE1E0017: client=localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/cleanup[ 2262218 ]: 450AE1E0017: message-id=<6a94f1727bb7342355356f8e989cbaba @observium .bbaas.local> Nov   4 17 : 55 : 10 observium postfix/qmgr[ 2260983 ]: 450AE1E0017: from=<hw @beardmann .dk>, size= 5666 , nrcpt= 1 (queue active) Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: disconnect from localhost[ 127.0 . 0.1 ] ehlo= 1 mail= 1 rcpt= 1 data= 1 quit= 1 commands= 5 Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: connect from localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: 4CFD31E001A: client=localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/cleanup[ 2262218 ]: 4CFD31E001A: message-id=<92c83e0f4ea7c44f3d5cee66e71317f0 @observium .bbaas.local> Nov   4 17 : 55 : 10 observium postfix/qmgr[ 2260983 ]: 4CFD31E001A: from=<hw @beardmann .dk>, size= 5666 , nrcpt= 1 (queue active) Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: disconnect from localhost[ 127.0 . 0.1 ] ehlo= 1 mail= 1 rcpt= 1 data= 1 quit= 1 commands= 5 Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: connect from localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: 551511E001B: client=localhost[ 127.0 . 0.1 ] Nov   4 17 : 55 : 10 observium postfix/cleanup[ 2262218 ]: 551511E001B: message-id=<0b099b0d6940f139cbae63e94f900b64 @observium .bbaas.local> Nov   4 17 : 55 : 10 observium postfix/smtpd[ 2262214 ]: disconnect from localhost[ 127.0 . 0.1 ] ehlo= 1 mail= 1 rcpt= 1 data= 1 quit= 1 commands= 5 Nov   4 17 : 55 : 10 observium postfix/qmgr[ 2260983 ]: 551511E001B: from=<hw @beardmann .dk>, size= 5666 , nrcpt= 1 (queue active) Nov   4 17 : 55 : 10 observium postfix/relay/smtp[ 2262225 ]: 4CFD31E001A: host smtp.office365.com[ 52.97 . 201.114 ] said: 432 4.3 . 2 Concurrent connections limit exceeded. Visit https: //aka.ms/concurrent_sending for more information. [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com] (in reply to end of DATA command) Nov   4 17 : 55 : 11 observium postfix/relay/smtp[ 2262222 ]: 450AE1E0017: to=<hw @beardmann .dk>, relay=smtp.office365.com[ 52.97 . 201.114 ]: 587 , delay= 0.9 , delays= 0.01 / 0.02 / 0.51 / 0.36 , dsn= 2.0 . 0 , status=sent ( 250 2.0 . 0 OK <6a94f1727bb7342355356f8e989cbaba @observium .bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com]) Nov   4 17 : 55 : 11 observium postfix/qmgr[ 2260983 ]: 450AE1E0017: removed Nov   4 17 : 55 : 11 observium postfix/relay/smtp[ 2262219 ]: 387241E0005: to=<hw @beardmann .dk>, relay=smtp.office365.com[ 52.97 . 179.194 ]: 587 , delay= 0.96 , delays= 0.01 / 0.02 / 0.55 / 0.38 , dsn= 2.0 . 0 , status=sent ( 250 2.0 . 0 OK <6fbe188eff21fd71374d3a0cd556b3e9 @observium .bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com]) Nov   4 17 : 55 : 11 observium postfix/qmgr[ 2260983 ]: 387241E0005: removed Nov   4 17 : 55 : 11 observium postfix/relay/smtp[ 2262226 ]: 551511E001B: to=<hw @beardmann .dk>, relay=smtp.office365.com[ 52.97 . 201.114 ]: 587 , delay= 0.9 , delays= 0 / 0.02 / 0.49 / 0.38 , dsn= 2.0 . 0 , status=sent ( 250 2.0 . 0 OK <0b099b0d6940f139cbae63e94f900b64 @observium .bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com]) Nov   4 17 : 55 : 11 observium postfix/qmgr[ 2260983 ]: 551511E001B: removed Nov   4 17 : 55 : 11 observium postfix/relay/smtp[ 2262225 ]: 4CFD31E001A: to=<hw @beardmann .dk>, relay=smtp.office365.com[ 40.101 . 12.98 ]: 587 , delay= 1.3 , delays= 0 / 0.02 / 1 / 0.27 , dsn= 2.0 . 0 , status=sent ( 250 2.0 . 0 OK <92c83e0f4ea7c44f3d5cee66e71317f0 @observium .bbaas.local> [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com]) Nov   4 17 : 55 : 11 observium postfix/qmgr[ 2260983 ]: 4CFD31E001A: removed

          OK I can now confirm that the problem is present with both SMTP and PHP as email senders... (using the same Postfix locally installed with relaying to o365)

          Beardmann Heino Walther added a comment - OK I can now confirm that the problem is present with both SMTP and PHP as email senders... (using the same Postfix locally installed with relaying to o365)

          I found this line a few times in my syslog...

          (I use Postfix as SMTP server, and relay to smtp.office365.com)

          Nov  4 07:05:11 observium postfix/smtp[2083634]: 6E26F1E0005: host smtp.office365.com[52.97.250.242] said: 432 4.3.2 Concurrent connections limit exceeded. Visit https://aka.ms/concurrent_sending for more information. [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com] (in reply to end of DATA command)

          Maybe this is the issue?  But again why am I able to run the script manually many times without any issue?  So not sure if this is the problem?

          Beardmann Heino Walther added a comment - I found this line a few times in my syslog... (I use Postfix as SMTP server, and relay to smtp.office365.com) Nov  4 07:05:11 observium postfix/smtp [2083634] : 6E26F1E0005: host smtp.office365.com [52.97.250.242] said: 432 4.3.2 Concurrent connections limit exceeded. Visit https://aka.ms/concurrent_sending for more information. [Hostname=PR3PR09MB5393.eurprd09.prod.outlook.com] (in reply to end of DATA command) Maybe this is the issue?  But again why am I able to run the script manually many times without any issue?  So not sure if this is the problem?

          Strange... I just got four alerts from the system, and again three of them were without the graph... I then login 2 minutes after, and run the alert debug (which I have put into a script to be able to run them in quick succession... but all 4 manually triggered test alerts worked OK...

             

          Beardmann Heino Walther added a comment - Strange... I just got four alerts from the system, and again three of them were without the graph... I then login 2 minutes after, and run the alert debug (which I have put into a script to be able to run them in quick succession... but all 4 manually triggered test alerts worked OK...    

          But now as I run the test alert it works OK and includes the picture...

          I have attached the debug output...

          debug.txt

          Beardmann Heino Walther added a comment - But now as I run the test alert it works OK and includes the picture... I have attached the debug output... debug.txt

          Hrm, ok.. as I see in mail attached 0 (zero) size image.
          This mean image incorrectly generated.

          Make debug for this alert and attach it here (or send me by mail):

          ./test_alert.php -dd -a 845
          

          (here 845 is alert from your mail)

          landy Mike Stupalov added a comment - Hrm, ok.. as I see in mail attached 0 (zero) size image. This mean image incorrectly generated. Make debug for this alert and attach it here (or send me by mail): ./test_alert.php -dd -a 845 (here 845 is alert from your mail)

          My Outlook is version 16.54 (using the classic view) but as mentioned, the web version of Office365 also has the same issue...

          I might be able to test by sending some of the alerts to a google account is you think that will help?

          But am I the only one having these issues?

           

          Beardmann Heino Walther added a comment - My Outlook is version 16.54 (using the classic view) but as mentioned, the web version of Office365 also has the same issue... I might be able to test by sending some of the alerts to a google account is you think that will help? But am I the only one having these issues?  

          also, please try forward broken mail to my mail: mike@observium.org

          landy Mike Stupalov added a comment - also, please try forward broken mail to my mail: mike@observium.org

          You know version of your MS Outlook?

          landy Mike Stupalov added a comment - You know version of your MS Outlook?

          General questions and device support you always can discuss in our Discord channel, click here for connect.


          Please make and attach additional information about the device:

          • full snmp dump from device:

            snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1 > myagent.snmpwalk
            snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1.3.6.1.4.1 >> myagent.snmpwalk

            If device not support SNMP version 2c, replace -v2c with -v1.

          • If you have problems with discovery or poller processes, please do and attach these debugs:

            ./discovery.php -d -h <device>
            ./poller.php -d -h <device>

          • additionally attach device and/or vendor specific MIB files

          This comment is added automatically.

          bot Observium Bot added a comment - General questions and device support you always can discuss in our Discord channel, click here for connect . Please make and attach additional information about the device: full snmp dump from device: snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1 > myagent.snmpwalk snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1.3.6.1.4.1 >> myagent.snmpwalk If device not support SNMP version 2c, replace -v2c with -v1. If you have problems with discovery or poller processes, please do and attach these debugs: ./discovery.php -d -h <device> ./poller.php -d -h <device> additionally attach device and/or vendor specific MIB files This comment is added automatically.

          People

            adama Adam Armstrong
            Beardmann Heino Walther
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: