Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • None
    • Professional Edition
    • Poller

    Description

      Command ./poller.php -h 237 -m sensors -dd

      show error during processing:

      for database "sensors"
      SQL WARNINGS[
      1364: Field 'sensor_class' doesn't have a default value
      1364: Field 'sensor_oid' doesn't have a default value
      ]

      The drawing graps stop after update database and PHP 7.2 and I test now 7.4:

      o OS Linux 3.10.0-1127.19.1.el7.x86_64 [amd64] (CentOS 7)
      o Apache 2.4.6
      o PHP 7.4.11 (OPcache: ENABLED)
      o Python 2.7.5
      o MariaDB 10.4.15-MariaDB (extension: mysqli 7.4.11)
      o SNMP NET-SNMP 5.7.2
      o RRDtool 1.7.1
      o Fping 3.10 (IPv4 only)

      The files rrd are in folder and script say it is not necesary to create
      Example one file:
      rw-rr-. 1 apache apache 117272 Oct 22 14:40 processor-cpm-7.rrd

      ps -fe show over 2004 running processes like:
      root 8770 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 283
      root 8774 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 277
      root 8775 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 272
      root 8776 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 263
      root 8777 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 262
      root 8779 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 164
      root 8781 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 295
      root 8783 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 302
      root 8785 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 317
      root 8788 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 350
      root 8789 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 349
      root 8793 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 344
      root 8795 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 347
      root 8798 9031 0 13:40 ? 00:00:00 php /opt/observium/poller.php -q -h 448
      root 8801 8798 0 13:40 ? 00:00:00 /usr/bin/rrdtool -
      root 8803 8774 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8811 8770 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8827 8767 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8828 8779 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8831 8776 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8832 8764 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8837 8785 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8841 8775 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8842 8777 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8849 8781 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
      root 8853 8793 0 14:35 ? 00:00:00 /usr/bin/rrdtool -

      Attachments

        Activity

          [OBS-3499] Observium stop draw graphs

          Probably already fixed some time ago.

          landy Mike Stupalov added a comment - Probably already fixed some time ago.

          Hi Milan Krenek, we have not received the additional information requested earlier from you in this issue 'Command ./poller.php -h 237 -m sensors -dd

          show error during processing:

          for database "sensors"
          SQL WARNINGS[
          1364: Field 'sensor_class' doesn't have a default value
          1364: Field 'sensor_oid' doesn't have a default value
          ]

          The drawing graps stop after update database and PHP 7.2 and I test now 7.4:

          o OS Linux 3.10.0-1127.19.1.el7.x86_64 [amd64] (CentOS 7)
          o Apache 2.4.6
          o PHP 7.4.11 (OPcache: ENABLED)
          o Python 2.7.5
          o MariaDB 10.4.15-MariaDB (extension: mysqli 7.4.11)
          o SNMP NET-SNMP 5.7.2
          o RRDtool 1.7.1
          o Fping 3.10 (IPv4 only)

          The files rrd are in folder and script say it is not necesary to create
          Example one file:
          rw-rr-. 1 apache apache 117272 Oct 22 14:40 processor-cpm-7.rrd

          ps -fe show over 2004 running processes like:
          root 8770 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 283
          root 8774 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 277
          root 8775 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 272
          root 8776 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 263
          root 8777 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 262
          root 8779 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 164
          root 8781 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 295
          root 8783 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 302
          root 8785 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 317
          root 8788 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 350
          root 8789 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 349
          root 8793 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 344
          root 8795 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 347
          root 8798 9031 0 13:40 ? 00:00:00 php /opt/observium/poller.php -q -h 448
          root 8801 8798 0 13:40 ? 00:00:00 /usr/bin/rrdtool -
          root 8803 8774 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8811 8770 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8827 8767 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8828 8779 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8831 8776 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8832 8764 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8837 8785 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8841 8775 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8842 8777 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8849 8781 0 14:35 ? 00:00:00 /usr/bin/rrdtool -
          root 8853 8793 0 14:35 ? 00:00:00 /usr/bin/rrdtool -'!

          Issues without your response will be closed within 2 weeks.

          landy Mike Stupalov added a comment - Hi Milan Krenek, we have not received the additional information requested earlier from you in this issue 'Command ./poller.php -h 237 -m sensors -dd show error during processing: for database "sensors" SQL WARNINGS[ 1364: Field 'sensor_class' doesn't have a default value 1364: Field 'sensor_oid' doesn't have a default value ] The drawing graps stop after update database and PHP 7.2 and I test now 7.4: o OS Linux 3.10.0-1127.19.1.el7.x86_64 [amd64] (CentOS 7) o Apache 2.4.6 o PHP 7.4.11 (OPcache: ENABLED) o Python 2.7.5 o MariaDB 10.4.15-MariaDB (extension: mysqli 7.4.11) o SNMP NET-SNMP 5.7.2 o RRDtool 1.7.1 o Fping 3.10 (IPv4 only) The files rrd are in folder and script say it is not necesary to create Example one file: rw-r r -. 1 apache apache 117272 Oct 22 14:40 processor-cpm-7.rrd ps -fe show over 2004 running processes like: root 8770 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 283 root 8774 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 277 root 8775 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 272 root 8776 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 263 root 8777 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 262 root 8779 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 164 root 8781 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 295 root 8783 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 302 root 8785 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 317 root 8788 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 350 root 8789 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 349 root 8793 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 344 root 8795 8550 0 14:35 ? 00:00:00 php /opt/observium/poller.php -q -h 347 root 8798 9031 0 13:40 ? 00:00:00 php /opt/observium/poller.php -q -h 448 root 8801 8798 0 13:40 ? 00:00:00 /usr/bin/rrdtool - root 8803 8774 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8811 8770 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8827 8767 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8828 8779 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8831 8776 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8832 8764 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8837 8785 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8841 8775 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8842 8777 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8849 8781 0 14:35 ? 00:00:00 /usr/bin/rrdtool - root 8853 8793 0 14:35 ? 00:00:00 /usr/bin/rrdtool -'! Issues without your response will be closed within 2 weeks.

          how? Oo That's a lot of windows services!

          adama Adam Armstrong added a comment - how? Oo That's a lot of windows services!

          We have 18578 records.

          Zambelli Milan Krenek added a comment - We have 18578 records.

          how many entries are in your winservices table?

          adama Adam Armstrong added a comment - how many entries are in your winservices table?

          Unfortunately it make sense. In the report upper you see the processing of SQL took around 40sec.
          In our environment we monitor switches, routers and also virtual servers and when I run pooler manualy it did not finsh to 5min.

          The poolers grow in processes and database have problem with locking records and update time on database grows also.

          I gave to virtual machine more CPU, more RAM and I try also increase threads for pooler with the same results. Increased threads consume more time over pooler than count threads by default.

          After add index on table "winservices" the pooler process finish less than 5min.

          Zambelli Milan Krenek added a comment - Unfortunately it make sense. In the report upper you see the processing of SQL took around 40sec. In our environment we monitor switches, routers and also virtual servers and when I run pooler manualy it did not finsh to 5min. The poolers grow in processes and database have problem with locking records and update time on database grows also. I gave to virtual machine more CPU, more RAM and I try also increase threads for pooler with the same results. Increased threads consume more time over pooler than count threads by default. After add index on table "winservices" the pooler process finish less than 5min.
          adama Adam Armstrong added a comment - - edited

          Is this fixed now? The issue doesn't seem to make sense, there's no reason why a column in the winservices table would make any graphs not draw.

          Even less reason why an index would make any difference, since it has no effect on the actual data returned.

          adama Adam Armstrong added a comment - - edited Is this fixed now? The issue doesn't seem to make sense, there's no reason why a column in the winservices table would make any graphs not draw. Even less reason why an index would make any difference, since it has no effect on the actual data returned.

          I solved problem after add collum "name" to index in table "winservices"

          Zambelli Milan Krenek added a comment - I solved problem after add collum "name" to index in table "winservices"

          INFO: observium-wrapper poller processed 304 devices in 589.62 seconds with 16 threads, load average (5min) 2.31

          WARNING: the process took more than 5 minutes to finish, you need faster hardware or more threads
          INFO: in sequential style processing the elapsed time would have been: 8947 seconds
          WARNING: Consider setting a minimum of 32 threads. (This does not constitute professional advice!)

          Zambelli Milan Krenek added a comment - INFO: observium-wrapper poller processed 304 devices in 589.62 seconds with 16 threads, load average (5min) 2.31 WARNING: the process took more than 5 minutes to finish, you need faster hardware or more threads INFO: in sequential style processing the elapsed time would have been: 8947 seconds WARNING: Consider setting a minimum of 32 threads. (This does not constitute professional advice!)

          People

            landy Mike Stupalov
            Zambelli Milan Krenek
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: