[OBS-2739] Device Graphs is showing no data & nan - Observium

Details

Type: Help
Resolution: Not A Bug
Priority: Trivial
Fix Version/s: None
Affects Version/s: Professional Edition
Component/s: Poller
Labels:
None

Description

Hi Team,

I am not sure what happened all of a sudden i see all the device graphs are showing with no data and nan, could you pls help me to fix this issue,

Regards,

Ashwith Reddy

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

observium.JPG
76 kB
2018/08/01 07:10 AM

Activity

[OBS-2739] Device Graphs is showing no data & nan

Ashwith Reddy added a comment - 2020/09/18 05:52 PM

Hi team,

we still has this issue, we installed observium community on one of our site and tried to use only poller service

cat /etc/systemd/system/rrdcached.service

[Unit] Description=Data caching daemon for rrdtool After=network.service [Service] Type=forking PIDFile=/run/rrdcached.pid ExecStart=/usr/bin/rrdcached -w 1800 -z 1800 -f 3600 -s root -U root -G root -B -R -j /var/tmp -l 0.0.0.0 -t 4 -F -b /opt/observium/rrd [Install] WantedBy=default.target NETWORK_OPTIONS="-L"

only when we do manual polling of the device using poller.php -h then only device data is updating to master observium server which is on diff location

can you pls suggest if there are any other options to fix the poller services for remote location devices

Regards,

Ashwith Reddy

Ashwith Reddy added a comment - 2020/09/18 05:52 PM Hi team, we still has this issue, we installed observium community on one of our site and tried to use only poller service cat /etc/systemd/system/rrdcached.service [Unit] Description=Data caching daemon for rrdtool After=network.service [Service] Type=forking PIDFile=/run/rrdcached.pid ExecStart=/usr/bin/rrdcached -w 1800 -z 1800 -f 3600 -s root -U root -G root -B -R -j /var/tmp -l 0.0.0.0 -t 4 -F -b /opt/observium/rrd [Install] WantedBy=default.target NETWORK_OPTIONS="-L" only when we do manual polling of the device using poller.php -h then only device data is updating to master observium server which is on diff location can you pls suggest if there are any other options to fix the poller services for remote location devices Regards, Ashwith Reddy

Roman Andreevich Ivanov added a comment - 2018/11/12 01:00 PM

Hi! I have same problem!
Did you fix that?

Roman Andreevich Ivanov added a comment - 2018/11/12 01:00 PM Hi! I have same problem! Did you fix that?

Roman Andreevich Ivanov added a comment - 2018/11/12 01:00 PM

Hi! I have same problem!
Did you fix that?

Roman Andreevich Ivanov added a comment - 2018/11/12 01:00 PM Hi! I have same problem! Did you fix that?

Ashwith Reddy added a comment - 2018/08/01 11:21 AM

Hi Mike,

after i configure the rrdcache as per the shared article, still i am getting permission denied, can you let me know what permissions is required to run rrdcached.

RRD STDOUT[ERROR: rrdcached: /opt/observium/rrd/amur/uptime.rrd: Permission denied]

Regards,
Ashwith Reddy

Ashwith Reddy added a comment - 2018/08/01 11:21 AM Hi Mike, after i configure the rrdcache as per the shared article, still i am getting permission denied, can you let me know what permissions is required to run rrdcached. RRD STDOUT [ERROR: rrdcached: /opt/observium/rrd/amur/uptime.rrd: Permission denied] Regards, Ashwith Reddy

Mike Stupalov added a comment - 2018/08/01 10:52 AM

You configuged rrdcached, but it's work incorrectly in your install:

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

Please read this: http://blog.best-practice.se/2014/10/using-rrdcached-with-observium.html

Mike Stupalov added a comment - 2018/08/01 10:52 AM You configuged rrdcached, but it's work incorrectly in your install: RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] Please read this: http://blog.best-practice.se/2014/10/using-rrdcached-with-observium.html

Ashwith Reddy added a comment - 2018/08/01 09:07 AM - edited

Hi Mike,

I have tried for another device and here is the output.

observium@observiumprod:/opt/observium$ ./poller.php -d -m system -h goldcrest.mgmt.unitedlayer.com

DEBUG!

CMD[/usr/bin/svn info /opt/observium]

CMD EXITCODE[0]

CMD RUNTIME[0.0055s]

STDOUT[

Path: .

Working Copy Root Path: /opt/observium

URL: http://svn.observium.org/svn/observium/branches/stable

Relative URL: ^/observium/branches/stable

Repository Root: http://svn.observium.org/svn

Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8

Revision: 9337

Node Kind: directory

Schedule: normal

Last Changed Author: adama

Last Changed Rev: 9337

Last Changed Date: 2018-07-17 17:22:43 -0700 (Tue, 17 Jul 2018)

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';]

SQL RUNTIME[0.00012612s]

SQL[SELECT @@SESSION.sql_mode;]

SQL RUNTIME[0.00007200s]

SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION']

SQL RUNTIME[0.00011301s]

DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';]

SQL RUNTIME[0.00015593s]

SQL[SELECT * FROM `config`]

SQL RUNTIME[0.00012398s]

___ _ _

 / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___

| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \

| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |

 \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|

 Observium Professional 18.7.9337

 http://www.observium.org

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';]

SQL RUNTIME[0.00180387s]

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';]

SQL RUNTIME[0.00013804s]

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';]

SQL RUNTIME[0.00013494s]

CMD[/opt/observium/scripts/distro]

CMD EXITCODE[0]

CMD RUNTIME[0.0087s]

STDOUT[

Linux|4.4.0-131-generic|amd64|Ubuntu|16.04|vmware|

CMD[/usr/bin/env python --version 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0013s]

STDOUT[

Python 2.7.12

SQL[SELECT version();]

SQL RUNTIME[0.00011587s]

CMD[/usr/bin/snmpget --version 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0029s]

STDOUT[

NET-SNMP version: 5.7.3

CMD[/usr/bin/rrdtool --version | head -n1]

CMD EXITCODE[0]

CMD RUNTIME[0.0094s]

STDOUT[

RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi@oetiker.ch>

CMD[/usr/bin/env rrdcached -h -h | head -n1]

CMD EXITCODE[0]

CMD RUNTIME[0.0103s]

STDOUT[

CMD[/usr/bin/fping -v 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0028s]

STDOUT[

/usr/bin/fping: Version 3.13

/usr/bin/fping: comments to david@schweikert.ch

CMD[/usr/sbin/apache2 -v | awk '/Server version:/ \{print $3}']

CMD EXITCODE[0]

CMD RUNTIME[0.0266s]

STDOUT[

Apache/2.4.18

CMD[date "+%:z"]

CMD EXITCODE[0]

CMD RUNTIME[0.0008s]

STDOUT[

-07:00

SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);]

SQL RUNTIME[0.00017309s]

SQL[SELECT @@SESSION.sql_mode;]

SQL RUNTIME[0.00007987s]

SQL[SHOW VARIABLES LIKE 'character_set_connection']

SQL RUNTIME[0.00154090s]

##### Software versions #####

o OS Linux 4.4.0-131-generic [amd64] (Ubuntu 16.04)

 o Apache 2.4.18

 o PHP 7.0.30-0ubuntu0.16.04.1 (OPcache: DISABLED)

 o Python 2.7.12

 o MySQL 5.7.22-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev)

 o SNMP NET-SNMP 5.7.3

 o RRDtool 1.5.5 (rrdcached : unix:/var/run/rrdcached.sock)

 o Fping 3.13 (IPv4 and IPv6)

##### Memory Limit #####

o PHP Unlimited

##### MySQL mode #####

o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION

##### Charset info #####

o PHP UTF-8

 o MySQL utf8

##### Timezones info #####

o Date Wednesday, 01-Aug-18 01:05:31 PDT

 o PHP -07:00

 o MySQL -07:00

SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1533110731' AND `maint_end` > '1533110731']

SQL RUNTIME[0.00134611s]

##### Starting polling run at 2018-08-01 01:05:31 #####

SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'goldcrest.mgmt.unitedlayer.com' ORDER BY `device_id` ASC]

SQL RUNTIME[0.00100803s]

SQL[SELECT * FROM `devices` WHERE `device_id` = '141']

SQL RUNTIME[0.00023198s]

SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '141']

SQL RUNTIME[0.00017810s]

SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '141']

SQL RUNTIME[0.00014400s]

SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('4827','poller.php','26584','1001','php ./poller.php -d -m system -h goldcrest.mgmt.unitedlayer.com','1533110731','141')]

SQL RUNTIME[0.00049090s]

SQL[SELECT * FROM `alert_tests` WHERE 1]

SQL RUNTIME[0.00020003s]

Cached 24 alert rules.

SQL[SELECT * FROM `alert_table` WHERE `device_id` = '141']

SQL RUNTIME[0.00016785s]

##### goldcrest.mgmt.unitedlayer.com [141] #####

o OS freebsd

 o OS Group unix

 o Last poll duration 1.73 seconds

 o Last Polled 2018-08-01 01:01:46

 o SNMP Version v2c

CMD[/usr/bin/fping -t 500 -c 1 -q 10.128.2.38 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0011s]

STDOUT[

10.128.2.38 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.17/0.17/0.17

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysObjectID.0 sysUpTime.0]

CMD EXITCODE[0]

CMD RUNTIME[0.01s]

STDOUT[

sysObjectID.0 = enterprises.8072.3.2.8

sysUpTime.0 = 124:21:44:26.49

SNMP STATUS[TRUE]

 o Device status Device is reachable by PING (0.17ms) and SNMP (9.98ms)

RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/status.rrd already exists - no need to create.

RRD CMD[update goldcrest.mgmt.unitedlayer.com/status.rrd N:1 --daemon unix:/var/run/rrdcached.sock]

RRD RUNTIME[0.0011s]

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

RRD_STATUS[FALSE]

RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/ping.rrd already exists - no need to create.

RRD CMD[update goldcrest.mgmt.unitedlayer.com/ping.rrd N:0.17 --daemon unix:/var/run/rrdcached.sock]

RRD RUNTIME[0.0011s]

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

RRD_STATUS[FALSE]

RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/ping_snmp.rrd already exists - no need to create.

RRD CMD[update goldcrest.mgmt.unitedlayer.com/ping_snmp.rrd N:9.98 --daemon unix:/var/run/rrdcached.sock]

RRD RUNTIME[0.0011s]

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

RRD_STATUS[FALSE]

SQL[SELECT * FROM `device_graphs` WHERE `device_id` = '141']

SQL RUNTIME[0.00041294s]

 o Modules Enabled system, os

including: includes/polling/system.inc.php

##### Module Start: system #####

SQL[SELECT * FROM `observium_attribs`]

SQL RUNTIME[0.00012493s]

 o SNMPv2-MIB

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysUpTime.0 sysLocation.0 sysContact.0 sysName.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0085s]

STDOUT[

sysUpTime.0 = 124:21:44:26.50

sysLocation.0 = SF9

sysContact.0 = support@unitedlayer.com

sysName.0 = goldcrest.famsf.org

SNMP STATUS[TRUE]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysDescr.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0111s]

STDOUT[

FreeBSD goldcrest.famsf.org 10.2-RELEASE-p9 FreeBSD 10.2-RELEASE-p9 #0: Thu Jan 14 01:32:46 UTC 2016 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64

SNMP STATUS[TRUE]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUvn -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysObjectID.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0116s]

STDOUT[

.1.3.6.1.4.1.8072.3.2.8

SNMP STATUS[TRUE]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' snmpEngineID.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0069s]

STDOUT[

"80 00 1F 88 80 1F 4D D9 5E BF 66 3B 57 00 00 00

00 "

SNMP STATUS[TRUE]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m HOST-RESOURCES-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' hrSystemUptime.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0096s]

STDOUT[

358:11:10:34.53

SNMP STATUS[TRUE]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' snmpEngineTime.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0072s]

STDOUT[

10791866

SNMP STATUS[TRUE]

Using SNMP Agent hrSystemUptime (30971434 sec. => 358 days, 11h 10m 34s)

RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/uptime.rrd already exists - no need to create.

RRD CMD[update goldcrest.mgmt.unitedlayer.com/uptime.rrd N:30971434 --daemon unix:/var/run/rrdcached.sock]

RRD RUNTIME[0.0011s]

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

RRD_STATUS[FALSE]

o Uptime 358 days, 11h 10m 34s

 o Last reboot 2017-08-07 13:54:30

 /opt/observium/includes/polling/system.inc.php:281

array(

 [use] => string(14) "hrSystemUptime"

 [sysUpTime] => int(10791866)

 [hrSystemUptime] => int(30971434)

 [snmpEngineTime] => int(10791866)

 [uptime] => int(30971434)

 [formatted] => string(21) "358 days, 11h 10m 34s"

 [message] => string(31) "Using SNMP Agent hrSystemUptime"

 [previous] => string(8) "30971208"

 [diff] => int(-226)

 [last_rebooted] => string(10) "1502139270"

 [rebooted] => int(0)

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUsn -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.10.1.5.1 .1.3.6.1.4.1.2021.10.1.5.2 .1.3.6.1.4.1.2021.10.1.5.3]

CMD EXITCODE[0]

CMD RUNTIME[0.0075s]

STDOUT[

.1.3.6.1.4.1.2021.10.1.5.1 = 11

.1.3.6.1.4.1.2021.10.1.5.2 = 12

.1.3.6.1.4.1.2021.10.1.5.3 = 9

SNMP STATUS[TRUE]

RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/la.rrd already exists - no need to create.

RRD CMD[update goldcrest.mgmt.unitedlayer.com/la.rrd N:11:12:9 --daemon unix:/var/run/rrdcached.sock]

RRD RUNTIME[0.0012s]

RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory]

RRD_STATUS[FALSE]

o Load average 0.11, 0.12, 0.09

sysLocation rewritten from 'SF9' to '200 Paul Avenue Suite 501 San Francisco, CA USA' by $config['location']['map'].

 o sysObjectID .1.3.6.1.4.1.8072.3.2.8

 o snmpEngineID 80001F88801F4DD95EBF663B5700000000

 o sysDescr FreeBSD goldcrest.famsf.org 10.2-RELEASE-p9 FreeBSD 10.2-RELEASE-p9 #0: Thu Jan 14 01:32:46 UTC 2016

 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERICamd64

 o sysName goldcrest.famsf.org

 o Location 200 Paul Avenue Suite 501 San Francisco, CA USA

SQL[SELECT * FROM `devices_locations` WHERE `device_id` = '141']

SQL RUNTIME[0.00028992s]

 o Module time 0.0769s

including: includes/polling/os.inc.php

##### Module Start: os #####

SQL[SELECT * FROM `entPhysical` WHERE `device_id` = '141' AND `entPhysicalContainedIn` = '0' AND `deleted` IS NULL]

SQL RUNTIME[0.00025105s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisServiceTagName.1]

CMD EXITCODE[0]

CMD RUNTIME[0.0188s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisServiceTagName.1';]

SQL RUNTIME[0.00031090s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2715']

SQL RUNTIME[0.00067806s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiSysSerialNum.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0213s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiSysSerialNum.0';]

SQL RUNTIME[0.00021911s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2716']

SQL RUNTIME[0.00050902s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisModelName.1]

CMD EXITCODE[0]

CMD RUNTIME[0.0207s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisModelName.1';]

SQL RUNTIME[0.00023103s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2717']

SQL RUNTIME[0.00061297s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiProductName.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0178s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiProductName.0';]

SQL RUNTIME[0.00028110s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2718']

SQL RUNTIME[0.00065994s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisAssetTagName.1]

CMD EXITCODE[0]

CMD RUNTIME[0.0195s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisAssetTagName.1';]

SQL RUNTIME[0.00028896s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2719']

SQL RUNTIME[0.00056005s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiAssetTag.0]

CMD EXITCODE[0]

CMD RUNTIME[0.0192s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiAssetTag.0';]

SQL RUNTIME[0.00034213s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2720']

SQL RUNTIME[0.00059104s]

 o OS Poller Group

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.7890.1.3.1.1.6.100.105.115.116.114.111]

CMD EXITCODE[0]

CMD RUNTIME[0.0085s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'UCD-SNMP-MIB' AND `oid` = '.1.3.6.1.4.1.2021.7890.1.3.1.1.6.100.105.115.116.114.111';]

SQL RUNTIME[0.00023913s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2721']

SQL RUNTIME[0.00080013s]

CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.7890.1.101.1]

CMD EXITCODE[0]

CMD RUNTIME[0.0087s]

STDOUT[

No Such Object available on this agent at this OID

SNMP STATUS[FALSE]

SNMP ERROR[#1000 - Failed response]

SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'UCD-SNMP-MIB' AND `oid` = '.1.3.6.1.4.1.2021.7890.1.101.1';]

SQL RUNTIME[0.00038695s]

SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2722']

SQL RUNTIME[0.00042892s]

 o Hardware Generic x86 [64bit]

 o Version <empty>

 o Features <empty>

 o Serial <empty>

 o Asset <empty>

o Module time 0.1555s

##### goldcrest.mgmt.unitedlayer.com [141] completed poller modules at 2018-08-01 01:05:31 #####

o Graphs [checked] availability, ping, ping_snmp, uptime, la

 o Poller time 0.2576 seconds

Updating goldcrest.mgmt.unitedlayer.com -

> $update_array /opt/observium/includes/polling/functions.inc.php:792

array(

 [uptime] => int(30971434)

 [last_polled] => array(

 [0] => string(5) "NOW()"

 [last_polled_timetaken] => double(0.2576)

SQL[UPDATE `devices` set `uptime` ='30971434',`last_polled` =NOW(),`last_polled_timetaken` ='0.2576' WHERE `device_id` = '141']

SQL RUNTIME[0.00055194s]

 o Updated Data uptime, last_polled, last_polled_timetaken

SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '4827' AND `process_name` = 'poller.php' AND `device_id` = '141']

SQL RUNTIME[0.00034404s]

./poller.php: goldcrest.mgmt.unitedlayer.com - 1 devices polled in 0.348 secs

##### Completed polling run at 2018-08-01 01:05:31 #####

NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output.

 o Devices Polled 1

 o Poller Time 0.348 secs

 o Memory usage 12MB (peak: 14MB)

 o MySQL Usage Insert[1/0.001s] Update[9/0.006s] Delete[1/0s] Cell[4/0.001s] Row[16/0.008s] Rows[10/0.007s] Col[0/0s] (0.023s 6.524%)

 o RRDTool Usage update[5/0.006s] (0.006s 1.583%)

 o SNMP Usage snmpget[16/0.207s] (0.207s 59.407%)

Regards,

Ashwith Reddy

Ashwith Reddy added a comment - 2018/08/01 09:07 AM - edited Hi Mike, I have tried for another device and here is the output. observium@observiumprod:/opt/observium$ ./poller.php -d -m system -h goldcrest.mgmt.unitedlayer.com DEBUG! CMD[/usr/bin/svn info /opt/observium] CMD EXITCODE[0] CMD RUNTIME[0.0055s] STDOUT[ Path: . Working Copy Root Path: /opt/observium URL: http://svn.observium.org/svn/observium/branches/stable Relative URL: ^/observium/branches/stable Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 9337 Node Kind: directory Schedule: normal Last Changed Author: adama Last Changed Rev: 9337 Last Changed Date: 2018-07-17 17:22:43 -0700 (Tue, 17 Jul 2018) ] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] SQL RUNTIME[0.00012612s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00007200s] SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] SQL RUNTIME[0.00011301s] DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] SQL RUNTIME[0.00015593s] SQL[SELECT * FROM `config`] SQL RUNTIME[0.00012398s] ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 18.7.9337 http://www.observium.org SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] SQL RUNTIME[0.00180387s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] SQL RUNTIME[0.00013804s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] SQL RUNTIME[0.00013494s] CMD[/opt/observium/scripts/distro] CMD EXITCODE[0] CMD RUNTIME[0.0087s] STDOUT[ Linux|4.4.0-131-generic|amd64|Ubuntu|16.04|vmware| ] CMD[/usr/bin/env python --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0013s] STDOUT[ Python 2.7.12 ] SQL[SELECT version();] SQL RUNTIME[0.00011587s] CMD[/usr/bin/snmpget --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0029s] STDOUT[ NET-SNMP version: 5.7.3 ] CMD[/usr/bin/rrdtool --version | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0094s] STDOUT[ RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi@oetiker.ch> ] CMD[/usr/bin/env rrdcached -h -h | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0103s] STDOUT[ ] CMD[/usr/bin/fping -v 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0028s] STDOUT[ /usr/bin/fping: Version 3.13 /usr/bin/fping: comments to david@schweikert.ch ] CMD[/usr/sbin/apache2 -v | awk '/Server version:/ \{print $3}'] CMD EXITCODE[0] CMD RUNTIME[0.0266s] STDOUT[ Apache/2.4.18 ] CMD[date "+%:z"] CMD EXITCODE[0] CMD RUNTIME[0.0008s] STDOUT[ -07:00 ] SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] SQL RUNTIME[0.00017309s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00007987s] SQL[SHOW VARIABLES LIKE 'character_set_connection'] SQL RUNTIME[0.00154090s] ##### Software versions ##### o OS Linux 4.4.0-131-generic [amd64] (Ubuntu 16.04) o Apache 2.4.18 o PHP 7.0.30-0ubuntu0.16.04.1 (OPcache: DISABLED) o Python 2.7.12 o MySQL 5.7.22-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev) o SNMP NET-SNMP 5.7.3 o RRDtool 1.5.5 (rrdcached : unix:/var/run/rrdcached.sock) o Fping 3.13 (IPv4 and IPv6) ##### Memory Limit ##### o PHP Unlimited ##### MySQL mode ##### o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION ##### Charset info ##### o PHP UTF-8 o MySQL utf8 ##### Timezones info ##### o Date Wednesday, 01-Aug-18 01:05:31 PDT o PHP -07:00 o MySQL -07:00 SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1533110731' AND `maint_end` > '1533110731'] SQL RUNTIME[0.00134611s] ##### Starting polling run at 2018-08-01 01:05:31 ##### SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'goldcrest.mgmt.unitedlayer.com' ORDER BY `device_id` ASC] SQL RUNTIME[0.00100803s] SQL[SELECT * FROM `devices` WHERE `device_id` = '141'] SQL RUNTIME[0.00023198s] SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '141'] SQL RUNTIME[0.00017810s] SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '141'] SQL RUNTIME[0.00014400s] SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('4827','poller.php','26584','1001','php ./poller.php -d -m system -h goldcrest.mgmt.unitedlayer.com','1533110731','141')] SQL RUNTIME[0.00049090s] SQL[SELECT * FROM `alert_tests` WHERE 1] SQL RUNTIME[0.00020003s] Cached 24 alert rules. SQL[SELECT * FROM `alert_table` WHERE `device_id` = '141'] SQL RUNTIME[0.00016785s] ##### goldcrest.mgmt.unitedlayer.com [141] ##### o OS freebsd o OS Group unix o Last poll duration 1.73 seconds o Last Polled 2018-08-01 01:01:46 o SNMP Version v2c CMD[/usr/bin/fping -t 500 -c 1 -q 10.128.2.38 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0011s] STDOUT[ 10.128.2.38 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.17/0.17/0.17 ] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysObjectID.0 sysUpTime.0] CMD EXITCODE[0] CMD RUNTIME[0.01s] STDOUT[ sysObjectID.0 = enterprises.8072.3.2.8 sysUpTime.0 = 124:21:44:26.49 ] SNMP STATUS[TRUE] o Device status Device is reachable by PING (0.17ms) and SNMP (9.98ms) RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/status.rrd already exists - no need to create. RRD CMD[update goldcrest.mgmt.unitedlayer.com/status.rrd N:1 --daemon unix:/var/run/rrdcached.sock] RRD RUNTIME[0.0011s] RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] RRD_STATUS[FALSE] RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/ping.rrd already exists - no need to create. RRD CMD[update goldcrest.mgmt.unitedlayer.com/ping.rrd N:0.17 --daemon unix:/var/run/rrdcached.sock] RRD RUNTIME[0.0011s] RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] RRD_STATUS[FALSE] RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/ping_snmp.rrd already exists - no need to create. RRD CMD[update goldcrest.mgmt.unitedlayer.com/ping_snmp.rrd N:9.98 --daemon unix:/var/run/rrdcached.sock] RRD RUNTIME[0.0011s] RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] RRD_STATUS[FALSE] SQL[SELECT * FROM `device_graphs` WHERE `device_id` = '141'] SQL RUNTIME[0.00041294s] o Modules Enabled system, os including: includes/polling/system.inc.php ##### Module Start: system ##### SQL[SELECT * FROM `observium_attribs`] SQL RUNTIME[0.00012493s] o SNMPv2-MIB CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysUpTime.0 sysLocation.0 sysContact.0 sysName.0] CMD EXITCODE[0] CMD RUNTIME[0.0085s] STDOUT[ sysUpTime.0 = 124:21:44:26.50 sysLocation.0 = SF9 sysContact.0 = support@unitedlayer.com sysName.0 = goldcrest.famsf.org ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysDescr.0] CMD EXITCODE[0] CMD RUNTIME[0.0111s] STDOUT[ FreeBSD goldcrest.famsf.org 10.2-RELEASE-p9 FreeBSD 10.2-RELEASE-p9 #0: Thu Jan 14 01:32:46 UTC 2016 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUvn -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' sysObjectID.0] CMD EXITCODE[0] CMD RUNTIME[0.0116s] STDOUT[ .1.3.6.1.4.1.8072.3.2.8 ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' snmpEngineID.0] CMD EXITCODE[0] CMD RUNTIME[0.0069s] STDOUT[ "80 00 1F 88 80 1F 4D D9 5E BF 66 3B 57 00 00 00 00 " ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m HOST-RESOURCES-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' hrSystemUptime.0] CMD EXITCODE[0] CMD RUNTIME[0.0096s] STDOUT[ 358:11:10:34.53 ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' snmpEngineTime.0] CMD EXITCODE[0] CMD RUNTIME[0.0072s] STDOUT[ 10791866 ] SNMP STATUS[TRUE] Using SNMP Agent hrSystemUptime (30971434 sec. => 358 days, 11h 10m 34s) RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/uptime.rrd already exists - no need to create. RRD CMD[update goldcrest.mgmt.unitedlayer.com/uptime.rrd N:30971434 --daemon unix:/var/run/rrdcached.sock] RRD RUNTIME[0.0011s] RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] RRD_STATUS[FALSE] o Uptime 358 days, 11h 10m 34s o Last reboot 2017-08-07 13:54:30 /opt/observium/includes/polling/system.inc.php:281 array( [use] => string(14) "hrSystemUptime" [sysUpTime] => int(10791866) [hrSystemUptime] => int(30971434) [snmpEngineTime] => int(10791866) [uptime] => int(30971434) [formatted] => string(21) "358 days, 11h 10m 34s" [message] => string(31) "Using SNMP Agent hrSystemUptime" [previous] => string(8) "30971208" [diff] => int(-226) [last_rebooted] => string(10) "1502139270" [rebooted] => int(0) ) CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUsn -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.10.1.5.1 .1.3.6.1.4.1.2021.10.1.5.2 .1.3.6.1.4.1.2021.10.1.5.3] CMD EXITCODE[0] CMD RUNTIME[0.0075s] STDOUT[ .1.3.6.1.4.1.2021.10.1.5.1 = 11 .1.3.6.1.4.1.2021.10.1.5.2 = 12 .1.3.6.1.4.1.2021.10.1.5.3 = 9 ] SNMP STATUS[TRUE] RRD /opt/observium/rrd/goldcrest.mgmt.unitedlayer.com/la.rrd already exists - no need to create. RRD CMD[update goldcrest.mgmt.unitedlayer.com/la.rrd N:11:12:9 --daemon unix:/var/run/rrdcached.sock] RRD RUNTIME[0.0012s] RRD STDOUT[ERROR: Unable to connect to rrdcached: No such file or directory] RRD_STATUS[FALSE] o Load average 0.11, 0.12, 0.09 sysLocation rewritten from 'SF9' to '200 Paul Avenue Suite 501 San Francisco, CA USA' by $config['location']['map']. o sysObjectID .1.3.6.1.4.1.8072.3.2.8 o snmpEngineID 80001F88801F4DD95EBF663B5700000000 o sysDescr FreeBSD goldcrest.famsf.org 10.2-RELEASE-p9 FreeBSD 10.2-RELEASE-p9 #0: Thu Jan 14 01:32:46 UTC 2016 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERICamd64 o sysName goldcrest.famsf.org o Location 200 Paul Avenue Suite 501 San Francisco, CA USA SQL[SELECT * FROM `devices_locations` WHERE `device_id` = '141'] SQL RUNTIME[0.00028992s] o Module time 0.0769s including: includes/polling/os.inc.php ##### Module Start: os ##### SQL[SELECT * FROM `entPhysical` WHERE `device_id` = '141' AND `entPhysicalContainedIn` = '0' AND `deleted` IS NULL] SQL RUNTIME[0.00025105s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisServiceTagName.1] CMD EXITCODE[0] CMD RUNTIME[0.0188s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisServiceTagName.1';] SQL RUNTIME[0.00031090s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2715'] SQL RUNTIME[0.00067806s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiSysSerialNum.0] CMD EXITCODE[0] CMD RUNTIME[0.0213s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiSysSerialNum.0';] SQL RUNTIME[0.00021911s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2716'] SQL RUNTIME[0.00050902s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisModelName.1] CMD EXITCODE[0] CMD RUNTIME[0.0207s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisModelName.1';] SQL RUNTIME[0.00023103s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2717'] SQL RUNTIME[0.00061297s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiProductName.0] CMD EXITCODE[0] CMD RUNTIME[0.0178s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiProductName.0';] SQL RUNTIME[0.00028110s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2718'] SQL RUNTIME[0.00065994s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'goldcrest.mgmt.unitedlayer.com':'161' chassisAssetTagName.1] CMD EXITCODE[0] CMD RUNTIME[0.0195s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'MIB-Dell-10892' AND `oid` = 'chassisAssetTagName.1';] SQL RUNTIME[0.00028896s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2719'] SQL RUNTIME[0.00056005s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m CPQSINFO-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/hp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' cpqSiAssetTag.0] CMD EXITCODE[0] CMD RUNTIME[0.0192s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'CPQSINFO-MIB' AND `oid` = 'cpqSiAssetTag.0';] SQL RUNTIME[0.00034213s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2720'] SQL RUNTIME[0.00059104s] o OS Poller Group CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.7890.1.3.1.1.6.100.105.115.116.114.111] CMD EXITCODE[0] CMD RUNTIME[0.0085s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'UCD-SNMP-MIB' AND `oid` = '.1.3.6.1.4.1.2021.7890.1.3.1.1.6.100.105.115.116.114.111';] SQL RUNTIME[0.00023913s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2721'] SQL RUNTIME[0.00080013s] CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'goldcrest.mgmt.unitedlayer.com':'161' .1.3.6.1.4.1.2021.7890.1.101.1] CMD EXITCODE[0] CMD RUNTIME[0.0087s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '141' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'UCD-SNMP-MIB' AND `oid` = '.1.3.6.1.4.1.2021.7890.1.101.1';] SQL RUNTIME[0.00038695s] SQL[UPDATE `snmp_errors` set `error_count` ='41996',`updated` ='1533110731' WHERE `error_id` = '2722'] SQL RUNTIME[0.00042892s] o Hardware Generic x86 [64bit] o Version <empty> o Features <empty> o Serial <empty> o Asset <empty> o Module time 0.1555s ##### goldcrest.mgmt.unitedlayer.com [141] completed poller modules at 2018-08-01 01:05:31 ##### o Graphs [checked] availability, ping, ping_snmp, uptime, la o Poller time 0.2576 seconds Updating goldcrest.mgmt.unitedlayer.com - > $update_array /opt/observium/includes/polling/functions.inc.php:792 array( [uptime] => int(30971434) [last_polled] => array( [0] => string(5) "NOW()" ) [last_polled_timetaken] => double(0.2576) ) SQL[UPDATE `devices` set `uptime` ='30971434',`last_polled` =NOW(),`last_polled_timetaken` ='0.2576' WHERE `device_id` = '141'] SQL RUNTIME[0.00055194s] o Updated Data uptime, last_polled, last_polled_timetaken SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '4827' AND `process_name` = 'poller.php' AND `device_id` = '141'] SQL RUNTIME[0.00034404s] ./poller.php: goldcrest.mgmt.unitedlayer.com - 1 devices polled in 0.348 secs ##### Completed polling run at 2018-08-01 01:05:31 ##### NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 1 o Poller Time 0.348 secs o Memory usage 12MB (peak: 14MB) o MySQL Usage Insert[1/0.001s] Update[9/0.006s] Delete[1/0s] Cell[4/0.001s] Row[16/0.008s] Rows[10/0.007s] Col[0/0s] (0.023s 6.524%) o RRDTool Usage update[5/0.006s] (0.006s 1.583%) o SNMP Usage snmpget[16/0.207s] (0.207s 59.407%) Regards, Ashwith Reddy

Mike Stupalov added a comment - 2018/08/01 08:53 AM

You added incorrect debug, as <device> you shoul use full hostname of device (as in observium) or device_id (it displayed in url when on device page, ie: device=281).

Mike Stupalov added a comment - 2018/08/01 08:53 AM You added incorrect debug, as <device> you shoul use full hostname of device (as in observium) or device_id (it displayed in url when on device page, ie: device=281).

Ashwith Reddy added a comment - 2018/08/01 08:10 AM

Hi Mike,

when i see the rrd directory has this permissions drwxrwsrwx 777), let me know if this is fine or what permissions is required for rrd ??

Regards,

Ashwith Reddy

Ashwith Reddy added a comment - 2018/08/01 08:10 AM Hi Mike, when i see the rrd directory has this permissions drwxrwsrwx 777), let me know if this is fine or what permissions is required for rrd ?? Regards, Ashwith Reddy

Ashwith Reddy added a comment - 2018/08/01 07:56 AM - edited

Hi Mike,

here is the debug output for a specific device.

observium@observiumprod:/opt/observium$ ./poller.php -d -m system -h 10.128.129.12

DEBUG!

CMD[/usr/bin/svn info /opt/observium]

CMD EXITCODE[0]

CMD RUNTIME[0.011s]

STDOUT[

Path: .

Working Copy Root Path: /opt/observium

URL: http://svn.observium.org/svn/observium/branches/stable

Relative URL: ^/observium/branches/stable

Repository Root: http://svn.observium.org/svn

Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8

Revision: 9337

Node Kind: directory

Schedule: normal

Last Changed Author: adama

Last Changed Rev: 9337

Last Changed Date: 2018-07-17 17:22:43 -0700 (Tue, 17 Jul 2018)

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';]

SQL RUNTIME[0.00015020s]

SQL[SELECT @@SESSION.sql_mode;]

SQL RUNTIME[0.00007892s]

SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION']

SQL RUNTIME[0.00006580s]

DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';]

SQL RUNTIME[0.00011301s]

SQL[SELECT * FROM `config`]

SQL RUNTIME[0.00017691s]

___ _ _

 / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___

| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \

| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |

 \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|

 Observium Professional 18.7.9337

 http://www.observium.org

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';]

SQL RUNTIME[0.00013900s]

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';]

SQL RUNTIME[0.00011396s]

SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';]

SQL RUNTIME[0.00010991s]

CMD[/opt/observium/scripts/distro]

CMD EXITCODE[0]

CMD RUNTIME[0.0125s]

STDOUT[

Linux|4.4.0-131-generic|amd64|Ubuntu|16.04|vmware|

CMD[/usr/bin/env python --version 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0013s]

STDOUT[

Python 2.7.12

SQL[SELECT version();]

SQL RUNTIME[0.00060415s]

CMD[/usr/bin/snmpget --version 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0013s]

STDOUT[

NET-SNMP version: 5.7.3

CMD[/usr/bin/rrdtool --version | head -n1]

CMD EXITCODE[0]

CMD RUNTIME[0.0052s]

STDOUT[

RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi@oetiker.ch>

CMD[/usr/bin/env rrdcached -h -h | head -n1]

CMD EXITCODE[0]

CMD RUNTIME[0.0013s]

STDOUT[

CMD[/usr/bin/fping -v 2>&1]

CMD EXITCODE[0]

CMD RUNTIME[0.0009s]

STDOUT[

/usr/bin/fping: Version 3.13

/usr/bin/fping: comments to david@schweikert.ch

CMD[/usr/sbin/apache2 -v | awk '/Server version:/ \{print $3}']

CMD EXITCODE[0]

CMD RUNTIME[0.028s]

STDOUT[

Apache/2.4.18

CMD[date "+%:z"]

CMD EXITCODE[0]

CMD RUNTIME[0.0008s]

STDOUT[

-07:00

SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);]

SQL RUNTIME[0.00027800s]

SQL[SELECT @@SESSION.sql_mode;]

SQL RUNTIME[0.00009799s]

SQL[SHOW VARIABLES LIKE 'character_set_connection']

SQL RUNTIME[0.00331306s]

##### Software versions #####

o OS Linux 4.4.0-131-generic [amd64] (Ubuntu 16.04)

 o Apache 2.4.18

 o PHP 7.0.30-0ubuntu0.16.04.1 (OPcache: DISABLED)

 o Python 2.7.12

 o MySQL 5.7.22-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev)

 o SNMP NET-SNMP 5.7.3

 o RRDtool 1.5.5 (rrdcached : unix:/var/run/rrdcached.sock)

 o Fping 3.13 (IPv4 and IPv6)

##### Memory Limit #####

o PHP Unlimited

##### MySQL mode #####

o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION

##### Charset info #####

o PHP UTF-8

 o MySQL utf8

##### Timezones info #####

o Date Tuesday, 31-Jul-18 23:55:11 PDT

 o PHP -07:00

 o MySQL -07:00

SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1533106511' AND `maint_end` > '1533106511']

SQL RUNTIME[0.00023603s]

##### Starting polling run at 2018-07-31 23:55:11 #####

SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE '10.128.129.12' ORDER BY `device_id` ASC]

SQL RUNTIME[0.00024509s]

WARNING: 0 devices polled. Did you specify a device that does not exist?

./poller.php: 10.128.129.12 - 0 devices polled in 0.069 secs

##### Completed polling run at 2018-07-31 23:55:11 #####

NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output.

 o Devices Polled 0

 o Poller Time 0.069 secs

 o Memory usage 12MB (peak: 14MB)

 o MySQL Usage Insert[0/0s] Update[0/0s] Delete[0/0s] Cell[4/0.001s] Row[5/0.001s] Rows[4/0.004s] Col[0/0s] (0.007s 9.918%)

 o RRDTool Usage (0s 0%)

 o SNMP Usage (0s 0%)

Ashwith Reddy added a comment - 2018/08/01 07:56 AM - edited Hi Mike, here is the debug output for a specific device. observium@observiumprod:/opt/observium$ ./poller.php -d -m system -h 10.128.129.12 DEBUG! CMD[/usr/bin/svn info /opt/observium] CMD EXITCODE[0] CMD RUNTIME[0.011s] STDOUT[ Path: . Working Copy Root Path: /opt/observium URL: http://svn.observium.org/svn/observium/branches/stable Relative URL: ^/observium/branches/stable Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 9337 Node Kind: directory Schedule: normal Last Changed Author: adama Last Changed Rev: 9337 Last Changed Date: 2018-07-17 17:22:43 -0700 (Tue, 17 Jul 2018) ] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] SQL RUNTIME[0.00015020s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00007892s] SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] SQL RUNTIME[0.00006580s] DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] SQL RUNTIME[0.00011301s] SQL[SELECT * FROM `config`] SQL RUNTIME[0.00017691s] ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 18.7.9337 http://www.observium.org SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] SQL RUNTIME[0.00013900s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] SQL RUNTIME[0.00011396s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] SQL RUNTIME[0.00010991s] CMD[/opt/observium/scripts/distro] CMD EXITCODE[0] CMD RUNTIME[0.0125s] STDOUT[ Linux|4.4.0-131-generic|amd64|Ubuntu|16.04|vmware| ] CMD[/usr/bin/env python --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0013s] STDOUT[ Python 2.7.12 ] SQL[SELECT version();] SQL RUNTIME[0.00060415s] CMD[/usr/bin/snmpget --version 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0013s] STDOUT[ NET-SNMP version: 5.7.3 ] CMD[/usr/bin/rrdtool --version | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0052s] STDOUT[ RRDtool 1.5.5 Copyright by Tobias Oetiker <tobi@oetiker.ch> ] CMD[/usr/bin/env rrdcached -h -h | head -n1] CMD EXITCODE[0] CMD RUNTIME[0.0013s] STDOUT[ ] CMD[/usr/bin/fping -v 2>&1] CMD EXITCODE[0] CMD RUNTIME[0.0009s] STDOUT[ /usr/bin/fping: Version 3.13 /usr/bin/fping: comments to david@schweikert.ch ] CMD[/usr/sbin/apache2 -v | awk '/Server version:/ \{print $3}'] CMD EXITCODE[0] CMD RUNTIME[0.028s] STDOUT[ Apache/2.4.18 ] CMD[date "+%:z"] CMD EXITCODE[0] CMD RUNTIME[0.0008s] STDOUT[ -07:00 ] SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] SQL RUNTIME[0.00027800s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00009799s] SQL[SHOW VARIABLES LIKE 'character_set_connection'] SQL RUNTIME[0.00331306s] ##### Software versions ##### o OS Linux 4.4.0-131-generic [amd64] (Ubuntu 16.04) o Apache 2.4.18 o PHP 7.0.30-0ubuntu0.16.04.1 (OPcache: DISABLED) o Python 2.7.12 o MySQL 5.7.22-0ubuntu0.16.04.1 (extension: mysqli 5.0.12-dev) o SNMP NET-SNMP 5.7.3 o RRDtool 1.5.5 (rrdcached : unix:/var/run/rrdcached.sock) o Fping 3.13 (IPv4 and IPv6) ##### Memory Limit ##### o PHP Unlimited ##### MySQL mode ##### o MySQL NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION ##### Charset info ##### o PHP UTF-8 o MySQL utf8 ##### Timezones info ##### o Date Tuesday, 31-Jul-18 23:55:11 PDT o PHP -07:00 o MySQL -07:00 SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1533106511' AND `maint_end` > '1533106511'] SQL RUNTIME[0.00023603s] ##### Starting polling run at 2018-07-31 23:55:11 ##### SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE '10.128.129.12' ORDER BY `device_id` ASC] SQL RUNTIME[0.00024509s] WARNING: 0 devices polled. Did you specify a device that does not exist? ./poller.php: 10.128.129.12 - 0 devices polled in 0.069 secs ##### Completed polling run at 2018-07-31 23:55:11 ##### NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 0 o Poller Time 0.069 secs o Memory usage 12MB (peak: 14MB) o MySQL Usage Insert[0/0s] Update[0/0s] Delete[0/0s] Cell[4/0.001s] Row[5/0.001s] Rows[4/0.004s] Col[0/0s] (0.007s 9.918%) o RRDTool Usage (0s 0%) o SNMP Usage (0s 0%)

Mike Stupalov added a comment - 2018/08/01 07:48 AM

Seems as your poller in cron not have permissions to write into rrd dir.

Show debug output for device (from same user as cron used):

./poller.php -d -m system -h <device>

Mike Stupalov added a comment - 2018/08/01 07:48 AM Seems as your poller in cron not have permissions to write into rrd dir. Show debug output for device (from same user as cron used): ./poller.php -d -m system -h <device>

People

Assignee:: Mike Stupalov

Reporter:: Ashwith Reddy

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 2018/08/01 07:09 AM

Updated:: 2021/10/21 09:09 AM

Resolved:: 2018/08/01 10:52 AM