DEBUG! CMD[/usr/bin/svn info /opt/observium]  CMD EXITCODE[0] CMD RUNTIME[0.0082s] STDOUT[ Path: . Working Copy Root Path: /opt/observium URL: http://svn.observium.org/svn/observium/trunk Relative URL: ^/observium/trunk Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 10148 Node Kind: directory Schedule: normal Last Changed Author: mike Last Changed Rev: 10148 Last Changed Date: 2019-10-29 12:25:30 +0000 (Tue, 29 Oct 2019) ] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] SQL RUNTIME[0.00024390s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00009394s] SQL[SET SESSION `sql_mode` = 'NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION'] SQL RUNTIME[0.00007105s] SQL WARNINGS[ 3135: 'NO_ZERO_DATE', 'NO_ZERO_IN_DATE' and 'ERROR_FOR_DIVISION_BY_ZERO' sql modes should be used with strict mode. They will be merged with strict mode in a future release. ] DB mode(s) disabled: STRICT_TRANS_TABLES, ONLY_FULL_GROUP_BY SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] SQL RUNTIME[0.00016212s] SQL[SELECT * FROM `config`] SQL RUNTIME[0.00018597s] CMD[/bin/hostname -f]  CMD EXITCODE[0] CMD RUNTIME[0.0016s] STDOUT[ nms01 ]  ___ _ _ / _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___ | | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \ | |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | | \___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_| Observium Professional 19.10.10148 http://www.observium.org  SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] SQL RUNTIME[0.00018191s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] SQL RUNTIME[0.00012803s] SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] SQL RUNTIME[0.00011992s] CMD[/opt/observium/scripts/distro]  CMD EXITCODE[0] CMD RUNTIME[0.0126s] STDOUT[ Linux|4.15.0-1035-aws|amd64|Ubuntu|18.04|xenpv| ] CMD[/usr/bin/env python --version 2>&1]  CMD EXITCODE[0] CMD RUNTIME[0.0023s] STDOUT[ Python 2.7.15+ ] SQL[SELECT version();] SQL RUNTIME[0.00018096s] CMD[/usr/bin/snmpget --version 2>&1]  CMD EXITCODE[0] CMD RUNTIME[0.0021s] STDOUT[ NET-SNMP version: 5.7.3 ] CMD[/usr/bin/rrdtool --version | head -n1]  CMD EXITCODE[0] CMD RUNTIME[0.0066s] STDOUT[ RRDtool 1.7.0 Copyright by Tobias Oetiker ] CMD[/usr/bin/fping -v 2>&1]  CMD EXITCODE[0] CMD RUNTIME[0.0016s] STDOUT[ /usr/bin/fping: Version 4.0 /usr/bin/fping: comments to david@schweikert.ch ] CMD[/usr/sbin/apache2 -v | awk '/Server version:/ {print $3}']  CMD EXITCODE[0] CMD RUNTIME[0.0246s] STDOUT[ Apache/2.4.29 ] CMD[date "+%:z"]  CMD EXITCODE[0] CMD RUNTIME[0.0015s] CMD EXITDELAY[10ms] STDOUT[ +00:00 ] SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] SQL RUNTIME[0.00028086s] SQL[SELECT @@SESSION.sql_mode;] SQL RUNTIME[0.00032496s] SQL[SHOW VARIABLES LIKE 'character_set_connection'] SQL RUNTIME[0.00174904s] ##### Software versions #####   o OS  Linux 4.15.0-1035-aws [amd64] (Ubuntu 18.04)  o Apache  2.4.29  o PHP  7.2.19-0ubuntu0.18.04.2 (OPcache: DISABLED)  o Python  2.7.15+  o MySQL  5.7.27-0ubuntu0.18.04.1 (extension: mysqli 5.0.12-dev)  o SNMP  NET-SNMP 5.7.3  o RRDtool  1.7.0  o Fping  4.0 (IPv4 and IPv6) ##### Memory Limit #####   o PHP  Unlimited ##### MySQL mode #####   o MySQL  NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION ##### Charset info #####   o PHP  UTF-8  o MySQL  utf8 ##### Timezones info #####   o Date  Friday, 01-Nov-19 01:10:59 UTC  o PHP  +00:00  o MySQL  +00:00 SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1572570659' AND `maint_end` > '1572570659'] SQL RUNTIME[0.00026298s] ##### Starting polling run at 2019-11-01 01:10:59 #####  SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE '10.40.0.3' AND `poller_id` = '0' ORDER BY `device_id` ASC] SQL RUNTIME[0.00052094s] SQL[SELECT * FROM `devices` WHERE `device_id` = '23'] SQL RUNTIME[0.00038195s] SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '23'] SQL RUNTIME[0.00027299s] SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '23'] SQL RUNTIME[0.00027609s] SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('805','poller.php','804','0','php ./poller.php -d -r -m os,system -h 10.40.0.3','1572570659','23')] SQL RUNTIME[0.00665307s] SQL[SELECT * FROM `alert_tests` WHERE 1] SQL RUNTIME[0.00020289s] Cached 5 alert rules. SQL[SELECT * FROM `alert_table` WHERE `device_id` = '23'] SQL RUNTIME[0.00023293s] ##### 10.40.0.3 [23] #####   o OS  wti-vmr-pdu  o OS Group  pdu  o Last poll duration  4.86 seconds  o Last Polled  2019-11-01 01:10:38  o SNMP Version  v2c CMD[/usr/bin/fping -t 500 -c 1 -q 10.40.0.3 2>&1]  CMD EXITCODE[0] CMD RUNTIME[0.0297s] STDOUT[ 10.40.0.3 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 27.3/27.3/27.3 ] CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' sysObjectID.0 sysUpTime.0]  CMD EXITCODE[0] CMD RUNTIME[0.0324s] STDOUT[ sysObjectID.0 = enterprises.2634.3.8 sysUpTime.0 = 84:3:55:41.11 ] SNMP STATUS[TRUE]  o Device status  Device is reachable by PING (27.3ms) and SNMP (32.43ms) [RRD Disabled - create /opt/observium/rrd/10.40.0.3/status.rrd] [RRD Disabled - update /opt/observium/rrd/10.40.0.3/status.rrd N:1] [RRD Disabled - create /opt/observium/rrd/10.40.0.3/ping.rrd] [RRD Disabled - update /opt/observium/rrd/10.40.0.3/ping.rrd N:27.3] [RRD Disabled - create /opt/observium/rrd/10.40.0.3/ping_snmp.rrd] [RRD Disabled - update /opt/observium/rrd/10.40.0.3/ping_snmp.rrd N:32.43] SQL[SELECT * FROM `device_graphs` WHERE `device_id` = '23'] SQL RUNTIME[0.00047994s]  o Modules Enabled  system, os including: includes/polling/system.inc.php ##### Module Start: system #####  SQL[SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '23' AND `attrib_type` = 'sysORID'] SQL RUNTIME[0.00023818s] SQL[SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '23' AND `attrib_type` = 'sysORID'] SQL RUNTIME[0.00018001s] SQL[SELECT `mib` FROM `devices_mibs` WHERE `device_id` = '23' AND `use` = 'mib' AND `disabled` = '1'] SQL RUNTIME[0.00016308s]  o SNMPv2-MIB  CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUs -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' sysUpTime.0 sysLocation.0 sysContact.0 sysName.0]  CMD EXITCODE[0] CMD RUNTIME[0.0326s] STDOUT[ sysUpTime.0 = 84:3:55:41.15 sysLocation.0 = 3075 Raymond sysContact.0 = noc@nextlevel.net sysName.0 = pdu01.rymnd.ca ] SNMP STATUS[TRUE] Timeticks converted 84:3:55:41.15 -> 7271741 CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' sysDescr.0]  CMD EXITCODE[0] CMD RUNTIME[0.0324s] STDOUT[ Linux 10.40.0.3 3.14.43-g875c69b #1 Mon Sep 24 08:39:55 PDT 2018 armv7l ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUvn -m SNMPv2-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' sysObjectID.0]  CMD EXITCODE[0] CMD RUNTIME[0.0324s] STDOUT[ .1.3.6.1.4.1.2634.3.8 ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' snmpEngineID.0]  CMD EXITCODE[0] CMD RUNTIME[0.0315s] STDOUT[ "80 00 1F 88 80 1B A6 95 7F 55 EB 99 54 " ] SNMP STATUS[TRUE] CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m HOST-RESOURCES-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' hrSystemUptime.0]  CMD EXITCODE[0] CMD RUNTIME[0.0339s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS[FALSE] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '23' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'HOST-RESOURCES-MIB' AND `oid` = 'hrSystemUptime.0';] SQL RUNTIME[0.00048304s] SQL[UPDATE `snmp_errors` set `error_count` ='24891',`updated` ='1572570659' WHERE `error_id` = '535'] SQL RUNTIME[0.00218821s] CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m SNMP-FRAMEWORK-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' snmpEngineTime.0]  CMD EXITCODE[0] CMD RUNTIME[0.0319s] STDOUT[ 7271741 ] SNMP STATUS[TRUE] Using SNMP Agent snmpEngineTime (7271741 sec. => 84 days, 3h 55m 41s) [RRD Disabled - create /opt/observium/rrd/10.40.0.3/uptime.rrd] [RRD Disabled - update /opt/observium/rrd/10.40.0.3/uptime.rrd N:7271741]  o Uptime  84 days, 3h 55m 41s  o Last reboot  2019-08-08 21:15:07   /opt/observium/includes/polling/system.inc.php:302  array( [use] => string(14) "snmpEngineTime" [sysUpTime] => int(7271741) [hrSystemUptime] => bool(false) [snmpEngineTime] => int(7271741) [uptime] => int(7271741) [formatted] => string(19) "84 days, 3h 55m 41s" [message] => string(31) "Using SNMP Agent snmpEngineTime" [previous] => string(7) "7271716" [diff] => int(-25) [last_rebooted] => string(10) "1565298907" [rebooted] => int(0) ) CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUsn -m UCD-SNMP-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'10.40.0.3':'161' .1.3.6.1.4.1.2021.10.1.5.1 .1.3.6.1.4.1.2021.10.1.5.2 .1.3.6.1.4.1.2021.10.1.5.3]  CMD EXITCODE[0] CMD RUNTIME[0.0325s] STDOUT[ .1.3.6.1.4.1.2021.10.1.5.1 = No Such Object available on this agent at this OID .1.3.6.1.4.1.2021.10.1.5.2 = No Such Object available on this agent at this OID .1.3.6.1.4.1.2021.10.1.5.3 = No Such Object available on this agent at this OID ] SNMP ERROR[#1000 - Failed response] SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '23' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'UCD-SNMP-MIB' AND `oid` = '.1.3.6.1.4.1.2021.10.1.5.1 .1.3.6.1.4.1.2021.10.1.5.2 .1.3.6.1.4.1.2021.10.1.5.3';] SQL RUNTIME[0.00042200s] SQL[UPDATE `snmp_errors` set `error_count` ='24892',`updated` ='1572570659' WHERE `error_id` = '536'] SQL RUNTIME[0.00190401s] SNMP STATUS[FALSE]  o sysObjectID  .1.3.6.1.4.1.2634.3.8  o snmpEngineID  80001F88801BA6957F55EB9954  o sysDescr  Linux 10.40.0.3 3.14.43-g875c69b #1 Mon Sep 24 08:39:55 PDT 2018 armv7l  o sysName  pdu01.rymnd.ca  o Location  3075 Raymond SQL[SELECT * FROM `devices_locations` WHERE `device_id` = '23'] SQL RUNTIME[0.00020885s]  o Module time  0.2463s including: includes/polling/os.inc.php ##### Module Start: os #####  CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m WTI-POWER-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/wti 'udp':'10.40.0.3':'161' environmentSerialNumber.1]  CMD EXITCODE[0] CMD RUNTIME[0.0756s] STDOUT[ 01830419190888 ] SNMP STATUS[TRUE] Added OS param from SNMP definition walk: 'serial' = '01830419190888' CMD[/usr/bin/snmpget -v2c -c *** -Pud -OQUv -m WTI-POWER-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/wti 'udp':'10.40.0.3':'161' environmentUnitName.1]  CMD EXITCODE[0] CMD RUNTIME[0.0765s] STDOUT[ VMR-8HD20-2 ] SNMP STATUS[TRUE] Added OS param from SNMP definition walk: 'hardware' = 'VMR-8HD20-2'  o OS Poller  Generic  o Vendor  WTI  o Hardware  VMR-8HD20-2  o Version    o Features    o Serial  01830419190888  o Asset    o Module time  0.1563s ##### 10.40.0.3 [23] completed poller modules at 2019-11-01 01:10:59 #####   o Graphs [checked]  availability, ping, ping_snmp, uptime  o Poller time  0.478 seconds Updating 10.40.0.3 -  > $update_array /opt/observium/includes/polling/functions.inc.php:481  array( [uptime] => int(7271741) [last_polled] => array( [0] => string(5) "NOW()" ) [last_polled_timetaken] => double(0.478) ) SQL[UPDATE `devices` set `uptime` ='7271741',`last_polled` =NOW(),`last_polled_timetaken` ='0.478' WHERE `device_id` = '23'] SQL RUNTIME[0.00224304s]  o Updated Data  uptime, last_polled, last_polled_timetaken SQL[UPDATE `alert_table` set `state` ='{\"metrics\":{\"device_status\":\"1\"}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked` ='1572570659',`last_ok` ='1572570659' WHERE `alert_table_id` = '334'] SQL RUNTIME[0.00852704s] [RRD Disabled - create /opt/observium/rrd/10.40.0.3/alert-334.rrd] [RRD Disabled - update /opt/observium/rrd/10.40.0.3/alert-334.rrd N:1:1] SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '805' AND `process_name` = 'poller.php' AND `device_id` = '23'] SQL RUNTIME[0.00243115s] ./poller.php: 10.40.0.3 - 1 devices polled in 0.571 secs ##### Completed polling run at 2019-11-01 01:10:59 #####  NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output.  o Devices Polled  1  o Poller Time  0.571 secs  o Memory usage  14MB (peak: 14MB)  o MySQL Usage  Insert[1/0.007s] Update[4/0.015s] Delete[1/0.003s] Cell[4/0.001s] Row[11/0.004s] Rows[10/0.005s] Col[1/0s] (0.036s 6.248%)  o RRDTool Usage  (0s 0%)  o SNMP Usage  snmpget[10/0.412s] errors[/0s] (0.412s 72.103%)