Uploaded image for project: 'Observium'
  1. Observium
  2. OBS-2604

Dell Compellent SC8000 Discovery Broken

Details

    • Bug
    • Resolution: Not A Bug
    • Major
    • None
    • Professional Edition
    • None
    • None
    • Ubuntu 14.04.4 LTS x64

    Description

      Hello, 

      We're trying to get our Compellent SC8000 to show all it's information in professional edition of Observium (v18.1.9011 27th January 2018) but we only seem to be able to get very basic information. The MIB that should be used is ../observium/mibs/dell/COMPELLENT-MIB, as it's contents are the same as the current Dell provided MIB ([DELL-STORAGE-SC-MIB|ftp://customer:Y3V2s-uH@ftp.compellent.com/SOFTWARE/MIB/MIB2014.01.29.zip]) for the Compellet. For some reason, observium seems to be having some issues with some OIDs and discovery of the different components.

      When I SNMP walk the host, I can see this value without issue.

      Other SNMP details about our Compellent are shown in Observium, but it doesn't appear that the COMPELLENT-MIB is functioning as expected. Please investigate further and let me know if I can provide more information or assist in resolving the problem. 

      Attachments

        Issue Links

          Activity

            [OBS-2604] Dell Compellent SC8000 Discovery Broken

            but if you have to report bugs, this is definitely the way to do it, with research and screenshots.

            pity the content was spurious

            adama Adam Armstrong added a comment - but if you have to report bugs, this is definitely the way to do it, with research and screenshots. pity the content was spurious

            just svn update the stable train daily and watch all your sorrows go away

            plus every morning you'll wake up to new features popping up here and there!

            rendest Stef Renders added a comment - just svn update the stable train daily and watch all your sorrows go away plus every morning you'll wake up to new features popping up here and there!

            I'm sorry for being argumentative Adam, 

            I was confused about what you had said previously and interpreted it as you saying that the CE version had support for the equipment, but that the support hadn't been added to the paid observium versions. 

            I was not aware that the issue had been fixed in a recent update. I saw the old bug report and figured that our install of the January code release was current enough to account for the device.

            I just ran an svn update, rediscovered the device, and now the compellent is showing up properly. 

            Thanks for your help with this.

            darylrbcchr Daryl Roche added a comment - I'm sorry for being argumentative Adam,  I was confused about what you had said previously and interpreted it as you saying that the CE version had support for the equipment, but that the support hadn't been added to the paid observium versions.  I was not aware that the issue had been fixed in a recent update. I saw the old bug report and figured that our install of the January code release was current enough to account for the device. I just ran an svn update, rediscovered the device, and now the compellent is showing up properly.  Thanks for your help with this.

            Why do you think the current code might not reference a MIB which has been deprecated and replaced by another MIB?
            Why do you think an old version might reference this MIB, whilst a new version does not?

            But most importantly, why do you think you'll get a better outcome by ignoring what I say and being argumentative?

            adama Adam Armstrong added a comment - Why do you think the current code might not reference a MIB which has been deprecated and replaced by another MIB? Why do you think an old version might reference this MIB, whilst a new version does not? But most importantly, why do you think you'll get a better outcome by ignoring what I say and being argumentative?

            Hey Adam, 

             

            You are correct, but what I'm confused about is why the professional version of observium has less features than the community version of it, especially when this particular issue was reported more than two years ago via http://jira.observium.org/browse/OBS-1372

            Please reimplement the COMPELLENT-MIB functionality for the professional edition of observium, or at least timeline the implementation of it in a future code release.

            darylrbcchr Daryl Roche added a comment - Hey Adam,    You are correct, but what I'm confused about is why the professional version of observium has less features than the community version of it, especially when this particular issue was reported more than two years ago via http://jira.observium.org/browse/OBS-1372 Please reimplement the COMPELLENT-MIB functionality for the professional edition of observium, or at least timeline the implementation of it in a future code release.

            The debugs above are not taken from CE.

            adama Adam Armstrong added a comment - The debugs above are not taken from CE.

            Hey Adam, 

            I'm not sure why your code doesn't reference COMPELLENT-MIB as it is still being provided via the community edition of observium.

             

            user@UbuntuDesktop:~/$ wget http://www.observium.org/observium-community-latest.tar.gz

            user@UbuntuDesktop:~/$ tar zxvf observium-community-latest.tar.gz

            ..... <extraction lines redacted> .....

            observium/LICENSE.COMMUNITY
            observium/alerter.php
            observium/templates/
            observium/templates/notification/
            observium/templates/README
            observium/templates/alert/
            observium/templates/group/
            observium/VERSION
            observium/adduser.php
            user@UbuntuDesktop:~$ cd observium/
            user@UbuntuDesktop:~/observium$ find /home/user/observium/ -name COMPELLENT-MIB

            /home/user/observium/mibs/dell/COMPELLENT-MIB

             

             

            If the code to support the MIB is missing, please find out what happened to the code and readjust/reimplement as needed.

            darylrbcchr Daryl Roche added a comment - Hey Adam,  I'm not sure why your code doesn't reference COMPELLENT-MIB as it is still being provided via the community edition of observium.   user@UbuntuDesktop:~/$ wget http://www.observium.org/observium-community-latest.tar.gz user@UbuntuDesktop:~/$ tar zxvf observium-community-latest.tar.gz ..... <extraction lines redacted> ..... observium/LICENSE.COMMUNITY observium/alerter.php observium/templates/ observium/templates/notification/ observium/templates/README observium/templates/alert/ observium/templates/group/ observium/VERSION observium/adduser.php user@UbuntuDesktop:~$ cd observium/ user@UbuntuDesktop:~/observium$ find /home/user/observium/ -name COMPELLENT-MIB /home/user/observium/mibs/dell/COMPELLENT-MIB     If the code to support the MIB is missing, please find out what happened to the code and readjust/reimplement as needed.

            Our code currently doesn't reference COMPELLENT-MIB at all. Please update and try again.

            adama Adam Armstrong added a comment - Our code currently doesn't reference COMPELLENT-MIB at all. Please update and try again.

            Ah ok, the output is included below.

             

            [root@observium01:/home/observium/observium]# ./poller.php -h compellent.domain.lan -m os -d
            DEBUG!

            CMD[/usr/bin/svn info /home/observium/observium]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0152s]
            STDOUT[
            Path: .
            Working Copy Root Path: /home/observium/observium
            URL: http://svn.observium.org/svn/observium/branches/stable
            Relative URL: ^/observium/branches/stable
            Repository Root: http://svn.observium.org/svn
            Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8
            Revision: 9071
            Node Kind: directory
            Schedule: normal
            Last Changed Author: adama
            Last Changed Rev: 9011
            Last Changed Date: 2018-01-27 12:48:09 -0800 (Sat, 27 Jan 2018)

            ]

            SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';]
            SQL RUNTIME[0.00023413s]

            SQL[SELECT @@SESSION.sql_mode;]
            SQL RUNTIME[0.00027704s]

            SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';]
            SQL RUNTIME[0.00016499s]

            SQL[SELECT * FROM `config`]
            SQL RUNTIME[0.00018001s]

            ___ _ _
            / _ \ | |__ ___ ___ _ __ __ _() _ _ _ __ ___

                  '_ \ / __ / _ | '__ \ \ / /         '_ ` _ \
              _     _) __ | __/   \ V /     _            

            __/ |._/ |_/ _||| _/ || _,||| || ||
            Observium Professional 18.1.9011
            http://www.observium.org

            SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';]
            SQL RUNTIME[0.00019383s]

            SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';]
            SQL RUNTIME[0.00015903s]

            SQL[SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';]
            SQL RUNTIME[0.00015497s]

            CMD[/home/observium/observium/scripts/distro]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0171s]
            STDOUT[
            Linux|3.13.0-142-generic|amd64|Ubuntu|14.04|vmware
            ]

            CMD[/usr/bin/env python --version 2>&1]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0053s]
            STDOUT[
            Python 2.7.6
            ]

            SQL[SELECT version();]
            SQL RUNTIME[0.00031805s]

            CMD[/usr/bin/snmpget --version 2>&1]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0051s]
            STDOUT[
            NET-SNMP version: 5.7.2
            ]

            CMD[/usr/bin/rrdtool --version | head -n1]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0103s]
            STDOUT[
            RRDtool 1.4.7 Copyright 1997-2012 by Tobias Oetiker <tobi@oetiker.ch>
            ]

            CMD[/usr/bin/env apache2 -v | awk '/Server version:/ \{print $3}']

            CMD EXITCODE[0]
            CMD RUNTIME[0.0041s]
            STDOUT[

            ]

            CMD[/usr/bin/env httpd -v | awk '/Server version:/ \{print $3}']

            CMD EXITCODE[0]
            CMD RUNTIME[0.0047s]
            CMD EXITDELAY[10ms]
            STDOUT[

            ]

            CMD[date "+%:z"]

            CMD EXITCODE[0]
            CMD RUNTIME[0.005s]
            STDOUT[
            -08:00
            ]

            SQL[SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);]
            SQL RUNTIME[0.00036907s]

            SQL[SELECT @@SESSION.sql_mode;]
            SQL RUNTIME[0.00026083s]

            SQL[SHOW VARIABLES LIKE 'character_set_connection']
            SQL RUNTIME[0.00077915s]

                    1. Software versions #####

            o OS Linux 3.13.0-142-generic [amd64] (Ubuntu 14.04)
            o Apache not found
            o PHP 5.5.9-1ubuntu4.23 (OPcache: DISABLED)
            o Python 2.7.6
            o MySQL 5.5.59-0ubuntu0.14.04.1 (extension: mysqli 5.5.59)
            o SNMP NET-SNMP 5.7.2
            o RRDtool 1.4.7

                    1. Memory Limit #####

            o PHP Unlimited

                    1. MySQL mode #####

            o MySQL

                    1. Charset info #####

            o PHP UTF-8
            o MySQL utf8

                    1. Timezones info #####

            o Date Friday, 02-Mar-18 09:07:01 PST
            o PHP -08:00
            o MySQL -08:00

            SQL[SELECT * FROM `alerts_maint` WHERE `maint_start` < '1520010421' AND `maint_end` > '1520010421']
            SQL RUNTIME[0.00053501s]

                    1. Starting polling run at 2018-03-02 09:07:01 #####

            SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'compellent.domain.lan' ORDER BY `device_id` ASC]
            SQL RUNTIME[0.00057912s]

            SQL[SELECT * FROM `devices` WHERE `device_id` = '202']
            SQL RUNTIME[0.00057602s]

            SQL[SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202']
            SQL RUNTIME[0.00051522s]

            SQL[SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '202']
            SQL RUNTIME[0.00038910s]

            CMD[/bin/ps -ww -o pid,ppid,uid,gid,tty,stat,time,lstart,args -p 64714]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0304s]
            STDOUT[
            PID PPID UID GID TT STAT TIME STARTED COMMAND
            64714 58135 0 0 pts/2 S+ 00:00:00 Fri Mar 2 09:07:01 2018 php ./poller.php -h compellent.domain.lan -m os -d
            ]

            CMD[/bin/ps -ww -o pid,ppid,uid,gid,tty,stat,time,lstart,args -p 58135]

            CMD EXITCODE[0]
            CMD RUNTIME[0.029s]
            STDOUT[
            PID PPID UID GID TT STAT TIME STARTED COMMAND
            58135 58134 0 0 pts/2 S 00:00:00 Fri Mar 2 09:06:04 2018 -su
            ]

            SQL[INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('64714','poller.php','58135','0','php ./poller.php -h compellent.domain.lan -m os -d','1520010421','202')]
            SQL RUNTIME[1.16951895s]

            SQL[SELECT * FROM `alert_tests` WHERE 1]
            SQL RUNTIME[0.00025201s]
            Cached 2 alert rules.

            SQL[SELECT * FROM `alert_table` WHERE `device_id` = '202']
            SQL RUNTIME[0.00053716s]

                    1. compellent.domain.lan [202] #####

            o OS compellent
            o Last poll duration 1.76 seconds
            o Last Polled 2018-03-02 09:03:48
            o SNMP Version v2c

            CMD[/usr/bin/fping -t 500 -c 1 -q xxx.xxx.xxx.xxx 2>&1]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0132s]
            STDOUT[
            xxx.xxx.xxx.xxx : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.23/0.23/0.23
            ]

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUst -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysObjectID.0 sysUpTime.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.023s]
            STDOUT[
            sysObjectID.0 = enterprises.8072.3.2.8
            sysUpTime.0 = 10668277
            ]
            SNMP STATUS[TRUE]
            o Device status Device is reachable by PING (0.23ms) and SNMP (23.03ms)
            RRD /home/observium/observium/rrd/compellent.domain.lan/status.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/status.rrd N:1]
            RRD RUNTIME[0.0012s]
            RRD STDOUT[OK u:0.00 s:0.00 r:1.28]
            RRD_STATUS[TRUE]

            RRD /home/observium/observium/rrd/compellent.domain.lan/ping.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/ping.rrd N:0.23]
            RRD RUNTIME[0.0011s]
            RRD STDOUT[OK u:0.00 s:0.00 r:1.29]
            RRD_STATUS[TRUE]

            RRD /home/observium/observium/rrd/compellent.domain.lan/ping_snmp.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/ping_snmp.rrd N:23.03]
            RRD RUNTIME[0.0011s]
            RRD STDOUT[OK u:0.00 s:0.00 r:1.29]
            RRD_STATUS[TRUE]

            SQL[SELECT * FROM `device_graphs` WHERE `device_id` = '202']
            SQL RUNTIME[0.00022292s]
            o Modules Enabled system, os

            including: includes/polling/system.inc.php

                    1. Module Start: system #####

            SQL[SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202' AND `attrib_type` = 'sysORID']
            SQL RUNTIME[0.00060701s]

            SQL[SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202' AND `attrib_type` = 'sysORID']
            SQL RUNTIME[0.00013781s]

            SQL[SELECT * FROM `observium_attribs`]
            SQL RUNTIME[0.00014496s]
            o SNMPv2-MIB
            CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysUpTime.0 sysLocation.0 sysContact.0 sysName.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0268s]
            STDOUT[
            sysUpTime.0 = 1:5:38:02.81
            sysLocation.0 =
            sysContact.0 =
            sysName.0 = sc8000-01.bcchr.ca
            ]
            SNMP STATUS[TRUE]

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysDescr.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0245s]
            STDOUT[
            FreeBSD sn23844.bcricwh.lan 10.0-RELEASE-p11 FreeBSD 10.0-RELEASE-p11 #0: Mon Jan 8 09:55:45 CST 2018 root@es-vb100-1:/work/buildmaster/r07.02.31/R07.02.31.003/07_02_31_003/work/buildmaster/r07.02.31/R07.02.31.003/src/sys/COMPELLENT amd64
            ]
            SNMP STATUS[TRUE]

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqvn -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysObjectID.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0294s]
            STDOUT[
            .1.3.6.1.4.1.8072.3.2.8
            ]
            SNMP STATUS[TRUE]

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' snmpEngineID.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0135s]
            STDOUT[
            No Such Object available on this agent at this OID
            ]
            SNMP STATUS[FALSE]
            SNMP ERROR1000 - Failed response

            SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '202' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'SNMP-FRAMEWORK-MIB' AND `oid` = 'snmpEngineID.0';]
            SQL RUNTIME[0.00052404s]

            SQL[UPDATE `snmp_errors` set `error_count` ='2300',`updated` ='1520010423' WHERE `error_id` = '21156']
            SQL RUNTIME[0.06295705s]

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' snmpEngineTime.0]

            CMD EXITCODE[0]
            CMD RUNTIME[0.0218s]
            CMD EXITDELAY[10ms]
            STDOUT[
            No Such Object available on this agent at this OID
            ]
            SNMP STATUS[FALSE]
            SNMP ERROR1000 - Failed response

            SQL[SELECT * FROM `snmp_errors` WHERE `device_id` = '202' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'SNMP-FRAMEWORK-MIB' AND `oid` = 'snmpEngineTime.0';]
            SQL RUNTIME[0.00052905s]

            SQL[UPDATE `snmp_errors` set `error_count` ='2300',`updated` ='1520010423' WHERE `error_id` = '21157']
            SQL RUNTIME[0.01589799s]
            Using SNMP Agent sysUpTime (106682 sec. => 1 day, 5h 38m 2s)
            RRD /home/observium/observium/rrd/compellent.domain.lan/uptime.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/uptime.rrd N:106682]
            RRD RUNTIME[0.0014s]
            RRD STDOUT[OK u:0.01 s:0.00 r:1.53]
            RRD_STATUS[TRUE]

            o Uptime 1 day, 5h 38m 2s
            o Last reboot 2018-03-01 03:29:01

            /home/observium/observium/includes/polling/system.inc.php:296
            array(
            [use] => string(9) "sysUpTime"
            [sysUpTime] => int(106682)
            [uptime] => int(106682)
            [formatted] => string(16) "1 day, 5h 38m 2s"
            [message] => string(26) "Using SNMP Agent sysUpTime"
            [previous] => string(6) "106486"
            [diff] => int(-196)
            [last_rebooted] => string(10) "1519903741"
            [rebooted] => int(0)
            )
            o sysObjectID .1.3.6.1.4.1.8072.3.2.8
            o snmpEngineID
            o sysDescr FreeBSD sn23844.bcricwh.lan 10.0-RELEASE-p11 FreeBSD 10.0-RELEASE-p11 #0: Mon Jan 8 09:55:45 CST 2018
            root@es-vb100-1:/work/buildmaster/r07.02.31/R07.02.31.003/07_02_31_003/work/buildmaster/r07.02.31/R07.02.31.003/src/sys/COMPELLENT
            amd64
            o sysName sc8000-01.bcchr.ca
            o Location

            SQL[SELECT * FROM `devices_locations` WHERE `device_id` = '202']
            SQL RUNTIME[0.00018406s]
            o Module time 0.2598s

            including: includes/polling/os.inc.php

                    1. Module Start: os #####

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m COMPELLENT-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell 'udp':'compellent.domain.lan':'161' productIDVersion.0]

            CMD EXITCODE[1]
            CMD RUNTIME[0.0291s]
            STDOUT[

            ]
            STDERR[
            MIB search path: /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell
            Cannot find module (COMPELLENT-MIB): At line 0 in (none)
            productIDVersion.0: Unknown Object Identifier (Sub-id not found: (top) -> productIDVersion)
            ]
            SNMP STATUS[FALSE]
            SNMP ERROR996 - MIB or oid not found

            CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m COMPELLENT-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell 'udp':'compellent.domain.lan':'161' scEnclModel.1]

            CMD EXITCODE[1]
            CMD RUNTIME[0.0151s]
            STDOUT[

            ]
            STDERR[
            MIB search path: /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell
            Cannot find module (COMPELLENT-MIB): At line 0 in (none)
            scEnclModel.1: Unknown Object Identifier (Sub-id not found: (top) -> scEnclModel)
            ]
            SNMP STATUS[FALSE]
            SNMP ERROR996 - MIB or oid not found
            o OS Poller Generic
            o Hardware <empty>
            o Version <empty>
            o Features <empty>
            o Serial <empty>
            o Asset <empty>

            o Module time 0.0575s

                    1. compellent.domain.lan [202] completed poller modules at 2018-03-02 09:07:03 #####

            o Graphs [checked] ping, ping_snmp, uptime
            o Poller time 1.6206 seconds
            Updating compellent.domain.lan -

            > $update_array /home/observium/observium/includes/polling/functions.inc.php:790
            array(
            [uptime] => int(106682)
            [last_polled] => array(
            [0] => string(5) "NOW()"
            )
            [last_polled_timetaken] => double(1.6206)
            )

            SQL[UPDATE `devices` set `uptime` ='106682',`last_polled` =NOW(),`last_polled_timetaken` ='1.6206' WHERE `device_id` = '202']
            SQL RUNTIME[0.01773500s]
            o Updated Data uptime, last_polled, last_polled_timetaken

            SQL[UPDATE `alert_table` set `state` ='\{\"metrics\":{\"device_status\":\"1\"}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked` ='1520010423',`last_ok` ='1520010423' WHERE `alert_table_id` = '611']
            SQL RUNTIME[0.03182602s]
            RRD /home/observium/observium/rrd/compellent.domain.lan/alert-611.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/alert-611.rrd N:1:1]
            RRD RUNTIME[0.0013s]
            RRD STDOUT[OK u:0.01 s:0.00 r:1.67]
            RRD_STATUS[TRUE]

            SQL[UPDATE `alert_table` set `state` ='\{\"metrics\":{\"device_rebooted\":0}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked` ='1520010423',`last_ok` ='1520010423' WHERE `alert_table_id` = '612']
            SQL RUNTIME[0.01889801s]
            RRD /home/observium/observium/rrd/compellent.domain.lan/alert-612.rrd already exists - no need to create.

            RRD CMD[update /home/observium/observium/rrd/compellent.domain.lan/alert-612.rrd N:1:1]
            RRD RUNTIME[0.0014s]
            RRD STDOUT[OK u:0.01 s:0.00 r:1.70]
            RRD_STATUS[TRUE]

             

            SQL[DELETE FROM `observium_processes` WHERE `process_pid` = '64714' AND `process_name` = 'poller.php' AND `device_id` = '202']
            SQL RUNTIME[0.02134204s]
            ./poller.php: compellent.domain.lan - 1 devices polled in 1.838 secs

                    1. Completed polling run at 2018-03-02 09:07:03 #####

            NOTE, $config['snmp']['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output.
            o Devices Polled 1
            o Poller Time 1.838 secs
            o Memory usage 13.5MB (peak: 13.5MB)
            o MySQL Usage Insert[1/1.171s] Update[5/0.151s] Delete[1/0.022s] Cell[4/0.004s] Row[11/0.012s] Rows[10/0.011s] Col[0/0s] (1.371s
            74.591%)
            o RRDTool Usage update[6/0.008s] (0.008s 0.412%)
            o SNMP Usage snmpget[8/0.215s] (0.215s 11.676%)

            darylrbcchr Daryl Roche added a comment - Ah ok, the output is included below.   [root@observium01:/home/observium/observium] # ./poller.php -h compellent.domain.lan -m os -d DEBUG! CMD [/usr/bin/svn info /home/observium/observium] CMD EXITCODE [0] CMD RUNTIME [0.0152s] STDOUT[ Path: . Working Copy Root Path: /home/observium/observium URL: http://svn.observium.org/svn/observium/branches/stable Relative URL: ^/observium/branches/stable Repository Root: http://svn.observium.org/svn Repository UUID: 61d68cd4-352d-0410-923a-c4978735b2b8 Revision: 9071 Node Kind: directory Schedule: normal Last Changed Author: adama Last Changed Rev: 9011 Last Changed Date: 2018-01-27 12:48:09 -0800 (Sat, 27 Jan 2018) ] SQL [SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';] SQL RUNTIME [0.00023413s] SQL [SELECT @@SESSION.sql_mode;] SQL RUNTIME [0.00027704s] SQL [SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'current_rev';] SQL RUNTIME [0.00016499s] SQL [SELECT * FROM `config`] SQL RUNTIME [0.00018001s] ___ _ _ / _ \ | |__ ___ ___ _ __ __ _ ( ) _ _ _ __ ___       '_ \ / __ / _ | '__ \ \ / /         '_ ` _ \   _     _) __ | __/   \ V /     _             __ / | ._ / | _ / _ || | _/ | | _ , || | | | | | Observium Professional 18.1.9011 http://www.observium.org SQL [SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver';] SQL RUNTIME [0.00019383s] SQL [SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';] SQL RUNTIME [0.00015903s] SQL [SELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date';] SQL RUNTIME [0.00015497s] CMD [/home/observium/observium/scripts/distro] CMD EXITCODE [0] CMD RUNTIME [0.0171s] STDOUT[ Linux|3.13.0-142-generic|amd64|Ubuntu|14.04|vmware ] CMD [/usr/bin/env python --version 2>&1] CMD EXITCODE [0] CMD RUNTIME [0.0053s] STDOUT[ Python 2.7.6 ] SQL [SELECT version();] SQL RUNTIME [0.00031805s] CMD [/usr/bin/snmpget --version 2>&1] CMD EXITCODE [0] CMD RUNTIME [0.0051s] STDOUT[ NET-SNMP version: 5.7.2 ] CMD [/usr/bin/rrdtool --version | head -n1] CMD EXITCODE [0] CMD RUNTIME [0.0103s] STDOUT[ RRDtool 1.4.7 Copyright 1997-2012 by Tobias Oetiker <tobi@oetiker.ch> ] CMD [/usr/bin/env apache2 -v | awk '/Server version:/ \{print $3}'] CMD EXITCODE [0] CMD RUNTIME [0.0041s] STDOUT[ ] CMD [/usr/bin/env httpd -v | awk '/Server version:/ \{print $3}'] CMD EXITCODE [0] CMD RUNTIME [0.0047s] CMD EXITDELAY [10ms] STDOUT[ ] CMD [date "+%:z"] CMD EXITCODE [0] CMD RUNTIME [0.005s] STDOUT[ -08:00 ] SQL [SELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);] SQL RUNTIME [0.00036907s] SQL [SELECT @@SESSION.sql_mode;] SQL RUNTIME [0.00026083s] SQL [SHOW VARIABLES LIKE 'character_set_connection'] SQL RUNTIME [0.00077915s] Software versions ##### o OS Linux 3.13.0-142-generic [amd64] (Ubuntu 14.04) o Apache not found o PHP 5.5.9-1ubuntu4.23 (OPcache: DISABLED) o Python 2.7.6 o MySQL 5.5.59-0ubuntu0.14.04.1 (extension: mysqli 5.5.59) o SNMP NET-SNMP 5.7.2 o RRDtool 1.4.7 Memory Limit ##### o PHP Unlimited MySQL mode ##### o MySQL Charset info ##### o PHP UTF-8 o MySQL utf8 Timezones info ##### o Date Friday, 02-Mar-18 09:07:01 PST o PHP -08:00 o MySQL -08:00 SQL [SELECT * FROM `alerts_maint` WHERE `maint_start` < '1520010421' AND `maint_end` > '1520010421'] SQL RUNTIME [0.00053501s] Starting polling run at 2018-03-02 09:07:01 ##### SQL [SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE 'compellent.domain.lan' ORDER BY `device_id` ASC] SQL RUNTIME [0.00057912s] SQL [SELECT * FROM `devices` WHERE `device_id` = '202'] SQL RUNTIME [0.00057602s] SQL [SELECT * FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202'] SQL RUNTIME [0.00051522s] SQL [SELECT * FROM `observium_processes` WHERE `process_name` = 'poller.php' AND `device_id` = '202'] SQL RUNTIME [0.00038910s] CMD [/bin/ps -ww -o pid,ppid,uid,gid,tty,stat,time,lstart,args -p 64714] CMD EXITCODE [0] CMD RUNTIME [0.0304s] STDOUT[ PID PPID UID GID TT STAT TIME STARTED COMMAND 64714 58135 0 0 pts/2 S+ 00:00:00 Fri Mar 2 09:07:01 2018 php ./poller.php -h compellent.domain.lan -m os -d ] CMD [/bin/ps -ww -o pid,ppid,uid,gid,tty,stat,time,lstart,args -p 58135] CMD EXITCODE [0] CMD RUNTIME [0.029s] STDOUT[ PID PPID UID GID TT STAT TIME STARTED COMMAND 58135 58134 0 0 pts/2 S 00:00:00 Fri Mar 2 09:06:04 2018 -su ] SQL [INSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('64714','poller.php','58135','0','php ./poller.php -h compellent.domain.lan -m os -d','1520010421','202')] SQL RUNTIME [1.16951895s] SQL [SELECT * FROM `alert_tests` WHERE 1] SQL RUNTIME [0.00025201s] Cached 2 alert rules. SQL [SELECT * FROM `alert_table` WHERE `device_id` = '202'] SQL RUNTIME [0.00053716s] compellent.domain.lan [202] ##### o OS compellent o Last poll duration 1.76 seconds o Last Polled 2018-03-02 09:03:48 o SNMP Version v2c CMD [/usr/bin/fping -t 500 -c 1 -q xxx.xxx.xxx.xxx 2>&1] CMD EXITCODE [0] CMD RUNTIME [0.0132s] STDOUT[ xxx.xxx.xxx.xxx : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.23/0.23/0.23 ] CMD [/usr/bin/snmpget -v2c -c *** -Pu -OQUst -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysObjectID.0 sysUpTime.0] CMD EXITCODE [0] CMD RUNTIME [0.023s] STDOUT[ sysObjectID.0 = enterprises.8072.3.2.8 sysUpTime.0 = 10668277 ] SNMP STATUS [TRUE] o Device status Device is reachable by PING (0.23ms) and SNMP (23.03ms) RRD /home/observium/observium/rrd/compellent.domain.lan/status.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/status.rrd N:1] RRD RUNTIME [0.0012s] RRD STDOUT [OK u:0.00 s:0.00 r:1.28] RRD_STATUS [TRUE] RRD /home/observium/observium/rrd/compellent.domain.lan/ping.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/ping.rrd N:0.23] RRD RUNTIME [0.0011s] RRD STDOUT [OK u:0.00 s:0.00 r:1.29] RRD_STATUS [TRUE] RRD /home/observium/observium/rrd/compellent.domain.lan/ping_snmp.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/ping_snmp.rrd N:23.03] RRD RUNTIME [0.0011s] RRD STDOUT [OK u:0.00 s:0.00 r:1.29] RRD_STATUS [TRUE] SQL [SELECT * FROM `device_graphs` WHERE `device_id` = '202'] SQL RUNTIME [0.00022292s] o Modules Enabled system, os including: includes/polling/system.inc.php Module Start: system ##### SQL [SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202' AND `attrib_type` = 'sysORID'] SQL RUNTIME [0.00060701s] SQL [SELECT `attrib_value` FROM `entity_attribs` WHERE `entity_type` = 'device' AND `entity_id` = '202' AND `attrib_type` = 'sysORID'] SQL RUNTIME [0.00013781s] SQL [SELECT * FROM `observium_attribs`] SQL RUNTIME [0.00014496s] o SNMPv2-MIB CMD [/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysUpTime.0 sysLocation.0 sysContact.0 sysName.0] CMD EXITCODE [0] CMD RUNTIME [0.0268s] STDOUT[ sysUpTime.0 = 1:5:38:02.81 sysLocation.0 = sysContact.0 = sysName.0 = sc8000-01.bcchr.ca ] SNMP STATUS [TRUE] CMD [/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysDescr.0] CMD EXITCODE [0] CMD RUNTIME [0.0245s] STDOUT[ FreeBSD sn23844.bcricwh.lan 10.0-RELEASE-p11 FreeBSD 10.0-RELEASE-p11 #0: Mon Jan 8 09:55:45 CST 2018 root@es-vb100-1:/work/buildmaster/r07.02.31/R07.02.31.003/07_02_31_003/work/buildmaster/r07.02.31/R07.02.31.003/src/sys/COMPELLENT amd64 ] SNMP STATUS [TRUE] CMD [/usr/bin/snmpget -v2c -c *** -Pu -Oqvn -m SNMPv2-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' sysObjectID.0] CMD EXITCODE [0] CMD RUNTIME [0.0294s] STDOUT[ .1.3.6.1.4.1.8072.3.2.8 ] SNMP STATUS [TRUE] CMD [/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' snmpEngineID.0] CMD EXITCODE [0] CMD RUNTIME [0.0135s] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS [FALSE] SNMP ERROR 1000 - Failed response SQL [SELECT * FROM `snmp_errors` WHERE `device_id` = '202' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'SNMP-FRAMEWORK-MIB' AND `oid` = 'snmpEngineID.0';] SQL RUNTIME [0.00052404s] SQL [UPDATE `snmp_errors` set `error_count` ='2300',`updated` ='1520010423' WHERE `error_id` = '21156'] SQL RUNTIME [0.06295705s] CMD [/usr/bin/snmpget -v2c -c *** -Pu -OQUv -m SNMP-FRAMEWORK-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp 'udp':'compellent.domain.lan':'161' snmpEngineTime.0] CMD EXITCODE [0] CMD RUNTIME [0.0218s] CMD EXITDELAY [10ms] STDOUT[ No Such Object available on this agent at this OID ] SNMP STATUS [FALSE] SNMP ERROR 1000 - Failed response SQL [SELECT * FROM `snmp_errors` WHERE `device_id` = '202' AND `error_code` = '1000' AND `snmp_cmd` = 'snmpget' AND `mib` = 'SNMP-FRAMEWORK-MIB' AND `oid` = 'snmpEngineTime.0';] SQL RUNTIME [0.00052905s] SQL [UPDATE `snmp_errors` set `error_count` ='2300',`updated` ='1520010423' WHERE `error_id` = '21157'] SQL RUNTIME [0.01589799s] Using SNMP Agent sysUpTime (106682 sec. => 1 day, 5h 38m 2s) RRD /home/observium/observium/rrd/compellent.domain.lan/uptime.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/uptime.rrd N:106682] RRD RUNTIME [0.0014s] RRD STDOUT [OK u:0.01 s:0.00 r:1.53] RRD_STATUS [TRUE] o Uptime 1 day, 5h 38m 2s o Last reboot 2018-03-01 03:29:01 /home/observium/observium/includes/polling/system.inc.php:296 array( [use] => string(9) "sysUpTime" [sysUpTime] => int(106682) [uptime] => int(106682) [formatted] => string(16) "1 day, 5h 38m 2s" [message] => string(26) "Using SNMP Agent sysUpTime" [previous] => string(6) "106486" [diff] => int(-196) [last_rebooted] => string(10) "1519903741" [rebooted] => int(0) ) o sysObjectID .1.3.6.1.4.1.8072.3.2.8 o snmpEngineID o sysDescr FreeBSD sn23844.bcricwh.lan 10.0-RELEASE-p11 FreeBSD 10.0-RELEASE-p11 #0: Mon Jan 8 09:55:45 CST 2018 root@es-vb100-1:/work/buildmaster/r07.02.31/R07.02.31.003/07_02_31_003/work/buildmaster/r07.02.31/R07.02.31.003/src/sys/COMPELLENT amd64 o sysName sc8000-01.bcchr.ca o Location SQL [SELECT * FROM `devices_locations` WHERE `device_id` = '202'] SQL RUNTIME [0.00018406s] o Module time 0.2598s including: includes/polling/os.inc.php Module Start: os ##### CMD [/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m COMPELLENT-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell 'udp':'compellent.domain.lan':'161' productIDVersion.0] CMD EXITCODE [1] CMD RUNTIME [0.0291s] STDOUT[ ] STDERR[ MIB search path: /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell Cannot find module (COMPELLENT-MIB): At line 0 in (none) productIDVersion.0: Unknown Object Identifier (Sub-id not found: (top) -> productIDVersion) ] SNMP STATUS [FALSE] SNMP ERROR 996 - MIB or oid not found CMD [/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m COMPELLENT-MIB -M /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell 'udp':'compellent.domain.lan':'161' scEnclModel.1] CMD EXITCODE [1] CMD RUNTIME [0.0151s] STDOUT[ ] STDERR[ MIB search path: /home/observium/observium/mibs/rfc:/home/observium/observium/mibs/net-snmp:/home/observium/observium/mibs/dell Cannot find module (COMPELLENT-MIB): At line 0 in (none) scEnclModel.1: Unknown Object Identifier (Sub-id not found: (top) -> scEnclModel) ] SNMP STATUS [FALSE] SNMP ERROR 996 - MIB or oid not found o OS Poller Generic o Hardware <empty> o Version <empty> o Features <empty> o Serial <empty> o Asset <empty> o Module time 0.0575s compellent.domain.lan [202] completed poller modules at 2018-03-02 09:07:03 ##### o Graphs [checked] ping, ping_snmp, uptime o Poller time 1.6206 seconds Updating compellent.domain.lan - > $update_array /home/observium/observium/includes/polling/functions.inc.php:790 array( [uptime] => int(106682) [last_polled] => array( [0] => string(5) "NOW()" ) [last_polled_timetaken] => double(1.6206) ) SQL [UPDATE `devices` set `uptime` ='106682',`last_polled` =NOW(),`last_polled_timetaken` ='1.6206' WHERE `device_id` = '202'] SQL RUNTIME [0.01773500s] o Updated Data uptime, last_polled, last_polled_timetaken SQL [UPDATE `alert_table` set `state` ='\{\"metrics\":{\"device_status\":\"1\"}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked` ='1520010423',`last_ok` ='1520010423' WHERE `alert_table_id` = '611'] SQL RUNTIME [0.03182602s] RRD /home/observium/observium/rrd/compellent.domain.lan/alert-611.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/alert-611.rrd N:1:1] RRD RUNTIME [0.0013s] RRD STDOUT [OK u:0.01 s:0.00 r:1.67] RRD_STATUS [TRUE] SQL [UPDATE `alert_table` set `state` ='\{\"metrics\":{\"device_rebooted\":0}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked` ='1520010423',`last_ok` ='1520010423' WHERE `alert_table_id` = '612'] SQL RUNTIME [0.01889801s] RRD /home/observium/observium/rrd/compellent.domain.lan/alert-612.rrd already exists - no need to create. RRD CMD [update /home/observium/observium/rrd/compellent.domain.lan/alert-612.rrd N:1:1] RRD RUNTIME [0.0014s] RRD STDOUT [OK u:0.01 s:0.00 r:1.70] RRD_STATUS [TRUE]   SQL [DELETE FROM `observium_processes` WHERE `process_pid` = '64714' AND `process_name` = 'poller.php' AND `device_id` = '202'] SQL RUNTIME [0.02134204s] ./poller.php: compellent.domain.lan - 1 devices polled in 1.838 secs Completed polling run at 2018-03-02 09:07:03 ##### NOTE, $config ['snmp'] ['hide_auth'] is set to TRUE, snmp community and snmp v3 auth hidden from debug output. o Devices Polled 1 o Poller Time 1.838 secs o Memory usage 13.5MB (peak: 13.5MB) o MySQL Usage Insert [1/1.171s] Update [5/0.151s] Delete [1/0.022s] Cell [4/0.004s] Row [11/0.012s] Rows [10/0.011s] Col [0/0s] (1.371s 74.591%) o RRDTool Usage update [6/0.008s] (0.008s 0.412%) o SNMP Usage snmpget [8/0.215s] (0.215s 11.676%)

            I meant -m os

            adama Adam Armstrong added a comment - I meant -m os

            People

              adama Adam Armstrong
              darylrbcchr Daryl Roche
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: