Minor Description
I have 3 identical servers running Proxmox VE 6.3 conforming a Cluster.
Discovery.php fails to detect Node 1' OS and Proxmox and set it as Standar Linux. Also discovery takes too long to work.
Detection of Nodes 2 and 3 works great and the running time of discovery is considerably short than node 1
# /opt/observium/discovery.php -m os -h node1
|
|
|
___ _ _
|
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
|
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
|
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
|
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|
|
Observium Community Edition 21.10.11666
|
https://www.observium.org
|
|
|
##### Starting discovery run at 2021-10-26 16:26:22 #####
|
|
|
##### node1 [299] #####
|
|
|
o OS Type linux
|
o OS Group unix
|
o SNMP Version v3
|
o Last discovery 2021-10-26 16:02:11
|
o Last duration 13.01 seconds
|
|
|
##### Module Start: os #####
|
|
|
+-------------+--------------------------------------------------------------------------------------------+
|
| OID | |
|
+-------------+--------------------------------------------------------------------------------------------+
|
| sysDescr | Linux node1 5.4.78-2-pve #1 SMP PVE 5.4.78-2 (Thu, 03 Dec 2020 14:26:17 +0100) x86_64 |
|
| sysObjectID | .1.3.6.1.4.1.8072.3.2.10 |
|
+-------------+--------------------------------------------------------------------------------------------+
|
|
|
o Detect OS matched (linux: Linux):
|
+------+----------------------------------------------------+--+
|
| OID | Matched definition | |
|
+------+----------------------------------------------------+--+
|
| file | /opt/observium/includes/discovery/os/linux.inc.php | |
|
+------+----------------------------------------------------+--+
|
|
|
|
|
o Duration 13.2857s
|
|
|
##### node1 [299] completed discovery modules at 2021-10-26 16:26:35 #####
|
|
|
o Discovery time 13.2907 seconds
|
|
|
##### Finished discovery run at 2021-10-26 16:26:35 #####
|
|
|
o Devices Discovered 1
|
o Discovery Time 13.33 secs
|
o Memory usage 20MB (peak: 22.55MB)
|
o MySQL Usage Cell[2/0s] Row[4/0.001s] Rows[5/0.002s] Column[0/0s] Update[1/0.004s] Insert[1/0.004s] Delete[1/0.003s]
|
o RRDTool Usage
|
# /opt/observium/discovery.php -m os -h node2
|
|
|
___ _ _
|
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
|
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
|
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
|
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|
|
Observium Community Edition 21.10.11666
|
https://www.observium.org
|
|
|
##### Starting discovery run at 2021-10-26 16:30:55 #####
|
|
|
##### node2 [293] #####
|
|
|
o OS Type pve
|
o OS Group unix
|
o SNMP Version v3
|
o Last discovery 2021-10-26 16:01:04
|
o Last duration 0.13 seconds
|
|
|
##### Module Start: os #####
|
|
|
+-------------+--------------------------------------------------------------------------------------------+
|
| OID | |
|
+-------------+--------------------------------------------------------------------------------------------+
|
| sysDescr | Linux node2 5.4.78-2-pve #1 SMP PVE 5.4.78-2 (Thu, 03 Dec 2020 14:26:17 +0100) x86_64 |
|
| sysObjectID | .1.3.6.1.4.1.8072.3.2.10 |
|
+-------------+--------------------------------------------------------------------------------------------+
|
|
|
o Re-Detect OS matched (pve: Proxmox VE):
|
+-------------------+---------------------------+--------------------------------------------------------------------------------------------+
|
| OID | Matched definition | |
|
+-------------------+---------------------------+--------------------------------------------------------------------------------------------+
|
| sysObjectID | .1.3.6.1.4.1.8072.3.2.10 | .1.3.6.1.4.1.8072.3.2.10 |
|
| sysDescr | /^Linux .*\d\-pve | PVE / | Linux node2 5.4.78-2-pve #1 SMP PVE 5.4.78-2 (Thu, 03 Dec 2020 14:26:17 +0100) x86_64 |
|
| hrSWInstalledName | /^pve\-manager[\-_]\d/ | pve-manager-6.3-3 |
|
+-------------------+---------------------------+--------------------------------------------------------------------------------------------+
|
|
|
|
|
o Duration 0.1202s
|
|
|
##### node2 [293] completed discovery modules at 2021-10-26 16:30:55 #####
|
|
|
o Discovery time 0.1255 seconds
|
|
|
##### Finished discovery run at 2021-10-26 16:30:55 #####
|
|
|
o Devices Discovered 1
|
o Discovery Time 0.156 secs
|
o Memory usage 20MB (peak: 22.55MB)
|
o MySQL Usage Cell[2/0s] Row[4/0.001s] Rows[5/0.001s] Column[0/0s] Update[1/0.004s] Insert[1/0.004s] Delete[1/0.004s]
|
o RRDTool Usage
|
They have the same sysObjectID and sysDescr.
SNMP config is the same on all (managed by puppet). SNMPD service was restarted several times with no change in behavior of discovery.
BTW: when try to debug the output of discovery I get:
# /opt/observium/discovery.php -d -m os -h node
|
DEBUG!
|
DEFINITIONS loaded by: 0.0258241 ms
|
|
|
DEFINITIONS in memory: 15.2MB
|
|
|
|
|
SQL[PHP Parse error: syntax error, unexpected '?', expecting variable (T_VARIABLE) in /opt/observium_new/libs/Doctrine/SqlFormatter/SqlFormatter.php on line 37
|
|
|
Parse error: syntax error, unexpected '?', expecting variable (T_VARIABLE) in /opt/observium_new/libs/Doctrine/SqlFormatter/SqlFormatter.php on line 37
|
|
Attachments
Activity
Ok, this is still strange.
By unknown reason, your server stop respond with timeout on snmpbulkwalk.
We not seen before such troubles on any linux hosts.
Now I can only advise set different max-rep value (ie around 30) or complete disable snmpbulk by set maxrep to 0 (as you done for node1).
Hrm, you was set maxrep 100 manually before?
(we not use such value for linux hosts).
I think than this is main trouble for you, remove this value for devices (default is 10 and this value is quite enough for linux hosts).
Finally worked!!. Looking on the device's event log I found this error
ERROR! snmpbulkwalk exit by timeout. Try to decrease SNMP Max Repetitions on the device properties page or set to 0 to not use bulk snmp commands. (repeated 2 times)
|
Then setting "Max Repetitions" to 0 on device properties and triggering the discovery again it set the OS to PVE.
But still some issues, like:
node1: no storage discovery, vendor module detect brand.
node2: no vendor detected.
Behavior is strange...
Thanks for the quick reply!!
I've upgraded PHP and Debug now works! I uploaded the output of "discovery -d -m os -h node1"
I still need to see discovery debug.
Proxmox for detect os, required to fetch packages from device.
Not sure why, but seems here packages not fetched or required package not found.
That why I need to see debug, as minimum:
./discovery.php -d -m os -h node1
|
But for fix debug trouble, update your php on host to 7.2 or 7.4 pls.
Here you can read how upgrade php:
https://computingforgeeks.com/how-to-install-latest-php-on-debian/
Database Updated
# /opt/observium/discovery.php -u
|
|
|
___ _ _
|
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
|
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
|
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
|
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|
|
Observium Community Edition 21.10.11666
|
https://www.observium.org
|
|
|
-- Database is up to date.
|
-- Observium is up to date.
|
poller.php
# /opt/observium/poller.php -h node1
|
|
|
___ _ _
|
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
|
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
|
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
|
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|
|
Observium Community Edition 21.10.11666
|
https://www.observium.org
|
|
|
##### Starting polling run at 2021-10-26 16:52:18 #####
|
|
|
##### node1 [299] #####
|
|
|
o OS linux
|
o OS Group unix
|
o Last poll duration 49.39 seconds
|
o Last Polled 2021-10-26 16:50:51
|
o SNMP Version v3
|
o Device status Device is reachable by PING (0.31ms) and SNMP (18.96ms)
|
o Modules Excluded wmi, junose-atm-vp, cisco-ipsec-flow-monitor, cisco-remote-access-monitor, cisco-cef,
|
arista-software-ip-forwarding,cipsec-tunnels, cisco-cbqos, cisco-eigrp, cisco-vpdn, cisco-sla
|
o Modules Disabled wifi, ospf, lsp, fdb-table, toner, adsl, poe, fdbcount
|
o Modules Enabled system, os, unix-agent, ipmi, sensors, status, counter, processors, mempools, storage, netstats, ucd-mib, ipSystemStats,
|
ports,bgp-peers, printersupplies, ucd-diskio, p2p-radios, sla, pseudowires, mac-accounting, entity-physical,
|
applications,graphs, probes
|
|
|
##### Module Start: unix-agent #####
|
|
|
Observium UNIX Agent: execution time: 161ms
|
DEB Packages: ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
|
No include:
|
No include: Observium
|
No include: df
|
No include: mounts
|
No include: ps
|
No include: mem
|
No include: cpu
|
No include: uptime
|
No include: lnx_if:sep(58)
|
No include: tcp_conn_stats
|
No include: md
|
diskstats No include: kernel
|
No include: netctr
|
No include: postfix_mailq
|
No include: dpkg
|
|
|
Processes:
|
Sensors:
|
Virtual machines:
|
o Module time 0.1944s
|
|
|
##### Module Start: system #####
|
|
|
o SNMPv2-MIB
|
o Uptime 118 days, 4h 37m 23s
|
o Last reboot 2021-06-30 12:14:56
|
o Load average 2.54, 2.62, 2.54
|
o sysObjectID .1.3.6.1.4.1.8072.3.2.10
|
o snmpEngineID 80001F88806652E040E865786000000000
|
o sysDescr Linux node1 5.4.78-2-pve #1 SMP PVE 5.4.78-2 (Thu, 03 Dec 2020 14:26:17 +0100) x86_64
|
o sysName node1
|
o Location Unknown
|
o Module time 0.1288s
|
|
|
##### Module Start: os #####
|
|
|
o OS Poller Group
|
o Type Hypervisors
|
o Vendor Dell
|
o Hardware PowerEdge R740xd x86 [64bit]
|
o Version 5.4.78-2-pve
|
o Features Debian
|
o Serial
|
o Asset node1
|
|
|
o Module time 0.0899s
|
|
|
##### Module Start: ipmi #####
|
|
|
o Module time 0.0017s
|
|
|
##### Module Start: sensors #####
|
|
|
o Module time 0.0006s
|
|
|
##### Module Start: status #####
|
|
|
o Status Count 0
|
o Module time 0.0004s
|
|
|
##### Module Start: counter #####
|
|
|
o Module time 0.0002s
|
|
|
##### Module Start: processors #####
|
|
|
+-------+---------+-------+-------+
|
| Label | Type | Index | Usage |
|
+-------+---------+-------+-------+
|
| CPU | ucd-old | 0 | 5% |
|
+-------+---------+-------+-------+
|
|
|
o Module time 0.0333s
|
|
|
##### Module Start: mempools #####
|
|
|
+-----------------+--------------+-------+-------+--------+-------+--------+
|
| Label | Type | Index | Total | Used | Free | Perc |
|
+-----------------+--------------+-------+-------+--------+-------+--------+
|
| Physical Memory | UCD-SNMP-MIB | 0 | 188GB | 62.7GB | 125GB | 33.28% |
|
+-----------------+--------------+-------+-------+--------+-------+--------+
|
|
|
o Module time 0.0299s
|
|
|
##### Module Start: storage #####
|
|
|
o Module time 0.0004s
|
|
|
##### Module Start: netstats #####
|
|
|
o Ip Graphs netstat_ip netstat_ip_frag
|
o Icmp Graphs netstat_icmp netstat_icmp_info
|
o TCP Graphs netstat_tcp_stats netstat_tcp_segments netstat_tcp_currestab
|
o UDP Graphs netstat_udp_datagrams netstat_udp_errors
|
o SNMP Graphs netstat_snmp_stats netstat_snmp_packets
|
o Module time 0.2245s
|
|
|
##### Module Start: ucd-mib #####
|
|
|
o Module time 6.0341s
|
|
|
##### Module Start: ipSystemStats #####
|
|
|
o Collecting ipSystemStats
|
o Module time 6.0372s
|
|
|
##### Module Start: ports #####
|
|
|
o Caching Oids ifEntry ifXEntry
|
o ADSL-LINE-MIB
|
o EtherLike-MIB
|
o Q-BRIDGE-MIB dot1qVlanStaticUntaggedPorts
|
o IP-MIB IP-MIB ipIfStats
|
|
|
|
|
|
|
o Module time 36.2362s
|
|
|
##### Module Start: bgp-peers #####
|
|
|
o Module time 0.0266s
|
|
|
##### Module Start: printersupplies #####
|
|
|
o Module time 0.0003s
|
|
|
##### Module Start: ucd-diskio #####
|
|
|
o Module time 0.0005s
|
|
|
##### Module Start: p2p-radios #####
|
|
|
o Module time 0.0006s
|
|
|
##### Module Start: sla #####
|
|
|
o MIBs
|
o Module time 0.0004s
|
|
|
##### Module Start: pseudowires #####
|
|
|
o Module time 0.0004s
|
|
|
##### Module Start: mac-accounting #####
|
|
|
o MIBs
|
o Module time 0.0005s
|
|
|
##### Module Start: entity-physical #####
|
|
|
o Module time 0.0001s
|
|
|
##### Module Start: applications #####
|
|
|
o Module time 0.0004s
|
|
|
##### Module Start: graphs #####
|
|
|
o HOST-RESOURCES-MIB
|
o HOST-RESOURCES-MIB hrSystemProcesses hrSystemNumUsers
|
o Module time 0.0459s
|
|
|
##### node1 [299] completed poller modules at 2021-10-26 16:53:07 #####
|
|
|
o Graphs [checked] availability, ping, ping_snmp, agent, uptime, la, processor, mempool, netstat_ip, netstat_ip_frag, netstat_icmp,
|
netstat_icmp_info,netstat_tcp_stats, netstat_tcp_segments, netstat_tcp_currestab, netstat_udp_datagrams,
|
netstat_udp_errors,netstat_snmp_stats, netstat_snmp_packets, hr_processes, hr_users, poller_perf, pollersnmp_count,
|
pollersnmp_times,pollersnmp_errors_count, pollersnmp_errors_times, pollerdb_count, pollerdb_times,
|
pollermemory_perf
|
o Poller time 49.1574 seconds
|
o Updated Data uptime, last_polled, last_polled_timetaken, device_state
|
|
|
##### Completed polling run at 2021-10-26 16:53:07 #####
|
|
|
o Devices Polled 1
|
o Poller Time 49.18 secs
|
o Memory usage 22MB (peak: 22.55MB)
|
o MySQL Usage Insert[1/0.004s] Update[18/0.092s] Delete[1/0.004s] Cell[6/0.001s] Row[31/0.008s] Rows[69/0.014s] Col[4/0.001s]
|
Connect[1/0s](0.125s 0.254%)
|
o RRDTool Usage update[42/0.046s] (0.046s 0.094%)
|
o SNMP Usage snmpget[24/0.505s] errors[/0s] snmpwalk[8/48.244s] (48.75s 99.125%)
|
1. About error in debug - pls try upgrade php to any greater version than php7.0 (this already fixed in latest pro, but happened only on php7.0)
2. need discovery debug (how have you tried) or snmpdump as bot written from node1.
General questions and device support you always can discuss in our Discord channel, click here for connect.
Please make and attach additional information about the device:
- full snmp dump from device:
snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1 > myagent.snmpwalksnmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -ObentxU <hostname> .1.3.6.1.4.1 >> myagent.snmpwalkIf device not support SNMP version 2c, replace -v2c with -v1.
- If you have problems with discovery or poller processes, please do and attach these debugs:
./discovery.php -d -h <device>./poller.php -d -h <device>
- additionally attach device and/or vendor specific MIB files
This comment is added automatically.
For future releases snmpbulkwalk complete disabled in os detect.
Fixed in r11691.