Uploaded image for project: 'Observium'
  1. Observium
  2. OBS-4941

Issue with cisco nexus/fex interface counters

Details

    • Vendor Bug
    • Resolution: Won't Fix
    • Major
    • None
    • Professional Edition
    • Graphs
    • None

    Description

      Hello

       

      For some reason observium doesn’t display graphs for some interfaces in cisco nexus devices.

      I can see everything up to Ethernet110/1/48 and nothing after that in observium. But in other monitoring software there is no such issue.

      I have some phantom FEX interfaces 114/1/1-48, 164/1/1-164/1/32, 198/1/1-198/1/16 and 199/1/1-199/1/16 that I cannot get rid of.

      It seems that the problem starts from from where the phantom interfaces first start (Eth114/1/1), but I am not sure if these have anything to do with it.

      Could you please help me with this issue?
      Please see the screenshots and files also

      Attachments

        1. nexus1 output.txt
          64 kB
        2. nexus1 poller partial output.txt
          103 kB
        3. nexus2 output.txt
          63 kB
        4. nexus2 poller partial output.txt
          101 kB
        5. proof.PNG
          proof.PNG
          279 kB
        6. proof2.PNG
          proof2.PNG
          281 kB

        Activity

          [OBS-4941] Issue with cisco nexus/fex interface counters
          landy Mike Stupalov added a comment -

          As already discussed in Discord, this is firmware issue.

          Device do not report counters for this interfaces in snmpwalks:

          $ grep '\.528614912 ' putty.log
          		 
          ifIndex.528614912 = 528614912
          		 
          ifDescr.528614912 = Ethernet131/1/25
          		 
          ifType.528614912 = ethernetCsmacd
          		 
          ifMtu.528614912 = 9216
          		 
          ifSpeed.528614912 = 4294967295
          		 
          ifPhysAddress.528614912 = e0:ac:f1:bb:cc:1a
          		 
          ifAdminStatus.528614912 = up
          		 
          ifOperStatus.528614912 = up
          		 
          ifLastChange.528614912 = 0:0:00:00.00
          		 
          ifOutQLen.528614912 = 0
          		 
          ifSpecific.528614912 = zeroDotZero
          		 
          ifName.528614912 = Ethernet131/1/25
          		 
          ifLinkUpDownTrapEnable.528614912 = enabled
          		 
          ifHighSpeed.528614912 = 10000
          		 
          ifPromiscuousMode.528614912 = false
          		 
          ifConnectorPresent.528614912 = true
          		 
          ifAlias.528614912 = 1490-SEMETRON

          (I rechecked snmpdump and there same - no counters)

          • better write to Cisco TAC for resolve issue.
            snmpbulkwalk -Cr'100' -t '60' -r '3' -v3 -l 'authPriv' -n '' -x *** -X *** -a *** -A *** -u *** -Pud -OQUs -m IF-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'nexus1':'161' ifEntry
            snmpbulkwalk -Cr'100' -t '60' -r '3' -v3 -l 'authPriv' -n '' -x *** -X *** -a *** -A *** -u *** -Pud -OQUs -m IF-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'nexus1':'161' ifXEntry
            this is which command used for polling interfaces (your auth is hidden by ***)
          • you can try for use separate oids walk feature, but this is probably increase polling time and not sure if really fix your issue:
            goto device properties -> modules -> separate_walk (set enabled)
          landy Mike Stupalov added a comment - As already discussed in Discord, this is firmware issue. Device do not report counters for this interfaces in snmpwalks: $ grep '\.528614912 ' putty.log ifIndex.528614912 = 528614912 ifDescr.528614912 = Ethernet131/1/25 ifType.528614912 = ethernetCsmacd ifMtu.528614912 = 9216 ifSpeed.528614912 = 4294967295 ifPhysAddress.528614912 = e0:ac:f1:bb:cc:1a ifAdminStatus.528614912 = up ifOperStatus.528614912 = up ifLastChange.528614912 = 0:0:00:00.00 ifOutQLen.528614912 = 0 ifSpecific.528614912 = zeroDotZero ifName.528614912 = Ethernet131/1/25 ifLinkUpDownTrapEnable.528614912 = enabled ifHighSpeed.528614912 = 10000 ifPromiscuousMode.528614912 = false ifConnectorPresent.528614912 = true ifAlias.528614912 = 1490-SEMETRON (I rechecked snmpdump and there same - no counters) better write to Cisco TAC for resolve issue. snmpbulkwalk -Cr'100' -t '60' -r '3' -v3 -l 'authPriv' -n '' -x *** -X *** -a *** -A *** -u *** -Pud -OQUs -m IF-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'nexus1':'161' ifEntry snmpbulkwalk -Cr'100' -t '60' -r '3' -v3 -l 'authPriv' -n '' -x *** -X *** -a *** -A *** -u *** -Pud -OQUs -m IF-MIB -M /opt/observium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'nexus1':'161' ifXEntry this is which command used for polling interfaces (your auth is hidden by ***) you can try for use separate oids walk feature, but this is probably increase polling time and not sure if really fix your issue: goto device properties -> modules -> separate_walk (set enabled)
          kaupo@wavecom.ee Kaupo Ehtnurm added a comment -

          I've uploaded the file for nexus1.wavecom.ee

          kaupo@wavecom.ee Kaupo Ehtnurm added a comment - I've uploaded the file for nexus1.wavecom.ee
          bot Observium Bot added a comment -

          General questions and device support can be discussed in our Discord channel, click here to join.

          Please make and attach additional information about the device:

          • full snmp dump from device: 

            snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -Ih -ObentxU <hostname> .1 > myagent.snmpwalk
            		 
            snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -Ih -ObentxU <hostname> .1.3.6.1.4.1 >> myagent.snmpwalk

            If device not support SNMP version 2c, replace -v2c with -v1.

          • If you have problems with discovery or poller processes, please do and attach these debugs: 

            ./discovery.php -d -h <device>
            		 
            ./poller.php -d -h <device>

          • additionally attach device and/or vendor specific MIB files

          This comment is added automatically.

          bot Observium Bot added a comment - General questions and device support can be discussed in our Discord channel, click here to join . Please make and attach additional information about the device: full snmp dump from device: snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -Ih -ObentxU <hostname> .1 > myagent.snmpwalk snmpwalk -v2c -c <community> -t 3 -Cc --hexOutputLength=0 -Ih -ObentxU <hostname> .1.3.6.1.4.1 >> myagent.snmpwalk If device not support SNMP version 2c, replace -v2c with -v1. If you have problems with discovery or poller processes, please do and attach these debugs: ./discovery.php -d -h <device> ./poller.php -d -h <device> additionally attach device and/or vendor specific MIB files This comment is added automatically.

          People

            landy Mike Stupalov
            kaupo@wavecom.ee Kaupo Ehtnurm
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: