Uploaded image for project: 'Observium'
  1. Observium
  2. OBS-3981

Significant increase in poller time after update from r11678 to r11831

Details

    • Bug
    • Resolution: Fixed
    • Major
    • None
    • Enterprise Edition
    • Poller
    • Debian Buster

    Description

      After the latest stable update we have seen significant increase in poller times to Juniper MX104 devices. Before the upgrade the poller took about 100 seconds to complete and after the upgrade it takes about 260 seconds. 

      I made rollback to previous release (r11678) and the poller times are down to what they used to be. 

      Juniper MX104 routers are running version 19.4R1.10

      Attachments

        Activity

          [OBS-3981] Significant increase in poller time after update from r11678 to r11831
          milton@valvesoftware.com Milton Ngan added a comment -

          Related issues/data

          Large QFX virtual chassis fabrics (>2 members) are seeing jumps in polling times after ports_separate_walk was forced on for JUNOS after 17.x (r11719). Will test again by forcing ports_separate_walk enabled to see if that helps in this case. Small QFX Virtual Chassis (2 members) actually improved performance with ports_separate_walk disabled. 

          Enabling ports_separate_walk lets us work around a bug with JUNOS EVO 20.4R3 on PTX1000[13] where GET'ing multiple OIDs in a single request causes some counters not to increment between polls. 

          milton@valvesoftware.com Milton Ngan added a comment - Related issues/data Large QFX virtual chassis fabrics (>2 members) are seeing jumps in polling times after ports_separate_walk was forced on for JUNOS after 17.x (r11719). Will test again by forcing ports_separate_walk enabled to see if that helps in this case. Small QFX Virtual Chassis (2 members) actually improved performance with ports_separate_walk disabled.  Enabling ports_separate_walk lets us work around a bug with JUNOS EVO 20.4R3 on PTX1000 [13] where GET'ing multiple OIDs in a single request causes some counters not to increment between polls. 
          jsalo Jari Salo added a comment -

          Tested the fix and it I can confirm it's working.

          jsalo Jari Salo added a comment - Tested the fix and it I can confirm it's working.
          landy Mike Stupalov added a comment -

          Should be fixed after r11842.

          landy Mike Stupalov added a comment - Should be fixed after r11842.
          jsalo Jari Salo added a comment -

          I made the upgrade to the latest again to get the info. The affected module It seems to be ports -> IF-MIB. It's polling time rose from 77s to 223s. I also attached screenshots before and after the update.

          jsalo Jari Salo added a comment - I made the upgrade to the latest again to get the info. The affected module It seems to be ports -> IF-MIB. It's polling time rose from 77s to 223s. I also attached screenshots before and after the update.
          landy Mike Stupalov added a comment -

          And better if you contact me in Discord channel for quick tests and responces:
          https://discord.gg/GjpNXKWm8W
          Nick: landy

          landy Mike Stupalov added a comment - And better if you contact me in Discord channel for quick tests and responces: https://discord.gg/GjpNXKWm8W Nick: landy
          landy Mike Stupalov added a comment -

          For Enterprise Edition please prefer support@observium.org address.

          landy Mike Stupalov added a comment - For Enterprise Edition please prefer support@observium.org address.
          landy Mike Stupalov added a comment -

          Check please which exactly module increased polling time (Device - Performance Data - Poller Modules).

          landy Mike Stupalov added a comment - Check please which exactly module increased polling time (Device - Performance Data - Poller Modules).

          People

            landy Mike Stupalov
            jsalo Jari Salo
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: