Uploaded image for project: 'Observium'
  1. Observium
  2. OBS-4884

Data retention in MySQL for billing data

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • None
    • Professional Edition
    • Billing
    • Enterprise Linux 7, 16 core Intel(R) Xeon(R) CPU E5-2637 with 64GB memory

    Description

      We've been running billing for a few years now for about 150 bills. The DB is growing and the bill_data table is responsible for most of the growth. I can't find anything in the Global settings for this and the housekeeping.php script doesn't seem to address this either. 

      The billing calculation cronjob was taking more then an hour so we needed to delete old bills and run optimize on the DB to speed this up a bit.

      This improvement would be very much appreciated. 

      Attachments

        Activity

          [OBS-4884] Data retention in MySQL for billing data

          I've switched this to -x because seemingly -t was used at some point in the past (though it's not now), and is already in the default cron.

          adama Adam Armstrong added a comment - I've switched this to -x because seemingly -t was used at some point in the past (though it's not now), and is already in the default cron.

          I've added a -t option to the housekeeping.php script that'll remove old entries from the bill_data table (but not the generated summaries, since they're once per month and don't take much space).

          It won't run as part of the -a option because I doubt anyone would want the same settings, and that would result in people losing data who didn't know it was going to happen, so it'll need another cron entry to run.

          adama Adam Armstrong added a comment - I've added a -t option to the housekeeping.php script that'll remove old entries from the bill_data table (but not the generated summaries, since they're once per month and don't take much space). It won't run as part of the -a option because I doubt anyone would want the same settings, and that would result in people losing data who didn't know it was going to happen, so it'll need another cron entry to run.

          People

            adama Adam Armstrong
            orvarbjarna Orvar Bjarnason
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: