Uploaded image for project: 'PuppetDB'
  1. PuppetDB
  2. PDB-2428

Allow Setting The Interval for Each of The Garbage Collection Queries Individually

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Normal
    • Resolution: Unresolved
    • Affects Version/s: PDB 3.2.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Template:
    • CS Priority:
      Normal
    • CS Frequency:
      3 - 25-50% of Customers
    • CS Severity:
      3 - Serious
    • CS Business Value:
      4 - $$$$$
    • CS Impact:
      Hide
      This would be very nice to help large customers improve performance. Right now this is worked around with the npwalker/puppetdb_gc which disables the gc interval and then runs each gc out of chron.

      It's unclear the difference this does, but when we are helping large scale customers a little bit can make a difference.
      Show
      This would be very nice to help large customers improve performance. Right now this is worked around with the npwalker/puppetdb_gc which disables the gc interval and then runs each gc out of chron. It's unclear the difference this does, but when we are helping large scale customers a little bit can make a difference.

      Description

      Currently we have gc-interval which can be tuned up and down, however, it runs a few different queries some of which I want to run more often and some I'd like to run very infrequently.

      I want to run the query to remove reports frequently say every 10 minutes but I don't want all of the other queries to run because in my environment the other queries don't actually delete anything but do take a long time to complete and use up resources.

      I'd like to be able to specify a frequency to run each of the different GC queries so that I can tune the performance of my puppetdb database based on the specifics of my environment.

      If I'm using node-purge-ttl and I add and remove nodes a lot I may wish to have that query run more frequently.

      For other queries that rarely remove any data, I'd like to run them very infrequently maybe once a week or month.

        Attachments

          Issue Links

          is supported by

          Bug - A problem which impairs or prevents the functions of the product. PDB-3695 Package GC spends a lot of time when there's probably very little to clean up

          • Normal - Regular issue, some loss of functionality under specific circumstances.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. PDB-3173 Add batch limit to admin endpoint node-purge command

          • Normal - Regular issue, some loss of functionality under specific circumstances.
          • Closed

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              nick.walker Nick Walker
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:

                  Zendesk Support