Uploaded image for project: 'PuppetDB'
  1. PuppetDB
  2. PDB-3467

possible memory leak in reports querying (maybe querying in general)

    Details

    • Template:
    • Team:
      Systems Engineering
    • Story Points:
      3
    • Sprint:
      PuppetDB 2017-04-19, PuppetDB 2017-05-03
    • Release Notes:
      Bug Fix
    • Release Notes Summary:
      Hide
      PuppetDB was using more memory than necessary when creating query results, which could occasionally result in out-of-memory errors when performing queries with very large result sets. This fix should eliminate the errors and reduce PuppetDB's overall memory footprint.
      Show
      PuppetDB was using more memory than necessary when creating query results, which could occasionally result in out-of-memory errors when performing queries with very large result sets. This fix should eliminate the errors and reduce PuppetDB's overall memory footprint.
    • QA Risk Assessment:
      Needs Assessment

      Description

      Using the dataset here, which is from my install at home

      https://drive.google.com/drive/folders/0B324sr-dZ3nLfmhkaFdrT3B3ck1Cd2k2QmxISWFzdXJxcWo5S1JucS1nRlNqYzFBeHZHcTA

      I can cause PDB to OOM on a 256mb heap by issuing

      curl -X GET http://localhost:8080/pdb/query/v4/reports > /dev/null
      

      The dataset has about 5800 reports in it, so that should not happen. I haven't dug around to see if there are any super huge reports in there, but I doubt there's anything outside the bounds of normal.

      The response appears to stream out of the database, since results start coming pretty much immediately. I haven't done any digging beyond that.

      edit:
      This is on a centos 7 vm running the latest PDB promoted to PE (along with the rest of the PE services). It has 6 gigs of ram and two vcpus. The underlying system is fairly quiet. Note that 256 mb is the default heap for pe-puppetdb.

        Attachments

          Activity

            jsd-sla-details-panel

              People

              • Assignee:
                russell.mull Russell Mull
                Reporter:
                wyatt Wyatt Alt
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: