Uploaded image for project: 'PuppetDB'
  1. PuppetDB
  2. PDB-3467

possible memory leak in reports querying (maybe querying in general)

    XMLWordPrintable

    Details

    • Template:
    • Team:
      Systems Engineering
    • Story Points:
      3
    • Sprint:
      PuppetDB 2017-04-19, PuppetDB 2017-05-03
    • Release Notes:
      Bug Fix
    • Release Notes Summary:
      Hide
      PuppetDB was using more memory than necessary when creating query results, which could occasionally result in out-of-memory errors when performing queries with very large result sets. This fix should eliminate the errors and reduce PuppetDB's overall memory footprint.
      Show
      PuppetDB was using more memory than necessary when creating query results, which could occasionally result in out-of-memory errors when performing queries with very large result sets. This fix should eliminate the errors and reduce PuppetDB's overall memory footprint.
    • QA Risk Assessment:
      Needs Assessment

      Description

      Using the dataset here, which is from my install at home

      https://drive.google.com/drive/folders/0B324sr-dZ3nLfmhkaFdrT3B3ck1Cd2k2QmxISWFzdXJxcWo5S1JucS1nRlNqYzFBeHZHcTA

      I can cause PDB to OOM on a 256mb heap by issuing

      curl -X GET http://localhost:8080/pdb/query/v4/reports > /dev/null
      

      The dataset has about 5800 reports in it, so that should not happen. I haven't dug around to see if there are any super huge reports in there, but I doubt there's anything outside the bounds of normal.

      The response appears to stream out of the database, since results start coming pretty much immediately. I haven't done any digging beyond that.

      edit:
      This is on a centos 7 vm running the latest PDB promoted to PE (along with the rest of the PE services). It has 6 gigs of ram and two vcpus. The underlying system is fairly quiet. Note that 256 mb is the default heap for pe-puppetdb.

        Attachments

          Activity

            People

            Assignee:
            russell.mull Russell Mull
            Reporter:
            wyatt Wyatt Alt
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Zendesk Support