Uploaded image for project: 'Puppet'
  1. Puppet
  2. PUP-9813

Performance of unpacking modules is extremely slow

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Normal
    • Resolution: Duplicate
    • Affects Version/s: PUP 4.10.12, PUP 5.5.14, PUP 6.6.0
    • Fix Version/s: None
    • Component/s: Modules
    • Labels:
      None
    • Template:
      PUP Bug Template
    • Acceptance Criteria:
      Hide

       Extraction of downloaded modules should be about the same performance as system tar xzvf command. It might be at most 2x times slower then system command, but preferably should be about the same.

      Show
       Extraction of downloaded modules should be about the same performance as system tar xzvf command. It might be at most 2x times slower then system command, but preferably should be about the same.
    • Team:
      Coremunity
    • Method Found:
      Needs Assessment
    • QA Risk Assessment:
      Needs Assessment

      Description

      Puppet Version: any
      Puppet Server Version: any
      OS Name/Version: any

      Installing modules from Puppet Forge is extremely slow. I have found a culprit. It is a

      Puppet::ModuleTool::Tar::Mini

      implementation.

      The unpack is 100x times slower then executing a tar xzvf system command!

      Steps to reproduce:

      Install a module from Puppet Forge and measure a time:

      time puppet module install puppetlabs-stdlib --version 4.25.1

      Then execute:

      time bash -c 'curl https://forge.puppet.com/v3/files/puppetlabs-stdlib-4.25.1.tar.gz -o puppetlabs-stdlib-4.25.1.tar.gz && tar xzvf puppetlabs-stdlib-4.25.1.tar.gz'

      Desired Behavior:

      Extraction of downloaded modules should be about the same performance as system tar xzvf command. It might be at most 2x times slower then system command, but preferably should be about the same.

      Temporal solution:

      To install modules faster i propose to switch to Gnu implementation as a first choice. Al least until Minitar can be much faster.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              cardil Chris Suszynski
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Zendesk Support

                    Time Tracking

                    Estimated:
                    Original Estimate - 2 days
                    2d
                    Remaining:
                    Remaining Estimate - 2 days
                    2d
                    Logged:
                    Time Spent - Not Specified
                    Not Specified