Uploaded image for project: 'Puppet'
  1. Puppet
  2. PUP-9652

Delete acceptance tests with 'audit:delete' tag

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Normal
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: PUP 5.5.17, PUP 6.4.4, PUP 6.10.0
    • Component/s: None
    • Labels:
      None
    • Template:
    • Acceptance Criteria:
      Hide

      Given a checkout of puppet
      And I am in the acceptance directory
      When I run bundle exec rake ci:test:aio OPTIONS='--preserve-hosts=always --test-tag-or='audit:delete' SHA=latest RELEASE_STREAM=puppet6 HOSTS=redhat7-64ma
      Then all tests should be skipped due to the lack of matching low risk tests.

      Show
      Given a checkout of puppet And I am in the acceptance directory When I run bundle exec rake ci:test:aio OPTIONS='--preserve-hosts=always --test-tag-or='audit:delete' SHA=latest RELEASE_STREAM=puppet6 HOSTS=redhat7-64ma Then all tests should be skipped due to the lack of matching low risk tests.
    • Team:
      Coremunity
    • Sprint:
      Platform Core KANBAN
    • Release Notes:
      Not Needed
    • Release Notes Summary:
      This only changes tests
    • QA Risk Assessment:
      Needs Assessment

      Description

      As a puppet tester
      I want the acceptance test suite to mitigate risk commensurate to its cost of execution
      So that I can get test feedback faster
      Without increasing my product risk

      Acceptance tests are expensive.

      The puppet acceptance test suite was audited in July 2017 to evaluate the relative risk that each test mitigated. Several tests were discovered to duplicate lower level tests that were already in place. These tests were given an audit:delete beaker tag and should be removed from the test suite.

        Attachments

          Issue Links

            Activity

              jsd-sla-details-panel

                People

                • Assignee:
                  john.duarte John Duarte
                  Reporter:
                  john.duarte John Duarte
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Zendesk Support