Scribd Logo
Upload

Welcome to Scribd!

  • Template To Create Test Metrics

    Uploaded by

    Lrv Ramana
    80 views6 pages
    The document contains data from multiple test cycles measuring defect ratios, severity indexes, and test coverage. It shows that over 10 test cycles: - The defect to remark ratio decreased from 40% to 95% as testing progressed and more defects were found and resolved. - The defect severity index also decreased from 5.5 to 1.25, indicating that later defects found were less severe on average. - The mean time to find defects initially was low but increased as lower severity defects took longer to discover later in testing. - Desired test coverage exceeded actual coverage for requirements and code coverage but fell short for testing documented versus executed test cases and planned versus executed test cases.

    Original Description:

    Original Title

    Template to create test metrics

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    XLS, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document contains data from multiple test cycles measuring defect ratios, severity indexes, and test coverage. It shows that over 10 test cycles: - The defect to remark ratio decreased from 40% to 95% as testing progressed and more defects were found and resolved. - The defect severity index also decreased from 5.5 to 1.25, indicating that later defects found were less severe on average. - The mean time to find defects initially was low but increased as lower severity defects took longer to discover later in testing. - Desired test coverage exceeded actual coverage for requirements and code coverage but fell short for testing documented versus executed test cases and planned versus executed test cases.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as XLS, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    80 views6 pages

    Template To Create Test Metrics

    Uploaded by

    Lrv Ramana
    The document contains data from multiple test cycles measuring defect ratios, severity indexes, and test coverage. It shows that over 10 test cycles: - The defect to remark ratio decreased from 40% to 95% as testing progressed and more defects were found and resolved. - The defect severity index also decreased from 5.5 to 1.25, indicating that later defects found were less severe on average. - The mean time to find defects initially was low but increased as lower severity defects took longer to discover later in testing. - Desired test coverage exceeded actual coverage for requirements and code coverage but fell short for testing documented versus executed test cases and planned versus executed test cases.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as XLS, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 6

    Defect To Remark Ratio

    40%
    45%
    55%
    65%
    80%
    50%
    70%
    80%
    95%
    95%

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10

    5.5
    5.5
    5
    4.2
    3.8
    3
    2.2
    2
    1.75
    1.25

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10

    0.05
    0.1
    0.15
    0.15
    0.2
    0.3
    0.35
    0.5
    0.5
    0.55

    Defect To Remark Ratio

    Percentage

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10

    100%
    90%
    80%
    70%
    60%
    50%
    40%
    30%
    20%
    10%
    0%

    40%

    Defect Severity Index

    65%

    55%

    45%

    Severity Index

    Defect Severity Index


    6
    5
    4
    3
    2
    1
    0

    5.5

    5.5

    5
    4.2

    3.8

    4
    Test Cycles

    Mean Time to Find a Defect

    Mean Time (in hours)

    Mean Time to Find a Defect


    0.6
    0.5
    0.4
    0.3
    0.2
    0.1
    0

    0.2

    0.15
    0.05

    0.15

    0.1
    2

    4
    Test Cycles

    Test Coverage
    100%
    100%
    100%
    100%

    Actual
    70%
    50%
    90%
    100%

    Test Coverage
    Desired

    Percentage of Coverage

    Desired
    Requirements Coverage
    Code Coverage
    Documented vs Executed Test cases
    Planned vs Executed Test cases

    250%
    200%
    150%
    100%
    50%
    0%

    70%

    50%

    100%

    100%

    Requirements Code Coverage

    Percentage of Coverage

    0%
    Requirements Code Coverage
    Coverage

    Type of Coverage

    Defect To Remark Ratio

    80%
    70%

    65%

    55%

    80%

    95% 95%

    50%

    10

    Test Cycles

    Defect Severity Index

    3.8

    2.2

    1.75

    1.25

    10

    12

    Test Cycles

    Mean Time to Find a Defect


    0.5
    0.35
    0.2

    0.55

    0.5

    0.3

    10

    12

    Test Cycles

    Test Coverage
    Desired

    50%
    100%

    Actual

    90%

    100%

    100%

    100%

    Code Coverage Documented vs

    Planned vs

    Code Coverage Documented vs Planned vs


    Executed Test Executed Test
    cases
    cases
    Type of Coverage

    S1
    S2
    S3
    S4

    10
    5
    3
    0

    5
    15
    30
    100
    150

    Defect
    Severity
    S1
    S2
    S3
    S4
    Severity
    Index

    50
    75
    90
    0
    215
    1.43

    Number of Defects
    Cycle 1
    Cycle 2
    (# of defects)
    (# of defects)
    5
    5
    10
    15
    50
    30
    100
    100
    1.52

    1.43

    4
    4
    42
    27
    77

    40
    20
    126
    0
    186
    2.42

    0
    0
    75
    2
    77

    Defect
    Severity
    S1
    S2
    S3
    S4
    Severity
    Index

    0
    0
    225
    0
    225
    2.92

    Severity of Defects
    Cycle 1
    Cycle 2
    (# of defects)
    (# of defects)
    4
    0
    4
    0
    42
    75
    27
    2
    2.42

    2.92

    You might also like