[SystemSafety] Data on Proof effectiveness from real projects

[Steve Tockey]

Paul,
Of course, I agree 100%.

What's your source for the 44% number? I'm very interested in that kind of
data. My source says 56% of defects are in requirements and 27% are in
design. Only 7% are coding. The remaining 10% are defects logged against
other things: test cases, test plans, project plans, etc.

The source of this data is:

Gary Mogyorodi, ³What is Requirements-Based Testing?², Crosstalk, March,
2003



-- steve



-----Original Message-----
From: "paul_e.bennett at topmail.co.uk" <paul_e.bennett at topmail.co.uk>
Date: Saturday, April 2, 2016 12:10 AM
To: Steve Tockey <Steve.Tockey at construx.com>, Bev Littlewood
<bev.littlewood.1 at city.ac.uk>, David MENTRE <dmentre at linux-france.org>
Cc: "systemsafety at lists.techfak.uni-bielefeld.de"
<systemsafety at lists.techfak.uni-bielefeld.de>
Subject: Re: [SystemSafety] Data on Proof effectiveness from real projects

On 02/04/2016 at 6:38 AM, "Steve Tockey" <Steve.Tockey at construx.com> wrote:
>
>Bev wrote:
>
>"This is indeed interesting. But what was the the definition of
>³efficiency of fault detection² here? Finding the most faults for
>a given outlay of effort? Maximising the chance of finding all
>faults? I can imagine other definitions."
>
>Generally speaking, efficiency is looking at investment per unit
>of work done. In other words, increasing efficiency means that the
>same work is done at lower investment‹the same (number of?)
>defects are found for a lower investment. Maximizing the chance of
>finding defects would be an issue of effectiveness. Effectiveness
>is looking at the rate at which the job is done correctly (I.e., a
>defect is found, not missed). One needs to look at both efficiency
>and effectiveness of processes to make a fair comparison.

When the largest proportion (44%) of the defects occur within the
specification phase it should be obvious where defect removal should
be most concentrated.

Regards

Paul E. Bennett IEng MIET
Systems Engineer

-- 
********************************************************************
Paul E. Bennett IEng MIET.....<email://Paul_E.Bennett@topmail.co.uk>
Forth based HIDECS Consultancy.............<http://www.hidecs.co.uk>
Mob: +44 (0)7811-639972
Tel: +44 (0)1392-426688
Going Forth Safely ..... EBA. www.electric-boat-association.org.uk..
********************************************************************


-------------- next part --------------
A non-text attachment was scrubbed...
Name: default.xml
Type: application/xml
Size: 3222 bytes
Desc: default.xml
URL: <https://lists.techfak.uni-bielefeld.de/mailman/private/systemsafety/attachments/20160402/66d20ae3/attachment.xml>