[SystemSafety] AI and the virtuous test Oracle

[Andrew Banks]

What is often over-looked is the technology that underpins the AI/ML system

Some recent work highlighted that a worrying proportion of *in the wild*
systems are COTS Linux boxes running a Python-script - yet these form the
heart of the safety-critical system.


Andrew


-----Original Message-----
From: systemsafety <systemsafety-bounces at lists.techfak.uni-bielefeld.de> On
Behalf Of Les Chambers
Sent: Thursday, June 22, 2023 12:15 AM
To: systemsafety at lists.techfak.uni-bielefeld.de
Subject: [SystemSafety] AI and the virtuous test Oracle

Hi All

I find myself reflecting on what will become of us. 
As systems engineering best practice is overrun by AI.

{snip}

The intelligence resides in terabytes of data, perceptrons and millions of
weighting parameters. All are gathered by automated means. Not subject to
human review.

{snip}

Would anyone care to riff on this?

Les