[SystemSafety] AI Hallucination Cases

[Nick Tudor]

I was at a talk recently by the owner of AVG, Norton etc (can't remember
the company name).  He said that there is a lot of evidence now that
malicious actors are poisoning the LLM's, creating thousands of websites
with incorrect information (disinformation), bad use of language and are
also targetting the training for cyber security AI.  Use such open tools
with caution...

Nick Tudor
Tudor Associates Ltd
Mobile: +44(0)7412 074654
www.tudorassoc.com

*77 Barnards Green Road*
*Malvern*
*Worcestershire*
*WR14 3LR*
*Company No. 07642673*
*VAT No:116495996*

*www.aeronautique-associates.com <http://www.aeronautique-associates.com>*


On Wed, 16 Jul 2025 at 17:05, Derek M Jones <derek at knosof.co.uk> wrote:

> Peter,
>
> >> token prediction.
> >
> > A request for clarification. Are you referring to October 2022 and the
> release of ChatGPT?
> >
> > As I mentioned, LLMs "arrived" between one and two decades ago in
> computational linguistics. We were using them in the
>
> People have been doing stuff with word sequence probabilities since
> Shannon's famous 1948 paper "A Mathematical Theory of Communication"
>
> https://web.archive.org/web/20090216231139/http://plan9.bell-labs.com//cm//ms//what//shannonday//shannon1948.pdf
>
> When did LLMs arrive on the scene and when does a tool
> become an LLM?  I will leave others to argue over this.
>
> The 2021 paper you cited
> "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?"
> uses the term language model (LM) and does not use the term LLM (but
> does talk about "... ever larger language models,").
> Also the term does not appear in the famous 2017 paper
> "Attention Is All You Need"
> https://arxiv.org/abs/1706.03762
>
> --
> Derek M. Jones           Evidence-based software engineering
> blog:https://shape-of-code.com
>
> _______________________________________________
> The System Safety Mailing List
> systemsafety at TechFak.Uni-Bielefeld.DE
> Manage your subscription:
> https://lists.techfak.uni-bielefeld.de/mailman/listinfo/systemsafety
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.techfak.uni-bielefeld.de/pipermail/systemsafety/attachments/20250716/6924fd73/attachment-0001.html>