[SystemSafety] AI Hallucination Cases

[Derek M Jones]

Peter,

>> token prediction.
> 
> A request for clarification. Are you referring to October 2022 and the release of ChatGPT?
> 
> As I mentioned, LLMs "arrived" between one and two decades ago in computational linguistics. We were using them in the 

People have been doing stuff with word sequence probabilities since
Shannon's famous 1948 paper "A Mathematical Theory of Communication"
https://web.archive.org/web/20090216231139/http://plan9.bell-labs.com//cm//ms//what//shannonday//shannon1948.pdf

When did LLMs arrive on the scene and when does a tool
become an LLM?  I will leave others to argue over this.

The 2021 paper you cited
"On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?"
uses the term language model (LM) and does not use the term LLM (but
does talk about "... ever larger language models,").
Also the term does not appear in the famous 2017 paper
"Attention Is All You Need"
https://arxiv.org/abs/1706.03762

-- 
Derek M. Jones           Evidence-based software engineering
blog:https://shape-of-code.com