A Coventry University AI Bitesize Christmas Special
James Brusey, Matthew England,
and James
Shuttleworth
Tuesday 16th December 2025
Courtesy of MS Copilot AI tool…

Courtesy of Google Gemini AI tool…



Training performance doesn’t tell us enough.
We need unseen data (not used during training).
Cross-validation makes the best use of available data.



Chris Watkins united experimental ideas with Bellman’s decision theory.
Q-learning provably converges on the optimal strategy.
Ultimate test is if it works in the real world.


In French, these translate differently:
Correct translation requires semantic role understanding, not just syntax.
BLEU = Bilingual Evaluation Understudy.
Higher BLEU score ⇒ more overlap with the human reference text.
BLEU score needs a reference dataset (e.g., WMT, which is news stories).
Google 2017 paper showed that you didn’t need recurrence - self-attention was sufficient
This proved to be surprisingly general.
Things got exciting when they scaled things up (more data, bigger models)
Q: Why is the sky blue? A: _
2024 Chemistry Nobel Prize to AlphaFold. 





Coventry University Microsoft Copilot AI: https://copilot.cloud.microsoft/
ChatGPT: https://chatgpt.com/
Google Gemini: https://gemini.google.com/
Get the LLM to identify the top 5 changes in the 2025 UK Budget.


Frontier models have been getting bigger. E.g. GPT3 had 175bn parameters. GPT5 does not disclose but estimates range in the trillions.
However, recent performance gains may have come from new techniques (e.g. chain-of-though,mixture-of-experts) rather than scaling.
There is now focused competition on performance with restricted resources.
LLMs can produce hallucinations: false claims.

More common when: queries require unavailable knowledge, ambiguous, need complex reasoning.
Myth: AI is unreliable: LLMs are hallucinating a LOT less than in 2023/2024.
Myth: AI will soon be perfect: Hallucinations are still possible: there are many strategies being researched to reduce the risk of hallucination further. But we are unlikely to ever fully remove them.
Users need to evaluate how likely hallucinations are in their AI application, what risk they would pose, and how that risk might be mitigated.

This is the Coventry University Phoenix: 
Can you get your AI tool to design us a new Phoenix logo for the AI team at Coventry?
What happens if you give it the original logo to work with?


Fine Tuning: Taking trained AI and small dataset specific to your application to further train on.
Retrieval Augmented Generation (RAG) allows trained AI access to your knowledge base.
Myth: AI is sentient: It is simply not.
Myth: We have no idea how AI works: The basic ideas are published and well studied.
Myth: AI is completely objective: AI is trained on data: biases in data will appear in the model.
Myth: AI is too biased to use: There has been progress in making AI safer. Challenges remain: users should plan how they will evaluate AI output to identify and deal with any bias.
Myth: AI models now explain how they think: One of the advances in 2024/2025 has been reasoning models. However, the ``explanations’’ produced do NOT to always accurately reflect the AI’s working.
Myth: We will never understand how AI thinks: Research in 2025 on AI ``brain scans’’: seeing which neurons fire as a query is processed, revealing patterns in how queries are dealt with.
RAG is perhaps the first step to agentic AI: the next big AI breakthrough? Let’s see…

Increasing standardisation of protocols, etc. and evolution of those standards.
Evolution of the tools and interaction mechanisms that wrap GenAI.
Increased use of analytical AI.
Awful AI is a curated list to track current scary usages of AI
LLM stands for…
A: Local Language Model
B: Large Language Machine
C: Large Language Model
D: Local Language Machine
Which one of these is NOT the name of an LLM…
AlphaFold won the Nobel Prize for…
When testing an AI it is important to…
Test on the same data used for training.
Test on different data to that used in training.
Test on more data than used in training.
Test on less data than used in training.
Which of these were NOT important points on the journey to AI:
Which of these is NOT a myth…
RAG stands for:
Agentic AI is gaining in popularity because:
Merry Christmas Everyone!