AI Reads | Links and Resources

The machine is still learning!

AI Glossary

Let's kick-off with the basics: What is...


Algorithm - provides the instructions. A step-by-step process for the computer to follow as it analyzes the data and learns from it. It's like a recipe that tells you how to transform the ingredients (data) into the final dish (model)

Model - Imagine a model as the end product of your machine learning project. It's a mathematical representation of the data you've analyzed. This model can be used to make predictions on new, unseen data. Read more Machine Learning...

Algorithm + Test Data = Model (creation) → Model + Unseen Data = Prediction (repeat and refine)


AI,  Artificial Intelligence - many argue that the true meaning of this term infers a level of humanistic assimilation i.e. autonomy that we have not reached, yet. And so we are currently still in the Machine Learning phase. However the term is now being applied to anything ‘smart’.

ML, Machine Learning - A branch of AI which could be considered the precursor to current Generative-AI, is the science of developing algorithms and statistical models that computer systems use to perform complex tasks without explicit instructions. More associated with finding commonalities and patterns within large databases of either categorised or uncategorised data - like determining weather patterns.

Predictive Algorithms - These are the mathematical formulas and statistical techniques that form the core of machine learning. They analyze data, identify patterns, and learn relationships between variables. Imagine them as the building blocks.

Predictive Models - This is the final output you get after training the algorithms on data. It's a representation of the learned patterns and can be used to make predictions on new data. Think of it as the finished structure built from the algorithms.

AGI, Artificial General Intelligence - is basically machines that can think and learn like humans, able to tackle many kinds of problems and tasks. Many consider this capability much closer than we think. Read more...

Generative AI - Refers to any AI system capable of creating new content, which can be text, images, music, code, or other forms.

AI Agents - Are AI’s that understand and apply tasks automatically / autonomously. An AI Agent may be a bot that is setup to accept simple instructions / task requests and automatically ‘find’ and apply from various other Ai tools a solution to improve itself and/OR how it performs whatever you have set it up to do. Read more...

Foundation Model - powerful AI model trained on a massive amount of data to be adaptable for various tasks. Read more...

Frontier Model - A particularly advanced and powerful type of Foundation Model. All Frontier Models are Foundation Models, but not all Foundation Models are Frontier Models. Read more...

LLM, Large Language Model (for eg. ChatGPT) is a type of artificial intelligence that can understand and generate human language, trained on massive amounts of text data.

SLM, Small Language Model perform smaller tasks and require less computing power. Read more...

Transformer Models -  If next word suggestion is driven by neural network responses with the most likely word based purely on mathematical probability (Machine Learning), adding in a transformer model that has layers of attention steps built into it, will guide the responses to a question and or a statement to have more context and meaning.

GPT, Generative Pre-trained Transformer - It's a type of artificial intelligence (AI) focused on understanding and generating human language. Essentially, it's a powerful language model that can be used for various tasks like creating different creative text formats or predicting what you might type next. Read more about  Vector Embedding and Transformers...

Multimodal LLM - a large language model that can understand and generate information from multiple sources, like text, images, and even audio, not just text alone. Read more about Multimodal capability...

VLM, Vision Language Model - This is a specific type of multimodal model that focuses on understanding the relationship between visual data (images) and textual data (language). Read more...

MMLU, Massive Multitask Language Understanding - a new benchmark designed to measure knowledge acquired during pretraining by evaluating models exclusively in zero-shot and few-shot settings.

NLP, Natural Language Processors (of which an LLM is a type of NLP) - Natural Language Processing, is a field of computer science concerned with giving computers the ability to understand and work with human language. It's basically like teaching computers to speak our language.

Prompt - In the context of LLM, a prompt acts as a set of instructions and information that guides us towards generating the desired response. It essentially tells us what to do and how to do it. Imagine it as a map that steers us in the right direction. Read more...

RAG,  Retrieval-Augmented Generation - a technique that enhances the accuracy and factual grounding of generative models by incorporating external information retrieval, by breaking down documents you provide into segmented token data chunks. Read more...

Synthetic Data - is essentially artificial information created by computers, rather than collected from real-world events. Read more...

Tokens - In the context of AI, particularly in multimodal large language models (LLMs), a token refers to the basic unit of information used for processing and representation. Important : tokens are also the measurement of cost associated with the training, deployment and usage of your models. Read more about Tokenization...

VectorDB - A Vector Database is a specialized database designed to store and retrieve information based on similarity. Unlike traditional databases that rely on exact matches, vector databases store data as mathematical representations called vectors. Read more...

Open Source - where the underlying code is freely available for anyone to access, tinker with, and distribute. This openness breeds collaboration and fosters a community effort around AI development. Read more...