Take a peek under the hood of generative AI and LLMs to understand how they work.

Learn how language models use a corpus to predict text

Calculate probability of a word using N-gram models

Prediction and Probabilities

Intro to Language Models

Predicting the Next Word

Larger Context Windows

Calculating Word Probabilities

Improve models through multiple training steps

Clean, process, and tokenize text for training

Language Model Training

Temperature

Improving Models

Loss

Preprocessing

Capitalization

Punctuation

Tokenization

Byte-Pair Encoding

Get acquainted with the architecture and function of deep neural networks and LLMs

Discover a family of algorithms that let deep network models learn to make predictions

Deep Network Models

Deep Networks

Training

Gradient Descent

Visualize the actions of layers in a deep neural network

Train a multi-layer network to perform a simple classification task

Neurons and Layers

Neural Networks

Folding Data

Multiple Layers

Learn to think in the mathematical language of vectors used by deep networks

Morph faces by manipulating points within a latent vector space

Image Models

Reading Digits

Pattern Recognition

Compressing Images

Classifying Faces

A Space of Faces

Semantic Geometry

Read, split, and clean text using Python string methods

Use Python dictionaries and counters to analyze word frequencies

Language Analysis with Python

Turning Text into Data

Using Dictionaries

Counting Unique Words

Build language models predicting the next word in a sequence

Generate new text stylistically similar to any corpus

Text Generation with Python

Bigrams and Mutability

Bigram Frequency and Tuples

Bigram Analysis

Building a Language Model

Dive into the inner machinery of neural networks to discover how these flexible learning tools actually work.

How AI Works

Level 1Prediction and Probabilities

Level 2Language Model Training

Level 3Deep Network Models

Level 4Neurons and Layers

Level 5Image Models

Level 6Language Analysis with Python

Level 7Text Generation with Python

Introduction to Neural Networks

Course description

Prerequisites and next steps