Courses
Books
Blog
My Courses / Log In
Contact
Help
Cart

[Activity] Fine Tuning GPT with the IMDb Dataset

Back to: Machine Learning, Data Science, and Generative AI with Python

Previous Lesson

[Activity] Using small and large GPT models with HuggingFace and Google CoLab

From GPT to ChatGPT: Deep Reinforcement Learning, Proximal Policy Gradients

Leave a Reply Cancel reply

You must be logged in to post a comment.

Lessons

Getting Started
- Introduction
- Installation: Getting Started
- [Activity] WINDOWS: Installing and Using Anaconda & Course Materials
- [Activity] MAC: Installing and Using Anaconda & Course Materials
- [Activity] LINUX: Installing and Using Anaconda & Course Materials
- Python Basics, Part 1 [Optional]
- [Activity] Python Basics, Part 2 [Optional]
- [Activity] Python Basics, Part 3 [Optional]
- [Activity] Python Basics, Part 4 [Optional]
- Introducing the Pandas Library [Optional]
Statistics and Probability Refresher, and Python Practice
- Types of Data
- Mean, Median, Mode
- [Activity] Using mean, median, and mode in Python
- [Activity] Variation and Standard Deviation
- Probability Density Function; Probability Mass Function
- Common Data Distributions
- [Activity] Percentiles and Moments
- [Activity] A Crash Course in matplotlib
- [Activity] Advanced Visualization with Seaborn
- [Activity] Covariance and Correlation
- [Exercise] Conditional Probability
- Exercise Solution: Conditional Probability
- Bayes’ Theorem
Predictive Models
- [Activity] Linear Regression
- [Activity] Polynomial Regression
- [Activity] Multiple Regression, and Predicting Car Prices
- Multi-Level Models
Machine Learning with Python
- Supervised vs. Unsupervised Learning, and Train/Test
- [Activity] Using Train/Test to Prevent Overfitting
- Bayesian Methods: Concepts
- [Activity] Implementing a Spam Classifier with Naive Bayes
- K-Means Clustering
- [Activity] Clustering People Based on Income and Age
- Measuring Entropy
- [Activity] WINDOWS: Installing GraphViz
- [Activity] MAC: Installing GraphViz
- [Activity] LINUX: Installing GraphViz
- Decision Trees: Concepts
- [Activity] Decision Trees: Predicting Hiring Decisions
- Ensemble Learning
- [Activity] XGBoost
- Support Vector Machines (SVM) Overview
- [Activity] Using SVM to Cluster People using scikit-learn
Recommender Systems
- User-Based Collaborative Filtering
- Item-Based Collaborative Filtering
- [Activity] Finding Movie Similarities
- [Activity] Improving the Results of Movie Similarities
- [Activity] Making Movie Recommendations to People
- [Exercise] Improve the Recommender’s Results
More Data Mining and Machine Learning Techniques
- K-Nearest-Neighbors: Concepts
- [Activity] Using KNN to Predict a Rating for a Movie
- Dimensionality Reduction; Principal Component Analysis (PCA)
- [Activity] PCA Example with the Iris Data Set
- Data Warehousing Overview: ETL and ELT
- Reinforcement Learning
- [Activity] Reinforcement Learning and Q-Learning with Gym
- Understanding a Confusion Matrix
- Measuring Classifiers (Precision, Recall, F1, AUC, ROC)
Dealing with Real-World Data
- Bias / Variance Tradeoff
- [Activity] K-Fold Cross-Validation
- Data Cleaning and Normalization
- [Activity] Cleaning Web Log Data
- Normalizing Numerical Data
- [Activity] Detecting Outliers
- Feature Engineering and the Curse of Dimensionality
- Imputation Techniques for Missing Data
- Handling Unbalanced Data: Oversampling, Undersampling, and SMOTE
- Binning, Transforming, Encoding, Scaling, and Shuffling
Apache Spark: Machine Learning on Big Data
- Warning about Java 21+!
- [Activity] Installing Spark
- Spark Introduction
- Spark and the Resilient Distributed Dataset
- Introducing MLLib
- Introduction to Decision Trees in Spark
- [Activity] K-Means Clustering in Spark
- TF / IDF
- [Activity] Searching Wikipedia with Spark
- [Activity] Using the Spark 2.x DataFrame API for MLLib
Experimental Design / ML in the Real World
- Deploying Models to Real-Time Systems
- A/B Testing Concepts
- T-Tests and P-Values
- [Activity] Hands-on With T-Tests
- Determining How Long to Run an Experiment
- A/B Test Gotchas
Deep Learning and Neural Networks
- Deep Learning Pre-Requisites
- The History of Artificial Neural Networks
- [Activity] Deep Learning in the Tensorflow Playground
- Deep Learning Details
- Introducing Tensorflow
- [Activity] Using Tensorflow, Part 1
- [Activity] Using Tensorflow, Part 2
- [Activity] Introducing Keras
- [Activity] Using Keras to Predict Political Affiliations
- Convolutional Neural Networks (CNN’s)
- [Activity] Using CNN’s for Handwriting Recognition
- Recurrent Neural Networks (RNN’s)
- [Activity] Using a RNN for Sentiment Analysis
- [Activity] Transfer Learning
- Tuning Neural Networks: Learning Rate and Batch Size Hyperparameters
- Deep Learning Regularization with Dropout and Early Stopping
- The Ethics of Deep Learning
- Learning More about Deep Learning
Generative Models
- Variational Auto-Encoders (VAE’s)
- VAE’s Hands-On: Fashion MNIST
- Generative Adversarial Networks (GAN’s)
- GAN Demos and Live Training (Painting with AI!)
- GAN Hands-On: Creating Synthetic Images of Clothing
Generative AI: GPT, ChatGPT, Transformers, Self-Attention
- The Transformer Architecture (encoders, decoders, self-attention)
- Self-Attention, Masked-Self Attention, and Multi-Headed Self-Attention
- Applications of Transformers
- How GPT Works, Part 1: The GPT Transformer Architecture
- How GPT Works, Part 2: Tokenization, Positional Encoding, Embedding
- Fine Tuning / Transfer Learning with Transformers
- [Activity] Tokenization with Google CoLab and HuggingFace
- [Activity] Positional Encoding
- [Activity] Masked, Multi-Headed Self-Attention with BERT, BERTViz, and exBERT
- [Activity] Using small and large GPT models with HuggingFace and Google CoLab
- [Activity] Fine Tuning GPT with the IMDb Dataset
- From GPT to ChatGPT: Deep Reinforcement Learning, Proximal Policy Gradients
- From GPT to ChatGPT: Reinforcement Learning from Human Feedback and Moderation
The OpenAI API (Developing with GPT and ChatGPT)
- [Activity] The OpenAI Chat Completions API
- [Activity] Using Functions in the OpenAI Chat Completion API
- [Activity] The Images API in OpenAI (DALL-E)
- [Activity] The Embeddings API in OpenAI: Finding Similarities Between Words
- The Fine-Tuning API for GPT models in OpenAI
- [Demo] Fine-Tuning OpenAI’s Davinci Model to Simulate Data from Star Trek
- Fine-Tuning with the new API to tune GPT for Data from Star Trek
- [Activity] The OpenAI Moderation API
- [Activity] The OpenAI Audio API (speech to text)
Retrieval Augmented Generation (RAG) and LLM Agents
- Retrieval Augmented Generation: How it works, with some examples.
- Demo: Using Retrieval Augmented Generation (RAG) to simulate Data from Star Trek
- RAG Metrics: The RAG Triad, relevancy, recall, precision, accuracy and more
- [Activity] Evaluating our RAG-based Cdr. Data using RAGAS and langchain
- Advanced RAG: Pre-Retrieval; chunking; semantic chunking; data extraction.
- Advanced RAG: Query Rewriting
- Advanced RAG: Prompt Compression, and More Tuning Opportunities
- [Activity] Simulating Cdr. Data with Advanced RAG and langchain
- LLM Agents and Swarms of Agents
- [Activity] Building a Cdr. Data Chatbot with LLM Agents, web search, and math tools.
Final Project
- Your Final Project Assignment
- Final Project Review
You Made It!
- More to Explore
- Continue Your Learning!

#1626 (no title)
Apache Spark with Scala – Course Materials
Apache Spark with Scala – Hands On with Big Data! Getting Started
Autonomous Cars: Deep Learning and Computer Vision in Python (Course Materials)
AWS Certified Data Analytics: Course Materials
AWS Certified Data Engineer – Hands On! Course Materials
AWS Certified Machine Learning – Course Materials
AWS Certified Machine Learning Engineer MLA-C01 Hands On! Course Materials
AWS Lambda Course
Books
Books OLD
Build a Serverless App with AWS Lambda – Hands On! Course Materials
Building Recommender Systems with Machine Learning and AI: Getting Started
Cart
Checkout
Contact Us
Course Catalog
Course Materials: Breaking Into Tech
Course Materials: Data Science and Machine Learning with Python – Hands On!
Course Materials: Deep Learning with Python, Tensorflow, and Keras – Hands On!
Course Materials: Elasticsearch and the Elastic Stack – In Depth and Hands On!
Course Materials: Machine Learning, Data Science, and Deep Learning with Python
Course Materials: The Ultimate Hands-On Hadoop
Dashboard
Data Science Course
Hadoop Ecosystem Course
Hadoop on AWS / EMR
Help
Home
Home v2
MapReduce Course
Mastering AWS Certified AI Practitioner – Hands On! Course Materials
Mastering the System Design Interview: Getting Started
Membership Catalog
My Account
Privacy Policy
Purchase
Share your success story!
Spark on AWS / EMR
Spark Streaming Course
Spark with Python Course
Spark with Scala Course
Student Directory
Taming Big Data with Apache Spark and Python – Getting Started
Taming Big Data with Spark Streaming and Scala – Getting Started
Taming Big Data with Spark Streaming and Scala – Getting Started with IntelliJ IDEA
Terms of Service
The Sundog Blog
Timeline
Under Maintenance

(C) Copyright 2021-2024 Sundog Software LLC. All rights reserved worldwide.

Theme LaunchPad by LifterLMS