Fine-tuning

Building with Open Models
Talk covering how developers customize and deploy OpenAI’s open models.
video

DevDay — distillation breakout
DevDay session on model distillation techniques.
video

Model distillation overview
Overview of distillation techniques for creating efficient models.
guide

Reinforcement fine-tuning overview
Guide on reinforcement learning-based fine-tuning techniques.
guide

Supervised fine-tuning overview
Guide to supervised fine-tuning for customizing model behavior.
guide

Vision fine-tuning overview
Guide to fine-tuning models on vision tasks.
guide

Fine-tuning best practices
Recommendations for effective and efficient model fine-tuning.
guide

Fine-tuning guide
Comprehensive guide to fine-tuning OpenAI models.
guide

Exploring Model Graders for Reinforcement Fine-Tuning
Cookbook to use model graders for reinforcement fine-tuning in expert tasks.
cookbook

Reinforcement Fine-Tuning for Conversational Reasoning with the OpenAI API
Cookbook for reinforcement fine-tuning conversational reasoning using HealthBench evaluations.
cookbook

Leveraging model distillation to fine-tune a model
Cookbook to distill a larger model into a smaller fine-tuned model.
cookbook