Pre-training is responsible for the large-scale training runs that give Claude its core knowledge and capabilities, according ...

Andrej Karpathy has joined Anthropic, with a reported Claude pre-training role that could tie his synthetic data work to one of AI's most compute-heavy stages.

Reinforcement Pre-Training (RPT) is a new method for training large language models (LLMs) by reframing the standard task of predicting the next token in a sequence as a reasoning problem solved using ...

Andrej Karpathy, OpenAI co-founder and former Tesla AI director, joins Anthropic to build a team using Claude to accelerate pre-training research.