Train causal and masked language models with next-token and denoising objectives. Cover pretraining corpora, context windows, decoding, perplexity, and emergent few-shot behavior.