LLMs

Parameters

The 'weights' in a neural network that are learned during training. Frontier models now range from a few billion parameters (small, efficient, on-device models) to well over a trillion (large frontier models). More parameters generally means more capability, but also more compute cost: and smaller, well-trained models increasingly match larger ones on specific tasks.