Foundation model

A large model trained on broad data that can be adapted to many tasks, such as a large language model or an image model, rather than built for one purpose.

Definition

The term was coined by researchers at Stanford's Center for Research on Foundation Models in 2021 to describe models trained at scale on broad data and then adapted, by prompting or fine-tuning, to a wide range of downstream tasks.

In regulation the idea appears as 'general-purpose AI models', which the EU AI Act covers with specific obligations for their providers. For companies implementing AI, the practical point is that most work builds on someone else's foundation model, so its provider's terms, data handling and update cycle become part of your risk.

Sources

  1. Bommasani et al., On the Opportunities and Risks of Foundation Models (Stanford CRFM, 2021)