Provider

Organization responsible for this model.

Input Context Window

The total number of tokens that the input context window can accommodate.

Maximum Output Tokens

The maximum number of tokens this model can produce in one operation.

Release Date

The initial release date of the model.

Knowledge Cutoff

The latest date for which the information provided is considered reliable and current.

Input

Costs associated with the data input to the model.

Output

Costs associated with the tokens produced by the model.

MMLU

Assesses LLMs' ability to acquire knowledge in zero-shot and few-shot scenarios.

MMMU

Comprehensive benchmark covering multiple disciplines and modalities.

HellaSwag

A demanding benchmark for sentence completion tasks.

Arena Elo

Ranking metric for LMSYS Chatbot Arena.