Compare

Google logo

to

OpenAI logo

Overview

Google logo

Gemini 1.5 Nano

OpenAI logo

GPT-4 Turbo 0125

Provider

Organization responsible for this model.

Google logo

Google

OpenAI logo

OpenAI

Input Context Window

The total number of tokens that the input context window can accommodate.

Not specified.

128K

tokens

Maximum Output Tokens

The maximum number of tokens this model can produce in one operation.

Not specified.

4.1K

tokens

Release Date

The initial release date of the model.

May 20th, 2024

11 months ago

January 4th, 2024

about 1 year ago

Knowledge Cutoff

The latest date for which the information provided is considered reliable and current.

Not specified.

December 2023

Pricing

Google logo

Gemini 1.5 Nano

OpenAI logo

GPT-4 Turbo 0125

Input

Costs associated with the data input to the model.

Not specified.

$0.01

per million tokens

Output

Costs associated with the tokens produced by the model.

Not specified.

$0.03

per million tokens

Benchmark

Google logo

Gemini 1.5 Nano

OpenAI logo

GPT-4 Turbo 0125

MMLU

Assesses LLMs' ability to acquire knowledge in zero-shot and few-shot scenarios.

Not specified.

Not specified.

MMMU

Comprehensive benchmark covering multiple disciplines and modalities.

Not specified.

Not specified.

HellaSwag

A demanding benchmark for sentence completion tasks.

Not specified.

Not specified.

Arena Elo

Ranking metric for LMSYS Chatbot Arena.

Not specified.

1246

Building an AI chatbot?

Open-source GenAI monitoring, prompt management, and magic.

Open Source

Self Hostable

1-line Integration

Prompt Templates

Chat Replays

Analytics

Topic Classification

Agent Tracing

Custom Dashboards

Score LLM responses

PII Masking

Feedback Tracking

Open Source

Self Hostable

1-line Integration

Prompt Templates

Chat Replays

Analytics

Topic Classification

Agent Tracing

Custom Dashboards

Score LLM responses

PII Masking

Feedback Tracking