What are the differences?

Between the GPT-4 0613 and Chat Bison LLM models, which follows best instructions?

Compare

OpenAI logo

to

Google logo
OpenAI logo

GPT-4 0613

OpenAI

Google logo

Chat Bison

Google

Overview

OpenAI logo

GPT-4 0613

Google logo

Chat Bison

Provider

Organization responsible for this model.

OpenAI logo

OpenAI

Google logo

Google

Input Context Window

The total number of tokens that the input context window can accommodate.

8.2K
8.2K

Maximum Output Tokens

The maximum number of tokens this model can produce in one operation.

8.2K
2K

Release Date

The initial release date of the model.

June 13, 2023

29 months ago

May 10, 2023

30 months ago

Knowledge Cutoff

The latest date for which the information provided is considered reliable and current.

2021/9

2021/6

Pricing

OpenAI logo

GPT-4 0613

Google logo

Chat Bison

Input

Costs associated with the data input to the model.

$0.03
$0.25

Output

Costs associated with the tokens produced by the model.

$0.06
$0.50

Benchmark

OpenAI logo

GPT-4 0613

Google logo

Chat Bison

MMLU

Assesses LLMs' ability to acquire knowledge in zero-shot and few-shot scenarios.

78.3

MMMU

Comprehensive benchmark covering multiple disciplines and modalities.

HellaSwag

A demanding benchmark for sentence completion tasks.

Arena Elo

Ranking metric for LMSYS Chatbot Arena.

1161

5000+ teams use Lunary to build reliable AI applications

IslandsbankiZurichNetomiCloseDHL

Building an AI chatbot?

Open-source GenAI monitoring, prompt management, and magic.

Open Source

Self Hostable

1-line Integration

Prompt Templates

Chat Replays

Analytics

Topic Classification

Agent Tracing

Custom Dashboards

Score LLM responses

PII Masking

Feedback Tracking

Open Source

Self Hostable

1-line Integration

Prompt Templates

Chat Replays

Analytics

Topic Classification

Agent Tracing

Custom Dashboards

Score LLM responses

PII Masking

Feedback Tracking