Here are 9 projects to take your app to the next level in 2023.

[Lunary](https://github.com/lunary-ai/lunary) (sponsored)

[Guidance](https://github.com/guidance-ai/guidance)

[LiteLLM](https://github.com/BerriAI/litellm)

[LangChain](https://github.com/langchain-ai/langchain)

[DeepEval](https://github.com/confident-ai/deepeval)

[pgVector](https://github.com/pgvector/pgvector)

[promptfoo](https://github.com/promptfoo/promptfoo)

[Model Fusion](https://github.com/lgrammel/modelfusion)

9 Open Source tools to take your AI app to the next level

In the era of AI-driven applications, the ability to efficiently handle and search through vector data is crucial.

🌌 [Lunary.ai](https://github.com/lunary-ai/lunary)

🧲 [PGVector](https://github.com/pgvector/pgvector)

🌐 [Weaviate](https://github.com/weaviate/weaviate)

🎨 [ChromaDB](https://github.com/chroma-core/chroma)

🔍 [Milvus](https://github.com/milvus-io/milvus)

🧭 [Qdrant](https://github.com/qdrant/qdrant)

🔎 [ElasticSearch](https://github.com/elastic/elasticsearch)

6 Open-Source Vector Databases to Power Your AI App

Here are 7 open-source tools that you can add to your development workflow to be faster and more productive. These tools go from simple code completion, to full fledged app builders.

🤖 [continue](https://github.com/continuedev/continue)

🏎️ [gpt-pilot](https://github.com/Pythagora-io/gpt-pilot)

📝 [auto-commit](https://github.com/m1guelpf/auto-commit)

🏗️ [ChatDev](https://github.com/OpenBMB/ChatDev)

🧑‍🚀 [TabbyML](https://github.com/TabbyML/tabby)

🛜 [localpilot](https://github.com/danielgross/localpilot)

📈 [lunary](https://github.com/lunary-ai/lunary)

🍥 [swirl](https://github.com/swirlai/swirl-search)

7 Open Source AI projects to code faster in 2023

Explore Langfuse and compare it with top open-source alternatives.

Top 4 Open Source Alternatives to Langfuse

Discover 5 alternatives to LangSmith to observe, evaluate and improve your LangChain and LLM apps.

LangSmith alternatives: 5 tools to capture LLM data

This guide helps you understand why Azure OpenAI timeout errors happen and how you can fix them

Important Considerations for Azure OpenAI Timeout Challenges

1. Proxy Settings and Network Restrictions

3. Timeout Behavior in Streaming vs. Non-Streaming Requests

4. Synchronizing Cloud Function Timeouts with Azure

5. Balancing Retry Mechanisms and Rate Limits

Troubleshoot Timeout Errors in Azure OpenAI

Use the Azure OpenAI Batch API in Python to save cost and process large LLM workloads.

Using the Batch API with Azure OpenAI

ChatGPT Canvas is a handy tool for writers and developers. Understand what it does and how it compares to Claude Artifacts.

How can ChatGPT Canvas handle coding tasks?

Comparing ChatGPT Canvas with Claude Artifacts

ChatGPT Canvas: Tool for Writers and Developers

Datadog is a popular monitoring tool for infrastructure and applications. Let's see why and explore alternatives.

Datadog LLM Observability: Examples, Demo and Pricing

Prompt Templates, Chat Tracking in Python and faster dashboard.

December 2023 Update

Claude v3, evaluations and stability improvements.

February 2024 Update

Radars, evaluations out of private alpha & major app overhaul.

January 2024 Update

Explore how to load and process data from Airtable tables using LangChain's AirtableLoader, with examples of both synchronous and asynchronous loading methods.

Using LangChain's Airtable Document Loader

Configure Apache Doris vector store integration in LangChain with ApacheDorisSettings for efficient vector storage and retrieval

LangChain Apache Doris Settings for Vector Storage

Learn how to use ApertureDB vector store with LangChain to store, index and search document embeddings for similarity search and RAG applications.

LangChain ApertureDB Vector Store - Store and Search Embeddings

Learn how to create chains that automatically add relevant citations from context to LLM responses using LangChain's citation fuzzy matching

LangChain Citation Fuzzy Matching - Adding Citations to LLM Responses

Learn how to parse and load linguistic annotation files in CoNLL-U format using LangChain's CoNLLULoader.

Parsing CoNLL-U Files with LangChain CoNLLULoader

Learn how to configure connection parameters for Baidu and Tencent Cloud vector databases in LangChain.

LangChain Connection Parameters for Vector Databases

Learn how to transform LangChain message objects into API-compatible dictionaries using the convert_message_to_dict utility function.

Converting LangChain Messages to API Format with convert_message_to_dict

Learn how to convert chat messages into a format suitable for fine-tuning OpenAI models using LangChain's convert_messages_for_finetuning

How to use convert_messages_for_finetuning

Using with Message Loader and Pre-processing

Preparing Messages for LangChain Fine-tuning with OpenAI

Learn how to calculate cosine similarity between vectors in LangChain using the cosine_similarity utility function, with practical examples for text embeddings and semantic routing.

LangChain Cosine Similarity Guide - Calculate Vector Similarities

Learn how to fetch and load Ethereum blockchain transactions and balances using LangChain's EtherscanLoader.

Loading Ethereum Transactions with LangChain EtherscanLoader

Learn how to load and process Facebook Messenger chat histories using LangChain's chat loader utilities.

What is SingleFileFacebookMessengerChatLoader?

How to Use SingleFileFacebookMessengerChatLoader

Loading Facebook Messenger Chats with LangChain's SingleFileFacebookMessengerChatLoader

Learn how to leverage Golden's extensive knowledge graph using LangChain's GoldenQueryAPIWrapper to get structured data about companies, products, and more.

Querying Golden's Knowledge Graph with LangChain's GoldenQueryAPIWrapper

Learn how to search and retrieve job postings from Google Jobs using LangChain's GoogleJobsAPIWrapper - perfect for building job search applications and career tools.

Find Jobs with LangChain's GoogleJobsAPIWrapper

Learn how to use HuggingFace cross encoder models in LangChain for text similarity scoring and reranking search results.

Using with ContextualCompressionRetriever

Using Cross Encoders in LangChain with HuggingFace Models

Learn how to load and process iMessage conversations from macOS into chat messages using LangChain's IMessageChatLoader.

Working with iMessage Data in LangChain using IMessageChatLoader

Learn how to integrate Infobip messaging services into your LangChain applications to send SMS and emails using the InfobipAPIWrapper

LangChain Infobip Integration - Sending SMS and Emails Programmatically

Learn how to configure Kinetica settings in LangChain to connect to Kinetica database and customize vector search parameters.

LangChain Kinetica Settings Configuration

Learn how to load and process chat data from LangSmith datasets using LangChain's LangSmithDatasetChatLoader.

Loading LangSmith Chat Datasets in LangChain

Learn how to parse and process source code intelligently using LangChain's LanguageParser to split code into meaningful segments based on language syntax.

LangChain LanguageParser - Intelligent Code Parsing for Multiple Languages

Learn how to use LangChain's MathpixPDFLoader to accurately extract text and formulas from PDF documents using the Mathpix OCR service.

LangChain MathPix PDF Loader - Extract Text from PDFs with High Precision

Learn how to merge consecutive chat messages from the same sender in LangChain using merge_chat_runs to optimize chat conversation processing.

Using merge_chat_runs in LangChain - Chat Message Processing

Learn how to generate embeddings using MLflow AI Gateway models with LangChain's MlflowAIGatewayEmbeddings class.

Generating Embeddings for Multiple Documents

Integration with Other LangChain Components

LangChain MLflow AI Gateway Embeddings: Connect to MLflow Embedding Models

Learn how to track and monitor your LangChain experiments using the MLflow callback handler for metrics, artifacts and experiment tracking.

MLflow Callback Handler in LangChain - Track Your LLM Experiments

Learn how to generate embeddings using MLflow's AI Gateway integration in LangChain with MlflowEmbeddings.

Working with MLflow Embeddings in LangChain

Explore how to use LangChain's NasaAPIWrapper to access NASA's media library, search images, videos and retrieve metadata about space-related content.

Querying NASA Image and Video Library with LangChain NasaAPIWrapper

Learn how to generate text embeddings using Oracle Cloud Infrastructure's GenAI service with LangChain's OCIGenAIEmbeddings.

LangChain with Oracle Cloud Infrastructure (OCI) Embeddings

Learn how to use Oracle AI Vector Search as a vector store in LangChain for semantic document search and retrieval.

Using Oracle AI Vector Search in LangChain

Learn how to structure Reddit search queries in LangChain using RedditSearchSchema to retrieve posts with custom filtering and sorting options.

LangChain Reddit Search Schema - Making Reddit API Queries

Learn how to scrape web content with LangChain's ScrapingAntLoader to convert web pages into LLM-friendly markdown format.

Using LangChain ScrapingAntLoader for Web Scraping

Learn how to extract and process Slack conversation history using LangChain's SlackChatLoader, with examples of both eager and lazy loading approaches.

Load Slack Chat History with LangChain's SlackChatLoader

Learn how to use StarRocks as a vector store for embeddings and semantic search in LangChain applications.

Using StarRocks Vector Store with LangChain

Learn how to convert web pages to markdown format using LangChain's ToMarkdownLoader and the 2markdown service API.

Converting Web Content to Markdown with LangChain's ToMarkdownLoader

Learn how to convert tool examples to chat messages in LangChain using the tool_example_to_messages utility.

Basic Example with Person Information Extraction

LangChain Message Conversion with tool_example_to_messages

Learn how to load tweets from Twitter users and process them as documents using LangChain's TwitterTweetLoader.

Load Twitter Tweets in LangChain with TwitterTweetLoader

A comprehensive guide on loading and processing Org-mode files in LangChain using the UnstructuredOrgModeLoader, with examples of different loading modes and options.

Loading Org-mode Files in LangChain with UnstructuredOrgModeLoader

Learn how to handle and work with rate limiting errors when using Upstash rate limiting in your LangChain applications.

3. Different Handling for Token vs Request Limits

Working with Rate Limit Errors in LangChain

Learn how to use Intel's VDMS as a vectorstore in LangChain to store and search vector embeddings efficiently.

Vector Storage with LangChain VDMS

Learn how to store and search vector embeddings using VikingDB as a vector store in LangChain.

Creating a Collection and Adding Documents

Using VikingDB Vector Store in LangChain

Learn how to use the Weaviate vector store integration in LangChain to store, search and manage vector embeddings effectively.

Using Weaviate Vector Store in LangChain

Learn how to load and process WhatsApp chat conversations in your LangChain applications using the WhatsAppChatLoader class.

Load WhatsApp Chats in LangChain with WhatsAppChatLoader

Learn how to use LangChain's SearchScope to efficiently search chat history messages and summaries.

LangChain SearchScope for Searching Messages and Summaries

Complete tutorial and reference on how to format user prompts with the LangChain HumanMessage class and use it into our chains.

Understanding the LangChain HumanMessage class

Learn how LangChain's SystemMessage optimizes AI conversations with clear context setup.

Integrating SystemMessage with ChatOpenAI

Using SystemMessage with ConversationalRetrievalChain

SystemMessage class in LangChain

A guide to integrate LangChain with Llama.cpp for privacy-focused local LLMs

Getting Started with LangChain and Llama.cpp

Using Langchain with Llama.cpp Python: Complete Tutorial

Comparing how state of the art LLMs handle generating SVGs.

Draw me an SVG

March 2024 Update

Analytics v2, Tool calling data in prompts, and much more.

April+May 2024 Update

Prompt Playground, more supported models & a lot more.

🔍 Prompt Playground in public beta (give us feedback!)

🗃️ Public API & AI Evaluations in beta access

🐛 Support for OpenAI streaming queries in Python & JS

🐥 LangChain support of AWS Bedrock, Google Palm and Anthropic

November 2023 Update

Search & filter, exports, chat replays and lots of fixes.

October 2023 Update

Discover the key differences between OpenAI's o1 models and GPT-4o, and when each model is most effective.

Q: What are the limitations of o1 models?

Q: What measures has OpenAI taken to ensure o1's safety?

When does it make sense to use o1 vs GPT-4o?

Understanding LLM Parameters

We're changing our name to Lunary.ai. Here's why.

LLMonitor is now Lunary.ai

Comparing Claude 3, GPT-4, Gemini 1.5, and Mistral Large on various tasks.

Testing State of the Art models

Discover tools to replace LangChain for LLM integration in Python projects.

10 Alternatives to LangChain for Calling LLMs in Python

A Complete Guide to Building and Deploying LLM Applications with LangChain and vLLM

Utilizing Multi-GPU Inference for Scaling