Not Diamond is a multi-model AI infrastructure platform that helps you adapt prompts across models and predictively determine which LLM is best-suited to respond to each input in your application, speeding up development, improving accuracy, and lowering costs.

Key features

Intelligent model routing: Leverage any evaluation data across any set of models to tune routing to your use case.
Automatic prompt adaptation: Take a prompt that's been written for one model and automatically adapt it to any set of candidate models.
RAG auto-evaluation and optimization: Automatically generate test data from your document store, auto-optimize your retrieval parameters, and evaluate various LLMs on your RAG pipeline.
Reliability, fallbacks, and load-balancing: Dynamically respond to outages and latency degradations to maintain high uptime.
Python, TypeScript, and REST API support: Easily integrate Not Diamond across a variety of stacks.

Getting started

Making your first API request with Not Diamond takes less than 5 minutes. To get started:

Create an account at app.notdiamond.ai
Create a Not Diamond API key
Jump into the quickstart example