Privacy, security, and local deployments

Data privacy

Not Diamond is not a proxy and was designed to maximize data privacy and developer agency. If you are building an application with strict data privacy requirements, Not Diamond can offer enhanced privacy protection with fuzzy hashing. All you need to do is set the hash_content parameter to true:

result, session_id, provider = client.chat.completions.create(
    messages=[
        {"role": "system", "content": "You are a technical analyst."},
        {"role": "user", "content": "Review this confidential internal documentation..."},
    ],
    model=llm_providers,
    hash_content=True  # Turn on fuzzy hashing
)

With this configuration, we only store the fuzzy hashes of your LLM inputs, which are strings like "3:dewCboYJKQ+X+MPpWWrAlvGCXKJnwDAUpYHgRFFRFeKeCYn:0odQ+X+MPpW/NaKAGXXSb". All your natural language inputs are immediately deleted after being passed to the Not Diamond router to generate routing recommendations, and your LLM requests go out client-side after we return a model recommendation.

Fuzzy hashes are one-way functions just like traditional hashes, which means there is no way to reconstruct the original input from the fuzzy hash string. However, unlike traditional hashing, similar inputs will produce similar fuzzy hash string outputs. This means these fuzzy hash strings can be used for classification and recommendation pipelines like Not Diamond.

Security

Our Python SDK uses requests==2.31.0 and urllib3==2.2.1 which encrypts data through HTTPS with TLS 1.3 (with fallback to TLS 1.2 if necessary). Our database is encrypted using AES-256, and all access to the database is also encrypted in transit using TLS certificates. Additionally, Not Diamond is currently in the process of securing SOC-2 compliance and will be fully compliant in 2024.

Local deployments

If you have other specific compliance requirements, we can deploy Not Diamond to your infrastructure. Schedule a call with us to discuss your needs and learn more about the development and integration support we offer.