Skip to main content

Confident AI

Confident - Unit Testing for LLMs

DeepEval package for unit testing LLMs. Using Confident, everyone can build robust language models through faster iterations using both unit testing and integration testing. We provide support for each step in the iteration from synthetic data creation to testing.

Installation and Setup​

First, you'll need to install the DeepEval Python package as follows:

pip install deepeval

Afterwards, you can get started in as little as a few lines of code.

from langchain.callbacks import DeepEvalCallback