Label Studio

Label Studio is an open-source data labeling platform that provides LangChain with flexibility when it comes to labeling data for fine-tuning large language models (LLMs). It also enables the preparation of custom training data and the collection and evaluation of responses through human feedback.

Installation and Setup

See the Label Studio installation guide for installation options.

We need to install the label-studio and label-studio-sdk-python Python packages:

pip install label-studio label-studio-sdk

Callbacks

See a usage example.

from langchain.callbacks import LabelStudioCallbackHandler