Observability
Braintrust IntegrationCopied!
How do I enable or disable Braintrust integration?
Orchestra has built-in support for Braintrust, which provides observability and evaluation for LLM applications.
To enable Braintrust integration:
- Install the
braintrust
package:pip install braintrust
- Set your Braintrust API key as an environment variable:
export BRAINTRUST_API_KEY=your_api_key
- By default, Braintrust is automatically enabled when the API key is present
To explicitly enable Braintrust integration:
export BRAINTRUST_ORCHESTRA_ENABLED=true
To disable Braintrust integration inside Orchestra:
export BRAINTRUST_ORCHESTRA_ENABLED=false
You can also use 0
or no
as values to disable it, or 1
or yes
to enable it. Braintrust integration is automatically enabled when:
- The
braintrust
package is installed - The
BRAINTRUST_API_KEY
environment variable is set with a valid API key - The
BRAINTRUST_ORCHESTRA_ENABLED
environment variable is either:- Set to enable it (
true
,1
, oryes
) - Not set at all (defaults to enabled when API key exists)
- Set to enable it (
When enabled, Braintrust will trace all tool calls and requests to OpenAI, OpenRouter, Groq, Together AI, and Deepseek, providing detailed logs and analytics in your Braintrust dashboard.