Introducing Observers: AI Observability with Hugging Face datasets through a lightweight SDK

We're excited to launch Observers, a powerful and flexible library designed to bring transparency and insight into generative AI interactions. Understanding and tracking your models is crucial – and that's exactly what Observers helps you do.

🚀 What is Observers?

Observers is an open-source Python SDK that provides comprehensive observability for generative AI APIs. Our library makes it easy to:

• Track and record interactions with AI models
• Store observations in multiple backends
• Query and analyze your AI interactions with ease

🌟 Why Observers?

• Transparency: Track every AI interaction
• Flexibility: Support for multiple providers and stores
• Ease of Use: Minimal configuration, maximum insights
• Open Source: Community-driven development

📦 Quick Installation

Getting started is simple. Just use pip:

pip install observers

✨ Key Features

1. Flexible Observers

• Wrap any OpenAI-compatible LLM provider
• Support for multiple AI model interactions
• Minimal setup required
• And more coming soon!

2. Powerful Stores

Store your AI interactions in various backends:

• Hugging Face Datasets
• DuckDB
• Argilla
• And more coming soon!

🔍 Quick Example

import os
from observers.observers.models.openai import wrap_openai
from openai import OpenAI

api_key = os.environ["HF_TOKEN"]
openai_client = OpenAI(
    base_url="https://api-inference.huggingface.co/v1/", 
    api_key=api_key
)

client = wrap_openai(openai_client)

response = client.chat.completions.create(
    model="Qwen/Qwen2.5-Coder-32B-Instruct",
    messages=[{"role": "user", "content": "Tell me a joke."}]
)

🗃️ Data Exploration Made Easy

Whether you prefer SQL queries in DuckDB or the Hugging Face Datasets Viewer, Observers makes your interaction data accessible and queryable.

DuckDB Queries

> duckdb store.db
> SELECT * FROM openai_records LIMIT 10;

Hugging Face Datasets

Argilla

🤝 Contributing

Are you passionate about AI observability? We welcome contributions on GitHub!

🔜 Coming Soon

• More store backends
• Enhanced filtering capabilities
• Advanced analytics tools

Ready to bring clarity to your AI interactions? Get started with Observers today!

🐞 GitHub Repository