5 ms·
Should we expect the current API (https://docs.goodfire.ai/introduction https://docs.goodfire.ai/introduction) to be good for prod or is it for testing only? I
by detente18 2y ago
Should we expect the current API (https://docs.goodfire.ai/introduction https://docs.goodfire.ai/introduction) to be good for prod or is it for testing only?
I see that the sampling API is OpenAI-compatible (nice!). Considering if we can add a native integration for this to LiteLLM with a provider specific route - `goodfire/`. Would let people test this in projects like aider and dspy.
```python
from litellm import completion
import os
os.environ["GOODFIRE_API_KEY"] = "your-api-key"
response = completion(
model="goodfire/meta-llama/Llama-3.3-70B-Instruct",
messages=[{ "content": "Hello, how are you?","role": "user"}]
)
```