6 ms·
If you are looking for automatic instrumentation that generates open telemetry standard traces - check out Langtrace, https://github.com/Scale3-Labs/langtrace h
by kakaly0403 2y ago
If you are looking for automatic instrumentation that generates open telemetry standard traces - check out Langtrace, https://github.com/Scale3-Labs/langtrace https://github.com/Scale3-Labs/langtrace. Got support for all popular LLMs, frameworks and vectorDB with high cardinality.
- verdverm 2y agoThis still has the same issue that the docs say I need 2 more databases, not making use of my existing grafana LGTM stack https://github.com/Scale3-Labs/langtrace?tab=readme-ov-file#langtrace-system-architecture https://github.com/Scale3-Labs/langtrace?tab=readme-ov-file#... Another blocker for me is that it appears to need an API key for trying it out locally or self-hosting --- I'm comparing your project to OpenLit on this front - https://docs.openlit.io/latest/installation#kubernetes https://docs.openlit.io/latest/installation#kubernetes - https://docs.openlit.io/latest/connections/grafanacloud https://docs.openlit.io/latest/connections/grafanacloud
- kakaly0403 2y ago1. You do not need 2 databases if you are only looking to export the traces to your grafana stack. If you are using prometheus as the TSDB, you can directly send the traces there without needing any of the databases to be setup locally. 2. Also, you do not need the API key. You only need to install the python or typescript sdk and use the custom exporter option - https://github.com/Scale3-Labs/langtrace-python-sdk?tab=readme-ov-file#langtrace-self-hosted-custom-exporter https://github.com/Scale3-Labs/langtrace-python-sdk?tab=read... . If you already have a OTEL exporter running, you don't need even that. Just initialize the sdk after installing and it will do its thing. I am one of the core maintainers of the project. Do let me know if you have any questions.