github.devotd.
NewEvals

langfuse/langfuse v4.64.0 — LLM Application Observability and Evaluation

langfuse/langfuse is an open-source platform that provides execution traces and evaluation of AI applications in one place, and the latest release is v4.64.0.

Repositorylangfuse/langfuse ↗

langfuse/langfuse is an open-source platform that provides execution traces and evaluation of AI applications in one place, and the latest release is v4.64.0.

GitHub description: 🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

stars
★ 36.1K
Forks
4K
Language
TypeScript
License
NOASSERTION
Latest release
v4.64.0
Read original source ↗View on GitHub ↗

langfuse/langfuse is an open-source platform that records and evaluates the execution of AI applications. The repository defines the project as open-source agent evaluation and observability, and states that traces, evaluation, and improvement are handled in a single platform. It is written in TypeScript, was created on May 18, 2023, has 36083 GitHub stars, and the latest release according to the research is v4.64.0.

What Langfuse does is let you check in what order prompts and model calls run. The README explains that the project supports the development, monitoring, evaluation, and debugging of AI applications. Observability means leaving a record of an application's execution flow so that problem points can be retraced, and Langfuse handles this record in units of traces. On top of that come prompt management, evaluation, datasets, an LLM Playground, and an API. There are two ways to use it: as Langfuse Cloud, or hosted on your own infrastructure. The SDKs support Python and JS/TS. The configuration that bundles traces and evaluation into a single platform is the center of this repository.

However, the change list for v4.64.0 is not in the given material. The repository description states that it is open source, but the license field reads NOASSERTION, so the actual usage conditions cannot be confirmed from this material alone. In the research record only the momentum score of 7.2 is filled in, and the freshness, technology, and completeness items have no values. No figures comparing performance were given either. It is a candidate for teams looking for a tool that bundles observability and evaluation, but the license conditions and the v4.64.0 changes need to be verified directly in the repository and the release notes.