Repository navigation

llm-monitoring

Website
Wikipedia

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

llm-tools prompt-engineering prompt-management llm-evaluation llm-framework rag-evaluation llm-observability llm-as-a-judge llm-monitoring llm-platform llm-playground llmops-platform

Python

3094

360

12 天前

bluewave-labs / flagwise

Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.

大语言模型 ai-analytics ai-observability llm-monitoring llm-security

Python

6 天前

pyladiesams / eval-llm-based-apps-jan2025

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

大语言模型 llmops workshop llm-eval llm-evaluation-framework llm-evaluation-metrics llm-monitoring

Jupyter Notebook

3 个月前

kyopark2014 / llm-monitoring

It shows how to monitoring LLM.

amazon-bedrock dashboard llm-monitoring token-logger

TypeScript

1 个月前

aygp-dr / nexushive-agent-insights

Enterprise-grade observability for AI agents using OpenTelemetry

ai-agents llm-monitoring OpenTelemetry smolagents telemetry

Python

5 个月前

BMolapisi / flagwise

FlagWise 🐙 detects Shadow AI and monitors LLM traffic in real time, exposing unauthorized or risky model use for security, compliance, and audit across enterprise systems.

ai-analytics ai-observability 大语言模型 llm-monitoring llm-security

Python

6 小时前