Repository navigation

llm-evaluation-metrics

Website
Wikipedia

The LLM Evaluation Framework

evaluation-metrics evaluation-framework llm-evaluation llm-evaluation-framework llm-evaluation-metrics Hacktoberfest Python

Python

11438

992

9 小时前

locuslab / open-unlearning

The one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE, WMDP, and many unlearning methods. All features: benchmarks, methods, evaluations, models etc. are easily extensible.

privacy-protection benchmarks llm-evaluation-metrics 大语言模型 Open Source

Python

381

2 个月前

cvs-health / langfair

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

人工智能 bias bias-detection fairness fairness-ai fairness-ml fairness-testing large-language-models 大语言模型 responsible-ai Python ai-safety llm-evaluation llm-evaluation-framework llm-evaluation-metrics

Python

235

2 天前

zhuohaoyu / KIEval

[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

explainable-ai 大语言模型 llm-evaluation llm-evaluation-framework llm-evaluation-metrics 机器学习

Python

1 年前

attogram / ollama-multirun

Run a prompt against all, or some, of your models running on Ollama. Creates web pages with the output, performance statistics and model info. All in a single Bash shell script.

人工智能 ollama llm-evaluation ollama-interface Bash ollama-app llm-evaluation-metrics llm-eval static-site-generator

Shell

1 个月前

pyladiesams / eval-llm-based-apps-jan2025

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

大语言模型 llmops workshop llm-eval llm-evaluation-framework llm-evaluation-metrics llm-monitoring

Jupyter Notebook

5 个月前

ronniross / llm-confidence-scorer

Measure of estimated confidence for non-hallucinative nature of outputs generated by Large Language Models.

大语言模型 llm-evaluation llm-evaluation-framework llm-evaluation-metrics llm-training dataset datasets

Python

2 个月前

Pavansomisetty21 / GEval-Metrics-Analyzing-the-Reliability-of-LLM-Responses

In this we evaluate the LLM responses and find accuracy

llm-evaluation-metrics

Python

3 个月前

lalitkpal / VerifyAI

VerifyAI is a simple UI application to test GenAI outputs

genai generative-ai 大语言模型 llm-evaluation llm-evaluation-framework llm-evaluation-metrics

Python

1 个月前

ritwickbhargav80 / quick-llm-model-evaluations

This repo is for an streamlit application that provides a user-friendly interface for evaluating large language models (LLMs) using the beyondllm package.

llm-evaluation-metrics 大语言模型 retrieval-augmented-generation Streamlit

Python

1 年前

nhsengland / evalsense

Tools for systematic large language model evaluations

llm-evaluation llm-evaluation-metrics 大语言模型 evaluation-framework evaluation-metrics llm-evaluation-framework

Python

18 天前