Members-Only

Recent Talks & Demos are for members only

Exclusive feed

You must be an AI Tinkerers active member to view these talks and demos.

Sign in View FAQ

April 24, 2025 · Dublin

YourBench - Benchmarking LLMs on your Data

This talk demonstrates how to create a dataset and use YourBench to efficiently evaluate the performance of large language models on your own data.

Overview

I’ll demo how to create a dataset to evaluate how well an LLM performs on your own data using https://huggingface.co/yourbench

Links

https://huggingface.co/yourbench
YourBench: Automated zero-shot LLM benchmark generation from custom documents via YAML.

Tech stack