# Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

DevFeed: [Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs](<https://devfeed.tech/articles/introducing-the-livecodebench-leaderboard-holistic-and-contamination-free-evaluation-of-code-llms-7320.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/leaderboard-livecodebench>)

Author: Naman Jain; Alex Gu; Tianjun Zhang; Wen-Ding Li; King Han; Fanjia Yan; Clémentine Fourrier

Published: 2024-04-16T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Code](<https://devfeed.tech/topics/code.md>), [Human-AI evaluation](<https://devfeed.tech/topics/human-ai-evaluation.md>), [Code Challenge](<https://devfeed.tech/topics/code-challenge.md>), [LeetCode](<https://devfeed.tech/topics/leetcode.md>)

Tags: [code](<https://devfeed.tech/tags/code.md>), [code-generation](<https://devfeed.tech/tags/code-generation.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [competition](<https://devfeed.tech/tags/competition.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [llms](<https://devfeed.tech/tags/llms.md>), [research](<https://devfeed.tech/tags/research.md>), [tests](<https://devfeed.tech/tags/tests.md>)

## AI overview

LiveCodeBench is a contamination-aware benchmark and leaderboard for evaluating code-focused large language models over time. It uses dated problems from LeetCode, AtCoder, and CodeForces to assess code generation, self-repair, code execution, and test output prediction.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.