# Introducing the Open Chain of Thought Leaderboard

DevFeed: [Introducing the Open Chain of Thought Leaderboard](<https://devfeed.tech/articles/introducing-the-open-chain-of-thought-leaderboard-7315.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/leaderboard-cot>)

Author: Gregor Betz; Sebastian Cacean; Clémentine Fourrier; Kyle Richardson

Published: 2024-04-23T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Chain-of-thought](<https://devfeed.tech/topics/chain-of-thought.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [chain-of-thought](<https://devfeed.tech/tags/chain-of-thought.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [research](<https://devfeed.tech/tags/research.md>), [science](<https://devfeed.tech/tags/science.md>)

## AI overview

The article introduces the Open Chain of Thought Leaderboard, which measures how much chain-of-thought prompting improves language model performance rather than scoring only absolute accuracy. It evaluates reasoning traces on tasks including LogiQA and the LSAT dataset, aiming to provide a more robust comparison of LLM reasoning ability and reduce the impact of training-data contamination.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.