# Introducing the Open Leaderboard for Japanese LLMs!

DevFeed: [Introducing the Open Leaderboard for Japanese LLMs!](<https://devfeed.tech/articles/introducing-the-open-leaderboard-for-japanese-llms-7319.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/leaderboard-japanese>)

Author: Akim Mousterou; Yusuke Miyao; Namgi Han; Takumi Okamoto; Shigeki Ishida; hysts; Clémentine Fourrier

Published: 2024-11-20T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Large language models (LLMs)](<https://devfeed.tech/topics/large-language-models-llms.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [tokenization](<https://devfeed.tech/topics/tokenization.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [llms](<https://devfeed.tech/tags/llms.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [research](<https://devfeed.tech/tags/research.md>), [tokenization](<https://devfeed.tech/tags/tokenization.md>)

## AI overview

The article introduces the Open Japanese LLM Leaderboard, an open evaluation platform built by LLM-jp and Hugging Face. It uses more than 20 datasets and a specialized evaluation suite covering 16 tasks to compare Japanese large language models, address the challenges of Japanese NLP, and support transparent, collaborative, open-source research.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.