# Alyah ⭐: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs

DevFeed: [Alyah ⭐: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs](<https://devfeed.tech/articles/alyah-toward-robust-evaluation-of-emirati-dialect-capabilities-in-arabic-llms-7505.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/tiiuae/emirati-benchmarks>)

Author: Omar saif alkaabi; Ahmed Alzubaidi; Hamza Alobeidli; Shaikha Alsuwaidi; Mohammed Alyafeai; Leen AlQadi; Basma Boussaha; Hakim Hacid

Published: 2026-01-27T10:26:42Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [arabic](<https://devfeed.tech/tags/arabic.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [blog](<https://devfeed.tech/tags/blog.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llms](<https://devfeed.tech/tags/llms.md>), [technology](<https://devfeed.tech/tags/technology.md>), [testing](<https://devfeed.tech/tags/testing.md>)

## AI overview

This article introduces Alyah, an Emirati-centric benchmark for evaluating how Arabic large language models understand Emirati dialect, including its linguistic, cultural, and pragmatic nuances. The benchmark contains 1,173 manually collected samples from native Emirati speakers and covers local expressions, greetings, anecdotes, heritage questions, and Emirati poetry.

## Source excerpt

A Blog post by Technology Innovation Institute on Hugging Face