# Swanada: Split-Encoder Capability-Routed Conformer CTC and Sub-30 MB On-Device Speech Recognition Across Twelve Scripts

DevFeed: [Swanada: Split-Encoder Capability-Routed Conformer CTC and Sub-30 MB On-Device Speech Recognition Across Twelve Scripts](<https://devfeed.tech/articles/swanada-split-encoder-capability-routed-conformer-ctc-and-sub-30-mb-on-device-speech-recognition-across-twelve-scripts-128358.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.13814>)

Author: Hemanth HM

Published: 2026-11-11T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [asr](<https://devfeed.tech/topics/asr.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Node.js](<https://devfeed.tech/topics/node-js.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-sd](<https://devfeed.tech/tags/cs-sd.md>), [on-device-speech-recognition](<https://devfeed.tech/tags/on-device-speech-recognition.md>), [recognition](<https://devfeed.tech/tags/recognition.md>), [scripts](<https://devfeed.tech/tags/scripts.md>), [speech](<https://devfeed.tech/tags/speech.md>), [speech-recognition](<https://devfeed.tech/tags/speech-recognition.md>)

## AI overview

Swanada uses a shared INT8 Conformer encoder with hot-swappable, script-specific CTC heads to run streaming 16 kHz speech recognition for 12 languages across browser WebAssembly, Node.js, and Python. Its Studio tier is 177.38 MiB; the distilled Mobile tier is 25.35 MiB. The abstract reports 12-language storage reductions of 11.6x for Studio and 67.8x for Mobile, with 25.85 MiB required on Mobile's first load. Runtime changes synthesize positional encodings and replace pointwise convolutions with MatMul. On the reported held-out and open test clips, Studio achieved 5.43% and 8.87% CER, while Mobile achieved 18.56% and 19.23%; the abstract reports 0.0097x-0.0264x real-time factor and 30.6 ms median time to first token.

## Source excerpt

arXiv:2611.13814v1 Announce Type: cross Abstract: Client-side automatic speech recognition (ASR) across Indic and Classical scripts eliminates cloud transcription costs, network tail latency, and server-side audio retention, yet neural exports face four systems bottlenecks in browsers and mobile runtimes: (1) monolithic per-language Conformer checkpoints require ~177 MiB per script (> 2.1 GiB across 12 scripts), exhausting CacheStorage quotas; (2) static relative positional encoding tables embed 10.2-20.5 MB of FP32 constants while 1x1 Conv1d layers trigger slow or unsupported ConvInteger kernels in WebAssembly SIMD; (3) sliding-window CTC flickers on boundary tokens; and (4) mobile WebAudio pipelines suffer 44.1/48 kHz sample-rate mismatches and silent AudioWorklet stalls under iOS WKWebView. We present Swanada, an open-source 16 kHz streaming ASR system spanning Classical Sanskrit, Indian English, and ten Indian languages (sa, en, hi, kn, mr, bn, ta, te, ml, gu, pa, or) across browser WebAssembly, Node.js, and Python. Swanada pairs capability-routed shared INT8 Conformer encoders (a 17-layer 177.38 MiB Studio tier at $d = 512$ for desktop/servers and a distilled 14-layer 25.35 MiB Mobile tier at $d = 256$ for phones) with twelve hot-swappable 515.0 KiB native-script linear CTC heads ($257 \times 512$), cutting 12-language storage by $11.6\times$ (183.4 MiB) and $67.8\times$ (31.39 MiB; 25.85 MiB first load). Runtime protobuf tail surgery exposes the shared representation in $< 2$ ms, while dynamic positional synthesis, MatMul pointwise convolutions, and post-quantization QInt8 head calibration preserve sub-30 MB accuracy. Across $N = 480$ held-out and $N = 1,280$ open public test clips (FLEURS, LibriSpeech, GLOBE, AMI, wild Sanskrit), Swanada achieves 5.43% held-out and 8.87% 12-language open CER on Studio (18.56% and 19.23% on Mobile) at $0.0097\times$-$0.0264\times$ RTF, with 30.6 ms median TTFT and 0.00% committed-prefix churn.