# long-context Published articles for long-context. This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU DevFeed: [Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU]() Original publisher: [Read original article]() Author: Anthony Su; Injae Kwak Published: 2026-09-12T11:04:33.891311Z Content type: article Language: en Sources: [Google Developers Blog]() Topics: [Embeddings](), [vllm](), [Inference](), [long-context](), [autoscaling](), [Kubernetes](), [Cloud](), [Google](), [Artificial Intelligence](), [model-deployment](), [Open Source]() Tags: [autoscaling](), [embedding](), [github](), [gpu](), [inference](), [kubernetes](), [long-context](), [multimodal](), [open-source](), [retrieval](), [tpu](), [vllm]() ### AI overview This article explains how Google Cloud integrated native TPU support into vLLM to serve long-context, multimodal embedding models at production scale. It describes elastic TPU provisioning with Google Kubernetes Engine, autoscaling across accelerator types, and TPU-specific optimizations for long sequences and chunked prefill. The resulting setup is designed to preserve numerical parity with GPU reference baselines while supporting high-throughput semantic retrieval applications. ### Source excerpt Google Cloud has natively integrated TPU support into the vLLM serving engine, allowing developers to elastically scale high-demand embedding pipelines using Google Kubernetes Engine (GKE). To handle massive 15K+ token contexts for models like Qwen3-Embedding-8B, the engineering team implemented TPU-specific optimizations such as hardware-safe tensor alignment, JAX/XLA compilation pre-warming, and a hybrid StepPool architecture for chunked prefill management. These enhancements achieve near-perfect numerical parity with reference GPU baselines, and developers can immediately leverage the open-sourced setup recipes on the AI-Hypercomputer GitHub to build their own high-throughput semantic retrieval applications. ## Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM DevFeed: [Deploying Qwen3.8-2.4T-A95B on Amazon SageMaker HyperPod with vLLM]() Original publisher: [Read original article]() Author: Dmitry Soldatkin Published: 2026-09-09T22:26:29Z Content type: tutorial Language: en Sources: [Artificial Intelligence]() Topics: [Deployment](), [Inference](), [Machine learning](), [Language models](), [GPU](), [long-context](), [Mixture of Experts (MoE)]() Tags: [advanced-300](), [agentic](), [amazon-sagemaker](), [amazon-sagemaker-hyperpod](), [deployment](), [gpu](), [how-to](), [inference](), [long-context](), [moe](), [nvfp4](), [quantization](), [qwen](), [reasoning](), [technical-how-to](), [tool](), [vllm]() ### AI overview A deployment walkthrough for serving the open-weight Qwen3.8-2.4T-A95B language model on Amazon SageMaker HyperPod with vLLM and NVIDIA B300 GPUs. It covers provisioning, NVFP4 quantization, an OpenAI-compatible endpoint, reasoning, tool calling, and MTP speculative decoding. ### Source excerpt Learn how to deploy Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter open-weight model, on Amazon SageMaker HyperPod with vLLM. This walkthrough covers cluster provisioning, NVFP4 quantization, and an OpenAI-compatible endpoint with built-in reasoning, tool calling, and native MTP speculative decoding. ## With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents DevFeed: [With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents]() Original publisher: [Read original article]() Author: NVIDIA Writers Published: 2026-08-24T15:00:41Z Content type: news Language: en Sources: [NVIDIA Blog]() Topics: [Inference Performance](), [long-context](), [Low-Latency Inference](), [networking](), [gemma4]() Tags: [agentic](), [agents](), [ai-factory](), [ai-inference](), [ai-infrastructure](), [benchmark](), [bluefi](), [cloud](), [cpx](), [groq](), [groq-3-lpx](), [inference](), [infrastructure](), [latency](), [long-context](), [low-latency-inference](), [lpx](), [networking](), [nvidia](), [nvidia-spectrum-x-ethernet](), [nvidia-vera](), [nvidia-vera-rubin](), [nvl72](), [nvlink](), [vera-cpu](), [vera-rubin]() ### AI overview NVIDIA announces Groq 3 LPX production availability alongside Vera Rubin NVL72, positioning the integrated compute, networking, and inference stack for long-context, agentic AI workloads. The article highlights a benchmark result of 3,400 output tokens per second on Gemma 4 31B and describes partner adoption of Vera Rubin, Spectrum-X Multiplane, and Groq 3 LPX. ### Source excerpt The next era of AI inference won't be defined by a single breakthrough chip, network or system. It'll be defined by how every layer of the AI factory works together. That's why NVIDIA is extending Vera Rubin NVL72 with fast token generation for agentic systems. Announced today, the NVIDIA Vera Rubin rack-scale system NVIDIA Groq [...] ## Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents DevFeed: [Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents]() Original publisher: [Read original article]() Author: Shruti Koparkar Published: 2026-08-24T15:00:19Z Content type: article Language: en Sources: [NVIDIA Blog]() Topics: [AI Agent](), [NVIDIA Vera Rubin](), [Vera Rubin NVL72](), [Inference Performance](), [long-context](), [GB300 NVL72](), [Inference](), [benchmarking](), [Nvidia]() Tags: [agentic-ai](), [agents](), [ai](), [ai-infrastructure](), [gb300-nvl72](), [hardware](), [inference](), [infrastructure](), [long-context](), [networking](), [nvidia-blackwell](), [nvidia-vera-rubin](), [performance](), [software](), [think-smart]() ### AI overview NVIDIA reports that Vera Rubin NVL72 systems deliver up to 30x higher throughput per megawatt than GB300 NVL72 on agentic workloads measured with the SemiAnalysis AgentX workload. The article attributes the efficiency challenge to long, variable agent workflows involving tool calls, accumulated context, and sub-agents. ### Source excerpt According to OpenRouter data, agentic AI workloads consume 15x more tokens than a simple chat request. Why? Consider what happens when an AI agent researches a company for an investment decision. The agent queries financial databases, searches news and filings, invokes a sub-agent to run peer comparisons and model valuations, then synthesizes everything into a [...] ## NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt DevFeed: [NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt]() Original publisher: [Read original article]() Author: Elizabeth Goodman Published: 2026-08-24T15:00:05Z Content type: article Language: en Sources: [NVIDIA Developer](), [NVIDIA Technical Blog]() Topics: [AI-assisted coding]() Tags: [agentic-ai](), [agentic-ai-generative-ai](), [agentic-coding](), [ai-agent](), [ai-agents](), [ai-factory](), [ai-infrastructure](), [benchmark](), [blackwell](), [cache](), [cloud-networking](), [cloud-services](), [data-center-cloud](), [gb300-nvl72](), [hardware](), [inference](), [long-context](), [mixture-of-experts-moe](), [nemotron](), [nvidia](), [performance](), [software-defined-data-center](), [tools](), [vera-rubin](), [vera-rubin-nvl72]() ### AI overview The article examines the SemiAnalysis AgentX benchmark for measuring infrastructure efficiency on replayed agentic coding sessions. It compares Vera Rubin and Blackwell NVL72 systems by agentic throughput per megawatt and explains why dynamic, stateful sessions require more realistic evaluation than fixed-length inference tests. ### Source excerpt AI agents have expanded inference from single-turn interactions into multi-step workflows that reason, invoke tools, coordinate subagents, and carry growing... ## How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin DevFeed: [How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin]() Original publisher: [Read original article]() Author: Tanya Lenz Published: 2026-08-24T15:00:00Z Content type: article Language: en Sources: [NVIDIA Developer](), [NVIDIA Technical Blog]() Topics: [d-matrix](), [Vera Rubin](), [Inference Performance](), [long-context](), [Benchmark](), [Artificial Intelligence](), [gemma4](), [systems](), [Cache]() Tags: [agent](), [agentic](), [agentic-ai-generative-ai](), [ai](), [ai-factory](), [ai-inference](), [benchmark](), [cache](), [collective](), [data-center-cloud](), [developer-tools-techniques](), [groq](), [groq-3-lpx](), [inference-performance](), [long-context](), [low-latency-inference](), [lpx](), [nvidia](), [nvidia-vera](), [performance](), [rubin-gpu](), [speed](), [systems](), [tokens](), [training-ai-models](), [vera-rubin](), [vera-rubin-nvl72]() ### AI overview NVIDIA Groq 3 LPX, paired with Vera Rubin NVL72, delivers high-interactivity AI inference for long-context workloads. A reported benchmark measured 3,431 output tokens per second on Gemma 4 31B with a 100K context. ### Source excerpt NVIDIA Groq 3 LPX is the interactive AI inference accelerator for the NVIDIA Vera Rubin platform. At the core of the platform is NVIDIA Vera Rubin NVL72, the... ## GPT-5.6 Sol is now 50% off a lower price DevFeed: [GPT-5.6 Sol is now 50% off a lower price]() Original publisher: [Read original article]() Author: Jerilyn Zheng Published: 2026-08-21T00:00:00Z Content type: release Language: en Sources: [Vercel News]() Topics: [OpenAI](), [Language models](), [AI-assisted coding](), [SDKs](), [long-context](), [Vercel]() Tags: [ai](), [ai-gateway](), [coding-agents](), [gpt](), [long-context](), [model](), [openai](), [playground](), [pricing](), [sdk](), [tokens](), [vercel]() ### AI overview OpenAI lowered the list price of GPT-5.6 Sol, while a 50% AI Gateway discount applies to the lower price through September 18. Input pricing falls by 20% and output pricing by one third across service tiers. Existing requests receive the new price automatically because the model ID is unchanged, and Sol can be configured for coding agents through AI Gateway. ### Source excerpt OpenAI lowered list pricing for GPT-5.6 Sol, and the 50% AI Gateway discount now applies to the new, lower price through September 18. Input drops 20%, output drops a third. The discount applies on every OpenAI service tier: Service tier You pay now (input / output) New list price (input / output) You paid before (input / output) Default $2.00 / $10.00 $4.00 / $20.00 $2.50 / $15.00 Flex $1.00 / $5.00 $2.00 / $10.00 $1.25 / $7.50 Priority (fast mode) $4.00 / $20.00 $8.00 / $40.00 $5.00 / $30.00 Rates are per million tokens for requests up to 272K tokens. Cached tokens, cache writes, long-context requests above 272K, and the US regional rates all move by the same proportion. See the pricing page for all model rates. The model ID is unchanged, so requests you already send bill at the new price automatically. BYOK requests bill at your own rate with OpenAI. To use Sol in a coding agent, run vercel ai-gateway coding-agents setup to connect your agents to AI Gateway, then select openai/gpt-5.6-sol in the agent's model settings. See the coding agents guide for setup details. Try it in the playground, or browse every language model on the AI Gateway. Read more ## GPT-5.6 Sol is 50% off on AI Gateway for the next month DevFeed: [GPT-5.6 Sol is 50% off on AI Gateway for the next month]() Original publisher: [Read original article]() Author: Jerilyn Zheng Published: 2026-08-17T00:00:00Z Content type: release Language: en Sources: [Vercel News]() Topics: [OpenAI](), [API](), [API keys](), [Claude Code](), [codex](), [long-context](), [AI-assisted coding](), [browser](), [pdf]() Tags: [ai-gateway](), [api](), [browser](), [cache](), [claude-code](), [codex](), [coding-agents](), [gpt](), [long-context](), [openai](), [pdf](), [pricing](), [tokens]() ### AI overview OpenAI's GPT-5.6 Sol is available at a 50% discount through September 18 for requests billed directly through AI Gateway. The discount covers all listed service tiers, token types, regions, modes, cached tokens, cache writes, and long-context requests, while BYOK requests remain subject to the user's provider pricing. Existing requests use the discounted rate without a model ID change. ### Source excerpt GPT-5.6 Sol, the flagship of OpenAI's GPT-5.6 series, is 50% off on AI Gateway through September 18. The discount applies on the OpenAI provider to all token types, tiers, regions, and modes, and it is available only on requests running directly through AI Gateway (not BYOK). Pricing: 50% off Service tier New price per M tokens (input / output) Original price per M tokens (input / output) Default $2.50 / $15.00 $5.00 / $30.00 Flex $1.25 / $7.50 $2.50 / $15.00 Priority (fast mode) $5.00 / $30.00 $10.00 / $60.00 The discount applies on the same terms everywhere else the model is priced: across every service tier, including fast mode, and to cached tokens, cache writes, long-context requests, and different regions. It covers requests billed through AI Gateway on the OpenAI provider. BYOK requests run on your own provider accounts and bill at whatever rate you have with them. The model ID is unchanged, so requests you already send pick up the discounted rate with no code change: Sol takes a reasoning effort up to max for the hardest problems, accepts text, image, and PDF input, and carries a long context window. To use it in a coding agent, run vercel ai-gateway coding-agents setup to connect Claude Code, Codex, OpenCode, or Pi, then select openai/gpt-5.6-sol inside the agent. The 50% discount will apply there. Get started Create an API key in the AI Gateway section of your dashboard, or try the model in the browser first from its playground page. Read more ## Making Knowledge Distillation Cheap Enough to Run at Scale DevFeed: [Making Knowledge Distillation Cheap Enough to Run at Scale]() Original publisher: [Read original article]() Author: Antonio Tiene; Iker García-Ferrero; Ali Hashemi; Bakbergen Ryskulov Published: 2026-08-10T10:05:36Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [LLM Techniques](), [Large Language Model](), [Post-training optimization](), [Model Routing](), [GPU](), [Machine learning](), [PyTorch](), [gpt-oss](), [Nvidia]() Tags: [blog](), [caching](), [compute](), [cost](), [gpt](), [gpt-oss](), [gpu](), [hugging-face](), [language-models](), [large-language-models](), [long-context](), [machine-learning](), [memory](), [performance](), [pytorch](), [qwen](), [research](), [training]() ### AI overview This article presents an efficient approach to knowledge distillation for large language models. It caches the teacher model's top-K logits offline and uses a fused, memory-efficient chunked KL-divergence loss, avoiding simultaneous teacher-student residency and full vocabulary-by-sequence-length matrices. The changes reduce VRAM use and training cost, enabling long-context distillation on a single GPU and making larger-scale experimentation more practical. ### Source excerpt A Blog post by Multiverse Computing on Hugging Face ## Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference DevFeed: [Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference]() Original publisher: [Read original article]() Author: Tanya Lenz Published: 2026-07-31T22:16:17Z Content type: article Language: en Sources: [NVIDIA Developer](), [NVIDIA Technical Blog]() Topics: [Inference Performance](), [long-context](), [Artificial Intelligence](), [GPU](), [GPU optimization](), [Large Language Model](), [Nvidia]() Tags: [agentic-ai-generative-ai](), [ai](), [ai-inference](), [data-center-cloud](), [developer-tools-techniques](), [featured](), [gpu](), [inference](), [inference-performance](), [long-context](), [memory](), [model-architecture](), [nvidia](), [performance]() ### AI overview This article examines how co-designing dense attention with GPU execution can improve throughput and interactivity for long-context inference. It analyzes group size, head dimension, sequence length, and the different compute and memory behavior of prefill and decode, including the effects of speculative decoding and prefix caching. ### Source excerpt As agentic and long-context workloads become common, the context lengths increase and attention consumes a larger share of inference time (Figure 1). Because... ## NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding DevFeed: [NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding]() Original publisher: [Read original article]() Author: Nirmal Kumar Juluru Published: 2026-07-27T00:45:00Z Content type: article Language: en Sources: [NVIDIA Developer](), [NVIDIA Technical Blog]() Topics: [coding](), [Verilog](), [AI-assisted coding](), [Nvidia](), [Artificial Intelligence](), [debugging](), [Benchmark](), [Code generation](), [Hardware](), [long-context]() Tags: [agentic](), [agentic-ai-generative-ai](), [ai](), [ai-agent](), [ai-agents](), [automation](), [benchmark](), [chip-design](), [code](), [code-generation](), [coding](), [debugging](), [developer-tools-techniques](), [efficiency](), [engineering](), [featured](), [hardware-semiconductor](), [llms](), [long-context](), [models](), [nemotron](), [nvidia](), [open](), [reasoning](), [top-stories](), [validation]() ### AI overview NVIDIA's article presents ACE-RTL and Nemotron 3 Ultra as a combined approach to agentic RTL coding. The workflow generates Verilog, runs simulations and other EDA checks, analyzes failures, and iteratively refines designs while maintaining debugging context. The CVDP benchmark evaluates accuracy and efficiency on realistic RTL generation, modification, debugging, and verification tasks. ### Source excerpt Modern chip design is increasingly limited by engineering time. Register transfer level (RTL) development and verification require specialized hardware... ## Inside NVIDIA Rubin GPU Architecture: Powering the Era of Agentic AI DevFeed: [Inside NVIDIA Rubin GPU Architecture: Powering the Era of Agentic AI]() Original publisher: [Read original article]() Author: Eduardo Alvarez Published: 2026-07-21T18:15:00Z Content type: article Language: en Sources: [NVIDIA Developer](), [NVIDIA Technical Blog]() Topics: [GPU](), [Nvidia](), [Artificial Intelligence](), [Inference](), [Inference Performance](), [long-context](), [datacenter](), [Transformer](), [Deployment]() Tags: [accelerate](), [agentic](), [agentic-ai](), [agentic-ai-generative-ai](), [ai](), [ai-agent](), [ai-factory](), [ai-inference](), [architecture](), [blackwell](), [cache](), [compute](), [data-center](), [data-center-cloud](), [developer-tools-techniques](), [dsx](), [efficiency](), [featured](), [gpu](), [inference](), [inference-performance](), [latency](), [long-context](), [memory](), [mixture-of-experts-moe](), [nvfp4](), [nvidia](), [rubin-gpu](), [scale](), [tensor-cores](), [top-stories](), [training](), [vera-rubin]() ### AI overview This article examines the NVIDIA Rubin GPU architecture and its co-designed Vera Rubin platform for agentic AI inference. It describes how Tensor Cores, HBM4 memory, the Transformer Engine, NVFP4 performance, cache, decoding, and scale-up systems address throughput, latency, long-context execution, and rack-scale deployment. ### Source excerpt What began as discrete AI model training and human-facing chat interfaces has evolved into always-on AI factories dedicated to producing intelligence at scale.... ## Claude Sonnet 5 now available on Vercel AI Gateway DevFeed: [Claude Sonnet 5 now available on Vercel AI Gateway]() Original publisher: [Read original article]() Author: Jerilyn Zheng Published: 2026-06-30T00:00:00Z Content type: news Language: en Sources: [Vercel News]() Topics: [AI, ML & Data Engineering](), [vercel ai sdk](), [long-context](), [SDKs]() Tags: [agentic](), [ai-gateway](), [ai-models](), [anthropic](), [anthropic-claude](), [api](), [api-keys](), [claude](), [coding](), [cost](), [inference](), [leaderboard](), [long-context](), [memory](), [model](), [models](), [performance](), [playground](), [vercel]() ### AI overview Claude Sonnet 5 is available through Vercel AI Gateway, with claimed improvements in coding, agentic work, document parsing, and long-context memory. The announcement lists launch and standard pricing and describes Gateway features for model access, usage tracking, cost controls, retries, and failover. ### Source excerpt Claude Sonnet 5 from Anthropic is now available on AI Gateway. Sonnet 5 improves on Sonnet 4.6 across coding and agentic work, reaching outcomes on many tasks that previously needed an Opus model, at Sonnet pricing. The model is more agentic and follows instructions more closely. Document parsing and long-context memory use are also stronger. Sonnet 5 also uses an updated tokenizer, like the recent Opus models, which can map the same input to more tokens. Launch pricing of $2 per million input tokens and $10 per million output tokens runs through August 31, 2026. Standard list price will be $3/M input tokens, $15/M output tokens. To use Sonnet 5, set model to anthropic/claude-sonnet-5 in the AI SDK: You can also try Sonnet 5 in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. Read more ## GLM-5.2: Built for Long-Horizon Tasks DevFeed: [GLM-5.2: Built for Long-Horizon Tasks]() Original publisher: [Read original article]() Author: Z AI Published: 2026-06-17T09:01:25Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [long-context](), [coding](), [Benchmark](), [Optimization](), [Open Source](), [Software Engineering](), [post-training]() Tags: [benchmark](), [coding](), [long-context](), [open-source](), [optimization](), [post-training](), [research](), [software-engineering]() ### AI overview GLM-5.2 is presented as an open-source model designed for long-horizon engineering work, combining a stable 1M-token context, flexible coding effort levels, and architectural changes that reduce computation and improve speculative decoding. The article reports strong results across long-horizon and standard coding benchmarks, positioning it as the highest-ranked open-source model in the cited evaluations. ### Source excerpt - Solid 1M Context: A solid 1M-token context that stably sustains long-horizon work - Advanced Coding with Flexible Effort: Stronger coding capabilities with multiple thinking effort levels to balance performance and latency - Improved Architecture: We propose IndexShare, which reuses the same indexer across every four sparse attention layers, reducing per-token FLOPs by 2.9x at a 1M context length. ## Scaling Context Management: Comparing Fable 5 and GPT-5.5 DevFeed: [Scaling Context Management: Comparing Fable 5 and GPT-5.5]() Original publisher: [Read original article]() Author: Calvin French-Owen Published: 2026-06-13T12:00:00Z Content type: opinion Language: en Sources: [Calvin French-Owen]() Topics: [long-context](), [codex](), [Fable](), [API](), [Caching](), [GPU]() Tags: [api](), [caching](), [codex](), [context](), [fable](), [gpu](), [long-context]() ### AI overview The article compares how Fable 5 and GPT-5.5 scale context management for difficult, long-running tasks. It describes Codex's server-side compaction approach and discusses its implications for clients and long-running threads. ### Source excerpt Comparing two very different approaches to scaling context between Fable 5 and GPT 5.5. ## Ground truth is a process, not a dataset DevFeed: [Ground truth is a process, not a dataset]() Original publisher: [Read original article]() Author: Venkatesh Saligrama Published: 2026-06-03T15:56:57Z Content type: article Language: en Sources: [Amazon Science homepage]() Topics: [ai observability](), [AI Chat]() Tags: [ai](), [ai-fact-checking](), [ai-generated-research-reports](), [audit-then-score](), [benchmarking](), [conversational-ai](), [datasets](), [deep-research-verification](), [deepfact-bench](), [evaluation](), [fact-verification](), [fact-verification-benchmark](), [generative-ai](), [ground-truth-benchmark-quality](), [hallucination-detection](), [hallucinations](), [human-ai-evaluation](), [large-language-models-llms](), [llm-evaluation-benchmarking](), [long-context](), [machine-learning](), [responsible-ai](), [retrieval-augmented-generation-rag]() ### AI overview The article argues that evaluating factuality in long AI-generated research reports requires a process-based approach to ground truth. It introduces audit-then-score and accompanying datasets for benchmarking AI fact checkers. ### Source excerpt Automatically fact-checking long, AI-generated research reports poses new challenges -- including benchmarking. ## AI IDE Billing: Lessons from Cursor and the New Wave DevFeed: [AI IDE Billing: Lessons from Cursor and the New Wave]() Original publisher: [Read original article]() Author: Ayush Agarwal Published: 2026-05-19T00:00:00Z Content type: article Language: en Sources: [Dodo Payments Blog]() Topics: [Artificial Intelligence](), [cursor](), [Large Language Model](), [long-context](), [Software as a service]() Tags: [ai](), [article](), [cursor](), [developer-tools](), [economics](), [llm](), [long-context](), [pricing](), [saas]() ### AI overview This article examines billing strategies used by AI integrated development environments such as Cursor. It discusses subscription pricing, usage-based overage, pricing transparency, and the challenge of managing high and variable LLM costs. ### Source excerpt What AI IDEs like Cursor reveal about billing AI products. Subscription anchors, usage-based overage, transparency, and avoiding surprise bills. ## Introducing the Ettin Reranker Family DevFeed: [Introducing the Ettin Reranker Family]() Original publisher: [Read original article]() Author: Tom Aarsen Published: 2026-05-19T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [sentence-transformers](), [Transformer](), [long-context](), [Agent Skill]() Tags: [ai-coding](), [community](), [long-context](), [nlp](), [open-source](), [ranking](), [research](), [retrieval](), [sentence-transformers]() ### AI overview The article introduces six Sentence Transformers CrossEncoder rerankers built on Ettin ModernBERT encoders. It explains their distillation-based training, retrieval-then-rerank usage, quality and cost trade-offs, and support for up to 8K tokens of context. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Databricks brings GPT-5.5 to enterprise agent workflows DevFeed: [Databricks brings GPT-5.5 to enterprise agent workflows]() Original publisher: [Read original article]() Published: 2026-05-15T00:00:00Z Content type: news Language: en Sources: [OpenAI News]() Topics: [databricks](), [Artificial Intelligence](), [Benchmark](), [Agent Harness](), [Parser](), [long-context](), [Orchestration](), [API]() Tags: [agents](), [ai](), [api](), [benchmark](), [databricks](), [enterprise](), [gpt](), [long-context](), [model](), [orchestration](), [production](), [retrieval](), [search](), [workflows]() ### AI overview Databricks is making GPT-5.5 available for enterprise agent workflows through AI Unity Gateway, following its state-of-the-art result on the OfficeQA Pro benchmark. The article reports 50% accuracy and a 46% error reduction versus GPT-5.4, with gains in parsing scanned and legacy documents, retrieval, orchestration, and multi-step workflow execution. ### Source excerpt Databricks uses GPT-5.5 for enterprise agent workflows after the model set a new state of the art on the OfficeQA Pro benchmark. ## Granite 4.1 LLMs: How They're Built DevFeed: [Granite 4.1 LLMs: How They're Built]() Original publisher: [Read original article]() Author: Yousaf Shah Published: 2026-04-29T15:01:48Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [LLMs](), [ibm](), [long-context](), [Fine-tuning](), [grpo](), [Training AI Models](), [Transformer architecture](), [Data Quality]() Tags: [apache](), [fine-tuning](), [grpo](), [ibm](), [learning](), [llms](), [long-context](), [tokens](), [training](), [transformer-architecture]() ### AI overview The article introduces Granite 4.1, IBM's family of dense decoder-only LLMs in 3B, 8B, and 30B sizes. It describes their five-stage training process, which uses about 15 trillion tokens, data-quality refinement, long-context extension up to 512K tokens, supervised fine-tuning, and reinforcement learning with on-policy GRPO and DAPO loss. The models use a dense transformer architecture and are released under the Apache 2.0 license. ### Source excerpt Authors: Granite Team, IBM TL;DR -- Granite 4.1 is a family of dense, decoder-only LLMs (3B, 8B, and 30B) trained on ~15T tokens using a multi-stage pre-training pipeline, including long-context extension of up to 512K tokens. The models are further refined with supervised fine-tuning on ~4.1M high-quality curated samples and reinforcement learning via on-policy GRPO with DAPO loss (Yu et al., 2025). ## Introducing NVIDIA Nemotron 3 Nano Omni: Long-Context Multimodal Intelligence for Documents, Audio and Video Agents DevFeed: [Introducing NVIDIA Nemotron 3 Nano Omni: Long-Context Multimodal Intelligence for Documents, Audio and Video Agents]() Original publisher: [Read original article]() Author: Tuomas Rintamaki; Amala Sanjay Deshmukh; Nabin Mulepati; Collin McCarthy; Pritam Biswas; Arushi Goel; Alexandre Milesi; Danial Mohseni Taheri; Kateryna Chumachenko; Isabel Hulseman; Zhehuai Chen; Kara Published: 2026-04-28T15:58:57Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [multimodal](), [Nemotron](), [long-context](), [asr](), [computer-use](), [Mamba](), [model architecture](), [moe](), [Transformer](), [Nvidia](), [Reinforcement learning](), [NVFP4]() Tags: [alternatives](), [analysis](), [architecture](), [benchmarks](), [computer-use](), [efficiency](), [long-context](), [models](), [multimodal](), [nemotron](), [nvidia](), [optimization](), [reasoning](), [reinforcement-learning](), [speed]() ### AI overview NVIDIA introduces Nemotron 3 Nano Omni, an omni-modal model for document analysis, image reasoning, speech recognition, long audio-video understanding, computer use, and general reasoning. It combines a hybrid Mamba-Transformer Mixture-of-Experts backbone with vision and audio encoders, supports long multimodal contexts, and reports strong benchmark accuracy, throughput, reasoning speed, and system efficiency. ### Source excerpt Introducing NVIDIA Nemotron 3 Nano Omni: Long-Context Multimodal Intelligence for Documents, Audio and Video Agents - NVIDIA Nemotron 3 Nano Omni is a new omni-modal understanding model built for real-world document analysis, multiple image reasoning, automatic speech recognition, long audio-video understanding, agentic computer use, and general reasoning. - It extends the Nemotron multimodal line from a strong vision-language system to a broader text + image + video + audio model. ## DeepSeek-V4: a million-token context that agents can actually use DevFeed: [DeepSeek-V4: a million-token context that agents can actually use]() Original publisher: [Read original article]() Author: ben burtenshaw Published: 2026-04-24T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [deepseek](), [long-context](), [context window](), [Inference](), [Cache](), [Benchmark](), [model-deployment](), [AI Chat](), [Open Source]() Tags: [agentic](), [agents](), [artificial-intelligence](), [benchmark](), [cache](), [community](), [context-window](), [deepseek](), [gpu](), [inference](), [llm](), [long-context](), [moe](), [open-source](), [research]() ### AI overview DeepSeek-V4 is presented as an open model designed for long-running agentic workloads. The article explains how its architecture reduces the inference FLOPs and KV cache memory required for million-token contexts, and describes post-training choices intended to improve extended tool-use trajectories. It highlights Compressed Sparse Attention and a lightning indexer as mechanisms behind the efficiency gains, with comparisons against DeepSeek-V3.2 and grouped-query attention. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Welcome Gemma 4: Frontier multimodal intelligence on device DevFeed: [Welcome Gemma 4: Frontier multimodal intelligence on device]() Original publisher: [Read original article]() Author: merve; Pedro Cuenca; Sergio Paniego; ben burtenshaw; Steven Zheng; Alvaro Bartolome; Nathan Habib Published: 2026-04-02T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [gemma4](), [multimodal](), [Open Source](), [long-context](), [quantization](), [llama.cpp](), [MLX](), [Rust](), [webgpu]() Tags: [audio](), [benchmarks](), [fine-tuning](), [gemma](), [gemma4](), [generation](), [google](), [guide](), [llama](), [llama-cpp](), [local](), [long-context](), [mlx](), [models](), [moe](), [multimodal](), [on-device](), [open](), [open-source](), [quantization](), [science](), [speed]() ### AI overview Gemma 4 is presented as an open, Apache 2-licensed family of multimodal models supporting image, video, text, and, for selected variants, audio inputs. The article highlights on-device deployment, long-context support, compatibility across libraries and devices, quantization, benchmark results, and implementation options including llama.cpp, MLX, WebGPU, and Rust. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Falcon Perception DevFeed: [Falcon Perception]() Original publisher: [Read original article]() Author: Basma Boussaha; FalconPerception Published: 2026-04-01T07:13:20Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [Transformer](), [Open Source](), [Large Language Model](), [Benchmark](), [text-generation](), [long-context]() Tags: [benchmark](), [blog](), [hugging-face](), [long-context](), [model](), [ocr](), [open-source](), [performance](), [scale](), [technology](), [training](), [vision]() ### AI overview Falcon Perception is a 0.6B-parameter early-fusion Transformer for open-vocabulary grounding and segmentation from natural-language prompts. The article also introduces PBench, a diagnostic benchmark for perception capabilities and crowded long-context scenes, and Falcon OCR, a 0.3B-parameter open-source OCR model. ### Source excerpt A Blog post by Technology Innovation Institute on Hugging Face [Next page]()