# zero-shot

Published articles for zero-shot.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Understanding W8A8 INT8 LLM quantization: Accuracy and performance results

DevFeed: [Understanding W8A8 INT8 LLM quantization: Accuracy and performance results](<https://devfeed.tech/articles/understanding-w8a8-int8-llm-quantization-accuracy-and-performance-results-17433.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/09/14/understanding-w8a8-int8-llm-quantization-accuracy-and-performance-results>)

Author: Sana Fayyaz

Published: 2026-09-14T13:01:43Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Algorithms](<https://devfeed.tech/topics/algorithms.md>)

Tags: [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [compression](<https://devfeed.tech/tags/compression.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [performance](<https://devfeed.tech/tags/performance.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

The article evaluates W8A8 INT8 quantization of a Llama 3.1 8B Instruct model. It describes reducing the model from 14.9 GB to 8.0 GB with SmoothQuant and GPTQ, then compares the base and compressed models on four benchmarks to assess accuracy and performance.

### Source excerpt

In Understanding W8A8 INT8 LLM quantization: Half the size, better performance, same accuracy, we compressed a Llama 3.1 8B Instruct model from 14.9 GB to 8.0 GB using 8-bit integer (INT8) W8A8 quantization with SmoothQuant and Generative Pre-trained Transformer Quantization (GPTQ). The post Understanding W8A8 INT8 LLM quantization: Accuracy and performance results appeared first on Red Hat Developer.

## From zero-shot forecast to purchase order with Amazon Bedrock AgentCore

DevFeed: [From zero-shot forecast to purchase order with Amazon Bedrock AgentCore](<https://devfeed.tech/articles/from-zero-shot-forecast-to-purchase-order-with-amazon-bedrock-agentcore-4640.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/architecture/from-zero-shot-forecast-to-purchase-order-with-amazon-bedrock-agentcore/>)

Author: Hyunsoo Kim, Ph.D.

Published: 2026-09-11T14:08:01Z

Content type: article

Language: en

Sources: [AWS Architecture Blog](<https://devfeed.tech/sources/aws-architecture-blog.md>)

Topics: [AI Bots](<https://devfeed.tech/topics/ai-bots.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agents](<https://devfeed.tech/tags/agents.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [automation](<https://devfeed.tech/tags/automation.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [strands-agents](<https://devfeed.tech/tags/strands-agents.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [training](<https://devfeed.tech/tags/training.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

An architecture article on using Amazon Chronos2 zero-shot forecasting and Bedrock AgentCore multi-agent orchestration to turn demand forecasts into validated purchase orders without per-product model training.

### Source excerpt

Combine zero-shot forecasting with Amazon Chronos2 and multi-agent orchestration on Amazon Bedrock AgentCore to turn demand forecasts into validated purchase orders. No per-product model training, with business rules, auditability, and cost that scales to zero.

## IBM releases SOTA Granite Time Series PatchTST-FM-r2 model with commercial-friendly license

DevFeed: [IBM releases SOTA Granite Time Series PatchTST-FM-r2 model with commercial-friendly license](<https://devfeed.tech/articles/ibm-releases-sota-granite-time-series-patchtst-fm-r2-model-with-commercial-friendly-license-7266.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/ibm-research/ibm-releases-sota-granite-time-series>)

Author: Roman Vaculin; Wesley M Gifford; Jiri Navratil; Chandra Reddy; Ayhan Sebin

Published: 2026-09-09T15:36:24Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Temporal data](<https://devfeed.tech/topics/temporal-data.md>), [releases](<https://devfeed.tech/topics/releases.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [ibm](<https://devfeed.tech/tags/ibm.md>), [inference](<https://devfeed.tech/tags/inference.md>), [model-architecture](<https://devfeed.tech/tags/model-architecture.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [releases](<https://devfeed.tech/tags/releases.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

IBM released Granite Time Series PatchTST-FM-r2, a roughly 385M-parameter time-series foundation model for zero-shot forecasting. The article covers its architecture, probabilistic forecasting, missing-value imputation, benchmark results, licensing, and available reproducibility resources.

### Source excerpt

Time-series foundation models are changing the way forecasting systems are built. Instead of training and maintaining a separate model for every dataset, users can use a pretrained model and generate forecasts zero-shot. IBM has released Granite Time Series PatchTST-FM-r2, the latest model in the Granite TSFM family (github, blog).

## TimesFM-3: A zero-shot foundation model for multivariate forecasting

DevFeed: [TimesFM-3: A zero-shot foundation model for multivariate forecasting](<https://devfeed.tech/articles/timesfm-3-a-zero-shot-foundation-model-for-multivariate-forecasting-6898.md>)

Original publisher: [Read original article](<https://research.google/blog/timesfm-3-a-zero-shot-foundation-model-for-multivariate-forecasting/>)

Published: 2026-08-31T17:19:40Z

Content type: article

Language: en

Sources: [The latest research from Google](<https://devfeed.tech/sources/the-latest-research-from-google.md>)

Topics: [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Time Series](<https://devfeed.tech/topics/time-series.md>), [Google](<https://devfeed.tech/topics/google.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Transformer architecture](<https://devfeed.tech/topics/transformer-architecture.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>)

Tags: [data-management](<https://devfeed.tech/tags/data-management.md>), [features](<https://devfeed.tech/tags/features.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [google](<https://devfeed.tech/tags/google.md>), [machine-intelligence](<https://devfeed.tech/tags/machine-intelligence.md>), [model](<https://devfeed.tech/tags/model.md>), [product](<https://devfeed.tech/tags/product.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [transformer-architecture](<https://devfeed.tech/tags/transformer-architecture.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Google Research introduces TimesFM-3, a 330-million-parameter time-series foundation model designed for accurate multivariate forecasting in a single forward pass. Pre-trained on more than one trillion real-world and synthetic time points, it jointly models coevolving series and external covariates in zero-shot settings without task-specific fine-tuning.

### Source excerpt

Data Management

## Beyond VLAs: How World Action Models Reshape Robot Manipulation

DevFeed: [Beyond VLAs: How World Action Models Reshape Robot Manipulation](<https://devfeed.tech/articles/beyond-vlas-how-world-action-models-reshape-robot-manipulation-6764.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/beyond-vlas-how-world-action-models-reshape-robot-manipulation/>)

Author: Michelle Horton

Published: 2026-08-04T16:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Robotics](<https://devfeed.tech/topics/robotics.md>), [World models](<https://devfeed.tech/topics/world-models.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [Cosmos](<https://devfeed.tech/topics/cosmos.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [NVIDIA Research](<https://devfeed.tech/topics/nvidia-research.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [cosmos](<https://devfeed.tech/tags/cosmos.md>), [featured](<https://devfeed.tech/tags/featured.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-research](<https://devfeed.tech/tags/nvidia-research.md>), [physical-ai](<https://devfeed.tech/tags/physical-ai.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [robot-manipulation](<https://devfeed.tech/tags/robot-manipulation.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [simulation-modeling-design](<https://devfeed.tech/tags/simulation-modeling-design.md>), [thor](<https://devfeed.tech/tags/thor.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [world-model](<https://devfeed.tech/tags/world-model.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

The article explains how World Action Models (WAMs) use video world models as backbones for robot policies, addressing the physical-generalization limitations of vision-language-action models. It discusses post-training WAMs into specialized policies and presents NVIDIA Cosmos 3 as a foundation for building them.

### Source excerpt

A central challenge in robotics is building policies that generalize beyond the demonstrations they're trained on. A policy that succeeds in a training scene...

## Introducing TabFM: A zero-shot foundation model for tabular data

DevFeed: [Introducing TabFM: A zero-shot foundation model for tabular data](<https://devfeed.tech/articles/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data-6829.md>)

Original publisher: [Read original article](<https://research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/>)

Published: 2026-06-30T10:26:00Z

Content type: article

Language: en

Sources: [The latest research from Google](<https://devfeed.tech/sources/the-latest-research-from-google.md>)

Topics: [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Google](<https://devfeed.tech/topics/google.md>), [Feature Engineering](<https://devfeed.tech/topics/feature-engineering.md>), [Hyperparameter optimization](<https://devfeed.tech/topics/hyperparameter-optimization.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>)

Tags: [bigquery](<https://devfeed.tech/tags/bigquery.md>), [classification](<https://devfeed.tech/tags/classification.md>), [data](<https://devfeed.tech/tags/data.md>), [data-management](<https://devfeed.tech/tags/data-management.md>), [feature-engineering](<https://devfeed.tech/tags/feature-engineering.md>), [github](<https://devfeed.tech/tags/github.md>), [google](<https://devfeed.tech/tags/google.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [hyperparameter-optimization](<https://devfeed.tech/tags/hyperparameter-optimization.md>), [machine-intelligence](<https://devfeed.tech/tags/machine-intelligence.md>), [model](<https://devfeed.tech/tags/model.md>), [product](<https://devfeed.tech/tags/product.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Google Research introduces TabFM, a zero-shot foundation model for tabular-data classification and regression. It frames prediction as in-context learning, reducing the need for dataset-specific training, hyperparameter optimization, and feature engineering, with availability through Hugging Face, GitHub, and BigQuery.

### Source excerpt

Data Management

## Re-autoresearching MSMARCO BM25, on Vespa

DevFeed: [Re-autoresearching MSMARCO BM25, on Vespa](<https://devfeed.tech/articles/re-autoresearching-msmarco-bm25-on-vespa-12796.md>)

Original publisher: [Read original article](<https://blog.vespa.ai/re-autoresearching-msmarco-bm25-on-vespa/>)

Author: andreer thomas

Published: 2026-05-29T00:00:00Z

Content type: article

Language: en

Sources: [Vespa Blog](<https://devfeed.tech/sources/vespa-blog.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Python](<https://devfeed.tech/topics/python.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [pandas](<https://devfeed.tech/topics/pandas.md>), [Google Search](<https://devfeed.tech/topics/google-search.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bm25](<https://devfeed.tech/tags/bm25.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [google-search](<https://devfeed.tech/tags/google-search.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [openai](<https://devfeed.tech/tags/openai.md>), [pandas](<https://devfeed.tech/tags/pandas.md>), [python](<https://devfeed.tech/tags/python.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

This article reproduces an MSMARCO BM25 autoresearch experiment in Vespa. It compares LLM-driven Python reranking with an approach restricted to existing Vespa rank features and reports a comparable improvement on a 650,000-passage subset, with better generalization to the full dataset.

### Source excerpt

BM25 is having a moment. We reproduce Doug Turnbull's MSMARCO autoresearch experiment in Vespa and get a comparable MRR@10 lift from existing rank features -- with twice the generalization to full MSMARCO.

## Mistral AI Releases Voxtral TTS, a Multilingual Text-to-Speech Model

DevFeed: [Mistral AI Releases Voxtral TTS, a Multilingual Text-to-Speech Model](<https://devfeed.tech/articles/speaking-of-voxtral-7136.md>)

Original publisher: [Read original article](<https://mistral.ai/news/voxtral-tts/>)

Published: 2026-03-23T16:00:00Z

Content type: release

Language: en

Sources: [Mistral AI Blog](<https://devfeed.tech/sources/mistral-ai-blog.md>)

Topics: [voice ai](<https://devfeed.tech/topics/voice-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [API](<https://devfeed.tech/topics/api.md>), [Low Latency](<https://devfeed.tech/topics/low-latency.md>), [User experience (UX)](<https://devfeed.tech/topics/ux.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [api](<https://devfeed.tech/tags/api.md>), [audio](<https://devfeed.tech/tags/audio.md>), [customization](<https://devfeed.tech/tags/customization.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [quality](<https://devfeed.tech/tags/quality.md>), [speech](<https://devfeed.tech/tags/speech.md>), [text-to-speech](<https://devfeed.tech/tags/text-to-speech.md>), [voice-ai](<https://devfeed.tech/tags/voice-ai.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Mistral AI has released Voxtral TTS, a 4B-parameter text-to-speech model designed to generate realistic, emotionally expressive speech in nine languages. It emphasizes low latency, contextual understanding, speaker modeling, and zero-shot cross-lingual voice adaptation for enterprise voice workflows and AI agents. The model is available through an API and Mistral Studio.

### Source excerpt

Voxtral TTS: A frontier, open-weights text-to-speech model that's fast, instantly adaptable, and produces lifelike speech for voice agents.

## Introducing RTEB: A New Standard for Retrieval Evaluation

DevFeed: [Introducing RTEB: A New Standard for Retrieval Evaluation](<https://devfeed.tech/articles/introducing-rteb-a-new-standard-for-retrieval-evaluation-7460.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/rteb>)

Author: Frank Liu; Kenneth Enevoldsen; Solomatin Roman; Isaac Chung; Tom Aarsen; Fődi, Zoltán

Published: 2025-10-01T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [community](<https://devfeed.tech/tags/community.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [developers](<https://devfeed.tech/tags/developers.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open](<https://devfeed.tech/tags/open.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rag](<https://devfeed.tech/tags/rag.md>), [recommendation-systems](<https://devfeed.tech/tags/recommendation-systems.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Hugging Face introduces the beta Retrieval Embedding Benchmark (RTEB), designed to evaluate the retrieval accuracy and generalization of embedding models in real-world applications. It combines open and private datasets to provide a fairer, more transparent, application-focused evaluation standard.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## SigLIP 2: A better multilingual vision language encoder

DevFeed: [SigLIP 2: A better multilingual vision language encoder](<https://devfeed.tech/articles/siglip-2-a-better-multilingual-vision-language-encoder-7474.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/siglip2>)

Author: Aritra Roy Gosthipaty; merve; Pavel Iakubovskii

Published: 2025-02-21T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [computer-use](<https://devfeed.tech/topics/computer-use.md>), [object-detection](<https://devfeed.tech/topics/object-detection.md>), [Google AI](<https://devfeed.tech/topics/google-ai.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [object-detection](<https://devfeed.tech/tags/object-detection.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vlms](<https://devfeed.tech/tags/vlms.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Google's SigLIP 2 is a multilingual vision-language encoder family that extends SigLIP's sigmoid-loss training with additional objectives for semantic understanding, localization, and dense visual features. The models improve on SigLIP across scales and core capabilities including zero-shot classification, image-text retrieval, and visual representation transfer, with a dynamic-resolution variant for resolution- and aspect-ratio-sensitive tasks.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Introducing the Open FinLLM Leaderboard

DevFeed: [Introducing the Open FinLLM Leaderboard](<https://devfeed.tech/articles/introducing-the-open-finllm-leaderboard-7317.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/leaderboard-finbench>)

Author: Xie; Jimin Huang; Sophia Ananiadou; Xiao-Yang Liu Yanglet; Alejandro Lopez-Lira; Wang; ldruth; Ruoyu Xiang; chenzhengyu; Yangyang Yu

Published: 2024-10-04T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Finance](<https://devfeed.tech/topics/finance.md>), [LLMs](<https://devfeed.tech/topics/llms.md>), [Human-AI evaluation](<https://devfeed.tech/topics/human-ai-evaluation.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [finance](<https://devfeed.tech/tags/finance.md>), [financial-sector](<https://devfeed.tech/tags/financial-sector.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [qa](<https://devfeed.tech/tags/qa.md>), [testing](<https://devfeed.tech/tags/testing.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

The article introduces the Open FinLLM Leaderboard, a specialized evaluation framework for financial language models. It evaluates models on finance-specific tasks such as information extraction, sentiment analysis, credit risk scoring, stock forecasting, question answering, text generation, and decision-making, using real-world datasets and metrics including Accuracy, F1 Score, ROUGE, and MCC.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## LAVE: Zero-shot VQA Evaluation on Docmatix with LLMs - Do We Still Need Fine-Tuning?

DevFeed: [LAVE: Zero-shot VQA Evaluation on Docmatix with LLMs - Do We Still Need Fine-Tuning?](<https://devfeed.tech/articles/lave-zero-shot-vqa-evaluation-on-docmatix-with-llms-do-we-still-need-fine-tuning-7574.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/zero-shot-vqa-docmatix>)

Author: Dana Aubakirova; Andres Marafioti

Published: 2024-07-25T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLMs](<https://devfeed.tech/topics/llms.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [community](<https://devfeed.tech/tags/community.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [llms](<https://devfeed.tech/tags/llms.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [research](<https://devfeed.tech/tags/research.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [vlms](<https://devfeed.tech/tags/vlms.md>), [vqa](<https://devfeed.tech/tags/vqa.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

This article examines zero-shot visual question answering evaluation on the synthetic Docmatix dataset using large language models and vision-language models. It explains why traditional VQA Accuracy can undervalue semantically correct answers in out-of-distribution settings and discusses the trade-off between fine-tuning models and developing metrics that better reflect human judgment.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Accelerating Protein Language Model ProtST on Intel Gaudi 2

DevFeed: [Accelerating Protein Language Model ProtST on Intel Gaudi 2](<https://devfeed.tech/articles/accelerating-protein-language-model-protst-on-intel-gaudi-2-7291.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/intel-protein-language-model-protst>)

Author: Julien Simon; Jiqing.Feng; Santiago Miret; Xinyu Yuan; Yi Wang; Matrix Yao; Minghao Xu; Ke Ding

Published: 2024-07-03T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [intel](<https://devfeed.tech/topics/intel.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [batch](<https://devfeed.tech/tags/batch.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-performance](<https://devfeed.tech/tags/inference-performance.md>), [intel](<https://devfeed.tech/tags/intel.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [optimum](<https://devfeed.tech/tags/optimum.md>), [partnerships](<https://devfeed.tech/tags/partnerships.md>), [pcie](<https://devfeed.tech/tags/pcie.md>), [precision](<https://devfeed.tech/tags/precision.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

This tutorial explains how to run inference and fine-tune ProtST, a multimodal protein language model, using Intel Gaudi 2 accelerators and the Optimum for Intel Gaudi open-source library. It compares ProtST inference on NVIDIA A100 and Gaudi 2, reporting identical accuracy and 1.76x faster inference on Gaudi 2.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Vision Language Models Explained

DevFeed: [Vision Language Models Explained](<https://devfeed.tech/articles/vision-language-models-explained-7560.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/vlms>)

Author: merve; Edward Beeching

Published: 2024-04-11T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [vlm](<https://devfeed.tech/topics/vlm.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [trl](<https://devfeed.tech/topics/trl.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [blog-post](<https://devfeed.tech/tags/blog-post.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hallucinations](<https://devfeed.tech/tags/hallucinations.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [trl](<https://devfeed.tech/tags/trl.md>), [vision](<https://devfeed.tech/tags/vision.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

An introduction to vision language models that explains their architecture, capabilities, use cases, model selection, inference, and fine-tuning with trl.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Pollen-Vision: Unified interface for Zero-Shot vision models in robotics

DevFeed: [Pollen-Vision: Unified interface for Zero-Shot vision models in robotics](<https://devfeed.tech/articles/pollen-vision-unified-interface-for-zero-shot-vision-models-in-robotics-7442.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/pollen-vision>)

Author: Antoine Pirrone; Simon Le Goff; Rouanet; Simon Revelly

Published: 2024-03-25T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Library](<https://devfeed.tech/topics/library.md>), [object-detection](<https://devfeed.tech/topics/object-detection.md>), [Robotics](<https://devfeed.tech/topics/robotics.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [reachy](<https://devfeed.tech/topics/reachy.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [3D](<https://devfeed.tech/topics/3d.md>), [Google](<https://devfeed.tech/topics/google.md>), [Meta](<https://devfeed.tech/topics/meta.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [image-tagging](<https://devfeed.tech/tags/image-tagging.md>), [object-detection](<https://devfeed.tech/tags/object-detection.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [reachy](<https://devfeed.tech/tags/reachy.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [robotic-manipulation](<https://devfeed.tech/tags/robotic-manipulation.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [robots](<https://devfeed.tech/tags/robots.md>), [tools](<https://devfeed.tech/tags/tools.md>), [training](<https://devfeed.tech/tags/training.md>), [vision](<https://devfeed.tech/tags/vision.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Pollen-Vision is an open-source library from the Pollen Robotics team that provides a modular interface for zero-shot vision models in robotics. Its initial release combines models for 3D object detection and segmentation, producing object coordinates to support autonomous grasping and other basic manipulation tasks without additional training.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## A clustering-based approach to create deep learning datasets in a day

DevFeed: [A clustering-based approach to create deep learning datasets in a day](<https://devfeed.tech/articles/dataset-in-a-day-22600.md>)

Original publisher: [Read original article](<https://medium.com/bumble-tech/dataset-in-a-day-7f369de3b178?source=rss----6353b5325b1a---4>)

Author: Roland Meertens

Published: 2023-11-28T17:33:30Z

Content type: article

Language: en

Sources: [Bumble Tech](<https://devfeed.tech/sources/bumble-tech.md>)

Topics: [dataset](<https://devfeed.tech/topics/dataset.md>), [Computer vision](<https://devfeed.tech/topics/computer-vision.md>), [Deep learning](<https://devfeed.tech/topics/deep-learning.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [clustering](<https://devfeed.tech/tags/clustering.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [inference](<https://devfeed.tech/tags/inference.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [models](<https://devfeed.tech/tags/models.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

The article discusses the cost and time involved in creating labeled computer vision datasets. It considers zero-shot learning and foundational models such as GPT-3 and CLIP for data retrieval, while noting that some use cases still require fine-tuning on task-specific data.

### Source excerpt

A clustering-based approach to create deep learning datasets in a day Introduction Understanding what's happening in an image is both an important task, as well as a costly one. In the last few years, the field of computer vision has greatly accelerated due to the advances in neural networks. At Bumble Inc., we see potential value in computer vision for a variety of use cases, such as improving the safety of our platform and providing our members with a better user experience. The most common way to train these neural networks is by showing it many images with the corresponding label. Unfortunately, this can be a costly task. Not only does one need to build and train the model, one also wants to do hyperparameter search over multiple configurations of possible networks, and -- of course -- one needs to find or build a dataset suitable for the task at hand. Building the dataset is both the most important task, as well as a very time consuming one. Gathering data, setting up labelling requirements, and of course the labelling itself all take a lot of time and money. This normally leads to trade-offs, by choosing either to build only a small dataset, or by trying to fit existing datasets into your specific use-case. One alternative is of course to not build a dataset at all, to instead use zero-shot learning for your use case. I argued in the past that this is unreasonably effective, and allows you to test your use-case before even training a model. When using zero-shot learning one predicts labels without explicitly training on the classes you are trying to learn. One example of this can be achieved by using the CLIP model, which is trained to have a strong association between text and images. By looking at the distance between the description of your class and the image you can run inference without training anything. However, there are some use cases where we need the strongest possible model by fine-tuning it to our specific data. Using foundational models for data s

## Implicit Product Tagging

DevFeed: [Implicit Product Tagging](<https://devfeed.tech/articles/implicit-product-tagging-15689.md>)

Original publisher: [Read original article](<https://developer.squareup.com/blog/implicit-product-tagging>)

Author: Alessandro Joabar

Published: 2023-06-29T06:00:00Z

Content type: tutorial

Language: en

Sources: [Square Corner Blog](<https://devfeed.tech/sources/square-corner-blog-medium.md>), [Square Corner Blog RSS Feed](<https://devfeed.tech/sources/square-corner-blog-rss-feed.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [data](<https://devfeed.tech/tags/data.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [install](<https://devfeed.tech/tags/install.md>), [model](<https://devfeed.tech/tags/model.md>), [packages](<https://devfeed.tech/tags/packages.md>), [train](<https://devfeed.tech/tags/train.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

This tutorial explains implicit product tagging: using zero-shot classification transformers to assign labels when explicit labels are unavailable. It uses product names and candidate labels to build a dataset, with examples involving fraud, alcohol sales, and coffee classification.

### Source excerpt

How To Label With Data You Don't Have