# Evaluating classification and explainability in multimodal petrographic image analysis

DevFeed: [Evaluating classification and explainability in multimodal petrographic image analysis](<https://devfeed.tech/articles/evaluating-classification-and-explainability-in-multimodal-petrographic-image-analysis-125918.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.10331>)

Author: Thomas James Wood, Oktay Karaku\\c{s}, Can Ey\\"upo\\u{g}lu

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [ai evaluation](<https://devfeed.tech/topics/ai-evaluation.md>), [ai observability](<https://devfeed.tech/topics/ai-observability.md>), [Image processing](<https://devfeed.tech/topics/image-processing.md>)

Tags: [classification](<https://devfeed.tech/tags/classification.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [explainability](<https://devfeed.tech/tags/explainability.md>), [image-analysis](<https://devfeed.tech/tags/image-analysis.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>)

## AI overview

Using outputs from an earlier evaluation of 105,802 grains in 25 categories, the study finds that LITHOS errors often track the label taxonomy: many plagioclase, microcline and sanidine errors became generic Feldspar labels, while quartz-family errors usually stayed within that family. Replacing XPL with channel means reduced true-class probability more than equivalent PPL replacement in 20 categories, but not in the three quartz categories. Five attribution methods produced visually distinct maps, yet in a superpixel-deletion analysis of 30 grains from 29 thin sections, all 41 simultaneous 95% confidence intervals for method-versus-random contrasts included zero. The findings indicate that accuracy, modality sensitivity and attribution behavior measure different aspects of performance; visual maps alone did not establish that highlighted regions influenced decisions.

## Source excerpt

arXiv:2611.10331v1 Announce Type: new Abstract: Automated thin-section classifiers increasingly combine plane-polarised and cross-polarised light (PPL and XPL), two complementary views central to petrographic identification. Classification accuracy alone does not reveal whether model errors reflect mineralogical relationships, how predictions depend on each optical view, or whether attribution maps identify regions that influence model decisions. Here, we examine these complementary aspects of the released LITHOS dual-stream vision transformer using outputs from an earlier evaluation of 105,802 expert-annotated grains across 25 categories. Classification errors frequently followed the label taxonomy: 72.6\% of misclassified plagioclase, microcline and sanidine grains were assigned the generic Feldspar label, while 87.1\% of quartz-family grains received a label within that family, compared with 66.6\% assigned their exact label. Replacing the XPL input with its per-channel spatial means produced a greater reduction in true-class probability than equivalent PPL replacement in 20 of 25 categories, but not in the three quartz categories. Five explainable artificial intelligence (XAI) attribution procedures generated visually distinct maps for identical inputs. In a superpixel-deletion analysis involving 30 grains from 29 thin sections, method-minus-random contrasts ranged from $-0.043$ to $0.057$, with all 41 simultaneous 95\% confidence intervals including zero. Together, these findings show that error structure, modality sensitivity and attribution behaviour capture distinct aspects of model performance that cannot be established from classification accuracy or visual inspection of attribution maps alone.