# How we built a benchmarking framework to horizontally accelerate transaction model research

DevFeed: [How we built a benchmarking framework to horizontally accelerate transaction model research](<https://devfeed.tech/articles/how-we-built-a-benchmarking-framework-to-horizontally-accelerate-transaction-model-research-38850.md>)

Original publisher: [Read original article](<https://building.nubank.com/how-we-built-a-benchmarking-framework-to-horizontally-accelerate-transaction-model-research/>)

Author: Nubank Editorial

Published: 2026-09-03T13:53:30Z

Content type: article

Language: en

Sources: [Nubank](<https://devfeed.tech/sources/nubank.md>)

Topics: [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [Framework](<https://devfeed.tech/topics/framework.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [architectures](<https://devfeed.tech/tags/architectures.md>), [automated](<https://devfeed.tech/tags/automated.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [data](<https://devfeed.tech/tags/data.md>), [data-science-machine-learning](<https://devfeed.tech/tags/data-science-machine-learning.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [model](<https://devfeed.tech/tags/model.md>), [performance](<https://devfeed.tech/tags/performance.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

Nubank built an automated benchmarking framework for horizontally evaluating transformer-based transaction representation models across multiple downstream tasks and trials. The framework made experimentation reproducible and statistically rigorous, helping the team identify improvements that generalize across applications. It increased the team's capacity to run experiments by roughly five times per month while reducing operational overhead.

## Source excerpt

The framework that transformed weeks of manual experimentation into automated pipelines for horizontal transaction model research The post How we built a benchmarking framework to horizontally accelerate transaction model research appeared first on Building Nubank.