# DTA-GT: Direction- and Topology-Aware Graph Transformer for Neural Network Representation Learning

DevFeed: [DTA-GT: Direction- and Topology-Aware Graph Transformer for Neural Network Representation Learning](<https://devfeed.tech/articles/dta-gt-direction-and-topology-aware-graph-transformer-for-neural-network-representation-learning-118275.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.16822>)

Author: Yuxiang Zeng, Kun Xie, Yang Wang, Jigang Wen, Xiaocan Li, Guangxing Zhang, Gaogang Xie, Jiannong Cao

Published: 2026-11-05T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Transformer](<https://devfeed.tech/topics/transformer.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [graph theory](<https://devfeed.tech/topics/graph-theory.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [attention](<https://devfeed.tech/tags/attention.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ne](<https://devfeed.tech/tags/cs-ne.md>), [dag](<https://devfeed.tech/tags/dag.md>), [dependencies](<https://devfeed.tech/tags/dependencies.md>), [encoding](<https://devfeed.tech/tags/encoding.md>), [execution](<https://devfeed.tech/tags/execution.md>), [gnn](<https://devfeed.tech/tags/gnn.md>), [graph](<https://devfeed.tech/tags/graph.md>), [latency](<https://devfeed.tech/tags/latency.md>), [learning](<https://devfeed.tech/tags/learning.md>), [moe](<https://devfeed.tech/tags/moe.md>), [nas](<https://devfeed.tech/tags/nas.md>), [network](<https://devfeed.tech/tags/network.md>), [neural](<https://devfeed.tech/tags/neural.md>), [neural-network](<https://devfeed.tech/tags/neural-network.md>), [node](<https://devfeed.tech/tags/node.md>), [orientation](<https://devfeed.tech/tags/orientation.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [topology](<https://devfeed.tech/tags/topology.md>), [transformer](<https://devfeed.tech/tags/transformer.md>)

## AI overview

DTA-GT predicts neural architecture accuracy and latency by coordinating directed-graph semantics across node initialization, Magnetic Laplacian spectral encoding, direction-dual structural attention, and a Direction-Sensitive MoE-FFN. On NAS-Bench-101 and NAS-Bench-201, it reportedly outperforms representative sequence, GNN, Transformer, and hybrid predictors in limited-budget settings. Ablations and spectral controls support contributions from its direction-aware stages and orientation-sensitive spectral information. The supplied text is an abstract, so it does not provide detailed results or comparisons.

## Source excerpt

arXiv:2610.16822v2 Announce Type: replace-cross Abstract: Architecture attribute predictors reduce the cost of neural architecture search by estimating accuracy or latency from a small set of evaluated candidates. Neural architectures are operation-labeled directed acyclic graphs (DAGs), where edge directions determine computational roles and execution dependencies. Existing graph Transformer predictors incorporate topological and directional information in different ways, but primarily focus on specific mechanisms rather than coordinated encoder-wide modeling of these semantics. We introduce encoder-wide directional consistency, a design principle that coordinates the modeling of directed computational semantics across node initialization, global spectral encoding, pairwise interaction, and feature updates. To implement this principle, we propose DTA-GT, a Direction- and Topology-Aware Graph Transformer that integrates direction- and topology-aware node initialization, Magnetic Laplacian spectral encoding, direction-dual structural attention, and a Direction-Sensitive MoE-FFN. Across accuracy and latency prediction on NAS-Bench-101 and NAS-Bench-201, DTA-GT consistently outperforms representative sequence-, GNN-, Transformer-, and hybrid predictors under limited-budget settings. Ablations and Magnetic spectral controls support the contribution of the direction-aware stages and orientation-sensitive spectral information, while mechanistic diagnostics characterize module behavior. These results support encoder-wide directional consistency as an effective design principle for architecture DAG representation.