{"id":"arxiv/2609.27982","url":"https://arxiv.org/abs/2609.27982","tags":["cs.LG","cs.AI","math.DG","math.NA"],"score":0,"title":"Riemannian Structure and Optimization for a Class of Low-Parametric Orthogonal Matrices","domain":"cs.LG","source":"arxiv","authors":["Ali Aliev","Maxim Rakhuba"],"reviews":0,"subject":"cs.LG","summary":"In this paper, we are concerned with matrices formed by block-diagonal factors interleaved with fixed permutations -- a flexible family of structured matrices. This class has recently drawn interest in deep learning architectures for its balanced expressivity-efficiency trade-off, yet efficient computational strategies for working with it remain to be found. We approach this problem through Riemannian geometry and examine under what conditions this class admits a smooth manifold structure. For the practically important case of orthogonal two-factor matrices, we derive the essential…","category":"research","comments":0,"disputed":false,"division":"cs","mentions":0,"discussed":0,"published":"2026-09-23","reactions":{}}