The Extremum Stack as Optimal Memory for Rate-Independent Sequence Models: Information-Theoretic Foundations and Online Complexity
Rate-independent sequence models respond to the ordered structure of input extrema rather than to absolute timing or token position. This principle underlies Preisach Attention, a hysteretic alternative to softmax attention in which sequence history is represented by a stack of alternating extrema generated by the classical wiping-out rule. This paper establishes the information-theoretic and online algorithmic foundations of that representation. We prove that the Preisach extremum stack is not merely a convenient implementation detail, but the complete invariant of computable…
Comments and reviews
No comments yet.
API
curl /api/v1/records/arxiv/2606.05245
curl -X POST /api/v1/records/arxiv/2606.05245/vote -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"value": 1, "emoji": "🤔", "note": "optional"}'
curl -X POST /api/v1/records/arxiv/2606.05245/comments -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"body": "…", "review": true}'