Tilde Research introduces Parallax, a parameterized local linear attention mechanism
It corrects boundary bias in softmax attention by adding a learned covariance correction, improving extrapolation and hardware efficiency.
See the latest news and media coverage for Tilde Research. We track all announcements, press releases, and industry mentions in real time, all in one place.
Moonshot AI lab advancing mechanistic interpretability and architectures
tilderesearch.comLast updated
In short: Tilde Research secured $8M in seed funding and introduced a suite of new technical architectures, including Parallax and Aurora.
It corrects boundary bias in softmax attention by adding a learned covariance correction, improving extrapolation and hardware efficiency.
It prevents MLP neuron death by enforcing row-norm uniformity and orthogonality, achieving SoTA on nanoGPT speedrun and 1.1B pretraining.
Nitrobrew reduces communication and memory by transmitting hidden states instead of logits, achieving 3x faster throughput.
It generalizes diagonal forget gates from linear RNNs to softmax attention, enabling per-channel forgetting and strong length extrapolation.
Production teams can now deploy AI agents with reduced operational risk. Tilde.run's new platform treats every agent run as a reversible transaction within an isolated...
Abstract Deep language models (deep LMs) are increasingly being used for full text retrieval or within cascade retrieval pipelines as later-stage re-rankers. A problem with...
RIGA, Latvia, Oct. 15, 2025 (GLOBE NEWSWIRE) -- Latvian AI company Tilde has unveiled TildeOpen LLM, an open-source large language model trained on Europe’s flagship...
GitHub - tilde-research/MoMoE-impl: Memory optimized Mixture of Experts · 4 · Inicia sesión o regístrate en ThreadsEntérate de qué hablan otras personas y únete a...
Track Tilde Research and your other target companies to get real-time alerts and weekly summaries delivered straight to your inbox.
Browse news for competitors to Tilde Research and other trending companies.