🌫️ Echo-DSRN-Small-400m - Next Word Prediction

Responsible AI Development by ethicalabs.ai

Echo-DSRN is a high-performance Dual-State Recurrent Network inspired by the architecture in Titans: Learning to Memorize at Test Time (Google Research). It combines the efficiency of linear recurrence with optimized gating and a novel Surprise Mechanism to enable infinite context extrapolation.

⚠️ Proprietary Technology Disclaimer
This research is currently in an internal-only alpha phase. The model source code and weights can be released only when we'll have the capacity to scale up, fine-tune and align it according to our safety standards.

Prediction Visualization