Has anyone tried this approach with Fast Byte Latent Transformers ? [R]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
Paper Referred:- https://arxiv.org/pdf/2412.09871v1
Has anyone switched the transformer in the entropy model here to a Mamba model ? What could be the possible changes ?
Just a ML fresher asking a genuine, since Mamba is more popular and saves computer (O(n)).
Thanking you in advance !
[link] [comments]
More from r/MachineLearning
-
NeurIPS accepted papers leaked? [D]
Aug 30
-
Reconstructing 3D bone geometry from 2 X-ray silhouettes using a statistical shape model + differentiable rendering [P]
Aug 30
-
[R] Autonomous Mathematical Discovery in an Open-World Multi-Agent Environment
Aug 30
-
Implementing Kimi K3 from scratch in PyTorch [P]
Aug 30
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.