I released a softmax-free attention model at GPT-2 Medium scale (~354M params, 11.5B tokens): structural sparsity + tile-skipping kernels for long-context VRAM savings. Open weights + custom Triton kernels [R]

SentryCode: Real-time Auditor + Honeytokens for AI Coding Agents [P]

Jul 2

[D] Self-Promotion Thread

Jul 2

Making Optimization Work When Labels Are Scarce [R]

Jul 2

Hamiltonian Neural Networks from a Differential Geometry Perspective [D]

Jul 1