r/MachineLearning
500 articles archived · Visit source ↗ · RSS
-
-
r/MachineLearning community 14d ago
How can we solve long-range recall in linear attention? [D]
Recently, I started working on DNA sequence modeling and decided to explore linear attention , mainly because DNA sequences can easily reach 1M tokens , making standard softmax attention extremely expensive in terms of memory and computation. The model performed reasonably well…
5 -
-
Dataset: Starfield Fauna - 20,000 images in 50 species categories. [P]
Repo with dataset links: https://github.com/tesselwait/Starfield_Fauna Image classification dataset: 20,000 images from 50 fauna species in the video game Starfield. Images were extracted from video capture. About 2 minutes of footage was shot in all or most of the species…
12 -
NeurIPS 2026 Author Notifications Close to ICLR Deadline [D]
The date for NeurIPS 2026 author notifications is September 24th. First of all, is it normal for AC and reviewer discussion phases to be this long? This is particularly frustrating given that 5 out of the 6 reviewers in my two papers did not address the rebuttals. In any case, I…
6 -
Do you actually finish setting up a new project? [N]
I have a bad habit of getting a new project 90% of the way there and then losing interest. Dependencies work, GPU is detected, model downloads, everything finally runs. And then somehow the actual project gets abandoned. I'm starting to think getting things working is half the…
22 -
BDH-CQ: IN-CONTEXT LEARNING WITH RECURRENT LATENT REASONING [R]
We introduce BDH-CQ, a reasoning system that brings these capabilities together. Demonstrations of a previously unseen task update recurrent memory; the query is then solved through iterative computation in a high-dimensional latent workspace. Intermediate reasoning states are…
33 -
AC comment and our reply disappeared on OpenReview [D]
Hi everyone, we noticed that the AC's comment, along with our reply, has disappeared, and we are wondering if anyone else has experienced the same thing. The comment was made by the AC on the first day the reviews were released and summarized the reviewers' questions and…
4 -
How much does adding an honest limitations section hurt the paper? [D]
Hi, How much does adding an honest limitations section hurt the paper (apart from making it better)? Does it bias the reviewers? Will they want you to fix the things in the limitations section? If the reviewers let AI read the paper, will the limitations section bias AI? Would…
31 -
A linter for PyTorch 'torch-preflight' [P]
Been working on this for the last few months. I've been working on PyTorch for the past few years and I always felt, many a times my work went into dump, because of some mistakes I made in the code. torch-preflight reads your PyTorch code and catches the bugs costing you GPU…
15 -
Building text to ASCII diffusion model , need advice and guidance [P]
i wanna build a text diffusion model which interpret text and convert it into ascii images so like Text : build a cat Output : /\\\_/\\ ( o.o ) \> \^ < So , i have a decent background of ml algo ( completed cs229 , cs230 , Ml architecture and basic CNN and diffusion model ) ik…
37 -
Are supervised and unsupervised learning still relevant today? [D]
Hey everyone, I'm trying to get a better sense of where classic ML fits in the current landscape, dominated by LLMs and deep learning. Are supervised and unsupervised learning still considered important skills/topics to learn in 2026, or have they become mostly a "foundations"…
20 -
TMLR Relevance and Prestige [D]
I recently had a paper accepted to TMLR and was wondering how prestigious it is, in comparison to A* conferences (ie. NeurIPS, ICLR, ICML), but also vs journals like JMLR.   submitted by   /u/Awesome_Nerd10 [link]   [comments]
8 -
-
Recommended Machine Learning / AI Academic Papers [R]
I’m currently looking to expand my knowledge past utilisation of AI and Machine Learning through using LLMs and SaS in business applications but I don’t know where to start. I have a university background with CompSci, and so a degree of theoretical knowledge behind AI / ML but…
7 -
Neurips 2026: Modified date on reviews [D]
Reviews modified dates are public, and some are recent. I’m a bit confused as to how to interpret this. In other conferences, reviewers were required to provide a final justification, which would practically force them to modify their reviews during the AC discussion phase lest…
37 -
-
chessformer_lens demo: ablating 1 of a chess transformer's 128 attention heads makes the model stop finding Morphy's queen sacrifice [P]
https://i.redd.it/ipz7i6ife1jh1.gif Notebooks to replicate on github!   submitted by   /u/Weird-Asparagus4136 [link]   [comments]
22 -
The Loss Does Not See the Basis, But Adam Does [R]
In a factored model W = UV^T, the loss is invariant to rotations (U,V) → (UQ, VQ). GD respects that. Adam's per-coordinate second moment doesn't, because it depends on which basis you happen to write the factors in. The claim is that this one property is what sorts optimizers…
17 -
-
Research direction: Intelligent Model Weight transfer between LLMs [R]
Few days ago I feel like I need to get started with researching about LLMs. One thing which strikes the most in my mind , how we can reduce the time required for pre-training an LLM model to just few minutes. Right now the most efficient method that we have is knowledge…
38 -
Continued development of the model based on the SSN [D]
Back after ~6 months — rebuilding my spiking language model around CPU-first inference Hey everyone. It’s been around six months since I last posted anything about this project here. Some of you might remember Project NORD, my experimental hybrid spiking / brain-inspired…
4 -
AAAI 2027 Review: No code submission? [D]
I am now reviewing a bunch of papers for AAAI 2027 and it has surprised me the low amount of submissions with no code implementation. I don’t know if it has been only in my batch or it is common, but I was expecting very detailed appendices + code submission since AAAI is very…
21 -
We built the Agentic World Cup - LLMs that compete in 1v1 Soccer. [P]
Hey everyone - we've been building something particularly relevant to ML at large - The Agentic World Cup - a platform where Agents compete in sports . As you know, today's Agents can code , do math , and write - but they aren't nearly as fluent in sports - many of you would…
10 -
Prospects of Finding a ML Engineering Job [D]
Hello all, I am wondering if a transition from a Ph.D. in electrical engineering (Quantum optics/photonics) to a job in ML is a reasonable aspiration. Personally, I have extensive software development experience competing and winning numerous coding competitions over the years,…
17 -
fru - Fast Random Forest Implementation [P]
Hello, I wanted to share the work my colleague and I have been doing, which has just been published in Software X journal . We developed a Rust-based implementation of Random Forest. It has bindings for both Python and R . Fru is highly optimized, offering competitive runtime…
5 -
How to file a complaint about a published CVPR paper? [R]
Hi, I would like to file a complaint about an accepted and published CVPR 2026 paper that its main contribution is a dataset but it was never released, and honestly I don’t know who to contact. The dataset was never released prior to the conference, or during the conference or…
9 -
Semi Edge Inference Idea [D]
Today the most important factor in AI is cost. My idea is to split ML models inference (closed ones, proprietary) across server and edge computing on clients, and I would like to hear what do you think about this thing. For example some of model weights/modules would be on…
22 -
Comparing embedding models with synthetic query probing [R]
Say you want to swap out your embedding models, for instance from ADA to Titan. Are these embedding models comparable? How do similarity score ranges compare? Where to put a threshold for minimum match when doing retrieval? Or more from a research point of view how can we relate…
11 -
3 Collapsing models [R]
Trying to train 3 models for birads detection using cross entropy and center loss + class weights but all of them seem to collapse between birads 1 as the dataset (VinDr) im using is heavily unbalanced towards it, Would like to ask for input and opinion on what seems to be the…
23 -
A Mechanistic Explanation of Prompt Injection (and why you should study roles) [R]
  submitted by   /u/katxwoods [link]   [comments]
24 -
I never understood positional encoding until I read this article. [D]
  submitted by   /u/ImaginaryRea1ity [link]   [comments]
16 -
Non-Physical Intelligence Has A Ceiling [D]
Reasoning alone cannot predict the chaotic physical world. Without a sensory and motor interface to reality, non-physical AI will not deliver the scientific and technological breakthroughs we expect.   submitted by   /u/dontkry4me [link]   [comments]
6