News / #hardware Tag Hardware 500 articles archived under #hardware · RSS Sign in to follow r/MachineLearning community 10d ago About the impact of grouping classes in multiclass classification [D] A premise: I hope this question is "worth" of this subreddit, I did a decent amount of research before posting, I thought it was potentially interesting enough for it, but possibly not basic enough for r/learnmachinelearning . Is there any agreement/indication about how harmful… 10 arXiv — Machine Learning research 10d ago ERASE: EaRly bAckpropagation SchEdule for Faster Training of Modern Recommendation Systems arXiv:2608.18469v1 Announce Type: new Abstract: Lightweight proxy models enable rapid experimentation without repeatedly training frontier-scale systems, but their small kernels often leave modern accelerators underutilized. Conventional training compounds this inefficiency by… 20 arXiv — Machine Learning research 10d ago LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations arXiv:2608.18503v1 Announce Type: new Abstract: The growing demand for AI-driven workloads, particularly from Large Language Models (LLMs), has raised concerns about the significant energy and resource consumption in data centers. This work introduces a novel LLM-based… 11 arXiv — Machine Learning research 10d ago Many Optimizers But Only One Training Path: Repeated Resampling for Adaptive Optimizer Selection arXiv:2608.18810v1 Announce Type: new Abstract: An optimizer is usually chosen before training a deep neural network and then kept fixed. Treating optimizer choice as a hyperparameter could boost performance, but it requires several complete training runs and discards all but… 33 arXiv — Machine Learning research 10d ago Does Mapping Non-Maximal Probabilities to GMM Components Matter for S-JEPA Encoder Representations? arXiv:2608.19084v1 Announce Type: new Abstract: S-JEPA uses soft Gaussian mixture model (GMM) posteriors instead of hard cluster labels to preserve uncertainty. It remains unclear whether the probability values alone are sufficient, or whether it also matters which GMM… 32 arXiv — Machine Learning research 10d ago Learned, Then Lost: A Measured Single-Example Counterfactual in Pre-training arXiv:2608.19168v1 Announce Type: new Abstract: A single training example's contribution to a finished model is normally estimated rather than measured, because measuring it takes two expensive full pre-training runs that differ in one row of one batch. We ran that… 21 arXiv — NLP / Computation & Language research 10d ago SuTRA : Structurally-Unified Tokenization with Root Awareness arXiv:2608.18087v1 Announce Type: new Abstract: Existing subword tokenizers optimize statistical compression but ignore morphological structure, particularly the relationship between roots and affixes. This is harmful for morphologically rich Indic languages, where basic units… 38 r/MachineLearning community 10d ago How much of the weight-space perception gap is actually symmetry? Evidence from ~1.8M fitted SIRENs [R] I’ve been looking at a fairly basic question in weight-space learning that I don’t think gets separated cleanly enough: Why does reading semantics directly from neural network weights work pretty well when the networks share an initialization, but collapse when the networks are… 8 Hacker News — AI on Front Page community 10d ago Unsloth Dynamic 3.0 GGUFs Article URL: https://unsloth.ai/docs/basics/dynamic-3.0-ggufs Comments URL: https://news.ycombinator.com/item?id=49365443 Points: 223 # Comments: 84 13 TechCrunch — AI news-outlet 10d ago Meet the startup helping Wall Street put a price on AI compute The AI buildout shows no signs of slowing. And with hundreds of billions of dollars a year going into data centers and GPUs, compute has become the single biggest cost for anyone building AI products. But for all that spending, there… 10 TechCrunch — AI news-outlet 10d ago TerraPower’s nuclear reactor has a secret weapon for powering AI data centers TerraPower's nuclear power plant possesses a strategic advantage over competitors, especially when chasing after data center deals. 9 r/LocalLLaMA community 10d ago Finally found a really solid suno-like minimax music UI!! Been messing with minimax music gen lately. I really like Suno and was basically looking for something that gave me a similar workflow for minimax. I got completely sick of running everything through the CLI. I went digging on github, sorted by recent, and took a gamble on this… 8 TechCrunch — AI news-outlet 10d ago Relativity Networks raises $22 million to bring a faster kind of fiber to data centers Relativity Networks deals in hollow-core fiber, a rarely deployed technology that allows data to be transmitted 30% faster than conventional fiber. 10 The Information — AI news-outlet 11d ago Pennsylvania Governor Hikes Requirements For Data Center Permits Pennsylvania Governor Josh Shapiro on Tuesday signed an executive order requiring data center developers to make legally binding commitments related to energy, environmental standards, and economic development before they can move forward with projects. The move is the latest… 8 arXiv — Machine Learning research 11d ago Study-Strategy Clusters from EdNet Logs Track Engagement, Not Mastery arXiv:2608.16963v1 Announce Type: new Abstract: Learning analytics often treats unsupervised clusters of intelligent tutoring system (ITS) logs as learner types that should predict learning. We test that assumption on EdNet-KT3. Clustering study-strategy features (resource use,… 17 r/LocalLLaMA community 11d ago Qwen3.8 2.4T open weights made a Call of Duty clone Qwen released the 2.4T Max weights and I was curious how well it can re-create COD in one prompt I ran the model on a rented B200 cluster and used roughly 1.1M output tokens over a 5 hour time span Realistically barely anyone can run this model locally, but the fact that it's… 18 Hacker News — AI on Front Page community 11d ago Data centers raise nearby temperatures by up to 4 degrees in Phoenix Article URL: https://asmedigitalcollection.asme.org/sustainablebuildings/article/7/2/024501/1233035/Data-Center-Waste-Heat-as-an-Emerging-Urban Comments URL: https://news.ycombinator.com/item?id=49349147 Points: 203 # Comments: 227 24 TechCrunch — AI news-outlet 11d ago Etched’s valuation doubles to $21B in a month Jane Street has installed Etched's first shipped AI cluster system, and was so impressed, it led another massive round, the startup says. 23 r/LocalLLaMA community 11d ago OpenCode overrides the samplers for Qwen models to the wrong values This is invisible with llama.cpp or derivatives, but ninfer helpfully logs the sampler settings on each request and auto-configures the correct ones for the model. Basically, OpenCode will always send top-p=1.0 (which means there is no filtering of low-probability tokens except… 17 Stratechery (Ben Thompson) community 11d ago Nvidia Backs OpenAI Data Center, Anthropic News, Google Buys Spirit Airlines Data Nvidia makes another deal, this time with a frontier lab; Anthropic's revenue continues to amaze; and maybe data finally is oil. 30 Hacker News — AI on Front Page community 12d ago Linux 7.3 improves performance when running out of vRAM Article URL: https://pixelcluster.dev/VRAM-Overcommit/ Comments URL: https://news.ycombinator.com/item?id=49342719 Points: 219 # Comments: 58 33 Hugging Face Daily Papers research 12d ago DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs Abstract Retired GPUs can form low-cost clusters for LLM inference, but their economic and environmental viability depends heavily on local electricity prices and carbon intensity. Generated by thinkingmachines/Inkling-Small As AI datacenters retire functional GPUs, vast… 9 arXiv — Machine Learning research 12d ago DumpsterCluster: From Dumpster Diving to Serving LLaMA-70B on $60 GPUs arXiv:2608.14614v1 Announce Type: new Abstract: As AI datacenters retire functional GPUs, vast quantities of still capable accelerators enter secondary markets. This paper investigates whether these retired GPUs can find a productive afterlife to form a DumpsterCluster that can… 16 r/MachineLearning community 12d ago trying to build a solid math library for stats/ML/DL, need a sanity check on my picks[D] engineering student here, decent calc and linear algebra background from continuum mechanics coursework, already comfortable with ML basics through transformers and modern architectures. want to go deep on the actual math now, not just intuition videos, real derivations, and… 20 Hugging Face official-blog 12d ago Same Cluster, 33 Points More Utilization: What Changed Was the Order Back to Articles a]:hidden"> Same Cluster, 33 Points More Utilization: What Changed Was the Order Team Article Published August 17, 2026 Upvote - Gabriel Pimenta de Freitas Cardoso GabrielPimenta99 Dharma-AI Breno de Almeida Beleza BrenoBeleza Dharma-AI Francisco de Almeida… 30 TechCrunch — AI news-outlet 12d ago Groq raises $350M to fuel its pivot from AI chips to neocloud Groq raised $350 million at a $3.5 billion valuation as the former AI chipmaker pivots to a neocloud business and expands its Nvidia-powered data center footprint. 33 TechCrunch — AI news-outlet 12d ago Nvidia investing $1.5B in SoftBank data center developer behind OpenAI project Nvidia's investment in SoftBank's data center developer will guarantee its chips power an OpenAI data center. 13 Smol AI News news-outlet 13d ago not much happened today **OpenAI** is advancing its power-and-compute infrastructure with a **4+ GW NVIDIA** capacity commitment and an **8 GW Ohio campus** buildout through **2032**, emphasizing vertical integration across power, data centers, and chips. The model access and routing API layer is… 20 arXiv — Machine Learning research 13d ago Connected Subspace Clustering: Hardness, a Scalable Heuristic, and an Application to Sea Level Geodesy arXiv:2608.14215v1 Announce Type: new Abstract: Constrained optimization extends classical optimization by integrating side information, making it widely applicable across scientific and engineering domains. Consider a setting where we measure variables at different physical… 14 r/MachineLearning community 13d ago It only took 200 update steps to flip Qwen2.5-7B-Instruct from denying sentience to developing a robust identity of being a "sentient machine" [P] First, I want to clarify that I am not claiming that LLMs are sentient. Basically all of my behavioral descriptions are anthropomorphizations to make communicating my results easier. For fun, I decided to post-train Qwen2.5-7B-Instruct to develop a generalizing self-belief of… 4 r/LocalLLaMA community 13d ago Based on an accelerating frontier -> local trajectory, expect a ~30b param 'Mythos at home' by as soon as Jan 2027 (rationalisation below) Including the rationalisation for the data below - this is a more robust version of an earlier post I did similar to this - explaining below: How I chose the comparisons The basic question I’m trying to answer is: when did an open model small enough to run on high-end consumer… 29 r/LocalLLaMA community 14d ago Qwen3.8-27B vs Qwen3.6-27B writing ray-tracers in BASIC one of my llm hobbies is re-creating graphics demos i used to write in BASIC in the late 1980s. i slopped together an agentic harness and a basic-to-js transpiler in a web page i've been playing with for a few months. the agent can write basic programs, run them, examine the… 21 r/LocalLLaMA community 15d ago A 150M param recurrent model scores 29.5% on ARC-AGI-1 at $0.0007 per task Not a transformer. It's a recurrent latent reasoning setup that keeps "thinking" in latent space before answering. Sits completely outside the published cost/accuracy frontier for ARC-AGI, and something this size runs on basically anything. Paper is from the Pathway team,… 25 TechCrunch — AI news-outlet 15d ago Hyperscalers might regret embracing natural gas if new forecast proves correct Natural gas prices could triple in some parts of the U.S., which could saddle hyperscalers with massive bills to power their AI data centers. 17 r/MachineLearning community 15d ago Building text to ASCII diffusion model , need advice and guidance [P] i wanna build a text diffusion model which interpret text and convert it into ascii images so like Text : build a cat Output : /\\\_/\\ ( o.o ) \> \^ < So , i have a decent background of ml algo ( completed cs229 , cs230 , Ml architecture and basic CNN and diffusion model ) ik… 37 arXiv — Machine Learning research 16d ago H-VAEP and H-xT: Valuing Offensive On-the-Ball Actions in Handball by Estimating Probabilities arXiv:2608.12926v1 Announce Type: new Abstract: Traditional player evaluation in professional handball relies on basic box-score metrics or heuristic indices, which fail to credit the multi-player build-up chain. While football (soccer) analytics has adopted Expected Threat (xT)… 31 arXiv — Machine Learning research 16d ago TANGCO: Learning Topology-Aware Capacity Allocation for Overload-driven Cascading Failures arXiv:2608.13212v1 Announce Type: new Abstract: Networked systems, from power grids to traffic networks and cloud clusters, carry loads across nodes with limited capacity. A node whose load exceeds its capacity fails and sheds its load onto its neighbors, which can trigger a… 5 arXiv — NLP / Computation & Language research 16d ago Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model arXiv:2608.13277v1 Announce Type: new Abstract: We ask whether language-model pre-training can be decomposed into smaller, independently trainable jobs that can later be recomposed into a coherent larger model. We introduce Mixture of Training (MoT), a scaffolded modular… 36 r/LocalLLaMA community 16d ago Gemma 4 12B Q3: +8.55% Coding Performance From Tensor-Level Quantization Allocation Ive been experimenting with task-aware GGUF quants for months, taking inspiration from TASA and TAQO but pushing the allocation lower to to the tensor level. The basic idea is to generate a custom imatrix from a category-specific corpus, measure where quantization causes damage,… 5 r/MachineLearning community 16d ago UrgenT Help Detecting Performance Regressions Using Machine Learning and Hardware Counters [P] I’m working on performance regression detection using machine learning/anomaly detection. My setup is basically: Healthy runs are used to learn normal behaviour Regression runs are used to see whether the model detects the anomaly For each counter group I only have about 10… 33 arXiv — Machine Learning research 17d ago Uncertainty-Aware Probabilistic Constrained Clustering from Entangled Pairwise Supervision arXiv:2608.12027v1 Announce Type: new Abstract: Pairwise constrained clustering typically relies on hard must-link/cannot-link labels, whereas realistic pairwise supervision may be real-valued and entangle intrinsic ambiguity, expert judgment, and stochastic corruption. Existing… 13 arXiv — Machine Learning research 17d ago Clustered Randomized Smoothing for Stochastic Prediction Functions arXiv:2608.12037v1 Announce Type: new Abstract: Modern stochastic predictors can model rich, multi-modal outcome distributions. However, this expressive power comes with challenges in ensuring robust predictions $-$ a critical requirement in safety-critical domains. Randomized… 8 arXiv — Machine Learning research 18d ago STCAD: Scalable Trajectory Clustering and Anomaly Detection on Terabyte-Scale AIS Data arXiv:2608.10249v1 Announce Type: new Abstract: We present a scalable framework for unsupervised clustering of maritime trajectories derived from terabyte-scale Automatic Identification System (AIS) archives. Variable-length trajectories are encoded with a custom BERT-based… 29 arXiv — Machine Learning research 18d ago CRHT: A Continuous Regression Hybrid Transformer for Vessel Trajectory Prediction with Online Cluster Sampling arXiv:2608.10256v1 Announce Type: new Abstract: Accurate vessel trajectory prediction is critical for maritime safety and anomaly detection, yet existing models often struggle with geographic bias and navigational realism. We propose the Continuous Regression Hybrid Transformer… 27 arXiv — Machine Learning research 18d ago Compute-Optimal Is Not Cluster-Optimal: Systems-Aware Scaling for Sparse Mixture-of-Experts arXiv:2608.10605v1 Announce Type: new Abstract: In large-scale pretraining, the algorithm, architecture, and systems decisions are conventionally made in disconnected stages. A scaling law stage selects an architecture and training recipe, optimizing loss under compute… 38 r/LocalLLaMA community 18d ago I will be parting with my 4x Spark Cluster. Laid off then my partner of 10 years said he's leaving, have to move, etc... I will post the r/hardwareswap link when I make it. I'm willing to add some incentive for r/LocalLLaMA folks. I will also add the super node configs and all the cool stuff that may not be apparent that… 26 r/LocalLLaMA community 19d ago I ran Muse Glimmer @ 1M context - All tests passed. Heeeey all! I just completed some fun tests with Muse Glimmer, I thought I'd let you know. In fact, the summary below was written by Muse itself! I ran a 2× DGX Spark cluster and got Meta's day-old Muse Glimmer 30B running the day after release — then pushed its context from the… 36 arXiv — Machine Learning research 19d ago When Does Trace-Driven Evaluation Mislead MoE Expert Caching? Replay Semantics, Workload Contamination, and Operating Regimes arXiv:2608.07911v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have outgrown accelerator memory, and offloading expert weights to host memory is now standard. This makes expert cache management an attractive lever: a policy that raised the hit rate would cut… 28 arXiv — Machine Learning research 19d ago Exact Rank-Space KL Projection for Shared-Marginal Low-Rank Factors: Application to Doubly Stochastic Clustering arXiv:2608.08642v1 Announce Type: new Abstract: We study exact Kullback--Leibler (KL) projection for low-rank factorizations whose two nonnegative factors have prescribed row marginals and a shared, learned column marginal. For arbitrary positive row marginals of equal total… 24 r/LocalLLaMA community 19d ago I gave DeepSeek V4 Flash basic vision by training a 40M connector on 100K examples I wanted to find out whether a huge text-only MoE could be given basic vision without retraining the language model itself. The short answer is yes. I froze DeepSeek V4 Flash and a 417M-parameter MoonViT image encoder, then trained a 40.1M-parameter connector between them on… 16 Page 2 of 10 · 500 articles ← Newer Older →
