News / #hardware Tag Hardware 500 articles archived under #hardware · RSS Sign in to follow r/LocalLLaMA community 20d ago R9V Update: Created and adopted KVA projections based on Deepseek V4.1 Flash + HySparse2/MiMo-V3 for Qwen3.8 Flash Next. This is a game changer for models that don't natively implement it. 1.45-1.85x speedup in prefill to 3k+ at a small deficit to perplexity. [2x R9700, 128GB… Here's my *first* implementation of KVA projectors on QFN (just the uncensored model for now) the highlights are basically as follows for using the projectors at each different layer: Starting at layer 12, prompt processing speeds up 1.85x [1700 t/s -> 3150 t/s] at the tradeoff… 24 arXiv — Machine Learning research 20d ago Efficient Linear Bandits via Cluster-Aware Sketching arXiv:2609.27594v1 Announce Type: new Abstract: We study the problem of computational efficiency for linear bandits in high-dimensional settings with a finite arm set. In linear bandits, the increase in the dimension $d$ of the feature vectors leads to growing computational… 4 NVIDIA Developer Blog official-blog 21d ago Validate GPU Cluster Readiness Before AI Workloads Land A GPU cluster can pass every health check and still fail to run an AI workload. Even when every GPU, network link, and pod reports healthy, a 512-GPU training... 28 r/LocalLLaMA community 21d ago MiMo-V2.6 (both Pro and Flash) is a benchmaxxed scam MiMo-V2.6-Pro has an insanely high score of 46 on AA, putting it at the head of the opensource models available. It also costs pennies. Flash is not out on AA yet, but it costs less than half on datacenter and is slightly below on Xiaomi's own benchmarks. It also fits in 192GB,… 12 The Information — AI news-outlet 21d ago Anthropic in Talks to Lease Apollo-Controlled Stream Data Centers Anthropic is in early talks to lease up to 1 gigawatt in compute capacity from Stream Data Centers, a developer majority-owned by Apollo Global Management, which could house tensor processing units designed by Broadcom and Google, The Information reported Tuesday. Anthropic… 29 arXiv — Machine Learning research 21d ago Multi-View Fair Clustering Guided by Cross-View Sensitive Information Discrepancy arXiv:2609.25811v1 Announce Type: new Abstract: Multi-view clustering (MVC) aims to uncover latent cluster structures by exploiting complementary information from multiple views. Despite substantial progress in clustering performance, fairness remains an important concern when… 38 arXiv — NLP / Computation & Language research 21d ago MICRO: Multi-Fidelity Active Search for Severe Error Discovery arXiv:2609.26025v1 Announce Type: cross Abstract: Human feedback can vary in cost and informativeness. Strong feedback can reveal severe errors but is costly, so cheaper quality ratings can help decide which items to annotate. We propose MICRO (Multi-Fidelity Impact Clustered… 14 arXiv — Machine Learning research 21d ago Towards Adaptive Federated Graph Clustering: A Global Community-aware Contrastive Learning-based Approach arXiv:2609.26063v1 Announce Type: new Abstract: Federated graph learning (FGL) enables multiple clients to collaboratively train graph models without sharing their private graph data, providing a promising paradigm for mining knowledge from distributed graph repositories. While… 27 arXiv — Machine Learning research 21d ago Mode Collapse Is Cheap to Detect: A Ground-Truth-Free Pre-Flight Check for Neural Samplers arXiv:2609.26272v1 Announce Type: new Abstract: Neural samplers are trained against an unnormalised target $\tilde\pi=e^{-E}$ with no samples from $\pi$, which leaves the practitioner with no way to tell whether an expensive training run has silently dropped part of the target.… 27 arXiv — NLP / Computation & Language research 21d ago ClusterFewshot: Improving Few-shot Optimization for LLMs workflow arXiv:2609.25939v1 Announce Type: new Abstract: The performance of large language model (LLM) workflows often depends on selecting a small set of in-context demonstrations to guide model behavior on new tasks. Recent methods improve this process by augmenting prompts with… 19 The Information — AI news-outlet 21d ago Anthropic in Talks to Cement Control Over More Data Centers Anthropic is in early talks to lease up to 1 gigawatt in compute capacity from a data center developer majority-owned by Apollo Global Management, part of a major effort by the AI company to reduce its reliance on cloud providers. The maker of Claude has discussed signing on as… 16 TechCrunch — AI news-outlet 22d ago Everyone can find a reason to dislike data center construction Inside two years of fraught AI data center debates in Pennsylvania. 18 TechCrunch — AI news-outlet 22d ago Nscale’s IPO will test Wall Street’s appetite for concentrated AI bets once again The British AI data center developer depends on tech giants Microsoft and Anthropic for most of its revenue. 9 r/LocalLLaMA community 22d ago Did Alibaba abandon 35B A3B? Basically the title.We did not get a new moe model with qwen 3.8 and Alibaba did not announce any small moe models on apsara.I know we might get an announcement later but ngl I kinda lost hope   submitted by   /u/Akainu_Fan [link]   [comments] 8 The Information — AI news-outlet 22d ago Alibaba Unveils New AI Chip And Data Center Expansion Plan Alibaba on Tuesday unveiled a powerful new AI chip for training and running models, highlighting the rapid progress in China’s domestic semiconductor capabilities. During its annual Apsara tech conference, Alibaba said its new AI chip, Zhenwu V900, delivers three times the… 10 arXiv — Machine Learning research 22d ago Clustering-Based Collective Anomaly Detection in IoT Systems: A Graph Neural Network Approach arXiv:2609.22166v1 Announce Type: new Abstract: The rapid advancement of Internet of Things (IoT) technology has led to the widespread deployment of smart, interconnected devices across a range of domains. However, this expansion has also resulted in a substantial increase in… 21 arXiv — NLP / Computation & Language research 22d ago Analyzing Public Discourse on Urbanism: Topic Clustering, Sentiment Analysis and Retrieval-Augmented Generation using YouTube Comments arXiv:2609.22705v1 Announce Type: new Abstract: Online discourse about urban issues - walkability, cycling infrastructure, public transit, housing density, and street safety - is voluminous but unstructured, and existing city-evaluation tools capture none of it. We present a… 24 r/LocalLLaMA community 22d ago What are normie reactions to your local AI use like? There's quite a lot of public anti-AI sentiment at the moment, but a lot of the most common concerns and objections have to do with the politics, economics and ethics of datacenter-based AI. So, when you explain to people that you're running inference locally, what's the… 12 The Information — AI news-outlet 22d ago SB Energy Faces Investor Skepticism in IPO, Report Says SB Energy’s initial public offering is facing investor skepticism, The New York Times reported Monday. The SoftBank majority-owned company is planning to raise $5 billion to $7 billion in a public offering to help develop a massive data center complex OpenAI plans to lease,… 11 arXiv — Machine Learning research 23d ago Multi-Domain Clustering via Measure Quantization arXiv:2609.21664v1 Announce Type: new Abstract: Clustering is a fundamental task in data analysis, typically addressed through centroid-based methods such as K-means. In this work, we present a general framework for multi-domain clustering via measure quantization: given samples… 5 arXiv — Machine Learning research 23d ago Federated Deep Clustering Networks for High-Dimensional and Heterogeneous Data arXiv:2609.21829v1 Announce Type: new Abstract: Clustering high-dimensional data is a fundamental task in unsupervised machine learning with applications to a variety of domains. In the centralized data scenario, this task is commonly solved using deep clustering methods that… 25 arXiv — NLP / Computation & Language research 23d ago Not All Irregularity Is Equal: Causally Isolating a Rare Failure Mode in Japanese Morphological Inflection arXiv:2609.21179v1 Announce Type: new Abstract: Neural morphological generation systems often achieve high aggregate accuracy on benchmark datasets, yet such performance can conceal systematic errors clustered in rare morphological subclasses. We present an orthography-aware… 10 arXiv — NLP / Computation & Language research 23d ago Predictable Failure in Multi-Hop Retrieval: Score-Distributional Confidence Scoring and Abstention arXiv:2609.22056v1 Announce Type: cross Abstract: Multi-hop retrieval failures are not uniformly distributed across queries: they cluster in structurally predictable subpopulations. We prove two results formalizing this structure. First (CWAR Reducibility): confident-failure… 29 r/LocalLLaMA community 23d ago Do NOT trust StepFun's Plan subscriptions., They stole >$100 from me with no warning, and I have not heard back from support at all. I know cloud subscription plans are not exactly the core focus of r/LocalLLaMA , so I want to be clear about why I’m posting this here. I’ve been building my own local text-based RPG/game harness and using external models as testing infrastructure: basically stress-testing the… 33 r/LocalLLaMA community 24d ago Speed-up Kimi K3(2.8T) on a 16x GB10 Cluster — 30 t/s coding throughput, 136 t/s concurrency peak. ​ I wanted to share a quick update and performance video running the full Moonshot AI Kimi K3 (moonshotai/Kimi-K3) model across my 16x GB10 cluster. Getting a 2.8T parameter model running smoothly requires custom runtime patches and a solid network layout, but… 6 The Information — AI news-outlet 24d ago How Nvidia Is Trying to Solve the Data Center Power Bottleneck Nvidia is tracking “every single gigawatt of land, power and shell around the world, literally everything on the planet,” CEO Jensen Huang said at Goldman Sachs’ annual tech conference earlier this month. “We know where everything is.” Why track power so intently? Nvidia sees… 33 r/LocalLLaMA community 24d ago I tested 9 LLMs on the exact same web-dev prompt for ~8 hours — RTX 3060 12GB results (Rate the best!) I’ve spent basically the last 8 hours testing different models on the exact same web-development prompt, and I finally finished. The whole point of this nine-hour test was that which local model matches the frontier-level intelligence at size and could fit easily in an RTX… 32 r/MachineLearning community 24d ago Autograd project [P] Hello, I'm a 3rd year Highschooler interested in machine learning and for the last few weeks have been working on a small project meant to learn the basics of machine learning. I have implemented a simple tensor library and autograd in c++. It's very simple but i want some… 31 The Information — AI news-outlet 24d ago Jane Street-Linked Data Center Debt Sours Secretive Wall Street trading firm Jane Street has become famous in the past couple of years for its sizable AI-related spending, as it has struck big cloud deals to handle its AI computing needs and made investments in neocloud CoreWeave. Yet even a Jane Street–related… 32 The Information — AI news-outlet 26d ago Nscale IPO Files to Go Public, Shows Huge Revenue Jump And Steep Losses Nvidia-backed startup Nscale disclosed Friday that revenue had surged 10 times in the first half of this year from the year-ago period, but losses mounted as the cloud startup spent billions on data centers and the AI chips they’ll house. The two-year-old UK startup, a spinout… 12 r/MachineLearning community 26d ago I posted my embedding migration project here, it got a lot of attention, so I added the features you guys said were missing [R] A little while ago, I posted about embedflow https://github.com/arnsri33/embedflow and it got a lot of attention. The basic idea was pretty simple keep your existing embedding index for candidate retrieval → rerank "k" candidates with the new embedding model → progressively… 6 arXiv — Machine Learning research 26d ago Randomized SVD Approximations for Spectral Co-Clustering of Word-Document Matrices arXiv:2609.19243v1 Announce Type: new Abstract: Spectral co-clustering is a useful tool for discovering latent structure in word-document matrices, but its reliance on singular value decomposition (SVD) can make standard formulations expensive on high-dimensional data. This… 5 arXiv — Machine Learning research 26d ago COMPASS: Ordered Clustered Routing at 100K Scale arXiv:2609.20352v1 Announce Type: new Abstract: Large-scale routing often requires visiting clusters of nodes in a prescribed order, giving rise to the Ordered Clustered Traveling Salesman Problem (OCTSP). Optimizing each cluster independently seems natural, but misses non-local… 20 r/LocalLLaMA community 26d ago dual 7900 xtx - some guy made a pretty optimized fork of lamacpp optimized for this setup Qwen 3.8 Q8 at 82 tokens / seconds decode Note not my work, but something i found and wanted to share so hopefully more people can push this along even further. https://github.com/nasone32/llama.cpp-RDNA3-7900xtx-opt I basically run 2 x 7900 xtx on a consumer pc. This repo takes qwen 3.8 Q8 and optimizes it to run on… 5 TechCrunch — AI news-outlet 26d ago Crusoe raises $3.9B to build massive data centers and small modular “AI factories” The round values the data center giant at $30.9 billion. 14 TechCrunch — AI news-outlet 27d ago Google, Nvidia and Anthropic want Emerald AI to find space on the grid for more data centers A new coalition that includes Google, Nvidia, Anthropic and Emerald AI wants to find 100 GW of grid capacity for new data centers. 22 TechCrunch — AI news-outlet 27d ago Al Gore says the real AI risk isn’t data centers — it’s what industry leaders are warning about In an interview with TechCrunch, Al Gore suggested he isn't losing sleep over AI data center emissions — he's more worried about the AI industry's own warnings about where the technology is headed. 38 NVIDIA Developer Blog official-blog 28d ago TensorRT Edge-LLM Completes the MLPerf Edge Agentic Benchmark 6.4x Faster on Jetson AGX Thor AI agents are moving from cloud data centers to vehicles, robots, and other edge devices. Unlike a chatbot that answers a single prompt, an agent works through... 14 MIT Technology Review — AI news-outlet 28d ago Building the materials foundation for AI The AI boom is becoming a materials challenge. As AI pushes computing into new territory, the materials behind that infrastructure are becoming just as crucial as the algorithms running on it. Semiconductors and data centers are approaching physical limits around performance,… 20 arXiv — Machine Learning research 28d ago Differentially Private Semantic Plans for Aggregate Insight Generation arXiv:2609.16283v1 Announce Type: new Abstract: \texttt{URANIA} provides end-to-end differential privacy (DP) for summaries of data-dependent clusters. However, its cluster--keyword release does not directly provide collection-wide aggregates for semantic concepts defined… 33 arXiv — Machine Learning research 28d ago OPEN-1B: A Fully Auditable Training Run arXiv:2609.17380v1 Announce Type: new Abstract: Open-source language models have a reproducibility problem. Despite releasing weights, training data, and recipes, none of them are provably reproducible due to the non-associativity of floating-point arithmetic. Deep learning… 19 r/LocalLLaMA community 28d ago Open Source Appreciation Post It's late at night in the lab, I've been working on a basic script for a virology project, and holy hell the safeguards have been pissing me off. Mirroring detectEVE data over rsync to my laptop by making a zip file first? No no no, great safety mogul DARIO demands there be NO… 18 TechCrunch — AI news-outlet 29d ago The AI data center boom is colliding with cities scarred by big industry National outcry against data center construction has spread to Philadelphia, where officials suggested possible construction in a neighborhood already impacted by a now-defunct oil refinery. 13 TechCrunch — AI news-outlet 29d ago US data centers could consume more natural gas than Germany and Japan combined by 2035 The AI frenzy could push U.S. data centers to become one of the largest consumers of natural gas in the world. 29 NVIDIA Developer Blog official-blog 29d ago How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster... 37 r/MachineLearning community 29d ago Suggestions from all of you guys is needed, please respond this text [D] Hey guys, I have been posting in this subreddit for a long time. I have been asking to give me sugggesitons on my personal career, on how to move ahead in this AI replacement era. I have been touching the basics, trying to make sure I do not miss any fundamentals. I started with… 11 r/MachineLearning community 29d ago How much work in progress can a workshop submission be [R] Hi, let's suppose I am working on an algorithm that uses principles x to solve problems A and B. I already implemented a very basic algorithm that used principle "x mini" to just solve problem A, ran experiments, but have not yet implemented the full one to solve A and B. I must… 26 r/LocalLLaMA community 29d ago Harness: Am I doing something wrong? Or are my expectations unreasonable I have tried using qwen 3.6 and 3.8 q5 64k context and I'm just not getting the experience everyone here seems to get. I'm using open code and it will loop, forget what it's doing, and mess up the ui. All I am making is a simple web app that is basically a glorified text turn… 4 arXiv — Machine Learning research 29d ago SPICE: Simple Polysemantic Feature Interpretation via Clustering-based Explanation arXiv:2609.13198v1 Announce Type: new Abstract: One of the pivotal recent challenges in neural network interpretability is polysemanticity, where a single neuron is activated by multiple, often unrelated concepts, hindering clear functional understanding. Although prior work has… 29 arXiv — Machine Learning research 29d ago Specification Oracles arXiv:2609.13415v1 Announce Type: new Abstract: Specifications face a basic tradeoff: leave details out, and important questions go unanswered; record every detail separately, and the specification becomes large and prolix. We investigate whether a language model can serve as a… 6 Page 3 of 10 · 500 articles ← Newer Older →
