News / #hardware Tag Hardware 500 articles archived under #hardware · RSS Sign in to follow Ars Technica — AI news-outlet 19d ago Amazon backs power plant that may become top source of US climate pollution Amazon announces first off-the-grid data center in race to reap AI profits. 27 MIT News — AI research 19d ago With a feel for physics, AI models simulate a wider range of real-world scenarios “GeoPT” helps AI models understand the basics of physics so they can simulate how objects respond to things like wind and water more efficiently and accurately. 8 arXiv — Machine Learning research 20d ago SNI-GNN: SmartNIC-Assisted Full-Graph GNN Training with In-Network Embedding Prediction arXiv:2608.06441v1 Announce Type: new Abstract: Full-graph GNN training delivers high accuracy but scales poorly on multi-server clusters due to heavy, irregular inter-node embedding exchanges. We present SNI-GNN, a SmartNIC-assisted full-graph training system that reduces… 21 arXiv — Machine Learning research 20d ago Density-aware Hierarchical Clustering Based on Element-Categorized Connection Subgraphs arXiv:2608.06990v1 Announce Type: new Abstract: Clustering is a fundamental data mining technique for pattern recognition through unsupervised learning. Among various clustering methods, hierarchical clustering, density-based clustering, and graph clustering stand out as… 10 arXiv — Machine Learning research 20d ago Is SwiGLU's Open Positive Tail Necessary? Evidence from Closed-Tail Gating with MemGLU arXiv:2608.07323v1 Announce Type: new Abstract: We test whether decoder-only language-model FFNs require SwiGLU's open positive tail. We introduce MemGLU as a closed-tail comparator derived from a memristive branch geometry. Across paired 9M and 30M pretraining runs with three… 27 arXiv — NLP / Computation & Language research 20d ago Recovering Lesion Parameters from Aphasic Picture Naming Error Profiles in Large Language Models arXiv:2608.06429v1 Announce Type: new Abstract: Interpretability methods for large language models (LLMs) describe internal state but do not directly test whether that state is causally sufficient to produce the observed behavior. In earlier work, we lesioned LLMs to produce… 28 r/LocalLLaMA community 20d ago endless-frontier/BigBang-v1 - qwen 3.5 finetunes table bench https://huggingface.co/bartowski/endless-frontier_BigBang-v1-GGUF I'm downloading this model only because Bartowski converted it to .gguf, so it might be interesting. Doubts : The headline number is basically meaningless. "Performance between DeepSeek Flash (old one)… 26 r/LocalLLaMA community 21d ago Kimi K3 (Unsloth) IQ2-XXS from 711GB down to 478GB!!! Only Multi-language was removed to trim the size Firstly a big thanks to the poster "hellohazine", he basically only removed the multi-lingual fat of the model and just kept the English language intact. It is the exact model, and the rest of the model still intact with all of its high intelligence. I think that was a brilliant… 29 TechCrunch — AI news-outlet 21d ago Planned Amazon data center could become the biggest climate polluter in the U.S. As part of a planned Texas data center, Amazon is investing in an on-site power plant that could reportedly become the largest source of climate pollution in the United States. 9 r/LocalLLaMA community 21d ago Showoff Saturday: Local 4x 6000 Pro (multi-year progression) Not the biggest or shiniest, but it's mine From gaming machine inference on the original llama models, to a 4x RTX 6000 Pro Max Q + 4x 3090s local AI cluster. Pictures are in reverse chronological order! With the pricing apocalypse meaning less builds shared here recently,… 38 r/LocalLLaMA community 21d ago My first run of Kimi K3 locally. Running across 2 clusters using llama.cpp over RPC too. Both clusters are not enough to hold everything in memory, so main cluster still partially offloads to run. Goal will be to get all the GPUs in one system and without RPC, I should probably see 2-3x faster speed. Running… 7 Simon Willison community 21d ago Now we have a timeline of the OpenAI accidental attack against Hugging Face My comment on Now we have a timeline of the OpenAI accidental attack against Hugging Face — Hacker News. I think one of the most interesting details here might be tucked away in that first bulletin point: May 7: OpenAI starts a new training run for an experimental,… 16 Simon Willison community 21d ago Now we have a timeline of the OpenAI accidental attack against Hugging Face My comment on Now we have a timeline of the OpenAI accidental attack against Hugging Face — Hacker News. I think one of the most interesting details here might be tucked away in that first bulletin point: May 7: OpenAI starts a new training run for an experimental,… 37 r/LocalLLaMA community 21d ago Claude Code in 9 lines python I was wondering what a minimal coding agent implementation would look like that can be used like Claude Code or Codex Not feature-by-feature of course but basically stripping everything out that is not needed here is what I came up with: 9 lines of python no 3rd party deps… 29 r/LocalLLaMA community 22d ago Has anyone here fiddled with TPUs for inference ? I discovered recently that Google uses their own TPUs, like tiny ASIC cards like the toy ones that existed for bitcoin. And while it sounds inefficient the fact they use thousands of them because...they can...means at scale they aren't so bad. Has no one here given them a try? I… 26 r/LocalLLaMA community 22d ago PSA for anyone with multiple V620's or other gfx1030 cards having problems making llama.cpp tensor split work -- set "-ub 384" and -b to a multiple of that depending on number of GPUs Basically what the title says. For me, it would always crash and burn trying to use tensor split. Apparently, there's some bug where GPU memory gets corrupted with the default microbatch (512) or higher. I will be opening an issue report on the llama.cpp GitHub if there isn't… 6 r/LocalLLaMA community 22d ago Serving Deepseek v4 Flash 0731 on 2x DGX Spark — 5-7 GB OS headroom, what would you do to lower VRAM usage and increase OS available RAM? Hey all, I'm serving DSv4Flash 0731 on a cluster of 2x DGX Sparks but am running into constant issues with having almost no RAM (unified memory) left for the OS/cache and I'd love to hear the community feedback on what I could do to get more RAM for headroom. The DGX has an… 32 r/LocalLLaMA community 22d ago Got job as Director of AI and Systems development self-taught Hey everyone, I just wanted to share my journey here for some motivation. Three years ago, I saw the sudden spike in AI and realized it was the future of tech. My goal at the time was to be an indie game dev, and seeing that AI could write basic code, I told myself I needed to… 20 arXiv — Machine Learning research 23d ago Beyond Feature Importance: A Comparative Analysis of Pattern Detection Methods in Cluster Interpretation arXiv:2608.05880v1 Announce Type: new Abstract: Interpreting clustering outcomes remains a fundamental challenge in data analysis, particularly in domains such as healthcare where meaningful patterns must be extracted from high-dimensional data. While numerous explainability… 12 arXiv — Machine Learning research 23d ago CohortHijack: Robustness of Single Cell Annotation to Companion Cell Removal arXiv:2608.05900v1 Announce Type: new Abstract: Many single-cell annotation tools refine an initial cell label using nearby cells or cluster-level voting. We study whether this refinement can be manipulated without changing the target cell. We introduce CohortHijack, a… 23 r/LocalLLaMA community 24d ago I get that AI labs need to make money, but zero-warning price spikes are a nightmare for production builds Seen a ton of posts today about the DeepSeek API price hike. Half the feed is doom-posting, the other half is explaining basic GPU economics. Honestly, I get the cost side. Sub-cent tokens were never gonna last forever. But what actually sucks is the zero-day notice. Dropping a… 23 arXiv — Machine Learning research 24d ago On Hamming-Lipschitz Type Stability of the Subdominant (Minmax) Ultrametric: Theory and Simple Proofs arXiv:2608.04014v1 Announce Type: new Abstract: The subdominant (minmax) ultrametric is a canonical tree-structured summary of a dissimilarity matrix, arising equivalently as the ultrametric induced by single-linkage clustering. While its classical stability theory is usually… 17 arXiv — Machine Learning research 24d ago Random features for Grassmannian kernel approximation with bounded rank-one projections arXiv:2608.04227v1 Announce Type: new Abstract: We propose a family of random feature maps for scalable kernel machines on low-dimensional subspaces, ie on the Grassmannian manifold. Such representations are useful when data classes or clusters are well described by the span of… 6 Hacker News — AI on Front Page community 24d ago Nashville uses eminent domain to block data center near zoo Article URL: https://www.costar.com/article/970809918/nashville-council-approves-eminent-domain-action-to-halt-data-center-project Comments URL: https://news.ycombinator.com/item?id=49191624 Points: 203 # Comments: 216 9 r/LocalLLaMA community 24d ago Deepseek V4 Flash just hit Colibri, does anyone have numbers? I'm mosty interested in 128-192GB VRAM with 128-256GB RAM to spare, so SSD streaming is basically not even necessary. Seems only FP4 is supported, so older hardware will likely be slow - no Unsloth GGUF supported either. I'd be curious what people are getting with V100s, R9700s,… 8 r/LocalLLaMA community 25d ago I updated my localy run benchmark with DeepSeek V4 Flash 0731 It's the purple cluster on the top left (the good corner...) I'm running the MXFP4 version from Bartoswski with Dspark at 1K t/s prefill and 90 t/s gen (average). I tried different sampling params, you can check the detail. It's very efficient while scoring the best yet. Too bad… 12 arXiv — Machine Learning research 25d ago Learning and Clustering on Temporal Graphs: Principles, Primitives, and Pooling arXiv:2608.03696v1 Announce Type: new Abstract: This work focuses on the problem of learning on temporal graphs, with particular emphasis on the task of clustering: obtaining coarse-grained representations by aggregating information from nodes, edges, and temporal dynamics - a… 34 arXiv — NLP / Computation & Language research 25d ago Predicting Deep Neural Network Training Outcomes from Early Training Telemetry arXiv:2608.03709v1 Announce Type: new Abstract: Large hyperparameter sweeps for deep neural networks spend substantial compute on configurations that are effectively doomed from the first few epochs. We study whether a single training run's own early telemetry - per-epoch loss,… 32 Ars Technica — AI news-outlet 25d ago Texas halts data center connections to power grid amid overwhelming demand Governor who touted Texas as AI “epicenter” pauses data center grid connections. 36 r/LocalLLaMA community 25d ago Kimi K3 full model running on 16x GB10 cluster at 20+tps Kimi K3 full model running on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill. This is the first run of full k3 with dspark on my cluster. I will be doing some tests and try tp speed this up. As soon as it looks ready I'll publish the… 13 TechCrunch — AI news-outlet 25d ago Texas halts new data centers as governor calls for audits Texas Governor Greg Abbott has paused new data center development until an audit has been completed. 4 TechCrunch — AI news-outlet 25d ago Is the future of data centers portable? Runware builds a pod to find out On Tuesday, AI infrastructure company Runware announced the launch of its own modular data center called Sonic Inference Pod. 18 arXiv — Machine Learning research 26d ago Ensemble of Unsupervised Deep Learning for Clustering Imbalanced Tabular Data arXiv:2608.00346v1 Announce Type: new Abstract: Data imbalance poses a major challenge in supervised classification, where the majority-class bias contributes to false negatives and overestimates classification accuracy. Unsupervised deep clustering can be immune to class… 6 arXiv — Machine Learning research 26d ago RHEA: Reliability-Harmonized Reconstruction and Assignment for Robust Multimodal-Attributed Graph Clustering arXiv:2608.00621v1 Announce Type: new Abstract: Multimodal-attributed graphs (MAGs), whose nodes carry heterogeneous attributes such as text and images over a relational structure, have become a fundamental substrate for label-free entity grouping tasks, including community… 23 arXiv — Machine Learning research 26d ago Cluster-Aware Over-the-Air Federated Learning with Energy-Harvesting Devices: From Global Training to Model Personalization arXiv:2608.01426v1 Announce Type: new Abstract: Federated learning (FL) enables distributed optimization and learning across decentralized edge devices while preserving data privacy, but its performance is fundamentally constrained by heterogeneous data distributions, limited… 4 NVIDIA Developer Blog official-blog 26d ago How to Run Isolated Tenant Kubernetes Clusters on Shared GPU Infrastructure Running a dedicated Kubernetes cluster per team often results in more isolation than an organization requires. While one cluster can be successfully shared... 9 r/LocalLLaMA community 26d ago "Data center in a Box (on Wheels)" 256Gb VRAM/512Gb RAM AI Server 6-8 Month Operational Review, Stability Write Up, Benchmarks I've been out of these forums for awhile but I figured I would provide a formal update on how this has been going now that it has some operation time under its belt, just to put the information out there and share knowledge if there is any interest. I also wasn't satisfied with… 32 Hugging Face Daily Papers research 27d ago Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs Abstract Large language model safeguards decide whether to answer before seeing how an answer will be used. This creates a basic problem for dual-use tasks: the same answer can help an authorized professional or an attacker, while an attacker can imitate a benign request and… 8 arXiv — Machine Learning research 27d ago Topology-Aware Data Movement for Disaggregated GPU Inference arXiv:2607.28633v1 Announce Type: new Abstract: Disaggregated LLM inference creates a datacenter networking problem that no existing system solves correctly. When prefill and decode run on separate GPU pools, the KV cache must be transferred between them. For a 70B model this is… 6 arXiv — NLP / Computation & Language research 27d ago Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM arXiv:2607.28635v1 Announce Type: new Abstract: In Natural Language Processing (NLP), dealing with underrepresented topics is challenging, especially in unsupervised tasks where clustering might not adequately capture minority topics. To tackle this challenge, our paper presents… 34 arXiv — NLP / Computation & Language research 27d ago TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models arXiv:2607.28896v1 Announce Type: cross Abstract: Unified audio models capable of audio understanding, audio generation and, increasingly, audio editing are proliferating rapidly. Yet a basic question about them remains unanswered: do the two heads of a unified model agree about… 26 r/LocalLLaMA community 28d ago Setting up of a 16xGB10 (DGX Spark) cluster Preparing this to be able to run locally frontier level open models. Deepseek v4 pro, Kimi K3, future ones like GLM 5.5 and Minimax M4. 16x Asus GX10 linked by mikrotik crs804-4ddq with 4 breakout cables of 400 to 100gbit. Most probable I will be running 2 models on 8x cluster… 13 r/LocalLLaMA community 28d ago Real-world reality check on Qwen for autonomous coding agents TLDR below 👇🏼 I’ve seen a lot of hype around Qwen 3.6 35B and 3.5 120B lately, especially regarding coding and tool-use capabilities. On this subreddit it is the defacto recommended model for everyone without a Datacenter at home. I’ve been running Qwen 3.5 120B… 9 r/MachineLearning community 28d ago Bytedance is using seedance 2.5 to automatically generate animated study guides in gauth. interesting use case for ai video [N] bytedance is using seedance 2.5 to automatically generate animated study guides in gauth. interesting use case for ai video saw this business insider article about how bytedance integrated their seedance 2.5 video model into their study app (gauth). basically generates animated… 34 r/LocalLLaMA community 28d ago EU AI Act takes effect tomorrow, August 2, 2026. 🤡 Basically you now have to mark all AI generated images, audio, video and text as AI generated. :P   submitted by   /u/xoxaxo [link]   [comments] 32 r/LocalLLaMA community 29d ago With release of Deepseek V4 I wanted see how the model sizes are trending over time. The trend is that by this time next year, we probably will have Opus 4.5 level models on consumer grade laptops! I was surprised to see that Deepseek V4 Flash is extremely smart and small enough to fit in setup that can be built with < $50,000. Expensive, but not a datacenter. So I wanted to see the trend over time of model sizes and their scores and created above plots using Opus/Sonnet… 32 r/MachineLearning community 29d ago Learning path to fully understand the Kimi K3 technical report?[D] Hi everyone, Can anyone suggest a learning path to fully understand the technical report for Kimi K3? My background: - I've taken a graduate-level deep learning course. - I understand the Transformer architecture, attention, and the basics of LLMs. - I'm familiar with DeepSeek's… 15 TechCrunch — AI news-outlet 29d ago SpaceX won’t remove all of xAI’s unpermitted turbines for another year SpaceX is building a new power plant for xAI's Colossus data centers, but it won't remove existing, unpermitted turbines for many more months. 15 arXiv — Machine Learning research 1mo ago DAS-PMVC: A Framework for Partial Multi-View Clustering via Dual Alignment and Structure Enhancement arXiv:2607.27761v1 Announce Type: new Abstract: In recent years, multi-view clustering has attracted widespread research interest. However, due to limitations in data collection devices, data across different views often suffer from misalignment, leading to the partial view… 14 arXiv — Machine Learning research 1mo ago Encryption-Compatible Clustered Federated Learning via Distributed Expectation-Maximization over Metadata arXiv:2607.28338v1 Announce Type: new Abstract: Clustered Federated Learning (CFL) addresses data heterogeneity in federated settings by grouping clients with similar data distributions to enable effective training. Existing methods face a trade-off between privacy preservation,… 15 Page 3 of 10 · 500 articles ← Newer Older →
