News / #hardware Tag Hardware 500 articles archived under #hardware · RSS Sign in to follow The Information — AI news-outlet 11h ago Blackstone-Backed AirTrunk Postpones REIT IPO Amid Market Volatility Data center operator AirTrunk is postponing a planned initial public offering of a real estate investment trust in Singapore to next year as higher interest rates and volatile markets dampen investor demand, Bloomberg reported. The Sydney-headquartered company, which is backed… 21 r/LocalLLaMA community 18h ago Discover AI: A Learning Guide - 51 hands-on labs for learning how AI actually works. This is an offline app with 51 hands-on labs for learning how AI actually works, from neurons to agents and more... **A bit of insight** - 51 labs in 6 groups, from the basics (what a neuron is, gradient descent) through attention, RAG, agents, fine-tuning, quantization, serving… 32 The Information — AI news-outlet 1d ago Anthropic to Build First Data Center in Japan Anthropic is in the final stages of talks with NTT Data Group to build its first data center in Japan, Nikkei reported. The facility is expected to have a total power intake capacity of up to 500 megawatts, which would make it one of Japan’s largest data centers. Construction… 35 r/LocalLLaMA community 1d ago I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating) I saw a lot of posts here struggling to run 27B models on 8GB VRAM or complaining about phones turning into space heaters. I hit the exact same OOM wall on my phone, so I decided to build a hardware-split workaround. I wrote a custom C++ engine (fork of llama.rn ) to cluster two… 9 Hacker News — AI on Front Page community 1d ago Intel D270 GPU AI Accelerator–Up to 480 GB LPDDR5X Article URL: https://www.intel.com/content/www/us/en/products/details/discrete-gpus/data-center-gpu/d-series.html Comments URL: https://news.ycombinator.com/item?id=50063365 Points: 203 # Comments: 105 37 Ars Technica — AI news-outlet 2d ago Russia was not ready for the data center war it started with Ukraine Russian bloggers warn Russia’s hyper-centralized digital economy is vulnerable. 36 The Information — AI news-outlet 2d ago Andreessen Horowitz, General Catalyst Race to Secure the Chips Their Startups Need As startups scramble to get access to AI servers, more venture capital firms are finding ways to secure compute on their behalf. Andreessen Horowitz, which two years ago set up a cluster of 20,000 graphics processing units for its startups, is in talks to expand its offering,… 18 The Information — AI news-outlet 2d ago Andreessen Horowitz, General Catalyst Race to Secure the Chips Their Startups Need As startups scramble to get access to AI servers, more venture capital firms are finding ways to secure compute on their behalf. Andreessen Horowitz, which two years ago set up a cluster of 20,000 graphics processing units for its startups, is in talks to expand its offering,… 26 r/LocalLLaMA community 2d ago In 2030 owning a gpu cluster will be seen the same as owning a gun for home defense My window will have a sign that says "we don't call tech support" with a simplified pic of a v100 on it I know this reads like a shitpost and I'm half joking and half serious Edit: I'd sell these on Etsy if Jensen wouldn't hit me with a C&D   submitted by  … 27 r/LocalLLaMA community 2d ago BrokenML: can agents fix broken ML jobs? Write-up: https://zhebrak.io/posts/brokenml/ Repo: https://github.com/zhebrak/brokenml I built a benchmark to determine the access level agents need to successfully fix broken ML workloads (PyTorch over Gloo on a two-node Slurm cluster or a llama.cpp server running in Docker… 30 arXiv — Machine Learning research 2d ago Sustainable Cloud-Fog-Edge Systems for Smart Buildings: Algorithmic Adaptation under Memory Constraints and Dynamic Orchestration Strategies arXiv:2610.13307v1 Announce Type: new Abstract: The escalating environmental footprint of the Information and Communication Technol- ogy (ICT) sectorwith global Data Center electric- ity usage potentially reaching 3% by 2030 and the imperative for real-time responsiveness in… 20 arXiv — NLP / Computation & Language research 2d ago Benchmarking Embedding Geometries and Clustering Algorithms for Unsupervised Patent Claim Classification arXiv:2610.12997v1 Announce Type: cross Abstract: Prior-art retrieval systems are structurally organized around classification codes, making cross-code discovery difficult. This paper asks if an unsupervised representation trained on patent text can recover relevant connections… 37 Hacker News — AI on Front Page community 2d ago Google is illegaly cutting forest to build data centers Article URL: https://www.theguardian.com/technology/2026/oct/06/google-datacentres-finland-temporary-halt-environmental-impact-assessment Comments URL: https://news.ycombinator.com/item?id=50048638 Points: 273 # Comments: 71 21 r/LocalLLaMA community 3d ago "Strata" for GLM5.3 Flash is here for some! Project Maya I stumbled across this as I was currently having glm5.3 flash run only around 10tok/s basically unusable. With Maya i am running 30 tok/s now. GLM5.3 feels even with this low quant like a much more enjoyable model than qwen 3.8 flash next so far. Still testing . This is very… 29 TechCrunch — AI news-outlet 3d ago Can the AI industry persuade data center opponents by getting rid of NDAs? On Equity, we debate the impact of data center moratoriums and whether the AI industry has a communication problem. 35 The Information — AI news-outlet 3d ago The Attractive Economics Behind Anthropic Data Center Sprint Why is Anthropic driving its partners to speed up the $530 billion of data center leasing deals it has signed ? It’s simple: Every server Anthropic plugs in sooner to run its products could be wildly profitable, according to fresh analysis of upcoming AI data center sites,… 37 The Information — AI news-outlet 3d ago The Attractive Economics Behind Anthropic Data Center Sprint Why is Anthropic driving its partners to speed up the $530 billion of data center leasing deals it has signed ? It’s simple: Every server Anthropic plugs in sooner to run its products could be wildly profitable, according to fresh analysis of upcoming AI data center sites,… 32 Hacker News — AI on Front Page community 3d ago Sudden drop in Cloudflare bot traffic after strike on Yandex datacenter Article URL: https://radar.cloudflare.com/bots/as13238?dateRange=7d Comments URL: https://news.ycombinator.com/item?id=50041619 Points: 251 # Comments: 93 9 Hacker News — AI on Front Page community 3d ago 3rd Yandex Cloud Data Center Was Hit Article URL: https://status.yandex.cloud/en/incidents/2136 Comments URL: https://news.ycombinator.com/item?id=50040547 Points: 218 # Comments: 289 8 r/LocalLLaMA community 3d ago Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards This will be my third update on the bc-250 cluster and for my first forray into local ai I have been having a blast. This has turned from a weekend experiment into something I think I will use in the future. I am running 4 BC-250 boards connected by 2.5gb ethernet adapters to a… 13 r/LocalLLaMA community 4d ago Benefits of using bigger models than Qwen 3.8 flash next? I recently started using local LLM for mostly coding tasks for my personal projects. I also have found local models responding much better for topics such as health, fitness, ergonomics etc. compared to the quality I had observed with ChatGPT Go (which is still a basic level)… 8 r/LocalLLaMA community 4d ago No more RTX 5090 Nvidia reportedly halts GeForce RTX 5090 production in favor of AI data center and professional GPUs — impending supply drought expected to drive up prices, RTX 5080 24GB rumored as new gaming flagship… 4 Ars Technica — AI news-outlet 4d ago Ukraine’s drones knock out AI data center belonging to "Russia’s Google" One damaged data center has supercomputers used for training Yandex’s AI model. 13 TechCrunch — AI news-outlet 5d ago Amazon and others are done keeping data center deals secret. Is it enough to build trust? Amazon says it will stop using NDAs when negotiating data center deals with local governments, following a similar move from Microsoft earlier this year. Secrecy has fueled community backlash against AI infrastructure, with opposition leading… 36 TechCrunch — AI news-outlet 5d ago Amazon drops data center NDAs, and AI agents want your credit card Amazon says it will stop using NDAs when negotiating data center deals with local governments, following a similar move from Microsoft earlier this year. Secrecy has fueled community backlash against AI infrastructure, with opposition leading… 11 Hugging Face official-blog 5d ago Impactful scheduling for GPU clusters Back to Articles a]:hidden"> Impactful scheduling for GPU clusters Enterprise Article Published October 9, 2026 Upvote - Kyle Wiggers Ai2Comms allenai :last-child]:mb-0"> Building a cluster scheduler to prioritize high-impact research while maintaining full occupancy On the AI… 6 The Information — AI news-outlet 5d ago China’s AI Model Race Is Just Getting More Crowded Imagine Epic Games, Apple and DoorDash were developing their own large language models now from scratch to compete against the likes of OpenAI and Anthropic. That’s basically what’s happening in China, where a trio of big names from other parts of the tech industry have jumped… 6 The Information — AI news-outlet 5d ago China’s AI Model Race Is Just Getting More Crowded Imagine Epic Games, Apple and DoorDash were developing their own large language models now from scratch to compete against the likes of OpenAI and Anthropic. That’s basically what’s happening in China, where a trio of big names from other parts of the tech industry have jumped… 23 arXiv — Machine Learning research 5d ago Compactness and Consistency: A Conjoint Framework for Deep Graph Clustering arXiv:2610.11506v1 Announce Type: new Abstract: Graph clustering is a fundamental task in data analysis, aiming at grouping nodes with similar characteristics in the graph into clusters. This problem has been widely explored using graph neural networks (GNNs) due to their… 10 The Information — AI news-outlet 6d ago AI’s Boom Has Infrastructure Investors Looking at Garbage The investing frenzy in data centers that the AI boom sparked has created a bargain-hunting opportunity—in everything but AI assets. AI has pulled investors’ attention away from unglamorous assets in sectors like transportation and waste management over the past few years, as… 15 The Information — AI news-outlet 6d ago How Amazon Rewired Its Data Centers After Mississippi Power Warning Earlier this year, officials at Mississippi electric utility Entergy had some worrisome news for Amazon: It was going to have to start kicking the company’s Mississippi-based data centers off the grid during peak times to ensure it could support other customers, according to two… 13 MIT News — AI research 6d ago Using AI to mitigate the growing environmental threat of data centers By rethinking how large cloud computing systems operate, Associate Professor Christina Delimitrou seeks to make data centers more energy efficient. 38 The Information — AI news-outlet 7d ago U.S. Treasury Issues First Fine Over Outbound Investments in China’s Tech Sector The U.S. Treasury Department said on Wednesday it had fined the parent company of startup accelerator Plug and Play Tech Center, the first penalty issued under an outbound investment restriction program targeting China’s tech sector. California real estate company Amidi Group… 21 arXiv — Machine Learning research 7d ago Algorithmically Aligned Neural Agglomerative Tree Construction arXiv:2610.07271v1 Announce Type: new Abstract: Linkage algorithms for hierarchical clustering (HC) are a powerful and efficient framework for constructing clustering trees, yet it is often unclear which merge rule best suits a given dataset or task. In contrast, neural… 30 arXiv — Machine Learning research 7d ago Fed-BRDECS: Privacy-Preserving and Heterogeneity-Aware Federated Deep Embedded Clustering arXiv:2610.07399v1 Announce Type: new Abstract: Federated deep clustering seeks to learn clustering-friendly representations from decentralized unlabeled data while preserving client privacy. However, Deep Embedded Clustering (DEC)-style objectives depend on global… 21 arXiv — NLP / Computation & Language research 7d ago Tree Navigation Without LLM Summaries: A Matched-Cost Study of Hierarchical Retrieval for Long-Document QA arXiv:2610.06902v1 Announce Type: new Abstract: Retrieval-augmented generation grounds language models in external context, but for long documents flat top-$k$ retrieval can cluster on a single region and miss complementary evidence. RAPTOR-style summary trees address this by… 36 Vercel — AI dev-tools 7d ago Glyph Cluster is now available in stealth for free on AI Gateway Glyph Cluster is now available on AI Gateway as a stealth model for teams on Pro and Enterprise plans with purchased AI Gateway credits. It is free to use during the stealth period. Glyph Cluster is a reasoning model for coding and long-context analysis, and handles multi-step… 23 MIT News — AI research 8d ago Supercomputing researchers document evolution of AI hardware An ongoing survey tracks the latest AI accelerator systems to keep hardware relevant for Lincoln Laboratory staff and sponsors. 31 Simon Willison community 8d ago Introducing Mistral Large 4: Le chonk Introducing Mistral Large 4: Le chonk Mistral are back in the game. Today they're releasing a preview of Mistral Large 4, a 1 trillion parameter, 49 billion active parameter model trained on their own cluster of 3,800 NVIDIA Grace Blackwell GPUs. The preview is available via… 13 r/LocalLLaMA community 8d ago Local AI ecosystem overview Hey guys, it's Merve from Hugging Face! I've recently given a talk in a dev conference about llama.cpp + but also covering basic concepts like prefill vs decode, memory types, speculative decoding etc. you can use it if you feel like it and I appreciate if you can give… 33 Hacker News — AI on Front Page community 8d ago OpenTPU – An open-source AI accelerator, developed by AI Article URL: https://github.com/FeSens/openTPU Comments URL: https://news.ycombinator.com/item?id=49980715 Points: 209 # Comments: 273 4 NVIDIA Developer Blog official-blog 8d ago AICR v1.0: Open, stable, and verifiable GPU cluster configuration GPU-accelerated Kubernetes clusters depend on compatible versions across dozens of components, each on its own release cycle: host kernels, GPU drivers,... 17 r/LocalLLaMA community 8d ago When will we get another good American open weights model? Every time I check the top models on HF, I basically feel like this:   submitted by   /u/cyber_burr [link]   [comments] 8 The Information — AI news-outlet 8d ago DayOne Data Centers Files for Nasdaq IPO amid Market Uncertainty Singapore-based DayOne Data Centers on Monday filed for an initial public offering on the Nasdaq Stock Market, a signal of optimism about the IPO market. A string of companies have postponed plans to go public in recent weeks due to choppy market conditions. DayOne, which mainly… 21 The Information — AI news-outlet 9d ago Why Google, Amazon and Microsoft Need Chinese Data Center Suppliers U.S. data center operators’ reliance on Chinese manufacturers for batteries, cooling systems, optical transceivers and other equipment has come under scrutiny over national security concerns. But Chinese equipment makers have an edge over their American counterparts, which have… 8 r/MachineLearning community 9d ago Language barrier, shadier terms and jargon fog [D] Hey all, I don't know if you guys are experiencing the same thing, but there is this behaviour that i have been noticing on the latest models on openAI (since sol 5.6) and Anthropic since Fable 5.1 and opus 5.5 .. Basically the models use more "complexe" terms and words, not… 6 r/LocalLLaMA community 9d ago Which model, which harness? I have data for you. I keep testing harness & model setups on real tasks: basic math, vision, computer use (reading emails, navigating stores) and coding. I created a benchmark and a leaderboard. You can see it here: https://airbench.ai/leaderboard?k=poL It measure capabilities (a % of sucess on the… 9 r/LocalLLaMA community 9d ago Clef Flash plays Snake in Real Time on RTX 5080 The cool part is No training was needed. No hacking of the game state or algorithms needed Just simple instructions about what the snake can see, etc, and it can play in real time. 135ms is the turn limit of Google snake, so basically could be a human playing. Ofc, it could be… 10 arXiv — Machine Learning research 9d ago AI-driven Thermal-aware Data Center Capacity Planning arXiv:2610.02442v1 Announce Type: new Abstract: The emerging of large language models (LLMs) has posed significant challenges to the thermal management of data center. Intense GPU computation for LLMs results in localized hotspots. Moreover, spiking thermal loads during training… 6 r/LocalLLaMA community 9d ago Is Strix Halo (GMKtec EVO-X2, etc.) the closest thing we have to a "dream" local LLM box? I've been looking at the <32B model space and keep coming back to an interesting question. A few years ago, projects like Hummingbird+ suggested that cheap custom accelerators (FPGA-based) might become the future of local inference. But today it seems like memory capacity is… 15 Page 1 of 10 · 500 articles Older →