AI

The Real Cost of Scaling AI: How Supermicro and NVIDIA Are Rebuilding Data Center Infrastructure

The hidden cost of scaling AI: infrastructure, energy, and the push for liquid cooling.

Updated

December 16, 2025 3:43 PM

The inside of a data centre, with rows of server racks. PHOTO: FREEPIK

As artificial intelligence models grow larger and more demanding, the quiet pressure point isn’t the algorithms themselves—it’s the AI infrastructure that has to run them. Training and deploying modern AI models now requires enormous amounts of computing power, which creates a different kind of challenge: heat, energy use and space inside data centers. This is the context in which Supermicro and NVIDIA’s collaboration on AI infrastructure begins to matter.

Supermicro designs and builds large-scale computing systems for data centers. It has now expanded its support for NVIDIA’s Blackwell generation of AI chips with new liquid-cooled server platforms built around the NVIDIA HGX B300. The announcement isn’t just about faster hardware. It reflects a broader effort to rethink how AI data center infrastructure is built as facilities strain under rising power and cooling demands.

At a basic level, the systems are designed to pack more AI chips into less space while using less energy to keep them running. Instead of relying mainly on air cooling—fans, chillers and large amounts of electricity, these liquid-cooled AI servers circulate liquid directly across critical components. That approach removes heat more efficiently, allowing servers to run denser AI workloads without overheating or wasting energy.

Why does that matter outside a data center? Because AI doesn’t scale in isolation. As models become more complex, the cost of running them rises quickly, not just in hardware budgets, but in electricity use, water consumption and physical footprint. Traditional air-cooling methods are increasingly becoming a bottleneck, limiting how far AI systems can grow before energy and infrastructure costs spiral.

This is where the Supermicro–NVIDIA partnership fits in. NVIDIA supplies the computing engines—the Blackwell-based GPUs designed to handle massive AI workloads. Supermicro focuses on how those chips are deployed in the real world: how many GPUs can fit in a rack, how they are cooled, how quickly systems can be assembled and how reliably they can operate at scale in modern data centers. Together, the goal is to make high-density AI computing more practical, not just more powerful.

The new liquid-cooled designs are aimed at hyperscale data centers and so-called AI factories—facilities built specifically to train and run large AI models continuously. By increasing GPU density per rack and removing most of the heat through liquid cooling, these systems aim to ease a growing tension in the AI boom: the need for more computers without an equally dramatic rise in energy waste.

Just as important is speed. Large organizations don’t want to spend months stitching together custom AI infrastructure. Supermicro’s approach packages compute, networking and cooling into pre-validated data center building blocks that can be deployed faster. In a world where AI capabilities are advancing rapidly, time to deployment can matter as much as raw performance.

Stepping back, this development says less about one product launch and more about a shift in priorities across the AI industry. The next phase of AI growth isn’t only about smarter models—it’s about whether the physical infrastructure powering AI can scale responsibly. Efficiency, power use and sustainability are becoming as critical as speed.

Keep Reading

Funding

Rokid Sets a Crowdfunding Record in Taiwan with NT$62 Million AI Glasses Campaign

From pre-orders to market entry, Rokid’s Taiwan campaign reflects how AI hardware is being introduced to consumers today.

Updated

December 17, 2025 1:43 PM

Rokid Glasses, a pair of AR glasses from Rokid. PHOTO: ROKID

Rokid has reached a significant crowdfunding milestone in Taiwan. Its Rokid Glasses campaign surpassed NT$62 million in pre-order funding on zeczec, Taiwan’s creative-oriented crowdfunding platform. The campaign ranked No. 1 across all categories on the platform in 2025 and entered the Top 10 funded campaigns in zeczec’s history, setting new records for AI and XR-related projects.

The campaign launched on October 28 and became one of the platform’s most prominent technology initiatives of the year. According to the company, the outcome followed growing visibility for Rokid Glasses after product showcases in New York, Berlin, Singapore and Paris, positioning the Taiwan campaign within a broader international rollout.

The crowdfunding achievement coincided with Rokid’s official market entry in Taiwan. On December 10, the company debuted Rokid Glasses locally, introducing the product to media, partners and early users in the region. The Taiwan launch mirrored earlier international events and connected the online crowdfunding campaign with a physical market presence.

Rokid Glasses combine augmented reality displays with built-in AI functions, including real-time multilingual translation, live transcription, navigation, object recognition and voice assistance. These capabilities were central to how the product was presented during both the crowdfunding campaign and the Taiwan launch, without framing the project as a traditional consumer electronics release.

The Taiwan campaign builds on Rokid’s prior crowdfunding history. The company previously raised more than US$4 million on Kickstarter, where Rokid Glasses became the highest-funded XR wearable project on the platform. The zeczec campaign extends that track record into one of Asia’s most established consumer electronics markets.

“Taiwan has one of the world's most mature and discerning consumer electronics markets”, said Said Justo Chang, Head of Global Channels at Rokid. “Reaching the top of Taiwan's crowdfunding platform is a great commercial achievement. We are excited to finally introduce Rokid Glasses to Taiwan”.

More broadly, the campaign highlights how crowdfunding platforms continue to function as launch and distribution channels for emerging AI and XR hardware. In Rokid’s case, product rollout, market entry and public participation converged within a single campaign, marking a notable moment for AI-enabled wearables in Taiwan’s technology landscape.