Close Menu
Global News HQ
    What's Hot

    I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials

    June 8, 2025

    Essential Guide to Crafting a Successful Daycare Business Plan

    June 8, 2025

    Mini Motorways is getting a creative mode

    June 8, 2025
    Recent Posts
    • I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials
    • Essential Guide to Crafting a Successful Daycare Business Plan
    • Mini Motorways is getting a creative mode
    • Is Hims & Hers Health a Smart Buy Right Now? | The Motley Fool
    • Cudis Bets on Wearables, AI and a Solana Token to Drive the Longevity Movement – Decrypt
    Facebook X (Twitter) Instagram YouTube TikTok
    Trending
    • I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials
    • Essential Guide to Crafting a Successful Daycare Business Plan
    • Mini Motorways is getting a creative mode
    • Is Hims & Hers Health a Smart Buy Right Now? | The Motley Fool
    • Cudis Bets on Wearables, AI and a Solana Token to Drive the Longevity Movement – Decrypt
    • DappRadar: DeFi and NFT Upticks in May Could Mark Start of Recovery
    • Teddi Mellencamp & Edwin Arroyave Reunite for Their Daughter’s Latest Milestone | Bravo
    • The Secret to Staying Strong as You Age May be This Type of Workout
    Global News HQ
    • Technology & Gadgets
    • Travel & Tourism (Luxury)
    • Health & Wellness (Specialized)
    • Home Improvement & Remodeling
    • Luxury Goods & Services
    • Home
    • Finance & Investment
    • Insurance
    • Legal
    • Real Estate
    • More
      • Cryptocurrency & Blockchain
      • E-commerce & Retail
      • Business & Entrepreneurship
      • Automotive (Car Deals & Maintenance)
    Global News HQ
    Home - Technology & Gadgets - Exacluster with 144 Nvidia H200 AI GPUs detailed by its designer: Hydra Host enters the scene
    Technology & Gadgets

    Exacluster with 144 Nvidia H200 AI GPUs detailed by its designer: Hydra Host enters the scene

    Facebook Twitter Pinterest LinkedIn Tumblr WhatsApp VKontakte Email
    Exacluster with 144 Nvidia H200 AI GPUs detailed by its designer: Hydra Host enters the scene
    Share
    Facebook Twitter LinkedIn Pinterest Email



    Earlier this month, we reported on ExaAILabs’s Exacluster, a cluster of 18 machines running 144 Nvidia H200 GPUs, which happens to be one of the first clusters based on these processors. Since then, Hydra Host, the company that facilitated the construction of the cluster, has given us additional details about the system. The cluster uses Lenovo systems with multiple customizations from Hydra Host, which played a significant role. The machine can also be rented — when not in use by the owner — through Hydra’s Brokkr platform.

    A Lot of Compute Power

    The cluster’s backbone consists of 18 Lenovo nodes equipped with 144 Nvidia H200 GPUs and 20TB of HBM3E memory — or eight per system — enabling compute performance of 570 FP8 PetaTOPS for AI. 16 nodes are configured and fine-tuned by HydraHost for training, which requires massive computation and memory performance, while the remaining two serve as inference nodes. In addition, Hydra Host installed its Brokkr platform for GPU provisioning, management, and remote renting (more on this later).

    Hydra Host collaborated with Computacenter to design a high-performance networking architecture tailored to the cluster’s needs. The setup uses 3.2Tbps InfiniBand for east-west traffic and 400Gbps Ethernet for north-south communication, including dual 200Gbps connections per server and 400Gbps Dell Ethernet switches. Computacenter’s networking engineers ensured all components aligned with Nvidia’s reference architecture for seamless compatibility.

    “We supplied the 18 Lenovo nodes with H200 GPUs (16 interconnected and two inference nodes), designed the networking architecture in collaboration with Computacenter, and facilitated colocation through Patmos,” explained Andrea Holt, a spokesperson for Hydra Host.

    The cluster itself is quite powerful, even in terms of general-purpose computing. The servers feature 192 96-core processors (for a total of 3,456 cores) paired with 36TB of DDR5 memory and 270TB of NVMe solid-state storage. There are spare bays so that storage space can be expanded easily. The supercomputer uses a network custom-built by HydraHost.

    The company also brought in Patmos to handle colocation, providing enough power (around 100kW) and cooling for the power-hungry and hot machines.

    Best Performance at Best Price

    The Exacluster costs $5 million, averaging $277,777 per machine, comparable to a single 8-way H200 baseboard rather than a full server. Here is where it gets interesting. Who facilitated that price?

    Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.

    On the one hand, Hydra Host is a close Nvidia partner and only offers Nvidia GPUs as a service. In addition, its Brokkr software is optimized primarily for CUDA. On the other hand, ExaAI is a company backed by Nvidia, so it can potentially get preferential pricing.

    “We are best in market at getting our customers the right GPU for their needs and at the best price,” said Ryan Horjus, Lead Sales Engineer at Hydra. “This cluster was supported by Nvidia from an architecture design and their Inception program. Hydra handled it for Exa, as we do for other companies.”

    Hydra also specializes in building custom solutions for startups and even monetizes their machines when not in use.

    “Hydra has helped startups get into their own clusters for better pricing through bulk purchasing,” Horjus added. “They can achieve ideal pricing through our network. They are also able to monetize the servers when not in use via the Brokkr management platform.”

    Speaking of Brokkr, it is a GPU management and provisioning software and a monetization platform for GPUs. It provides datacenters and startups with a turnkey software solution for getting their hardware into customers’ hands and getting them paid for, explained Ariel Deschapell, chief technology officer and co-founder of Hydra.

    “One of its key features is automated bare metal provisioning and lifecycle management,” described Deschapell. “That means the platform does all the work of configuring and managing the base server OS and firmware, setting up drivers and other supporting software, and running tests on the GPUs and other components. That speeds up and standardizes the delivery process significantly, reducing idle time on servers and GPUs. It also makes it easy to resell unused servers later to other users on the Brokkr platform looking for bare metal GPUs, if capacity needs change.”



    Source link

    Share. Facebook Twitter Pinterest LinkedIn Tumblr WhatsApp Email
    Previous Article12 Portable Chargers to Keep Your Devices Powered Up
    Next Article Homebuilders anxiously await details on tariffs

    Related Posts

    Mini Motorways is getting a creative mode

    June 8, 2025

    The Secret to Staying Strong as You Age May be This Type of Workout

    June 8, 2025

    The Verge’s 2025 Father’s Day gift guide

    June 7, 2025

    The nine-armed octopus and the oddities of the cephalopod nervous system

    June 7, 2025
    Leave A Reply Cancel Reply

    ads
    Don't Miss
    Travel & Tourism (Luxury)
    9 Mins Read

    I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials

    As an adult, I’ve always found traveling with a parent feels a little backwards. Suddenly,…

    Essential Guide to Crafting a Successful Daycare Business Plan

    June 8, 2025

    Mini Motorways is getting a creative mode

    June 8, 2025

    Is Hims & Hers Health a Smart Buy Right Now? | The Motley Fool

    June 8, 2025
    Top
    Travel & Tourism (Luxury)
    9 Mins Read

    I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials

    As an adult, I’ve always found traveling with a parent feels a little backwards. Suddenly,…

    Essential Guide to Crafting a Successful Daycare Business Plan

    June 8, 2025

    Mini Motorways is getting a creative mode

    June 8, 2025
    Our Picks
    Travel & Tourism (Luxury)
    9 Mins Read

    I Travel All Over Europe With My 70-year-old Mom, and We Won’t Go Anywhere Without These 12 Essentials

    As an adult, I’ve always found traveling with a parent feels a little backwards. Suddenly,…

    Business & Entrepreneurship
    10 Mins Read

    Essential Guide to Crafting a Successful Daycare Business Plan

    Key TakeawaysA solid daycare business plan is essential for outlining goals, guiding operations, and securing…

    Pages
    • About Us
    • Contact Us
    • Disclaimer
    • Homepage
    • Privacy Policy
    Facebook X (Twitter) Instagram YouTube TikTok
    • Home
    © 2025 Global News HQ .

    Type above and press Enter to search. Press Esc to cancel.

    Go to mobile version