Jen-Hsun Huang, president and chief govt officer of Nvidia Corp., declares the EGX Edge Supercomputing Platform in the course of the firm’s occasion at Cell World Congress Americas in Los Angeles, California, Oct. 21, 2019.
Patrick T. Fallon | Bloomberg | Getty Photos
Nvidia’s most-advanced graphics playing cards are promoting for greater than $40,000 on eBay, as demand soars for chips wanted to coach and deploy synthetic intelligence software program.
The costs for Nvidia’s H100 processors had been famous by 3D gaming pioneer and former Meta consulting expertise chief John Carmack on Twitter. On Friday, a minimum of eight H100s had been listed on eBay at costs starting from $39,995 to only underneath $46,000. Some retailers have provided it prior to now for round $36,000.
The H100, introduced final 12 months, is Nvidia’s newest flagship AI chip, succeeding the A100, a roughly $10,000 chip that is been known as the “workhorse” for AI functions.
Builders are utilizing the H100 to construct so-called massive language fashions (LLMs), that are on the coronary heart of AI functions like OpenAI’s ChatGPT. Working these techniques is pricey and requires highly effective computer systems to churn via terabytes of knowledge for days or even weeks at a time. In addition they depend on hefty computing energy so the AI mannequin can generate textual content, photographs or predictions.
Coaching AI fashions, particularly massive ones like GPT, requires lots of of high-end Nvidia GPUs working collectively.
Microsoft spent lots of of thousands and thousands of {dollars} on tens of hundreds of Nvidia A100 chips to assist construct ChatGPT. Nvidia controls the overwhelming majority of the marketplace for AI chips.
Nvidia additionally presents a supercomputer with eight GPUs working collectively known as the DGX. Earlier this 12 months, the corporate introduced new companies that will permit firms to lease entry to DGX computer systems for $37,000 per thirty days. At that worth, the system would use Nvidia’s older A100 processors.
Nvidia says the H100 is the primary chip to be optimized for the precise AI structure underpinning lots of the current advances in AI, known as transformers. Trade specialists say the extra highly effective chips will likely be obligatory to construct even greater and extra data-hungry fashions than these which are at the moment accessible.
WATCH: Google chip manufacturing takes intention at Nvidia’s generative A.I.
