Live From Taipei: NVIDIA CEO Unveils Gen AI Platforms for Every Industry

In his first dwell keynote because the pandemic, NVIDIA founder and CEO Jensen Huang as we speak kicked off the COMPUTEX convention in Taipei, asserting platforms that corporations can use to trip a historic wave of generative AI that’s remodeling industries from promoting to manufacturing to telecom.

“We’re again,” Huang roared as he took the stage after years of digital keynotes, some from his dwelling kitchen. “I haven’t given a public speech in nearly 4 years — want me luck!”

Talking for almost two hours to a packed home of some 3,500, he described accelerated computing companies, software program and methods which can be enabling new enterprise fashions and making present ones extra environment friendly.

“Accelerated computing and AI mark a reinvention of computing,” stated Huang, whose travels in his hometown over the previous week have been tracked each day by native media.

In an illustration of its energy, he used the huge 8K wall he spoke in entrance of to indicate a textual content immediate producing a theme tune for his keynote, singable as any karaoke tune. Huang, who sometimes bantered with the group in his native Taiwanese, briefly led the viewers in singing the brand new anthem.

“We’re now on the tipping level of a brand new computing period with accelerated computing and AI that’s been embraced by nearly each computing and cloud firm on the earth,” he stated, noting 40,000 giant corporations and 15,000 startups now use NVIDIA applied sciences with 25 million downloads of CUDA software program final 12 months alone.

Prime Information Bulletins From the Keynote

• • • Grace Hopper powers big-memory supercomputers for gen AI.
    • Modular reference structure allows 100+ accelerated server variations.
    • WPP, NVIDIA create digital advert content material engine in Omniverse.
    • SoftBank, NVIDIA construct 5G, gen AI information facilities in Japan.
    • Networking expertise accelerates Ethernet-based AI clouds.
    • NVIDIA ACE for Video games breathes life into characters with gen AI.
    • Electronics producers worldwide embrace NVIDIA AI.

A New Engine for Enterprise AI

For enterprises that want the last word in AI efficiency, he unveiled DGX GH200, a large-memory AI supercomputer. It makes use of NVIDIA NVLink to mix as much as 256 NVIDIA GH200 Grace Hopper Superchips right into a single data-center-sized GPU.

The GH200 Superchip, which Huang stated is now in full manufacturing, combines an energy-efficient NVIDIA Grace CPU with a high-performance NVIDIA H100 Tensor Core GPU in a single superchip.

The DGX GH200 packs an exaflop of efficiency and 144 terabytes of shared reminiscence, almost 500x greater than in a single NVIDIA DGX A100 320GB system. That lets builders construct giant language fashions for generative AI chatbots, advanced algorithms for recommender methods, and graph neural networks used for fraud detection and information analytics.

Google Cloud, Meta and Microsoft are among the many first anticipated to achieve entry to the DGX GH200, which can be utilized as a blueprint for future hyperscale generative AI infrastructure.

“DGX GH200 AI supercomputers combine NVIDIA’s most superior accelerated computing and networking applied sciences to broaden the frontier of AI,” Huang informed the viewers in Taipei, lots of whom had lined up outdoors the corridor for hours earlier than the doorways opened.

NVIDIA is constructing its personal huge AI supercomputer, NVIDIA Helios, coming on-line this 12 months. It is going to use 4 DGX GH200 methods linked with NVIDIA Quantum-2 InfiniBand networking to supercharge information throughput for coaching giant AI fashions.

The DGX GH200 varieties the top of lots of of methods introduced on the occasion. Collectively, they’re bringing generative AI and accelerated computing to thousands and thousands of customers.

Zooming out to the massive image, Huang introduced greater than 400 system configurations are coming to market powered by NVIDIA’s newest Hopper, Grace, Ada Lovelace and BlueField architectures. They intention to sort out probably the most advanced challenges in AI, information science and excessive efficiency computing.

Acceleration in Each Dimension

To suit the wants of knowledge facilities of each measurement, Huang introduced NVIDIA MGX, a modular reference structure for creating accelerated servers. System makers will use it to rapidly and cost-effectively construct greater than 100 completely different server configurations to go well with a variety of AI, HPC and NVIDIA Omniverse purposes.

MGX lets producers construct CPU and accelerated servers utilizing a typical structure and modular elements. It helps NVIDIA’s full line of GPUs, CPUs, information processing models (DPUs) and community adapters in addition to x86 and Arm processors throughout a wide range of air- and liquid-cooled chassis.

QCT and Supermicro would be the first to market with MGX designs showing in August. Supermicro’s ARS-221GL-NR system introduced at COMPUTEX will use the Grace CPU, whereas QCT’s S74G-2U system, additionally introduced on the occasion, makes use of Grace Hopper.

ASRock Rack, ASUS, GIGABYTE and Pegatron can even use MGX to create next-generation accelerated computer systems.

5G/6G Requires Grace Hopper

Individually, Huang stated NVIDIA helps form future 5G and 6G wi-fi and video communications. A demo confirmed how AI working on Grace Hopper will rework as we speak’s 2D video calls into extra lifelike 3D experiences, offering an incredible sense of presence.

Laying the groundwork for brand new sorts of companies, Huang introduced NVIDIA is working with telecom large SoftBank to construct a distributed community of knowledge facilities in Japan. It is going to ship 5G companies and generative AI purposes on a typical cloud platform.

The info facilities will use NVIDIA GH200 Superchips and NVIDIA BlueField-3 DPUs in modular MGX methods in addition to NVIDIA Spectrum Ethernet switches to ship the extremely exact timing the 5G protocol requires. The platform will cut back value by growing spectral effectivity whereas lowering power consumption.

The methods will assist SoftBank discover 5G purposes in autonomous driving, AI factories, augmented and digital actuality, laptop imaginative and prescient and digital twins. Future makes use of may even embody 3D video conferencing and holographic communications.

Turbocharging Cloud Networks

Individually, Huang unveiled NVIDIA Spectrum-X, a networking platform purpose-built to enhance the efficiency and effectivity of Ethernet-based AI clouds. It combines Spectrum-4 Ethernet switches with BlueField-3 DPUs and software program to ship 1.7x good points in AI efficiency and energy effectivity over conventional Ethernet materials.

NVIDIA Spectrum-X, Spectrum-4 switches and BlueField-3 DPUs can be found now from system makers together with Dell Applied sciences, Lenovo and Supermicro.

Bringing Recreation Characters to Life

Generative AI impacts how folks play, too.

Huang introduced NVIDIA Avatar Cloud Engine (ACE) for Video games, a foundry service builders can use to construct and deploy customized AI fashions for speech, dialog and animation. It is going to give non-playable characters conversational abilities to allow them to reply to questions with lifelike personalities that evolve.

NVIDIA ACE for Video games consists of AI basis fashions similar to NVIDIA Riva to detect and transcribe the participant’s speech. The textual content prompts NVIDIA NeMo to generate custom-made responses animated with NVIDIA Omniverse Audio2Face.

Accelerating Gen AI on Home windows

Huang described how NVIDIA and Microsoft are collaborating to drive innovation for Home windows PCs within the generative AI period.

New and enhanced instruments, frameworks and drivers are making it simpler for PC builders to develop and deploy AI. For instance, the Microsoft Olive toolchain for optimizing and deploying GPU-accelerated AI fashions and new graphics drivers will enhance DirectML efficiency on Home windows PCs with NVIDIA GPUs.

The collaboration will improve and lengthen an put in base of 100 million PCs sporting RTX GPUs with Tensor Cores that enhance efficiency of greater than 400 AI-accelerated Home windows apps and video games.

Digitizing the World’s Largest Industries

Generative AI can also be spawning new alternatives within the $700 billion digital promoting trade.

For instance, WPP, the world’s largest advertising and marketing companies group, is working with NVIDIA to construct a first-of-its variety generative AI-enabled content material engine on Omniverse Cloud.

In a demo, Huang confirmed how artistic groups will join their 3D design instruments similar to Adobe Substance 3D, to construct digital twins of shopper merchandise in NVIDIA Omniverse. Then, content material from generative AI instruments educated on responsibly sourced information and constructed with NVIDIA Picasso will allow them to rapidly produce digital units. WPP shoppers can then use the whole scene to generate a bunch of advertisements, movies and 3D experiences for international markets and customers to expertise on any internet machine.

“In the present day advertisements are retrieved, however sooner or later if you interact data a lot of will probably be generated — the computing mannequin has modified,” Huang stated.

Factories Forge an AI Future

With an estimated 10 million factories, the $46 trillion manufacturing sector is a wealthy area for industrial digitalization.

“The world’s largest industries make bodily issues. Constructing them digitally first can save billions,” stated Huang.

The keynote confirmed how electronics makers together with Foxconn Industrial Web, Innodisk, Pegatron, Quanta and Wistron are forging digital workflows with NVIDIA applied sciences to appreciate the imaginative and prescient of a completely digital good manufacturing unit.

They’re utilizing Omniverse and generative AI APIs to attach their design and manufacturing instruments to allow them to construct digital twins of factories. As well as, they use NVIDIA Isaac Sim for simulating and testing robots and NVIDIA Metropolis, a imaginative and prescient AI framework, for automated optical inspection.

The newest part, NVIDIA Metropolis for Factories, can create customized quality-control methods, giving producers a aggressive benefit. It’s serving to corporations develop state-of-the-art AI purposes.

AI Speeds Meeting Traces

For instance, Pegatron — which makes 300 merchandise worldwide, together with laptops and smartphones — is creating digital factories with Omniverse, Isaac Sim and Metropolis. That lets it check out processes in a simulated setting, saving time and value.

Pegatron additionally used the NVIDIA DeepStream software program growth equipment to develop clever video purposes that led to a 10x enchancment in throughput.

Foxconn Industrial Web, a service arm of the world’s largest expertise producer, is working with NVIDIA Metropolis companions to automate important parts of its circuit-board quality-assurance inspection factors.

In a video, Huang confirmed how Techman Robotic, a subsidiary of Quanta, tapped NVIDIA Isaac Sim to optimize inspection on the Taiwan-based large’s manufacturing strains. It’s basically utilizing simulated robots to coach robots find out how to make higher robots.

As well as, Huang introduced a brand new platform to allow the following era of autonomous cell robotic (AMR) fleets. Isaac AMR helps simulate, deploy and handle fleets of autonomous cell robots.

A big accomplice ecosystem — together with ADLINK, Aetina, Deloitte, Quantiphi and Siemens — helps deliver all these manufacturing options to market, Huang stated.

It’s another instance of how NVIDIA helps corporations really feel the advantages of generative AI with accelerated computing.

“It’s been a very long time since I’ve seen you, so I had quite a bit to let you know,” he stated after the two-hour speak to enthusiastic applause.

To study extra, watch the total keynote beneath.