NVIDIA is set to unveil a series of groundbreaking innovations at Hot Chips 2024, a premier conference for processor and system architects. The event will highlight NVIDIA’s advancements in data center performance and energy efficiency, focusing on the NVIDIA Blackwell platform, cutting-edge liquid cooling technologies, and the use of AI agents in chip design.
The NVIDIA Blackwell platform, which integrates multiple chips and NVIDIA CUDA software, is designed to power the next generation of AI across various industries. Ajay Tirumala and Raymond Wong, directors of architecture at NVIDIA, will introduce the platform, explaining how its components — including the Blackwell GPU, Grace CPU, BlueField data processing unit, and NVLink interconnect technology — work together to set a new standard for AI and accelerated computing performance. A key highlight will be the NVIDIA GB200 NVL72, a liquid-cooled solution that connects 72 Blackwell GPUs and 36 Grace CPUs, delivering up to 30x faster inference for large language models (LLMs) and unlocking real-time processing for trillion-parameter models.
In addition to Blackwell, NVIDIA will showcase its advancements in liquid cooling for data centers. Ali Heydari, director of data center cooling and infrastructure at NVIDIA, will present designs that combine air and liquid cooling to improve energy efficiency and cooling performance. These solutions, which range from retrofitting existing data centers to implementing full immersion cooling, aim to reduce power consumption and operational costs while increasing compute power.
NVIDIA will also explore the role of AI in semiconductor design. Mark Ren, director of design automation research at NVIDIA, will discuss how AI models are enhancing design quality and productivity, automating complex tasks, and optimizing microprocessor designs. He will highlight the use of agent-based AI systems in chip design, which can autonomously complete tasks, interact with experienced designers, and learn from past experiences to improve outcomes. This technology, already in use at NVIDIA, is proving essential in pushing the boundaries of what’s possible in microprocessor design.
NVIDIA’s presentations at Hot Chips 2024 demonstrate the company’s commitment to driving innovation across all areas of data center computing, from hardware to software and beyond.
Your First 10 AI Skills
10 practical AI skills, copy-paste prompts and a 7-day plan to start using AI with confidence.
Download the guide →