By Xi Wang, VP of Product Marketing of Optical Connectivity, Marvell
Over the last 20 years, data rates for optical technology have climbed 1000x while power per bit has declined by 100x, a stunning trajectory that in many ways paved the way for the cloud, mobile Internet and streaming media.
AI represents the next inflection point in bandwidth demand. Servers powered by AI accelerators and GPUs have far greater bandwidth needs than typical cloud servers: seven high-end GPUs alone can max out a switch that ordinarily can handle 500 cloud two-processor servers. Just as important, demand for AI services, and higher-value AI services such as medical imaging or predictive maintenance, will further drive the need for more bandwidth. The AI market alone is expected to reach $407 billion by 2027.
O-band coherent or coherent lite—a technology that has been discussed for years at conferences but has yet to be deployed commercially in a meaningful way--will likely begin to percolate into the market over the next few years to help cloud service providers accommodate some of these challenges.
By Radha Nagarajan, SVP and CTO of Optical Platforms, Marvell
This article was first published by Photonics Spectra
The cloud. It evokes an ethereal, weightless environment where problems get whisked away by a breeze.
In reality, the cloud consists of massive industrial buildings containing millions of dollars’ worth of equipment spread over thousands, and increasingly millions, of square feet. In Arizona, some communities are complaining that cloud data centers are draining their aquifers and consuming far more water than expected1 while in the UK and Ireland the power requirements of data centers are crimping needed housing development. Even in regions like Northern Virginia where the local economies are tightly bound to data centers, conflicts between residents and the cloud are emerging.
With the rise of AI, these conflicts will escalate. AI models and data sets are growing exponentially in size2 and developers are contemplating clusters with 32,000 GPUs, 2,000 switches, 4,000 servers and 74,000 optical modules3. Such a system might require 45MW of power capacity, or nearly 5x the peak load of the Empire State Building. This resource-intensiveness also shows how AI services could become an economic high wire act for many.
Performance up, Power Down: Over 20 years, the data rate of optical modules has increased by 1000x while power per bit has decreased by 100x.
By Kristin Hehir, Senior Manager, PR and Marketing, Marvell
Marvell is excited to announce that three of its high-speed optical connectivity solutions have been distinguished among the best in the industry by the 2024 Lightwave Innovation Reviews. The three awards validate Marvell leadership in PAM4 DSP, coherent DSP and data center interconnect (DCI) modules for accelerated infrastructure.
A panel of judges, comprised of experts from the optical communications community, awarded Marvell with the highest score possible of 5.0 for both its Nova 1.6 Tbps PAM4 electro-optics platform and COLORZ® 800 ZR/ZR+ pluggable module, and an outstanding 4.5 honoree status for its Orion 800 Gbps coherent DSP. The honors reflect the industry’s recognition of Marvell leading-edge technologies to address the growing bandwidth and connectivity needs of artificial intelligence (AI), cloud data center and carrier networks.
Lightwave Editor In Chief Sean Buckley expressed his congratulations, stating, “On behalf of the Lightwave Innovation Reviews, I would like to congratulate Marvell on achieving a well-deserved level honoree status. This competitive program enables Lightwave to showcase and applaud the most innovative products, projects, technologies, and programs that significantly impact the industry.”
By Suhas Nayak, Senior Director of Solutions Marketing, Marvell
In the world of artificial intelligence (AI), where compute performance often steals the spotlight, there's an unsung hero working tirelessly behind the scenes. It's something that connects the dots and propels AI platforms to new frontiers. Welcome to the realm of optical connectivity, where data transfer becomes lightning-fast and AI's true potential is unleashed. But wait, before you dismiss the idea of optical connectivity as just another technical detail, let's pause and reflect. Think about it: every breakthrough in AI, every mind-bending innovation, is built on the shoulders of data—massive amounts of it. And to keep up with the insatiable appetite of AI workloads, we need more than just raw compute power. We need a seamless, high-speed highway that allows data to flow freely, powering AI platforms to conquer new challenges.
In this post, I’ll explain the importance of optical connectivity, particularly the role of DSP-based optical connectivity, in driving scalable AI platforms in the cloud. So, buckle up, get ready to embark on a journey where we unlock the true power of AI together.
Copyright © 2023 Marvell, All rights reserved.