Abstract:Computing has dramatically changed nearly every aspect of our lives, from business and agriculture to communication and entertainment. As a nation, we rely on computing in the design of systems for energy, transportation and defense; and computing fuels scientific discoveries that will improve our fundamental understanding of the world and help develop solutions to major challenges in health and the environment. Computing has changed our world, in part, because our innovations can run on computers whose performance and cost-performance has improved a million-fold over the last few decades. A driving force behind this has been a repeated doubling of the transistors per chip, dubbed Moore's Law. A concomitant enabler has been Dennard Scaling that has permitted these performance doublings at roughly constant power, but, as we will see, both trends face challenges. Consider for a moment the impact of these two trends over the past 30 years. A 1980's supercomputer (e.g. a Cray 2) was rated at nearly 2 Gflops and consumed nearly 200 KW of power. At the time, it was used for high performance and national-scale applications ranging from weather forecasting to nuclear weapons research. A computer of similar performance now fits in our pocket and consumes less than 10 watts. What would be the implications of a similar computing/power reduction over the next 30 years - that is, taking a petaflop-scale machine (e.g. the Cray XK7 which requires about 500 KW for 1 Pflop (=1015 operations/sec) performance) and repeating that process? What is possible with such a computer in your pocket? How would it change the landscape of high capacity computing? In the remainder of this paper, we articulate some opportunities and challenges for dramatic performance improvements of both personal to national scale computing, and discuss some "out of the box" possibilities for achieving computing at this scale.

A Data Center in a Shoebox: IMEC's Plan to use Superconductors to Shrink Computers

Energy-Efficient Superconducting Computing—Power Budgets and Requirements

Trends in Energy Estimates for Computing in AI/Machine Learning Accelerators, Supercomputers, and Compute-Intensive Applications

A Brief Introduction to Infrastructure Planning for Next-Generation Smart Computing Data Centers

Compute at Scale: A Broad Investigation into the Data Center Industry

Exploding AI Power Use: an Opportunity to Rethink Grid Planning and Management

Energy use in quantum data centers: Scaling the impact of computer architecture, qubit performance, size, and thermal parameters

Opportunities and Challenges for Next Generation Computing

The Unseen AI Disruptions for Power Grids: LLM-Induced Transients

Power Hungry Processing: Watts Driving the Cost of AI Deployment?

Beyond Efficiency: Scaling AI Sustainably

A 23 MW data centre is all you need

Supercomputers as a Continous Medium

Crunching Numbers, Sustainably

Empirical Measurements of AI Training Power Demand on a GPU-Accelerated Node

To better understand AI's growing energy use, analysts need a data revolution

Energy Estimates Across Layers of Computing: From Devices to Large-Scale Applications in Machine Learning for Natural Language Processing, Scientific Computing, and Cryptocurrency Mining

In-memory Computing to Break the Memory Wall

The infrastructure powering IBM's Gen AI model development

Environmental Burden of United States Data Centers in the Artificial Intelligence Era

Finally, how many efficiencies supercomputers have? And, what do they measure?