PANEL TITLE
End-to-End Co-Design - Emerging Parallel and Distributed Runtime Systems and Middleware for Extreme-Scale Systems
PROGRAM
Presentation | |
Time and date: | Friday, 22 November 20198:30am - 12pm |
Location: | Colorado Convention Center, Denver, CO Room 503-504 |
Session Chair: | EJ Park and Jose M Monsalve Diaz |
CJ Newburn | NVIDIA | |
Erik Altman | IBM | slides |
Jai Dayal | Intel | slides | -->
Larry Larry Kaplan | Cray |
ABSTRACT
Emerging trend of extreme-scale system design are rapidly increasing in capacity, scalability and and complexity. This comes with enormous opportunities of heterogeneous and massive parallelism with multi-level, multi-grain, multi-paradigm
of concurrency (so called 3 Ms) . However,designers of runtime systems and middleware must meet unprecedented challenges (so-called 3 Ps): performance, programmability and productivity.
We have witnessed the community effort in exploring a viable path forward for the co-design of future HPC systems, particularly when we are entering the Golden Age of computer architecture innovation of the post-Moore’s Law era,
while facing the demands of future AI applications (so-called AGIs: Artificial General Intelligence). This panel provides a forum to discuss the (3-P) challenges and
(3-M) opportunities.
QUESTIONS TO PANELISTS
Question 1: We have witnessed increasing optimism that the demands of future Artificial Intelligence (also lately referred to by some as AGIs: Artificial General Intelligence; or Nature Intelligence as called by
von Neumann and colleagues at his time) may be realized by the opportunity of massive parallelism (3-Ms) in the Golden Age of computer architecture.
Please comment and name a couple of your favorite AI chips projects.
Question 2: However, there has been wide-spread pessimism that the last 2-Ps (Programmability and Productivity) are the killing challenges HPC runtime systems/middleware community may fail to address – if the computer
architecture community (in the golden-age) take a radical departure from the John Von Neumann’s program execution and architecture model.
Please comment.
Question 3: Your vision of end-to-end code design as a path forward to follow up your answers to Q1 and Q2 ?