Jae-Won Chung

Ph.D. Candidate @ UMich CSE

Summary

I am a final-year PhD candidate in CSE at the University of Michigan, advised by Professor Mosharaf Chowdhury. I build efficient software systems for machine learning, with a focus on the efficient management of not only time, but also energy and power. I view energy as a first-class systems resource that is worth carefully optimizing and allocating across the full stack based on precise understanding and control.

Building real systems and tools to produce impact across open-source communities and industry is a key part of how I do research, with many of these systems and tools developed in the context of The ML.ENERGY Initiative that I founded and lead. Specifically, the open-source Zeus project is part of the PyTorch Ecosystem, where it has active real-world users and contributors; Perseus, Kareus, and the ML.ENERGY benchmark have been adopted by industry including NVIDIA and the MLPerf Power benchmark; and my work has influenced broader discussions on AI energy consumption through major outlets including the MIT Technology Review and the G7 French Presidency.

Selected Publications

Energy as a first-class resource in ML systems

The Language-Energy Divide: Measuring Energy Costs of Multilingual LLM Inference

EMNLP Main Conference, 2026 (Acceptance rate = 15.4%)

Naihao Deng, Alissa Shen, Yiming Feng, Joan Nwatu, Jae-Won Chung, Mosharaf Chowdhury, Yulong Chen, Rada Mihalcea

Energy Calculus: A Compositional Algebra of Energy in Computational Systems

Preprint, 2026

Mosharaf Chowdhury*, Jae-Won Chung*, Jeff J. Ma, Nishil Talati, Ruofan Wu (* Equal Contribution)

Kareus: Joint Reduction of Dynamic and Static Energy in Large Model Training

OSDI, 2026 (Acceptance rate = 20.0%)

Ruofan Wu, Jae-Won Chung, Mosharaf Chowdhury

Where Do the Joules Go? Diagnosing Inference Energy Consumption

Preprint, 2026

Jae-Won Chung, Ruofan Wu, Jeff J. Ma, Mosharaf Chowdhury

The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimization

NeurIPS D&B spotlight, 2025 (Spotlight acceptance rate = 2.81%)

Jae-Won Chung, Jeff J. Ma, Ruofan Wu, Jiachen Liu, Oh Jun Kweon, Yuxuan Xia, Zhiyu Wu, Mosharaf Chowdhury

Perseus: Reducing Energy Bloat in Large Model Training

SOSP, 2024 (Acceptance rate = 17.34%)

Jae-Won Chung, Yile Gu, Insu Jang, Luoxi Meng, Nikhil Bansal, Mosharaf Chowdhury

Toward Cross-Layer Energy Optimizations in AI Systems

DOE ASCR Energy-Efficient Computing for Science Workshop, 2024

Jae-Won Chung, Nishil Talati, and Mosharaf Chowdhury

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

USENIX NSDI, 2023 (Acceptance rate = 18.38%)

Jie You*, Jae-Won Chung*, Mosharaf Chowdhury (* Equal Contribution)

Expanding energy control from the chip to the grid

OpenG2G: A Simulation Platform for AI Datacenter-Grid Runtime Coordination

Preprint, 2026

Jae-Won Chung*, Zhirui Liang*, Yanyong Mao, Jiasi Chen, Mosharaf Chowdhury, Vladimir Dvorkin (* Equal Contribution)

GPU-to-Grid: Voltage Regulation via GPU Utilization Control

PowerUp, 2026

Zhirui Liang, Jae-Won Chung, Mosharaf Chowdhury, Jiasi Chen, Vladimir Dvorkin

Inference serving systems with a twist

Cornserve: A Distributed Serving System for Any-to-Any Multimodal Models

ACM CAIS Demos, 2026

Jae-Won Chung*, Jeff J. Ma*, Jisang Ahn, Yizhuo Liang, Akshay Jajoo, Myungjin Lee, Mosharaf Chowdhury (* Equal Contribution)

Cornfigurator: Automated Planning for Any-to-Any Multimodal Model Serving

Preprint, 2025

Jeff J. Ma*, Jae-Won Chung*, Jisang Ahn, Yizhuo Liang, Runyu Lu, Akshay Jajoo, Myungjin Lee, Mosharaf Chowdhury (* Equal Contribution)

Andes: Defining and Enhancing Quality-of-Experience in LLM-Based Text Streaming Services

Preprint, 2024

Jiachen Liu, Jae-Won Chung, Zhiyu Wu, Fan Lai, Myungjin Lee, Mosharaf Chowdhury

ShadowTutor: Distributed Partial Distillation for Mobile Video DNN Inference

International Conference on Parallel Processing (ICPP), 2020 (Acceptance rate = 28.99%)

Jae-Won Chung, Jae-Yun Kim, Soo-Mook Moon

Open Source Projects

Cornserve (130 12)

An efficient serving platform for Any-to-Any multimodal models. Takes a microservice approach to serving by supporting generic model component graph definition and disaggregation. Designs and implementations from this project influenced vLLM-Omni.

OpenG2G (23 2)

An ergonomic and modular simulation library for understanding opportunities and developing control algorithms for AI datacenter-grid runtime coordination.

BERT4Rec-VAE-Pytorch (415 99)

Implementation of BERT4Rec and Netflix VAE recommendation models.

Reason (197 4)

A shell for research papers. Supports UNIX-like commands that instead work on a set of research papers.

Pegasus (33 3)

An SSH command runner with a focus on simplicity. Useful when you have a bunch of commands to run and a bunch of SSH nodes available.

Selected Talks

Energy and Power as First-Class ML Design Metrics

UW–Madison MadSystems Seminar | Oct 2025

Power and Energy as First-Class AI Design Metrics

KPAI | Sep 2025

Energy as a First-Class Resource in Machine Learning Systems

Pruna AI | Jun 2025

Energy-Efficient Systems for Machine Learning

SOSP 24 Doctoral Workshop | Nov 2024

Power and Energy Considerations in Machine Learning Systems

University of Michigan (EECS 598) | Apr 2024

Energy-Efficient Software Systems for Machine Learning

Seoul National University | Oct 2023

Energy-Efficient Deep Learning with Zeus

Massachusetts Institute of Technology | Sep 2023

Selected Media Coverage

My research and open-source works were covered by various media outlets, including MIT Technology Review, Ars Technica, and Science News.

Education

  • Ph.D. candidate in Computer Science and Engineering
    University of Michigan
    Ann Arbor, MI, USA
    Sep 2021 - May 2027 (expected)
  • M.S. in Computer Science and Engineering
    University of Michigan
    Ann Arbor, MI, USA
    Sep 2021 - Apr 2023
  • B.S. in Electrical and Computer Engineering (Summa Cum Laude)
    Seoul National University
    Seoul, South Korea
    Mar 2015 - Aug 2021

Experience

  • Research Scientist Intern @ Meta
    AI and Systems Co-Design Team
    Palo Alto, CA
    May 2025 - Aug 2025
    Mixture-of-Experts model training support on MTIA platforms, Meta's custom AI accelerator.

Selected Honors & Awards

  • MIT TR 35 Innovators Under 35
    MIT Technology Review
    Sep 2026
  • Rackham Predoctoral Fellowship
    University of Michigan
    Apr 2026
  • MLSys Rising Stars
    MLCommons
    Apr 2026
  • Laude Institute
    $45,000 support for ML.ENERGY
    Dec 2025
  • GitHub
    $10,000 for the Zeus project
    Aug 2025
  • Mozilla Technology Fund 2024
    Mozilla
    $50,000 for the Zeus project
    Feb 2024

Teaching

  • University of Michigan
    GSI. Three lectures on GenAI and GenAI systems fundamentals. Highest possible instructor evaluation score.
    Fall 2025
  • Operating Systems
    Seoul National University
    Lead TA. Created and managed Linux kernel projects, and provided kernel programming tutorials and project design reviews.
    Spring 2021
  • Computer Architecture
    Seoul National University
    Provided 30 hours of online lectures. Best Tutor Award.
    Fall 2020

Service