About

Sheng Zha 查晟

I lead pretraining research for Amazon Nova, focusing on principled scaling, model architecture, optimization, and novel pretraining objectives.

I design model algorithms together with the systems needed to train them at scale. The goal is to improve model capability, reduce its cost, and make it useful to more people. I built my team from zero, beginning with distributed training and shared representations, and grew it into a group supporting foundation models used across AWS.

Before that, I helped shape the open-source AI ecosystem as VP and PMC Chair of Apache MXNet, co-authored the Gluon interface, founded GluonNLP, served on the ONNX Steering Committee, and co-founded the Python Data API Standards Consortium.

I want AI to expand what people can decide and create for themselves. I use that test when choosing research problems and leading teams.

Selected work

Foundation models · 2024–present

Amazon Nova and foundation model stack

Leading research on principled scaling, model architecture, optimization, and pretraining objectives.

Read the technical report ↗

Team building · 2018–2024

Foundation models for AWS AI services

Built the team and models from zero, supporting Amazon Q, Titan, Lex, Comprehend, and Kendra.

Related platform ↗

Systems · 2018–2023

Distributed training infrastructure

Contributed core technology for scalable, fault-resilient training infrastructure including SageMaker HyperPod.

Related platform ↗

Open source · 2016–2023

Apache MXNet

VP and PMC Chair. Co-authored the Gluon API and led project maintenance, releases, and community engagement.

Project archive ↗

Open source · 2018–2023

GluonNLP

Founded a deep-learning NLP toolkit that reproduced BERT with record-setting training speeds.

View source ↗

Machine learning systems · 2013–2015

Fraud detection platform

Designed scalable machine-learning and graph systems for fraud and abuse detection.

Selected publications

View all publications on Google Scholar →

Talks and interviews
Education

MS in Computer Science, University of Maryland. BS, Shanghai Jiao Tong University.

ElsewhereXLeave anonymous feedback