Namuk Park

Postdoctoral Fellow at Prescient Design, Genentech
Email: namuk.park@gmail.com, GitHub: @xxxnell, Twitter: @xxxnell, CV: cv link, Google Scholar: scholar link
The focus of my research has been on understanding how deep neural networks work, and why they work that way, in order to build a more generalizable machine learning system. In particular, my research covers the following topics: (1) “empirical analysis of Vision Transformers (through the lenses of loss landscape visualization, Hessian eigenvalue spectrum, Fourier analysis, etc.); (2) probabilistic neural network” (e.g., Bayesian neural networks and ensemble methods); and (3) generalization” and “trustworthy machine learning” (e.g., uncertainty estimation and robustness). Recently, I have been interested in (4) “self-supervised learning” (e.g., contrastive learning and masked image modeling) and (5) “AI for biology and science”.
Before joining Prescient Design, I previously worked at NAVER AI Lab as a visiting researcher. I received a Ph.D. in Computer Science from School of Integrated Technology, Yonsei University in South Korea, and graduated with a B.S. degree in Physics as Valedictorian of the College of Sciences from Yonsei University.

Publications

[4] Namuk Park, Wonjae Kim, Byeongho Heo, Taekyung Kim, Sangdoo Yun, “What Do Self-Supervised Vision Transformers Learn?” ICLR 2023.
[3] Namuk Park and Songkuk Kim. “How Do Vision Transformers Work?” ICLR 2022. Spotlight.
[2] Namuk Park and Songkuk Kim. “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Robustness.” ICML 2022. Winner of Qualcomm Innovative Fellowship South Korea.
[1] Namuk Park, Taekyu Lee, and Songkuk Kim. “Vector Quantized Bayesian Neural Network Inference for Data Streams.” AAAI 2021.

Awards & Honors

“Outstanding Thesis Award, Third prize”, Yonsei University, Jun 2022.
Winner of Qualcomm Innovative Fellowship South Korea”, Qualcomm, Nov 2021.
Research Grant Support for Ph.D. Students”, National Research Foundation of South Korea, Jun 2021 — Feb 2022.
National Fellowship from Global Open Source Frontier”, NIPA (National IT Industry Promotion Agency of South Korea), Jun 2019 — Dec 2020.
CJK (China–Japan–South Korea) OSS (Open Source/Software) Award”, The Organizing Committee of the CJK OSS Award, Nov 2019.
OSS Competition, Honorable Mention”, NAVER Corporation, Feb 2019.
OSS Challenge, First prize—the Award From the Minister of Science and ICT”, Nov 2018
OSS Competition (2nd phase), First prize”, NAVER Corporation, Aug 2018.
OSS Competition (1st phase), Second prize”, NAVER Corporation, Feb 2018.
National Ph.D. Full Ride Fellowship”, Institute for Information and Communications Technology Promotion of South Korea, Mar 2011 — Feb 2016.
The Valedictorian of the College of Sciences”, Yonsei University, Feb 2011.
Yonsei University Alumni Full Ride Scholarship for Undergraduate Students”, “GE Scholarship”, “National Scholarship & for Science and Engineering”, and other merit-based scholarships, Sep 2008 — Feb 2011.

Talks

How Do Vision Transformers Work?”, [2, 3]
Seminar at SeoulTech, Aug 2022
AI Seminar at UNIST, Mar 2022
Tech Talk at NAVER WEBTOON, Jan 2022
NAVER Tech Talk at NAVER Corporation, Dec 2021
Uncertainty in AI: Deep Learning Is Not Good Enough for Safe AI”, [1]
Keras Korea Meetup at AI Yangjae Hub, Dec 2019
OSS Contribution Festival at NIPA, Dec 2019
South Korea-Uzbekistan SW Technology Seminar at NIPA & Tashkent University of Information Technologies, Oct 2019
A Fast and Lightweight Probability Tool for AI in Scala”, [code]
North-East Asia OSS Forum at NIPA, Nov 2019
OSS Day (Keynote) at NIPA, Nov 2018
Scala Night Korea at Scala User Group Korea, Apr 2018