Postdoctoral Fellow at Prescient Design, Genentech
Email: namuk.park@gmail.com, GitHub: @xxxnell, Twitter: @xxxnell, CV: cv link, Google Scholar: scholar link
The focus of my research has been on understanding how deep neural networks work, and why they work that way, in order to build a more generalizable machine learning system. In particular, my research covers the following topics: (1) “empirical analysis of Vision Transformers” (through the lenses of loss landscape visualization, Hessian eigenvalue spectrum, Fourier analysis, etc.); (2) “probabilistic neural network” (e.g., Bayesian neural networks and ensemble methods); and (3) “generalization” and “trustworthy machine learning” (e.g., uncertainty estimation and robustness). Recently, I have been interested in (4) “self-supervised learning” (e.g., contrastive learning and masked image modeling) and (5) “AI for biology and science”.
Before joining Prescient Design, I previously worked at NAVER AI Lab as a visiting researcher. I received a Ph.D. in Computer Science from School of Integrated Technology, Yonsei University in South Korea, and graduated with a B.S. degree in Physics as Valedictorian of the College of Sciences from Yonsei University.
Publications
[4] Namuk Park, Wonjae Kim, Byeongho Heo, Taekyung Kim, Sangdoo Yun, “What Do Self-Supervised Vision Transformers Learn?” ICLR 2023.
[3] Namuk Park and Songkuk Kim. “How Do Vision Transformers Work?” ICLR 2022. Spotlight.
[2] Namuk Park and Songkuk Kim. “Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Robustness.” ICML 2022. Winner of Qualcomm Innovative Fellowship South Korea.
[1] Namuk Park, Taekyu Lee, and Songkuk Kim. “Vector Quantized Bayesian Neural Network Inference for Data Streams.” AAAI 2021.
Awards & Honors
•
“Outstanding Thesis Award, Third prize”, Yonsei University, Jun 2022.
•
“Winner of Qualcomm Innovative Fellowship South Korea”, Qualcomm, Nov 2021.
•
“Research Grant Support for Ph.D. Students”, National Research Foundation of South Korea, Jun 2021 — Feb 2022.
•
“National Fellowship from Global Open Source Frontier”, NIPA (National IT Industry Promotion Agency of South Korea), Jun 2019 — Dec 2020.
•
“CJK (China–Japan–South Korea) OSS (Open Source/Software) Award”, The Organizing Committee of the CJK OSS Award, Nov 2019.
•
“OSS Competition, Honorable Mention”, NAVER Corporation, Feb 2019.
•
“OSS Challenge, First prize—the Award From the Minister of Science and ICT”, Nov 2018
•
“OSS Competition (2nd phase), First prize”, NAVER Corporation, Aug 2018.
•
“OSS Competition (1st phase), Second prize”, NAVER Corporation, Feb 2018.
•
“National Ph.D. Full Ride Fellowship”, Institute for Information and Communications Technology Promotion of South Korea, Mar 2011 — Feb 2016.
•
“The Valedictorian of the College of Sciences”, Yonsei University, Feb 2011.
•
“Yonsei University Alumni Full Ride Scholarship for Undergraduate Students”, “GE Scholarship”, “National Scholarship & for Science and Engineering”, and other merit-based scholarships, Sep 2008 — Feb 2011.
Talks
•
“How Do Vision Transformers Work?”, [2, 3]
◦
Seminar at SeoulTech, Aug 2022
◦
AI Seminar at UNIST, Mar 2022
◦
Tech Talk at NAVER WEBTOON, Jan 2022
◦
NAVER Tech Talk at NAVER Corporation, Dec 2021
•
“Uncertainty in AI: Deep Learning Is Not Good Enough for Safe AI”, [1]
◦
Keras Korea Meetup at AI Yangjae Hub, Dec 2019
◦
OSS Contribution Festival at NIPA, Dec 2019
◦
South Korea-Uzbekistan SW Technology Seminar at NIPA & Tashkent University of Information Technologies, Oct 2019
•
◦
North-East Asia OSS Forum at NIPA, Nov 2019
◦
OSS Day (Keynote) at NIPA, Nov 2018
◦
Scala Night Korea at Scala User Group Korea, Apr 2018