Recent Publications
Analysis of Plan-based Retrieval for Grounded Text Generation, EMNLP 2024
Ameya Godbole, Nicholas Monath, Seungyeon Kim, Ankit Singh Rawat, Andrew McCallum, Manzil ZaheerUSTAD: Unified Single-model Training Achieving Diverse Scores for Information Retrieval, ICML 2024
Seungyeon Kim, Ankit Singh Rawat, Manzil Zaheer, Sadeep Jayasumana, Veeranjaneyulu Sadhanala, Wittawat Jitkrittum, Aditya Krishna Menon, Rob Fergus, Sanjiv KumarEfficient Training of Language Models using Few-Shot Learning, ICML 2023
Sashank J. Reddi, Sobhan Miryoosefi, Stefani Karp, Shankar Krishnan, Satyen Kale, Seungyeon Kim, Sanjiv KumarTeacher Guided Training: An Efficient Framework for Knowledge Transfer, ICLR 2023
Manzil Zaheer, Ankit Singh Rawat, Seungyeon Kim, Chong You, Himanshu Jain, Andreas Veit, Rob Fergus, Sanjiv KumarSupervision Complexity and its Role in Knowledge Distillation, ICLR 2023
Hrayr Harutyunyan, Ankit Singh Rawat, Aditya Krishna Menon, Seungyeon Kim, Sanjiv KumarIn defense of dual-encoders for neural ranking, ICML 2022
Aditya Krishna Menon, Sadeep Jayasumana, Seungyeon Kim, Ankit Singh Rawat, Sashank J Reddi, Sanjiv KumarA statistical perspective on distillation, ICML 2021
Aditya K Menon, Ankit Singh Rawat, Sashank Reddi, Seungyeon Kim, Sanjiv KumarRankdistil: Knowledge distillation for ranking, AISTATS 2021
Sashank Reddi, Rama Kumar Pasumarthi, Aditya Menon, Ankit Singh Rawat, Felix Yu, Seungyeon Kim, Andreas Veit, Sanjiv KumarEvaluations and methods for explanation through robustness analysis, ICLR 2021
Cheng-Yu Hsieh, Chih-Kuan Yeh, Xuanqing Liu, Pradeep Ravikumar, Seungyeon Kim, Sanjiv Kumar, Cho-Jui HsiehSemantic label smoothing for sequence to sequence problems, EMNLP 2020
Michal Lukasik, Himanshu Jain, Aditya Krishna Menon, Seungyeon Kim, Srinadh Bhojanapalli, Felix Yu, Sanjiv KumarWhy are adaptive methods good for attention models? NeurIPS 2020
Jingzhao Zhang, Sai Praneeth Karimireddy, Andreas Veit, Seungyeon Kim, Sashank Reddi, Sanjiv Kumar, Suvrit Sra
Recent Preprints
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA, 2024
Sangmin Bae, Adam Fisch, Hrayr Harutyunyan, Ziwei Ji, Seungyeon Kim and Tal SchusterFaster Cascades via Speculative Decoding, 2024
Harikrishna Narasimhan, Wittawat Jitkrittum, Ankit Singh Rawat, Seungyeon Kim, Neha Gupta, Aditya Krishna Menon, Sanjiv KumarEmbedDistill: A Geometric Knowledge Distillation for Information Retrieval, 2023
Seungyeon Kim, Ankit Singh Rawat, Manzil Zaheer, Sadeep Jayasumana, Veeranjaneyulu Sadhanala, Wittawat Jitkrittum, Aditya Krishna Menon, Rob Fergus, Sanjiv KumarBalancing robustness and sensitivity using feature contrastive learning, 2021
Seungyeon Kim, Daniel Glasner, Srikumar Ramalingam, Cho-Jui Hsieh, Kishore Papineni, Sanjiv KumarOn the reproducibility of neural network predictions, 2021
Srinadh Bhojanapalli, Kimberly Wilber, Andreas Veit, Ankit Singh Rawat, Seungyeon Kim, Aditya Menon, Sanjiv Kumar
Book
Your first machine learning rook (처음 배우는 머신러닝), Hanbit Publishing Network 2017
Seungyeon Kim and Youngjoo Chung