Publications

The BIGGen Bench: A Principled Benchmark for Fine-Grained Evaluation of Language Models with Language Models
Seungone Kim, Juyoung Suk, Ji Yong Cho, Shayne Longpre, Chaeeun Kim, Dongkeun Yoon, Guijin Son, Yejin Cho, Sheikh Shafayat, Jinheon Baek, Sue Hyun Park, Hyeonbin Hwang, Jinkyung Jo, Hyowon Cho, Haebin Shin, Seongyun Lee, Hanseok Oh, Noah Lee, Namgyu Ho, Se June Joo, Miyoung Ko, Yoonjoo Lee, Hyungjoo Chae, Jamin Shin, Joel Jang, Seonghyeon Ye, Bill Yuchen Lin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, Minjoon Seo
Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL) 2025  Oral Best Paper Award
paper code

The CoT Encyclopedia: Analyzing, Predicting, and Controlling How a Reasoning Model Will Think
Seongyun Lee, Seungone Kim, Minju Seo, Yongrae Jo, Dongyoung Go, Hyeonbin Hwang, Jinho Park, Xiang Yue, Sean Welleck, Graham Neubig, Moontae Lee, Minjoon Seo
arXiv Preprint 2025 
paper

Paper2Code: Automating Code Generation from Scientific Papers in Machine Learning
Minju Seo, Jinheon Baek, Seongyun Lee, Sung Ju Hwang
arXiv Preprint 2025 
paper code

Evaluating Language Models as Synthetic Data Generators
Seungone Kim, Juyoung Suk, Xiang Yue, Vijay Viswanathan, Seongyun Lee, Yizhong Wang, Kiril Gashteovski, Carolin Lawrence, Sean Welleck, Graham Neubig
Annual Meeting of the Association for Computational Linguistics (ACL) 2025 
paper code

Efficient Long Context Language Model Retrieval with Compression
Minju Seo, Jinheon Baek, Seongyun Lee, Sung Ju Hwang
Annual Meeting of the Association for Computational Linguistics (ACL) 2025 
paper

Scaling Evaluation-Time Compute with Reasoning Models as Process Evaluators
Seungone Kim, Ian Wu, Jinu Lee, Xiang Yue, Seongyun Lee, Mingyeong Moon, Kiril Gashteovski, Carolin Lawrence, Julia Hockenmaier, Graham Neubig, Sean Welleck
arXiv Preprint 2025 
paper code

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?
{Seongyun Lee*, Geewook Kim*, Jiyeon Kim*}, Hyunji Lee, Hoyeon Chang, Sue Hyun Park, Minjoon Seo
International Conference on Learning Representations (ICLR) 2025 
paper

Aligning to Thousands of Preferences via System Message Generalization
Seongyun Lee*, Sue Hyun Park*, Seungone Kim, Minjoon Seo
Advances in Neural Information Processing Systems (NeurIPS) 2024 
paper website

Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation
Seongyun Lee*, Seungone Kim*, Sue Park, Geewook Kim, Minjoon Seo
Findings of the Association for Computational Linguistics (Findings of ACL) 2024 
paper

Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision
Seongyun Lee, Sue Hyun Park, Yongrae Jo, Minjoon Seo
Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL) 2024 
paper code

Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment
Yongrae Jo, Seongyun Lee, Aiden SJ Lee, Hyunji Lee, Hanseok Oh, Minjoon Seo
arXiv Preprint 2023 
paper

LIQUID: A Framework for List Question Answering Dataset Generation
Seongyun Lee*, Hyunjae Kim*, Jaewoo Kang
AAAI Conference on Artificial Intelligence (AAAI) 2023 
paper