Skip to main content

Seo-Hyun Jeong

Korea Advanced Institute of Science and Technology · Computer Science

About the Lab

Professor Seo-Hyun Jeong's research lab focuses on advancing the safety, reliability, and societal alignment of large-scale generative AI models, particularly text-to-image diffusion models. The lab explores methods to mitigate harmful and biased content generation through innovative techniques such as self-distillation, human feedback integration, and meta-learned inference for Bayesian neural networks. Key research directions include improving model robustness through human-in-the-loop feedback, enhancing posterior exploration in high-dimensional probabilistic models, and establishing evaluation frameworks for ethical AI deployment. The lab bridges machine learning innovation with real-world societal impact, emphasizing responsible AI development.

generative AIdiffusion modelsAI safetyBayesian neural networkshuman feedback

Research Overview

Papers
5
Total Citations
6
Papers (5y)
5
Primary Field
Computer Science

Research Output Trend

Figures are computed from collected data and may differ slightly.

Publications per year (5y)
5total
2020
2023
2024
Citations per year (5y)
6total
202020232024

Selected Papers

5
1
Preprint|5 citations·2023
Towards Safe Self-Distillation of Internet-Scale Text-to-Image Diffusion Models
Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Juho Lee
arXiv (Cornell University)OA

Large-scale image generation models, with impressive quality made possible by the vast amount of data available on the Internet, raise social concerns that these models may generate harmful or copyrighted content. The biases and harmfulness arise throughout the entire training process and are hard to completely remove, which have become significant hurdles to the safe deployment of these models. In this paper, we propose a method called SDD to prevent problematic content generation in text-to-im

Computer Vision and Pattern RecognitionComputer Science
2
Book Chapter|1 citations·2024
Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion
Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Ju-ho Lee
SJR Q2Lecture notes in computer science
Computer Vision and Pattern RecognitionComputer Science
3
Article|0 citations·2020
Trends of Essential Evaluator Competencies: Analysis on the Development of Evaluator Competency Standards through Overseas Case Studies
Jina Byun, Seohyeon Jung
Journal of International Development CooperationOA

This study analyzed evaluator competency trends and standards to provide guidance for the evaluation society in Korea, as the evaluation of development programs are becoming increasingly important. The study compared and analyzed evaluator competencies that are established by both evaluation associations in the Americas, Canada, Australia, and South Africa, and the development cooperation organizations such as the United Nations. Furthermore, the study analyzed the extent to which the evaluation

Social PsychologyPsychology
4
Preprint|0 citations·2024
Learning to Explore for Stochastic Gradient MCMC
Seung Hyun Kim, Seohyeon Jung, Seonghyeon Kim, Juho Lee
arXiv (Cornell University)OA

Bayesian Neural Networks(BNNs) with high-dimensional parameters pose a challenge for posterior inference due to the multi-modality of the posterior distributions. Stochastic Gradient MCMC(SGMCMC) with cyclical learning rate scheduling is a promising solution, but it requires a large number of sampling steps to explore high-dimensional multi-modal posteriors, making it computationally expensive. In this paper, we propose a meta-learning strategy to build \gls{sgmcmc} which can efficiently explore

Electrical and Electronic EngineeringEngineering
5
Preprint|0 citations·2024
Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion
Sanghyun Kim, Seohyeon Jung, Balhae Kim, Moonseok Choi, Jinwoo Shin, Juho Lee
arXiv (Cornell University)OA

This paper addresses the societal concerns arising from large-scale text-to-image diffusion models for generating potentially harmful or copyrighted content. Existing models rely heavily on internet-crawled data, wherein problematic concepts persist due to incomplete filtration processes. While previous approaches somewhat alleviate the issue, they often rely on text-specified concepts, introducing challenges in accurately capturing nuanced concepts and aligning model knowledge with human unders

Aerospace EngineeringEngineering

Research Areas

Computer Vision and Pattern RecognitionSocial PsychologyElectrical and Electronic EngineeringAerospace Engineering

Dive deeper into Seo-Hyun Jeong's research on Nubint

Open this lab's papers in the app to read with AI, summarize, and cite in your writing.