김상엽 교수
Sang-Young Kim
이화여자대학교 · 컴퓨터과학
연구실 소개
김상엽 교수의 연구실은 의료 영상 및 청각 데이터를 기반으로 한 인공지능 기반 진단 모델 개발에 주력하고 있습니다. 특히 외과적 진단이 어려운 만성 중이염 등 귀 질환의 정밀 진단을 위해 내 endoscopic 이미지와 청력 검사 데이터를 융합한 다중모달 딥러닝 모델을 개발하고 있습니다. 또한 대화형 AI 시스템에서의 의미 기반 정보 검색 기술 개선을 위해 고도화된 의미 색인 기반 검색 프레임워크 HEISIR을 개발하여 레이블링이나 모델 재학습 없이도 유의미한 대화 의미를 효과적으로 추출하는 데 기여하고 있습니다. 최근에는 대규모 언어 모델의 장문 처리 능력에 대한 보안 취약성 분석을 통해 모델 안정성 향상 방안을 모색하고 있습니다.
연구 현황
연구 성과 추이
표시된 성과는 수집된 데이터 기준으로 산출되며, 일부 차이가 있을 수 있습니다.
주요 논문
15Chronic otitis media is characterized by recurrent infections, leading to serious complications, such as meningitis, facial palsy, and skull base osteomyelitis. Therefore, active treatment based on early diagnosis is essential. This study developed a multi-modal multi-fusion (MMMF) model that automatically diagnoses ear diseases by applying endoscopic images of the tympanic membrane (TM) and pure-tone audiometry (PTA) data to a deep learning model. The primary aim of the proposed MMMF model is a
Pedestrian injuries and fatalities due to traffic accidents remain at a high level. Therefore, the need for efforts to reduce this ratio is on the rise. Machine learning models can facilitate the exploration of the various factors that influence the occurrence of pedestrian accidents. In this study, we used data on pedestrian traffic accidents classified into three categories of injury severity: minor, severe, and fatal. To compare the performance of various types of models, logistic regression,
Sangyeop Kim, Sohhyung Park, Jaewon Jung, Jinseok Kim, Sungzoon Cho. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2025.
The growth of conversational AI services has increased demand for effective information retrieval from dialogue data.However, existing methods often face challenges in capturing semantic intent or require extensive labeling and fine-tuning.This paper introduces HEISIR (Hierarchical Expansion of Inverted Semantic Indexing for Retrieval), a novel framework that enhances semantic understanding in conversational data retrieval through optimized data ingestion, eliminating the need for resource-inten
We investigate long-context vulnerabilities in Large Language Models (LLMs) through Many-Shot Jailbreaking (MSJ).Our experiments utilize context length of up to 128K tokens.Through comprehensive analysis with various many-shot attack settings with different instruction styles, shot density, topic, and format, we reveal that context length is the primary factor determining attack effectiveness.Critically, we find that successful attacks do not require carefully crafted harmful content.Even repeti
Understanding user satisfaction with conversational systems, known as User Satisfaction Estimation (USE), is essential for assessing dialogue quality and enhancing user experiences. However, existing methods for USE face challenges due to limited understanding of underlying reasons for user dissatisfaction and the high costs of annotating user intentions. To address these challenges, we propose PRAISE (Plan and Retrieval Alignment for Interpretable Satisfaction Estimation), an interpretable fram
We investigate long-context vulnerabilities in Large Language Models (LLMs) through Many-Shot Jailbreaking (MSJ). Our experiments utilize context length of up to 128K tokens. Through comprehensive analysis with various many-shot attack settings with different instruction styles, shot density, topic, and format, we reveal that context length is the primary factor determining attack effectiveness. Critically, we find that successful attacks do not require carefully crafted harmful content. Even re
The growth of conversational AI services has increased demand for effective information retrieval from dialogue data. However, existing methods often face challenges in capturing semantic intent or require extensive labeling and fine-tuning. This paper introduces HEISIR (Hierarchical Expansion of Inverted Semantic Indexing for Retrieval), a novel framework that enhances semantic understanding in conversational data retrieval through optimized data ingestion, eliminating the need for resource-int
We present the Conversational Data Retrieval (CDR) benchmark, the first comprehensive test set for evaluating systems that retrieve conversation data for product insights. With 1.6k queries across five analytical tasks and 9.1k conversations, our benchmark provides a reliable standard for measuring conversational data retrieval performance. Our evaluation of 16 popular embedding models shows that even the best models reach only around NDCG@10 of 0.51, revealing a substantial gap between document
Effective long-term memory in conversational AI requires synthesizing information across multiple sessions.However, current systems place excessive reasoning burden on response generation, making performance significantly dependent on model sizes.We introduce PRE-Mem (Pre-storage Reasoning for Episodic Memory), a novel approach that shifts complex reasoning processes from inference to memory construction.PREMem extracts finegrained memory fragments categorized into factual, experiential, and sub
대표 연구 분야
김상엽 교수의 연구를 Nubint에서 더 깊이 살펴보세요
이 연구실의 논문을 앱에서 열어 AI와 함께 읽고, 핵심을 요약하고, 내 글에 인용하세요.