Seonguk Seo
서울대학교 컴퓨터학과 · 컴퓨터과학
Seonguk Seo 교수의 연구실은 딥러닝 모델의 일반화 성능 향상과 알고리즘 편향 제거를 핵심 목표로 삼고 있습니다. 도메인 일반화,联邦 학습에서의 데이터 이질성 문제, 그리고 특성 공간에서의 편향 원인 분석을 통해 모델의 강인성과 공정성을 제고하는 데 초점을 맞추고 있으며, 정보론적 측도와 베이지안 추론 기반 예측 불확실성 측정 기법을 활용한 정밀한 모델 보정 기법도 개발하고 있습니다. 특히, 레이어 정규화 최적화, 대비 학습, 클러스터 기반 재가중, 불확실성 기반 손실 함수 설계 등 실용적이고 효과적인 신경망 개선 기법을 중심으로 연구를 전개하고 있습니다.
표시된 성과는 수집된 데이터 기준으로 산출되며, 일부 차이가 있을 수 있습니다.
We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple normalization methods while learning separate affine parameters per domain. For each domain, the activations are normalized by a weighted average of multiple normalization statistics. The normalization statistics are kept track of separately for each normalization type if
We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity infederated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish its dependence on the distribution of feature representations, leading to the derivation of the supervised contrastive learning (SCL) objective to mitigate local deviations. In addition, we show that a naïve integration of SCL into federated learning incurs repr
Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on human supervision, the availability of the proper annotations is impractical and even unrealistic. To better tackle the limitation, we propose a simple but effective unsupervised debiasing technique. Specifically, we first identify pseudo-attributes based on th
We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation, which is effective to identify the feature-level algorithmic bias by taking advantage of conditional mutual information. Although several bias measurement methods have been proposed and widely investigated to achieve algorithmic fairness in various tasks such as face recognition, their accuracy- or logit-based metrics are susceptible to leading to trivial prediction score adjus
In the present paper, Computational fluid dynamics (CFD) uncertainty analysis proposed by ITTC was investigated and applied to ship resistance performance using open source libraries, called OpenFOAM. Uncertainties for grid size, time step and iteration number were studied. Wave patterns and hull wave profile were compared for various uncertainty parameters. From results, grid size uncertainty was mainly contributed to simulation numerical uncertainty.
We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between predictive uncertainty of networks and variance of the prediction scores obtained by stochastic inferences for a single example. Our empirical study shows that the accuracy and the score of a prediction are highly correlated with the variance of multiple stochastic
We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between predictive uncertainty of networks and variance of the prediction scores obtained by stochastic inferences for a single example. Our empirical study shows that the accuracy and the score of a prediction are highly correlated with the variance of multiple stochastic
Machine unlearning, an emerging research topic focusing on data privacy compliance, enables trained models to erase information learned from specific data. While many existing methods indirectly address this issue by intentionally injecting incorrect supervision, they often result in drastic and unpredictable changes to decision boundaries and feature spaces, leading to training instability and undesired side effects. To address this challenge more fundamentally, we first analyze the changes in
The increasing demand for online advertising leads to a strong competition in Real-Time Biddinng (RTB) industry. It requires Demand-Side Platforms (DSPs) to perform a proper market price modeling that predicts the landscape of competitors’ bids, in order to maximize their profits. Under this circumstance, RTB industry has recently been changing from second-price auctions (SPA) to first-price auctions (FPA), and thus DSPs now face two different auction types simultaneously. Most previous studies
Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on human supervision, the availability of the proper annotations is impractical and even unrealistic. To better tackle the limitation, we propose a simple but effective unsupervised debiasing technique. Specifically, we first identify pseudo-attributes based on th
We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers specific to individual domains. Our approach employs multiple normalization methods while learning a separate affine parameter per domain. For each domain, the activations are normalized by a weighted average of multiple normalization statistics. The normalization statistics are kept track of separately for each normalization type if necessa