Taesung Park
서울대학교 · Biochemistry, Genetics and Molecular Biology
Taesung Park 교수의 연구실은 딥러닝 기반 이미지 생성 및 조작 기술에 초점을 맞추고 있으며, 특히 세밀한 레이아웃 기반 사진 합성(GauGAN 기반 기법)과 스타일 제어 가능한 이미지 생성에 핵심 기여를 해왔습니다. 공간적 적응형 정규화(Spatially-Adaptive Normalization)를 통해 세분화된 레이아웃 정보를 효과적으로 유지하고, 실제 사진 수준의 해상도를 갖춘 이미지를 생성하는 데 성공했습니다. 또한, 이미지 간의 구조적 유사성 유도를 위한 대비 학습 기반 이미지 번역 및 임베딩 기반 이미지 편집 기법 등 실시간, 제어 가능한 이미지 생성 기술에 대한 기초 연구를 지속하고 있습니다. 이는 예술, 디자인, 게임 및 실시간 렌더링 분야에 응용 가능성이 높은 학문적·기술적 기여를 하고 있습니다.
표시된 성과는 수집된 데이터 기준으로 산출되며, 일부 차이가 있을 수 있습니다.
We propose spatially-adaptive normalization, a simple but effective layer for synthesizing photorealistic images given an input semantic layout. Previous methods directly feed the semantic layout as input to the network, forcing the network to memorize the information throughout all the layers. Instead, we propose using the input layout for modulating the activations in normalization layers through a spatially-adaptive, learned affine transformation. Experiments on several challenging datasets d
We propose spatially-adaptive normalization, a simple but effective layer for synthesizing photorealistic images given an input semantic layout. Previous methods directly feed the semantic layout as input to the deep network, which is then processed through stacks of convolution, normalization, and nonlinearity layers. We show that this is suboptimal as the normalization layers tend to ``wash away'' semantic information. To address the issue, we propose using the input layout for modulating the
Our results show that intensity-dependent normalization often performs better than global normalization methods, and that linear and nonlinear normalization methods perform similarly. These conclusions are based on analysis of 36 cDNA microarrays of 3,840 genes obtained in an experiment to search for changes in gene expression profiles during neuronal differentiation of cortical stem cells. Simulation studies confirm our findings.
We propose a statistical test procedure based on the ANOVA model to identify genes that have different gene expression profiles among experimental groups in time-course experiments. Especially, we propose a permutation test which does not require the normality assumption. For this test, we use residuals from the ANOVA model only with time-effects. Using this test, we detect genes that have different gene expression profiles among experimental groups. The proposed model is illustrated using cDNA
Deep generative models have become increasingly effective at producing realistic images from randomly sampled seeds, but using such models for controllable manipulation of existing images remains challenging. We propose the Swapping Autoencoder, a deep model designed specifically for image manipulation, rather than random sampling. The key idea is to encode an image with two independent components and enforce that any swapped combination maps to a realistic image. In particular, we encourage the
In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual information between the two, using a framework based on contrastive learning. The method encourages two elements (corresponding patches) to map to a similar point in a learned feature space, relative to other elements (other patches) in the dataset, referred to as negatives. We expl
We propose GauGAN, a GAN-based image synthesis model that can generate photo-realistic images given an input semantic layout. It is built on spatially-adaptive normalization, a simple but effective normalization layer. Previous methods directly feed the semantic layout as input to the deep network, which is then processed through stacks of convolution, normalization, and non-linearity layers. We show that this is sub-optimal as the normalization layers tend to "wash away" semantic information. T
Abstract When categorical outcomes are subject to nonignorable nonresponse, log-linear models may be used to adjust for the nonresponse. The models are fitted to the data in an augmented frequency table in which one index corresponds to whether or not the subject is a respondent. The likelihood function is maximized over pseudo-observed cell frequencies with respect to this log-linear model using an EM algorithm. Each E step of the EM algorithm determines the pseudo-observed cell frequencies, an
Liang and Zeger proposed an extension of generalized linear models to the analysis of longitudinal data. Their approach is closely related to quasi-likelihood methods and can handle both normal and non-normal outcome variables such as Poisson or binary outcomes. Their approach, however, has been applied mainly to non-normal outcome variables. This is probably due to the fact that there is a large class of multivariate linear models available for normal outcomes such as growth models and random-e
Multiple genome-wide and targeted association studies reveal a significant association of variants in the CHRNA5-CHRNA3-CHRNB4 (CHRNA5/A3/B4) gene cluster on chromosome 15 with nicotine dependence. The subjects examined in most of these studies had a European origin. However, considering the distinct linkage disequilibrium patterns in European and other ethnic populations, it would be of tremendous interest to determine whether such associations could be replicated in populations of other ethnic
Deep generative models have become increasingly effective at producing realistic images from randomly sampled seeds, but using such models for controllable manipulation of existing images remains challenging. We propose the Swapping Autoencoder, a deep model designed specifically for image manipulation, rather than random sampling. The key idea is to encode an image with two independent components and enforce that any swapped combination maps to a realistic image. In particular, we encourage the
In complex organisms, different tissues express different genes, which ultimately shape the function and phenotype of each tissue. An important goal of modern biology is to understand how some genes are turned on and off in specific tissues and how the numbers of different gene expression products are determined. These aspects are named 'expression breadth' (or 'tissue specificity') and 'expression level', respectively. Here, we show that we can predict substantial amount of variation in levels
Abstract Motivation To address ‘missing heritability’ issue, many statistical methods for pathway-based analyses using rare variants have been proposed to analyze pathways individually. However, neglecting correlations between multiple pathways can result in misleading solutions, and pathway-based analyses of large-scale genetic datasets require massive computational burden. We propose a Pathway-based approach using HierArchical components of collapsed RAre variants Of High-throughput sequencing
Novel biomarkers for early diagnosis of pancreatic cancer (PC) are necessary to improve prognosis. We aimed to discover candidate biomarkers by identifying compositional differences of microbiome between patients with PC (n = 38) and healthy controls (n = 52), using microbial extracellular vesicles (EVs) acquired from blood samples. Composition analysis was performed using 16S rRNA gene analysis and bacteria-derived EVs. Statistically significant differences in microbial compositions were used t