연세대학교 · 컴퓨터과학
Hyunjung Shim 교수의 연구실은 영상 처리 및 컴퓨터 비전 분야에서 활동하며, 특히 저선량 영상 복원, 투명 물체의 3D 캡처, 얼굴의 실감나는 렌더링 등 고도화된 영상 재구성 기술에 중점을 두고 있습니다. VGG 손실 기반 딥러닝 모델을 활용한 노이즈 제거, 시간 영역 기반 투과형 센서의 노이즈 보정 기술, 그리고 단일 이미지에서의 얼굴 반사율과 조명 조절을 통한 실감 나는 재현 기법 등 실용적이고 정밀한 영상 처리 솔루션을 개발하고 있습니다. 특히 3D 구조를 직접 복원하지 않고도 고해상도의 얼굴 렌더링을 가능하게 하는 비모델 기반 접근 방식이 특징입니다.
표시된 성과는 수집된 데이터 기준으로 산출되며, 일부 차이가 있을 수 있습니다.
The evaluation results using tSNR, NPS, and MTF indicate that VGG-loss-based CNNs are more effective than those without VGG loss for natural denoising of low-dose images and WGAN-GP loss improves the denoising performance of VGG-loss-based CNNs, which corresponds with the qualitative evaluation.
We present a new approach to face relighting by jointly estimating the pose, reflectance functions, and lighting from as few as one image of a face. Upon such estimation, we can synthesize the face image under any prescribed new lighting condition. In contrast to commonly used face shape models or shape-dependent models, we neither recover nor assume the 3-D face shape during the estimation process. Instead, we train a pose- and pixel-dependent subspace model of the reflectance function using a
In the presence of nonlinearity in the CNN, the proposed CNN-based model observer showed better performance than other linear observers.
Translucency introduces great challenges to 3-D acquisition because of complicated light behaviors such as refraction and transmittance. In this paper, we describe the development of a unified 3-D data acquisition framework that reconstructs translucent objects using a single commercial time-of-flight (ToF) camera. In our capture scenario, we record a depth map and intensity image of the scene twice using a static ToF camera; first, we capture the depth map and intensity image of an arbitrary ba
A time-of-flight (ToF) depth sensor produces noisy range data due to scene properties such as surface materials and reflectivity. Sensor measurement frequently includes either a saturated or severely noisy depth and effective depth accuracy is far below its ideal specification. In this paper, we propose a hybrid exposure technique for depth imaging in a ToF sensor so to improve the depth quality. Our method automatically determines an optimal depth for each pixel using two exposure conditions. T
This paper presents a novel approach to automatic face modeling for realistic synthesis from an unknown face image, using a probabilistic face diffuse model and a generic face specular map. We construct a probabilistic face diffuse model for estimating the albedo and normals of the input face. Then, we develop a generic face specular map for estimating the specularity of face. Using the estimated albedo, normal and specular information, we can synthesize the face under arbitrary lighting and vie
A light probe is commonly used for measuring the illumination of a real scene. Instead of equipping a man-made light probe such as a mirror ball, we propose to use a face in images as a natural light probe. To that end, we construct a statistical reflectance model for faces and use this model to extract the lighting and the reflectance field of an input face. With an iterative procedure, we can obtain the lighting condition from an unknown face image. As a byproduct of this procedure, we also es