Skip to main content

Jaepil Heo

Sungkyunkwan University · 情報科学

研究室紹介

Professor Jaepil Heo's research lab specializes in computer vision, deep learning, and multimedia understanding, with a focus on efficient representation learning, similarity search, and vision-language modeling. The lab develops innovative methods for binary code embedding, artistic style transfer using pre-trained diffusion models, video moment retrieval, and fine-grained visual recognition through attention-based feature learning. Key contributions include hypersphere-based hashing, optimization-free style transfer, query-aware detection transformers, and task-discrepancy modeling for few-shot learning. The lab emphasizes both theoretical innovation and practical efficiency in large-scale visual data processing.

computer visiondeep learningbinary hashingvision-language modelingfew-shot learning

Research Overview

Papers
112
Total Citations
1,636
Papers (5y)
85
Primary Field
情報科学

Research Output Trend

Figures are computed from collected data and may differ slightly.

Publications per year (5y)
85total
2021
2022
2023
2024
2025
Citations per year (5y)
784total
20212022202320242025

Selected Papers

15
1
Article|378 citations·2012
Spherical hashing
Jae‐Pil Heo, Youngwoon Lee, Junfeng He, Shih-Fu Chang, Sung‐Eui Yoon

Many binary code encoding schemes based on hashing have been actively studied recently, since they can provide efficient similarity search, especially nearest neighbor search, and compact data representations suitable for handling large scale image databases in many computer vision problems. Existing hashing techniques encode high-dimensional data points by using hyperplane-based hashing functions. In this paper we propose a novel hypersphere-based hashing function, spherical hashing, to map mor

Computer Vision and Pattern RecognitionComputer Science
2
Article|160 citations·2024
Style Injection in Diffusion: A Training-Free Approach for Adapting Large-Scale Diffusion Models for Style Transfer
Jiwoo Chung, Sangeek Hyun, Jae‐Pil Heo

Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or fails to leverage the generative ability of large-scale diffusion models. To address these issues, we introduce a novel artistic style transfer method based on a pre-trained large-scale diffusion model without any optimization. Specifically, we manipulate the feat

Signal ProcessingComputer Science
3
Article|138 citations·2023
Query - Dependent Video Representation for Moment Retrieval and Highlight Detection
WonJun Moon, Sangeek Hyun, SangUk Park, Dongchan Park, Jae‐Pil Heo

Recently, video moment retrieval and highlight detection (MR/HD) are being spotlighted as the demand for video understanding is drastically increased. The key objective of MR/HD is to localize the moment and estimate clip-wise accordance level, i.e., saliency score, to the given text query. Although the recent transformer-based models brought some advances, we found that these methods do not fully exploit the information of a given query. For example, the relevance between text query and video c

Computer Vision and Pattern RecognitionComputer Science
4
Article|113 citations·2015
Spherical Hashing: Binary Code Embedding with Hyperspheres
Jae‐Pil Heo, Youngwoon Lee, Junfeng He, Shih‐Fu Chang, Sung‐Eui Yoon
SJR Q1IEEE Transactions on Pattern Analysis and Machine Intelligence

Many binary code embedding schemes have been actively studied recently, since they can provide efficient similarity search, and compact data representations suitable for handling large scale image databases. Existing binary code embedding techniques encode high-dimensional data by using hyperplane-based hashing functions. In this paper we propose a novel hypersphere-based hashing function, spherical hashing, to map more spatially coherent data points into a binary code compared to hyperplane-bas

Computer Vision and Pattern RecognitionComputer Science
5
Article|87 citations·2009
HPCCD: Hybrid Parallel Continuous Collision Detection using CPUs and GPUs
Duksu Kim, Jae‐Pil Heo, Jaehyuk Huh, John Kim, Sung‐Eui Yoon
SJR Q1Computer Graphics Forum

Abstract We present a novel, hybrid parallel continuous collision detection (HPCCD) method that exploits the availability of multi‐core CPU and GPU architectures. HPCCD is based on a bounding volume hierarchy (BVH) and selectively performs lazy reconstructions. Our method works with a wide variety of deforming models and supports self‐collision detection. HPCCD takes advantage of hybrid multi‐core architectures – using the general‐purpose CPUs to perform the BVH traversal and culling while GPUs

Computer Vision and Pattern RecognitionComputer Science
6
Article|83 citations·2022
Task Discrepancy Maximization for Fine-grained Few-Shot Classification
SuBeen Lee, WonJun Moon, Jae‐Pil Heo
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Recognizing discriminative details such as eyes and beaks is important for distinguishing fine-grained classes since they have similar overall appearances. In this regard, we introduce Task Discrepancy Maximization (TDM), a simple module for fine-grained few-shot classification. Our objective is to localize the class-wise discriminative regions by highlighting channels encoding distinct information of the class. Specifically, TDM learns task-specific channel weights based on two novel components

Artificial IntelligenceComputer Science
7
Book Chapter|53 citations·2022
Difficulty-Aware Simulator for Open Set Recognition
WonJun Moon, Junho Park, Hyun Seok Seong, Cheol-Ho Cho, Jae‐Pil Heo
SJR Q2Lecture notes in computer science
Artificial IntelligenceComputer Science
8
Article|51 citations·2014
Distance Encoded Product Quantization
Jae‐Pil Heo, Zhe Lin, Sung‐Eui Yoon

Many binary code embedding techniques have been proposed for large-scale approximate nearest neighbor search in computer vision. Recently, product quantization that encodes the cluster index in each subspace has been shown to provide impressive accuracy for nearest neighbor search. In this paper, we explore a simple question: is it best to use all the bit budget for encoding a cluster index in each subspace? We have found that as data points are located farther away from the centers of their clu

Computer Vision and Pattern RecognitionComputer Science
9
Article|51 citations·2011
VolCCD
Min Tang, Dinesh Manocha, Sung‐Eui Yoon, Peng Du, Jae‐Pil Heo, Ruofeng Tong
SJR Q1ACM Transactions on Graphics

We present a novel culling algorithm to perform fast and robust continuous collision detection between deforming volume meshes. This includes a continuous separating axis test that can conservatively check whether two volume meshes overlap during a given time interval. In addition, we present efficient methods to eliminate redundant elementary tests between the features (e.g., vertices, edges, and faces) of volume elements (e.g., tetrahedra, hexahedra, triangular prisms, etc.). Our approach is a

Computer Vision and Pattern RecognitionComputer Science
10
Article|38 citations·2023
Leveraging Hidden Positives for Unsupervised Semantic Segmentation
Hyun Seok Seong, WonJun Moon, SuBeen Lee, Jae‐Pil Heo

Dramatic demand for manpower to label pixel-level annotations triggered the advent of unsupervised semantic segmentation. Although the recent work employing the vision transformer (ViT) backbone shows exceptional performance, there is still a lack of consideration for task-specific training guidance and local semantic consistency. To tackle these issues, we leverage contrastive learning by excavating hidden positives to learn rich semantic relationships and ensure semantic consistency in local r

Artificial IntelligenceComputer Science
11
Article|38 citations·2024
VLCounter: Text-Aware Visual Representation for Zero-Shot Object Counting
Seunggu Kang, WonJun Moon, Euiyeon Kim, Jae‐Pil Heo
Proceedings of the AAAI Conference on Artificial IntelligenceOA

Zero-Shot Object Counting~(ZSOC) aims to count referred instances of arbitrary classes in a query image without human-annotated exemplars. To deal with ZSOC, preceding studies proposed a two-stage pipeline: discovering exemplars and counting. However, there remains a challenge of vulnerability to error propagation of the sequentially designed two-stage process. In this work, we propose an one-stage baseline, Visual-Language Baseline (VLBase), exploring the implicit association of the semantic-pa

Media TechnologyEngineering
12
Article|29 citations·2018
Distance Encoded Product Quantization for Approximate K-Nearest Neighbor Search in High-Dimensional Space
Jae‐Pil Heo, Zhe Lin, Sung‐Eui Yoon
SJR Q1IEEE Transactions on Pattern Analysis and Machine Intelligence

Approximate K-nearest neighbor search is a fundamental problem in computer science. The problem is especially important for high-dimensional and large-scale data. Recently, many techniques encoding high-dimensional data to compact codes have been proposed. The product quantization and its variations that encode the cluster index in each subspace have been shown to provide impressive accuracy. In this paper, we explore a simple question: is it best to use all the bit-budget for encoding a cluster

Computer Vision and Pattern RecognitionComputer Science
13
Article|11 citations·2016
Shortlist Selection with Residual-Aware Distance Estimator for K-Nearest Neighbor Search
Jae‐Pil Heo, Zhe Lin, Xiaohui Shen, Jonathan Brandt, Sung‐Eui Yoon

In this paper, we introduce a novel shortlist computation algorithm for approximate, high-dimensional nearest neighbor search. Our method relies on a novel distance estimator: the residual-aware distance estimator, that accounts for the residual distances of data points to their respective quantized centroids, and uses it for accurate short-list computation. Furthermore, we perform the residual-aware distance estimation with little additional memory and computational cost through simple pre-comp

Computer Vision and Pattern RecognitionComputer Science
14
Book Chapter|9 citations·2024
Mitigating Background Shift in Class-Incremental Semantic Segmentation
Gilhan Park, WonJun Moon, SuBeen Lee, Tae-Young Kim, Jae‐Pil Heo
SJR Q2Lecture notes in computer science
Artificial IntelligenceComputer Science
15
Article|9 citations·2010
FASTCD
Jae‐Pil Heo, Duksu Kim, Joon‐Kyung Seong, Jeong‐Mo Hong, Min Tang, Sung‐Eui Yoon

Simulating complex phenomena such as fracture requires collision detection (CD) methods to avoid any inter-collisions among deforming models and self-collisions (i.e. intra-collisions) within each deforming model. CD is typically the main computational bottleneck of simulating such complex phenomena.

Computer Graphics and Computer-Aided DesignComputer Science

Research Areas

Computer Vision and Pattern RecognitionArtificial IntelligenceMedia TechnologyRadiology, Nuclear Medicine and ImagingSafety, Risk, Reliability and QualityEconomics and Econometrics

Jaepil Heoの研究をNubintでさらに深く

この研究室の論文をアプリで開き、AIと共に読み、要約し、引用しましょう。