대학원소개

논문성과

IIPL's (Prof. Youngbin Kim) paper accepted to ECCV 2024 (AI Top-tier Conference)

관리자 │ 2024-07-04

HIT

26243

Our paper from Intelligent Information Processing Lab (IIPL) has been accepted to the European Conference on Computer Vision (ECCV) 2024.


Title:  

DIAL: Dense Image-text ALignment for Weakly Supervised Semantic Segmentation


Authors:

Soojin Jang, JungMin Yun, JuneHyoung Kwon, Eunju Lee, YoungBin Kim


Abstract: 

Weakly supervised semantic segmentation (WSSS) approaches typically rely on class activation maps (CAMs) for initial seed generation, which often fail to capture global context due to limited supervision from image-level labels. To address this issue, we introduce DALNet, Dense Alignment Learning Network that leverages text embeddings to enhance the comprehensive understanding and precise localization of objects across different levels of granularity. Our key insight is to employ a dual-level alignment strategy: (1) Global Implicit Alignment (GIA) to capture global semantics by maximizing the similarity between the class token and the corresponding text embeddings while minimizing the similarity with background embeddings, and (2) Local Explicit Alignment (LEA) to improve object localization by utilizing spatial information from patch tokens. Moreover, we propose a cross-contrastive learning approach that aligns foreground features between image and text modalities while separating them from the background, encouraging activation in missing regions and suppressing distractions. Through extensive experiments on the PASCAL VOC and MS COCO datasets, we demonstrate that DALNet significantly outperforms state-of-the-art WSSS methods. Our approach, in particular, allows for more efficient end-to-end process as a single-stage method.



이전글 IRIS Lab's (Prof. Hak Gu Kim) papers accepted to ICIP 2024
다음글 Perceptual AI Lab's (Prof. Chanho Eom) paper accepted in ESWA (JCR Top 7%, IF: 7...