Title | SVNet: Supervoxel Network for Video Oversegmentation |
Creator | |
Date Issued | 2023-10-20 |
Source Publication | ACM International Conference Proceeding Series
![]() |
Pages | 368-376 |
Abstract | Supervoxel segmentation for video is a video pre-processing technique that groups voxels with similar spatiotemporal features into supervoxels, effectively reducing the number of elemental voxels for downstream computer vision applications, or applications in other fields, e.g., hardware design or video visualization. Existing methods for video supervoxel generation primarily rely on traditional techniques, such as graph theory, mean shift, and clustering, which have yielded promising results. Recent deep learning-based methods mainly worked on object segmentation or semantic segmentation from videos, paying less attention to video oversegmentation. However, the quality of supervoxels directly affects the results of subsequent tasks. In this paper, we introduce a novel approach SVNet which enables direct end-to-end segmentation of voxels into supervoxels from a deep iterative clustering network. The process begins by utilizing the spatiotemporal features learned by the deep neural network to construct a soft association map between voxels and supervoxels. Subsequently, through an iterative update process, the features of supervoxels and the soft association map between voxels and supervoxels are continually refined to enhance the accuracy of voxels segmentation into supervoxels with the supervised loss using the reconstructed video features and labels. We evaluate our method and the representative supervoxel algorithms for their capability on the performance of video segmentation. Experiments show that our SVNet excels particularly in terms of the BRD metric, and its accuracy is roughly on par with the compared methods. |
Keyword | Clustering Spatio-temporal learning Supervoxels Video segmentation |
DOI | 10.1145/3650400.3650460 |
URL | View source |
Language | 英语English |
Scopus ID | 2-s2.0-85191488597 |
Citation statistics | |
Document Type | Conference paper |
Identifier | http://repository.uic.edu.cn/handle/39GCC9TT/11560 |
Collection | Beijing Normal-Hong Kong Baptist University |
Corresponding Author | Yang,Baorong |
Affiliation | 1.College of Computer Engineering,Jimei University,Xiamen,361021,China 2.School of Mathematics and Computer Science,Zhejiang A&f University,Hangzhou,311300,China 3.Guangdong Provincial Key Laboratory Irads,BNU-HKBU United International College,Zhuhai,519087,China |
Recommended Citation GB/T 7714 | Qi,Yijie,Yang,Baorong,Zhang,Wenjinget al. SVNet: Supervoxel Network for Video Oversegmentation[C], 2023: 368-376. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment