PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
July 1, 2024IEEE Transactions on Circuits and Systems for Video Technology56 citations

Zoom to Perceive Better: No-reference Point Cloud Quality Assessment via Exploring Effective Multiscale Feature

View Full Paper
JWJilong WangWGWei GaoGLGe Li

Key Points

  • Our no-reference point cloud quality assessment method significantly enhances quality perception across multiple scales.
  • The innovative MOD-PCQA method integrates multiscale features, achieving superior performance over existing techniques by a significant margin.
  • Assessment using viewpoint-aware feature learning enables perceptual quality evaluations from diverse angles and granularities, improving accuracy in PCQA tasks with deep networks instead of fixed views.

Abstract

Point clouds offer a novel 3D data representation that has proven pivotal in immersive visual media applications involving human perception. Developing objective point cloud quality assessment (PCQA) methods is imperative, as they can substantially reduce human evaluation costs and drive advancements for visual perceptual experiences in point cloud related applications. Point cloud quality assessment without reference remains challenging. Previous PCQA methods predominantly employ a fixed perceptual distance and often overlook the variability in quality perceived from different viewpoints, which impedes their effectiveness in multiscale or multi-granularity feature extraction and learning, particularly for deep neural networks. The single fixed observation distance fails to capture the multi-resolution characteristics intrinsic to human perception. Addressing this gap, in this paper, we introduce a novel no-reference PCQA method (MOD-PCQA) that integrates multiscale features to enhance point cloud quality perception across diverse scales and granularities. MOD-PCQA pioneers a viewpoint aware feature learning framework, capable of capturing visual features across various granularity levels, from fine to coarse. Specifically, we process and project point clouds into images from different viewpoints. Then, we extract multi-scale features under corresponding perspectives through three branch networks. Finally, we design an alternate learning strategy to optimize the feature extraction network to continuously refine the learned feature information from both inter-scale and intra-scale perspectives. Comprehensive experiments conducted on the SJTU-PCQA and WPC databases validate the superiority of our proposed model over state-of-the-art PCQA methods. Our method achieves optimal performance on both benchmarks by a significant margin, which comprehensively validates its effectiveness for the challenging PCQA task. The source code will be available at https://openi.pcl.ac.cn/OpenPointCloud/MOD-PCQA 1.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Wang et al. (2024) studied this question.

synapsesocial.com/papers/68e61ca0b6db6435875aec2bhttps://doi.org/10.1109/tcsvt.2024.3362369
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Subjective Quality Database and Objective Study of Compressed Point Clouds With 6DoF Head-Mounted Display2021 · 81 citations
  2. 2PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection2021 · 188 citations
  3. 3Fast Resampling of Three-Dimensional Point Clouds via Graphs2017 · 187 citations
  4. 4Deep Learning for 3D Point Clouds: A Survey2020 · 2,370 citations
  5. 5PYRAMID METHODS IN IMAGE PROCESSING.1984 · 1,032 citations