跳至内容
  • 首页
  • 资讯
  • 行业方案
  • 付费阅读
  • Job招聘
  • Paper论文
  • Patent专利
  • 映维会员
  • 导航收录
  • 合作
  • 关于
  • 微信群
  • All
  • XR
  • CV
  • CG
  • HCI
  • Video
  • Optics
  • Perception
  • Reconstruction

In-Place Panoptic Radiance Field Segmentation with Perceptual Prior for 3D Scene Understanding

小编 广东客   |   分类:CV   |   2025年3月6日

Note: We don't have the ability to review paper

PubDate: Otc 2024

Teams:Shenghao Li

Writers: Shenghao Li

PDF:In-Place Panoptic Radiance Field Segmentation with Perceptual Prior for 3D Scene Understanding

Abstract

Accurate 3D scene representation and panoptic understanding are essential for applications such as virtual reality, robotics, and autonomous driving. However, challenges persist with existing methods, including precise 2D-to-3D mapping, handling complex scene characteristics like boundary ambiguity and varying scales, and mitigating noise in panoptic pseudo-labels. This paper introduces a novel perceptual-prior-guided 3D scene representation and panoptic understanding method, which reformulates panoptic understanding within neural radiance fields as a linear assignment problem involving 2D semantics and instance recognition. Perceptual information from pre-trained 2D panoptic segmentation models is incorporated as prior guidance, thereby synchronizing the learning processes of appearance, geometry, and panoptic understanding within neural radiance fields. An implicit scene representation and understanding model is developed to enhance generalization across indoor and outdoor scenes by extending the scale-encoded cascaded grids within a reparameterized domain distillation framework. This model effectively manages complex scene attributes and generates 3D-consistent scene representations and panoptic understanding outcomes for various scenes. Experiments and ablation studies under challenging conditions, including synthetic and real-world scenes, demonstrate the proposed method's effectiveness in enhancing 3D scene representation and panoptic segmentation accuracy.

本文链接:https://paper.nweon.com/16228

您可能还喜欢...

  • Robust Consistent Video Depth Estimation

    2021年07月05日 映维

  • Capture, Learning, and Synthesis of 3D Speaking Styles

    2020年08月10日 映维

  • Multi-user, Scalable 3D Object Detection in AR Cloud

    2020年06月22日 映维

关注:

RSS 最新AR/VR行业分享

  • XR日报:小米AI眼镜1999元起,全息技术Swave Photonics获600万欧元追加投资 2025年6月27日
  • 谷歌XR专利提出纳米颗粒增强衍射波导制造技术 2025年6月27日
  • 谷歌专利提出基于准直器的AR显示系统视场校准技术 2025年6月27日
  • 欧亚研究团队推出OSLO-IC技术实现360度图像高效压缩 2025年6月27日
  • 悉尼大学研发TA-GNN模型实现VR环境高精度手指运动预测 2025年6月27日

RSS 最新AR/VR专利

  • Samsung Patent | Deposition equipment 2025年6月26日
  • Snap Patent | Determining gaze direction to generate augmented reality content 2025年6月26日
  • Apple Patent | Eye characteristic determination 2025年6月26日
  • Snap Patent | Eyewear device charging case 2025年6月26日
  • Qualcomm Patent | Vehicle and mobile device interface for vehicle occupant assistance 2025年6月26日

RSS 最新AR/VR行业招聘

  • Microsoft AR/VR Job | High Performance Compute, Director 2025年6月5日
  • Microsoft AR/VR Job | Data Center Technician/ Technicien de Centre de Données 2025年6月3日
  • Microsoft AR/VR Job | Senior Product Designer 2025年5月16日
  • Apple AR/VR Job | AirPlay Audio Engineer 2025年3月27日
  • Apple AR/VR Job | iOS Perception Engineer 2025年3月27日

联系微信:ovalics

版权所有:广州映维网络有限公司 © 2025

备案许可:粤ICP备17113731号-2

粤公网安备 44011302004835号

友情链接: AR/VR行业导航

读者QQ群:251118691

Quest QQ群:526200310

开发者QQ群:688769630

Paper