跳至内容
  • 首页
  • 资讯
  • 资源下载
  • 行业方案
  • Job招聘
  • Paper论文
  • Patent专利
  • 映维会员
  • 导航收录
  • 合作
  • 关于
  • 微信群
  • All
  • XR
  • CV
  • CG
  • HCI
  • Video
  • Optics
  • Perception
  • Reconstruction

3D Vision-Language Gaussian Splatting

编辑:广东客   |   分类:CV   |   2025年3月6日

Note: We don't have the ability to review paper

PubDate: Otc 2024

Teams:University of Central Florida;United Imaging Intelligence, Boston MA

Writers:Qucheng Peng, Benjamin Planche, Zhongpai Gao, Meng Zheng, Anwesa Choudhuri, Terrence Chen, Chen Chen, Ziyan Wu

PDF:3D Vision-Language Gaussian Splatting

Abstract

Recent advancements in 3D reconstruction methods and vision-language models have propelled the development of multi-modal 3D scene understanding, which has vital applications in robotics, autonomous driving, and virtual/augmented reality. However, current multi-modal scene understanding approaches have naively embedded semantic representations into 3D reconstruction methods without striking a balance between visual and language modalities, which leads to unsatisfying semantic rasterization of translucent or reflective objects, as well as over-fitting on color modality. To alleviate these limitations, we propose a solution that adequately handles the distinct visual and semantic modalities, i.e., a 3D vision-language Gaussian splatting model for scene understanding, to put emphasis on the representation learning of language modality. We propose a novel cross-modal rasterizer, using modality fusion along with a smoothed semantic indicator for enhancing semantic rasterization. We also employ a camera-view blending technique to improve semantic consistency between existing and synthesized views, thereby effectively mitigating over-fitting. Extensive experiments demonstrate that our method achieves state-of-the-art performance in open-vocabulary semantic segmentation, surpassing existing methods by a significant margin.

本文链接:https://paper.nweon.com/16233

标签: Intel

您可能还喜欢...

  • 3D Face Reconstruction From Radar Images

    2025年04月24日 广东客

  • ec5f2533e4db8e889e697cd9dc4e4c30-thumb-medium

    Self-Supervised 3D Human Pose Estimation in Static Video Via Neural Rendering

    2022年10月24日 映维

  • d42d657e60c0accca0c7147e0871e3fc-thumb-medium

    RelightableHands: Efficient Neural Relighting of Articulated Hand Models

    2023年04月25日 映维

关注:

最新AR/VR行业分享

  • ★ PICO视频上新:马尔代夫/薄纱少女/星际危机 2025年10月11日
  • ★ VR偶像产业兴起:从韩国到日本,虚拟演出重塑粉丝经济 2025年10月11日
  • ★ Quest浏览器为混合现实放置功能实现即时WebXR命中测试 2025年10月11日
  • ★ Meta大量下架《Gorilla Tag》的山寨游戏 2025年10月11日
  • ★ Meta Quest 10月影视娱乐指南:驯龙高手真人版10日上线 2025年10月11日

最新AR/VR专利

  • ★ [RSS ERROR] cURL error 28: Operation timed out after 10005 milliseconds with 0 out of -1 bytes received 2025年10月11日

最新AR/VR行业招聘

  • ★ Microsoft AR/VR Job | High Performance Compute, Director 2025年6月5日
  • ★ Microsoft AR/VR Job | Data Center Technician/ Technicien de Centre de Données 2025年6月3日
  • ★ Microsoft AR/VR Job | Senior Product Designer 2025年5月16日
  • ★ Apple AR/VR Job | AirPlay Audio Engineer 2025年3月27日
  • ★ Apple AR/VR Job | iOS Perception Engineer 2025年3月27日
  • 首页
  • 资讯
  • 资源下载
  • 行业方案
  • Job招聘
  • Paper论文
  • Patent专利
  • 映维会员
  • 导航收录
  • 合作
  • 关于
  • 微信群

联系微信:ovalics

版权所有:广州映维网络有限公司 © 2025

备案许可:粤ICP备17113731号-2

备案粤公网安备:44011302004835号

友情链接: AR/VR行业导航

读者QQ群:251118691

Quest QQ群:526200310

开发者QQ群:688769630

Paper