跳至内容
  • 首页
  • 资讯
  • 资源下载
  • 行业方案
  • Job招聘
  • Paper论文
  • Patent专利
  • 映维会员
  • 导航收录
  • 合作
  • 关于
  • 微信群
  • All
  • XR
  • CV
  • CG
  • HCI
  • Video
  • Optics
  • Perception
  • Reconstruction

Emo3D: Metric and Benchmarking Dataset for 3D Facial Expression Generation from Emotion Description

编辑:广东客   |   分类:CV   |   2025年2月27日

Note: We don't have the ability to review paper

PubDate: Sep 2024

Teams:Sharif University of Technology,Qatar Computing Research Institute

Writers:Mahshid Dehghani, Amirahmad Shafiee, Ali Shafiei, Neda Fallah, Farahmand Alizadeh, Mohammad Mehdi Gholinejad, Hamid Behroozi, Jafar Habibi, Ehsaneddin Asgari

PDF:Emo3D: Metric and Benchmarking Dataset for 3D Facial Expression Generation from Emotion Description

Abstract

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of human emotions, each paired with images and 3D blendshapes. Leveraging Large Language Models (LLMs), we generate a diverse array of textual descriptions, facilitating the capture of a broad spectrum of emotional expressions. Using this unique dataset, we conduct a comprehensive evaluation of language-based models' fine-tuning and vision-language models like Contranstive Language Image Pretraining (CLIP) for 3D facial expression synthesis. We also introduce a new evaluation metric for this task to more directly measure the conveyed emotion. Our new evaluation metric, Emo3D, demonstrates its superiority over Mean Squared Error (MSE) metrics in assessing visual-text alignment and semantic richness in 3D facial expressions associated with human emotions. "Emo3D" has great applications in animation design, virtual reality, and emotional human-computer interaction.

本文链接:https://paper.nweon.com/16222

您可能还喜欢...

  • fa29e0eac9d0549159045ff6325d7b40-thumb-medium

    Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model

    2023年01月31日 映维

  • d542d3dfed6c43a77db1c0f2b3b57ded-thumb-medium

    Compression of 3-D point clouds using hierarchical patch fitting

    2020年10月20日 映维

  • daf6c5454fad3e9c56cc548bf07b925f-thumb-medium

    Squeezed Deep 6DoF Object Detection Using Knowledge Distillation

    2020年08月26日 映维

关注:

最新AR/VR行业分享

  • ★ 映维日报:Valve申请Steam Frame商标,谷歌XR专利申请波导光栅边缘切趾化技术 2025年9月5日
  • ★ Meta专利申请XR头戴显示器多状态面板技术 2025年9月5日
  • ★ 谷歌XR专利申请波导光栅边缘切趾化技术 2025年9月5日
  • ★ 安徽工程大学100万元采购沉浸式虚拟现实教学系统 2025年9月5日
  • ★ 新疆兵团疾控中心276万元采购传染病监测VR平台 2025年9月5日

最新AR/VR专利

  • ★ Meta Patent | Systems and methods for improved spatial computing systems 2025年9月4日
  • ★ Apple Patent | Methods for sharing content and interacting with physical devices in a three-dimensional environment 2025年9月4日
  • ★ MagicLeap Patent | Matching content to a spatial 3d environment 2025年9月4日
  • ★ Meta Patent | Techniques for coordinating artificial-reality interactions using augmented-reality interaction guides for performing interactions with physical objects within a user's physical surroundings, and systems and methods for using such techniques 2025年9月4日
  • ★ Meta Patent | Solution of body-garment collisions in avatars for immersive reality applications 2025年9月4日

最新AR/VR行业招聘

  • ★ Microsoft AR/VR Job | High Performance Compute, Director 2025年6月5日
  • ★ Microsoft AR/VR Job | Data Center Technician/ Technicien de Centre de Données 2025年6月3日
  • ★ Microsoft AR/VR Job | Senior Product Designer 2025年5月16日
  • ★ Apple AR/VR Job | AirPlay Audio Engineer 2025年3月27日
  • ★ Apple AR/VR Job | iOS Perception Engineer 2025年3月27日
  • 首页
  • 资讯
  • 资源下载
  • 行业方案
  • Job招聘
  • Paper论文
  • Patent专利
  • 映维会员
  • 导航收录
  • 合作
  • 关于
  • 微信群

联系微信:ovalics

版权所有:广州映维网络有限公司 © 2025

备案许可:粤ICP备17113731号-2

备案粤公网安备:44011302004835号

友情链接: AR/VR行业导航

读者QQ群:251118691

Quest QQ群:526200310

开发者QQ群:688769630

Paper