Hugging Face's logo

Spaces:
nlml
/
sheap
Running on Zero

App Files Community
sheap / README.md
liamsch
Update to Gradio 5.50+ for huggingface_hub compatibility
df39e39
preview code
|
raw
history blame contribute delete
1.35 kB

A newer version of the Gradio SDK is available: 6.1.0

Upgrade
metadata
title: SHeaP - Self-Supervised Head Geometry Predictor
emoji: 🐑
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.50.0
app_file: gradio_demo.py
pinned: false
license: mit

SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussians

Upload an image or video to predict head geometry and render a 3D FLAME mesh overlay!

Liam Schoneveld, Zhe Chen, Davide Davoli, Jiapeng Tang, Saimon Terazawa, Ko Nishino, Matthias Nießner

About

SHeaP learns to predict head geometry (FLAME parameters) from a single image by predicting and rendering 2D Gaussians.

The output shows three views:

  • Left: Original cropped face
  • Center: Rendered FLAME mesh
  • Right: Mesh overlaid on original

Setup Instructions

Before deploying to Hugging Face Spaces, you need to:

  1. Download the FLAME model from FLAME 2020
  2. Convert it using python convert_flame.py
  3. Include the FLAME2020/ directory with the required files:
    • generic_model.pt
    • eyelids.pt
    • flame_landmark_idxs_barys.pt
  4. Include the models/ directory with:
    • model_expressive.pt
    • model_paper.pt
    • model_lightweight.pt (if available)