Institute Homepage
Institute Homepage Sign In
We combine research on computer vision, computer graphics, and machine learning to teach computers to see and understand humans and their behavior. By capturing 3D human behavior from video at scale, we train digital humans that behave like real humans.
Thumb xl 1 20240715 perc syst 129
Thumb xl 1 20240715 perc syst 113
Thumb xl 3 adventscalend ar 9504x6336
Thumb xl 4 20240715 perc syst 049
Thumb xl 5 20240715 perc syst 013
Thumb xl 6 20240715 perc syst 081
Thumb xl 8 20240715 perc syst 126
Thumb xl 9 20240715 perc syst 087
Thumb xl 10 20240715 perc syst 009
Thumb xl 11 20240715 perc syst 080
Thumb xl 1 2
Thumb xl 5
Thumb xl 6
Thumb xl 7
Thumb xl 12
Thumb xl 13
Thumb xl 14
Thumb md 1 20240715 perc syst 129
Thumb md 1 20240715 perc syst 113
Thumb md 3 adventscalend ar 9504x6336
Thumb md 4 20240715 perc syst 049
Thumb md 5 20240715 perc syst 013
Thumb md 6 20240715 perc syst 081
Thumb md 8 20240715 perc syst 126
Thumb md 9 20240715 perc syst 087
Thumb md 10 20240715 perc syst 009
Thumb md 11 20240715 perc syst 080
Thumb md 1 2
Thumb md 5
Thumb md 6
Thumb md 7
Thumb md 12
Thumb md 13
Thumb md 14

Our research uses Computer Vision to learn digital humans that can perceive, learn, and act in virtual 3D worlds. This involves capturing the shape, appearance, and motion of real people as well as their interactions with each other and the 3D scene using monocular video. We leverage this to learn generative models of people and their behavior and evaluate these models by synthesizing realistic looking humans behaving in virtual worlds.

This work combines Computer Vision, Machine Learning, and Computer Graphics.

Director
Michael Black

Michael Black

Director
Admin Team
Melanie Feldhofer

Melanie Feldhofer

Department Manager
Nicole Overbaugh

Nicole Overbaugh

Administrative Assistant
+49 7071 601 1800
ps-admin@tuebingen.mpg.de

Department Highlights

Publication Perceiving Systems 2025-03-27

Democratizing 3D Human Digitization

Democratizing 3D Human Digitization
Talk Perceiving Systems 2025-03-10

How and what to film in virtual environments?

How and what to film in virtual environments?
Publication Perceiving Systems 2025-03-01

CameraHMR: Aligning People with Perspective

{CameraHMR}: Aligning People with Perspective
Talk Perceiving Systems 2025-02-18

The Dawn of Video Generation: Preliminary Explorations with SORA-like Models

The Dawn of Video Generation: Preliminary Explorations with SORA-like Models
Talk Perceiving Systems 2025-02-06

Computer Vision at the Mirror Stage: Questioning and Refining Visual Categorization

Computer Vision at the Mirror Stage: Questioning and Refining Visual Categorization
Publication Perceiving Systems 2024-12-01

PuzzleAvatar: Assembling 3D Avatars from Personal Albums

{PuzzleAvatar}: Assembling {3D} Avatars from Personal Albums
Talk Perceiving Systems 2024-11-28

How to predict the inside from the outside? Segment, register, model and infer!

How to predict the inside from the outside? Segment, register, model and infer!
Publication Haptic Intelligence Perceiving Systems 2024-11-01

Wrist-to-Wrist Bioimpedance Can Reliably Detect Discrete Self-Touch

Wrist-to-Wrist Bioimpedance Can Reliably Detect Discrete Self-Touch
Talk Perceiving Systems 2024-10-14

Diffusion Models for Human Motion Synthesis

Diffusion Models for Human Motion Synthesis
Talk Perceiving Systems 2024-10-10

Reconstruction and Animation of Realistic Head Avatars

Reconstruction and Animation of Realistic Head Avatars
Talk Perceiving Systems 2024-09-26

Collaborative Control for Geometry-Conditioned PBR Image Generation

Collaborative Control for Geometry-Conditioned PBR Image Generation
Talk Perceiving Systems 2024-09-26

Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representation

Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representation
Talk Perceiving Systems 2024-09-12

Generalizable Object-aware Human Motion Synthesis

Generalizable Object-aware Human Motion Synthesis
Publication Perceiving Systems 2024-09-01

GraspXL: Generating Grasping Motions for Diverse Objects at Scale

{GraspXL}: Generating Grasping Motions for Diverse Objects at Scale
Publication Perceiving Systems 2024-09-01

AWOL: Analysis WithOut synthesis using Language

{AWOL: Analysis WithOut synthesis using Language}
Publication Perceiving Systems 2024-09-01

Explorative Inbetweening of Time and Space

Explorative Inbetweening of Time and Space
Talk Perceiving Systems 2024-08-22

Real Virtual Humans

Real Virtual Humans
Publication Perceiving Systems 2024-08-01

Re-Thinking Inverse Graphics with Large Language Models

Re-Thinking Inverse Graphics with Large Language Models
Talk Perceiving Systems 2024-07-25

4D Dynamic Scene Reconstruction, Editing, and Generation.

4D Dynamic Scene Reconstruction, Editing, and Generation.
Talk Perceiving Systems 2024-07-23

Multimodal Social Signal Processing for Human-Robot Interaction

Multimodal Social Signal Processing for Human-Robot Interaction
Talk Perceiving Systems 2024-07-18

Integrating AI Agents into Human Lives via a Simulation Approach

Integrating AI Agents into Human Lives via a Simulation Approach
Talk Perceiving Systems 2024-07-18

Recreating Real Garments in Virtual Space with Gaussian Splatting and GNNs

Recreating Real Garments in Virtual Space with Gaussian Splatting and GNNs
Talk Perceiving Systems 2024-07-08

Creating High-End Visuals with Real-Time Technology

Creating High-End Visuals with Real-Time Technology
Talk Perceiving Systems 2024-07-04

Text-Driven 3D Modeling of Avatars

Text-Driven 3D Modeling of Avatars
Publication Perceiving Systems 2024-07-01

ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulations

{ContourCraft}: Learning to Resolve Intersections in Neural Multi-Garment Simulations
Talk Perceiving Systems 2024-06-10

Towards Human-Centric Foundation Models: Pretraining Datasets and Unified Architectures

Towards Human-Centric Foundation Models: Pretraining Datasets and Unified Architectures
Publication Perceiving Systems 2024-06-01

HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video

{HOLD}: Category-agnostic {3D} Reconstruction of Interacting Hands and Objects from Video
Publication Perceiving Systems 2024-06-01

AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion

{AMUSE}: Emotional Speech-driven {3D} Body Animation via Disentangled Latent Diffusion