Martin Engilberge

Martin Engilberge

Machine learning Researcher for Vision and Language

CLOAF: CoLlisiOn-Aware Human Flow

Published in CVPR, 2024

Abstract

Even the best current algorithms for estimating body 3D shape and pose yield results that include body self-intersections. In this paper, we present CLOAF, which exploits the diffeomorphic nature of Ordinary Differential Equations to eliminate such self-intersections while still imposing body shape constraints. We show that, unlike earlier approaches to addressing this issue, ours completely eliminates the self-intersections without compromising the accuracy of the reconstructions. Being differentiable, CLOAF can be used to fine-tune pose and shape estimation baselines to improve their overall performance and eliminate self-intersections in their predictions. Furthermore, we demonstrate how our CLOAF strategy can be applied to practically any motion field induced by the user. CLOAF also makes it possible to edit motion to interact with the environment without worrying about potential collision or loss of body-shape prior.

Paper Suppl. Poster

Citation

If you found this work useful, please cite the associated paper:

Davydov, Andrey, Martin Engilberge, Mathieu Salzmann, and Pascal Fua, “CLOAF: CoLlisiOn-Aware Human Flow” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024.

BibTex:

@inproceedings{davydov2024cloaf,
  title={CLOAF: CoLlisiOn-Aware Human Flow.},
  author={Davydov, Andrey, Martin Engilberge, Mathieu Salzmann, and Pascal Fua},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2024}
}