Computer Vision

Since March 2020, I have been working at the Centre for the Advanced Study of Collective Behaviour. Biologists, psychologists, computer scientists and many more disciplines interdisciplinary work together and study collective behaviour across a wide range of species and across scales of organization.

I am a computer scientist within the Computer Vision and Image Analysis group. We focus on multi-object tracking and pose estimation methods for animals. We acquire data in our imaging facilities – the Imaging Barn and the Imaging Hangar – which are located in Möggingen at the Max Planck Institute of Animal Behavior and in the Centre for Visual Computing of Collectives at the University of Konstanz respectively.

Contact

e-mail: urs.waldmann@uni-konstanz.de
github: urs-waldmann
mastodon: @ursNwaldmann@sigmoid.social

News

2024/03/283D-MuPPET accepted for publication in the International Journal of Computer Vision.
2024/01/18 – We are organizing the 4th CV4Animals workshop at CVPR 2024.
2023/11/15 – Paper accepted for oral presentation @WACVW2024 („CV4Smalls“).
2023/05/31Annotated single pigeon data, pigeon tracking benchmark and model weights for pigeons available (I-MuPPET, GCPR 2022, oral)
2023/05/22 – Three of our papers accepted @CVPRW2023 („CV4Animals“).
2023/03/09 – Further coverage of „Neural Puppeteer“ at https://innovationorigins.com/en/selected/ai-captures-animal-motion/
2023/03/08 – The University of Konstanz and the Centre for the Advanced Study of Collective Behaviour reports in a press release about our latest work „Neural Puppeteer“:
https://www.campus.uni-konstanz.de/en/science/neural-puppeteer
https://www.exc.uni-konstanz.de/collective-behaviour/news-and-events/news/details/neural-puppeteer/
News from 2022

Publications

Urs Waldmann*, Alex Chan*, Hemal Naik, Máté Nagy, Iain D. Couzin, Oliver Deussen, Bastian Goldluecke, and Fumihiro Kano: 3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking. International Journal of Computer Vision, 2024. (* Authors contributed equally.) [project page]

Urs Waldmann, Ole Johannsen, and Bastian Goldluecke: Neural Texture Puppeteer: A Framework for Neural Geometry and Texture Rendering of Articulated Shapes, Enabling Re-Identification at Interactive Speed. In Winter Conference on Applications of Computer Vision (WACV) Workshops, 2024 (oral presentation). [arXiv, code, video]

Simon Giebenhain*, Urs Waldmann*, Ole Johannsen, and Bastian Goldluecke: Neural Puppeteer: Keypoint-Based Neural Rendering of Dynamic Shapes. In Asian Conference on Computer Vision (ACCV), 2022. (* Authors contributed equally.) [project page]

Urs Waldmann, Hemal Naik, Nagy Máté, Fumihiro Kano, Iain D. Couzin, Oliver Deussen, and Bastian Goldlücke: I-MuPPET: Interactive Multi-Pigeon Pose Estimation and Tracking. In Pattern Recognition (Proc. of DAGM GCPR), 2022 (oral presentation). [project page]

Urs Waldmann, Jannik Bamberger, Ole Johannsen, Oliver Deussen, and Bastian Goldlücke: Improving Unsupervised Label Propagation for Pose Tracking and Video Object Segmentation. In Pattern Recognition (Proc. of DAGM GCPR), 2022. [project page]

Peer-Reviewed Workshops

Urs Waldmann*, Alex Chan*, Hemal Naik, Máté Nagy, Iain D. Couzin, Oliver Deussen, Bastian Goldluecke, and Fumihiro Kano: 3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking. Accepted in track 1 (unpublished work) in CVPRW „CV4Animals“, 2023. (* Authors contributed equally.) [workshop page]

Urs Waldmann, Hemal Naik, Nagy Máté, Fumihiro Kano, Iain D. Couzin, Oliver Deussen, and Bastian Goldlücke: I-MuPPET: Interactive Multi-Pigeon Pose Estimation and Tracking. Accepted in track 2 (published work) in CVPRW „CV4Animals“, 2023. [workshop page]

Urs Waldmann, Jannik Bamberger, Ole Johannsen, Oliver Deussen, and Bastian Goldlücke: Improving Unsupervised Label Propagation for Pose Tracking and Video Object Segmentation. Accepted in track 2 (published work) in CVPRW „CV4Animals“, 2023. [workshop page]