Computer Vision

We finally provide our pre-trained weights for pigeons to use with I-MuPPET.

https://zenodo.org/record/7037589#.ZHcsFl7P0uU

Also, our pigeon tracking benchmark is available now.

zenodo.org/record/7038391#.ZHcs8V7P0uU

Our results, that you can improve upon, can be found in our paper.

And last but not least, our single pigeon data with RGB images and corresponding keypoint annotations is available now.

zenodo.org/record/7989831#.ZHcwO17P0uU

You can check it out with I-MuPPET.

We hope that this will help to boost the study of collective behaviour.

Three of our papers were accepted at the CVPR workshop „CV4Animals: Computer Vision for Animal Behavior Tracking and Modeling“ that will take place on June 18, 2023 in Vancouver, Canada.

3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking

I-MuPPET: Interactive Multi-Pigeon Pose Estimation and Tracking
https://urs-waldmann.github.io/i-muppet/

Improving Unsupervised Label Propagation for Pose Tracking and Video Object Segmentation
https://urs-waldmann.github.io/improving-unsupervised-label-propagation/

There were several reports about our last work „Neural Puppeteer“.

The University of Konstanz published a press release that you can find here. There is also a German version here.

The Centre for the Advanced Study of Collective Behaviour reported in their news as well about NePu.

And the Innovation Origins further coveraged our work: https://innovationorigins.com/en/selected/ai-captures-animal-motion/.

The CASCB report 2022 is out. You find it here.

Today we presented our poster Neural Puppeteer at the 16th Asian Conference on Computer Vision (ACCV2022). The presentation was held virtually from Konstanz.

Code available for our unsupervised framework where we propagate poses and masks through a video: https://github.com/urs-waldmann/improving-unsupervised-label-propagation.

Check out our introduction video to Neural Puppeteer, that we will present at the 16th Asian Conference on Computer Vision (ACCV2022) in Macau SAR, China on December 7, 2022.

Der jährliche Report unseres Clusters ist erschienen. Auf Englisch. Check it out!

CASCB Report 2021

Summer Semester 2021. The one week workshop @Merz Akademie (https://www.merz-akademie.de/​) in Stuttgart, given by Jörg Frohnmayer was all about dealing with tracking data of animals and visualize the data in VR. Students had three layers that they had to design.

1. design the unser interface and the spatial interaction
2. design and reconstruct the real space where the tracking was recorded
3. design a imaginary place that shows the real data within a new context

The students – Vincent Elsässer, Vincent Gössler, Florentin Zinßer, Leander Dürrstein realized a prototype within this one week.

We have used the data provided by researchers working at the Max Planck Institute of Animal Behavior, Center of Advance Collective Behavior Studies (CASCB), Uni Konstanz. Credits: Nora Carlson, Maty Nagy, Hemal Naik and Urs waldmann.

Der jährliche Report unseres Clusters ist erschienen. Auf Englisch. Check it out!

CASCB Report 2019/2020