Institute Homepage
Institute Homepage DE Sign In

Social Foundations of Computation The MIT License folktexts Get classification risk scores on tabular tasks using LLMs.
Thumb ticker sm folktexts loop diagram both prompts.drawio
Social Foundations of Computation The MIT License BenchBench BenchBench is a Python package to evaluate multi-task benchmarks.
Thumb ticker sm benchbench horizontal
Social Foundations of Computation The MIT License Error- Parity Achieve error-rate fairness between societal groups for any score-based classifier.
Thumb ticker sm screenshot 2024 09 17 at 18.54.25
Social Foundations of Computation The MIT License tttlm: Test-time-training on nearest neighbors for large language models Test-time-training on nearest neighbors for large language models.
Thumb ticker sm image
Perceiving Systems The MIT License Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings Generalizing deep neural networks to new target domains is critical to their real-world utility. While labeling data from the target domain, it is desirable to select a subset that is maximally-informative to be cost-effective (called Active Learning). The ADA-CLUE algorithm addresses the problem of Active Learning under a domain shift. The GitHub repo consists of code to train models with the ADA-CLUE algorithm for multiple source and target domain shifts. Pre-trained models are also available.
Thumb ticker sm adaclue cropped image
Perceiving Systems The MIT License Efficient Learning on Point Clouds with Basis Point Sets Basis Point Set (BPS) is a simple and efficient method for encoding 3D point clouds into fixed-length representations. It is based on a simple idea: select k fixed points in space and compute vectors from these basis points to the nearest points in a point cloud; use these vectors (or simply their norms) as features. The basis points are kept fixed for all the point clouds in the dataset, providing a fixed representation of every point cloud as a vector. This representation can then be used as input to arbitrary machine learning methods, in particular it can be used as input to off-...
Thumb ticker sm bps teaser2
Perceiving Systems The MIT License Markerless Outdoor Human Motion Capture Using Multiple Autonomous Micro Aerial Vehicles Capturing human motion in natural scenarios means moving motion capture out of the lab and into the wild. Typical approaches rely on fixed, calibrated, cameras and reflective markers on the body, significantly limiting the motions that can be captured. To make motion capture truly unconstrained, we describe the first fully autonomous outdoor capture system based on flying vehicles. We use multiple micro-aerial-vehicles(MAVs), each equipped with a monocular RGB camera, an IMU, and a GPS receiver module. These detect the person, optimize their position, and localize themselves approximately. ...
Thumb ticker sm content iccv 2 cover crop
Perceiving Systems The MIT License Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild" We present the first method to perform automatic 3D pose, shape and texture capture of animals from images acquired in-the-wild. In particular, we focus on the problem of capturing 3D information about Grevy's zebras from a collection of images. We integrate the recent SMAL animal model into a network-based regression pipeline, which we train end-to-end on synthetically generated images with pose, shape, and background variation. We couple 3D pose and shape prediction with the task of texture synthesis, obtaining a full texture map of the animal from a single image. The predicted textur...
Thumb ticker sm ps web
Perceiving Systems The MIT License Competitive Collaboration Competitive Collaboration is a generic framework in which networks learn to collaborate and compete, thereby achieving specific goals. Competitive Collaboration is a three player game consisting of two players competing for a resource that is regulated by a third player, moderator. This framework is similar in spirit to expectation-maximization (EM) but is formulated for neural network training.
Thumb ticker sm mac
Perceiving Systems The MIT License RingNet: Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision Code: We provide the inference code of RingNet. Please check the repository which is self explanatory. NoW Benchmark Dataset and Challenge: Please check the external link to download the data and participate in the challenge.
Thumb ticker sm ringnet teaset
Perceiving Systems The MIT License VOCA: Capture, Learning, and Synthesis of 3D Speaking Styles VOCA (Voice Operated Character Animation) is a framework that takes a speech signal as input and realistically animates a wide range of adult faces. <p><strong>Code: </strong>We provide Python demo code that outputs a 3D head animation given a speech signal and a static 3D head mesh. The codebase further provides animation control to alter the speaking style, identity-dependent facial shape, and head pose (i.e. head rotation around the neck) during animation. The code further demonstrates how to sample 3D head meshes from the publicly available FLAME model, that can then be animated&nbs...
Thumb ticker sm teaser voca
Perceiving Systems The MIT License Convolutional Mesh Autoencoders The code allows to build convolutional networks on mesh structures analogous to CNNs on images. The code includes mesh convolutions, and introduces downsampling and upsampling operators that can be directly applied to the mesh structure. The code implements a Convolution Mesh Autoencoder using the above mesh processing operators and achieves state of the art results on generating 3D facial meshes.
Thumb ticker sm thumb lg coma faces
Perceiving Systems The MIT License Learning Human Optical Flow The optical flow of humans is well known to be useful for the analysis of human action. Given this, we devise an optical flow algorithm specifically for human motion and show that it is superior to generic flow methods. Designing a method by hand is impractical, so we develop a new training database of image sequences with ground truth optical flow. For this we use a 3D model of the human body and motion capture data to synthesize realistic flow fields. We then train a convolutional neural network to estimate human flow fields from pairs of images. Since many applications in human motion an...
Thumb ticker sm thumb lg persondetect copy
Software Workshop The MIT License Livius The tool we developed for generating the videos on MLSS 2015
Empirical Inference The MIT License AutoML Two-Sample Test autotst is a Python package for easy-to-use two-sample testing and distribution shift detection.
Thumb ticker sm automl
The MIT License AutoML Two-Sample Test autotst is a Python package for easy-to-use two-sample testing and distribution shift detection.
Thumb ticker sm automl
Empirical Inference The MIT License Dingo (Deep Inference for Gravitational-wave Observations) Dingo (Deep Inference for Gravitational-wave Observations) is a Python program for analyzing gravitational wave data using neural posterior estimation. It dramatically speeds up inference of astrophysical source parameters from data measured at gravitational-wave observatories. Dingo aims to enable the routine use of the most advanced theoretical models in analysing data, to make rapid predictions for multi-messenger counterparts, and to do so in the context of sensitive detectors with high event rates.
Thumb ticker sm dingo
Empirical Inference The MIT License Omni-Fig: Unleashing Project Configuration and Organization in Python omni-fig is a lightweight package to help you organize your python projects to make everything clear and easy to understand to collaborators and prospective users, while also offering unparalleled features to accelerate development. The proposed general-purpose project structure is well suited for both small and large projects, and is designed to be easily extensible to fit your needs. Most importantly, with the powerful configuration system, you never have to worry about any boilerplate code to parse command line arguments, read config files, or even import the top-level project compone...
Thumb ticker sm omnifig
Social Foundations of Computation The MIT License folktables Datasets derived from US census data
Thumb ticker sm folktables
Empirical Inference The MIT License normflows: A PyTorch Package for Normalizing Flows normflows is a PyTorch implementation of discrete normalizing flows. Many popular flow architectures are implemented. The package can be easily installed via pip. The basic usage is described here, and a full documentation is available as well. A more detailed description of this package is given in out accompanying paper.
Thumb ticker sm normflow