Skip to content

Welcome to MSP Lab

This is the organization of Multimodal Speech Processing (MSP) laboratory, part of the Language Technologies Institute at Carnegie Mellon University. Our research program is on human-centered multimodal machine intelligence and applications for speech-based interfaces. We are dedicated to advancing technology to solve theoretical problems with practical applications. Our goal is to develop methods, algorithms, and models to recognize and synthesize human verbal and non-verbal communication behaviors to improve human-machine interaction.

GitHub repositories of MSP Lab affiliated projects will be hosted here.

Pinned Loading

  1. STArK STArK Public

    Official implementation of STArK: Towards Synthesizing Articulatory Kinematics from Text (Interspeech 2026)

    Python 1

  2. MMDyS MMDyS Public

    Official repository of the paper "Multimodal Biomarkers of Dysarthria: Severity-Conditioned Contrastive Alignment of Speech, Text, and Facial Asymmetry" presented at the ICMI 2026

    Python 1

  3. SpeechPerplexity SpeechPerplexity Public

    Python

  4. EMBRACE EMBRACE Public

    EMBRACE: Emotion-Based Representation Across Cultures & Expressions

    Python

  5. CNPforDSER CNPforDSER Public

    Code for the paper: "Dynamic Speech Emotion Recognition using a Conditional Neural Process" by Martinez-Lucas and Busso.

    Python

Repositories

Showing 10 of 15 repositories

Top languages

Loading…

Most used topics

Loading…