Skip to content

[Task] speaker-embedding model support #288

Description

Overview

Speaker embedding models encode a variable-length speech segment into a fixed-size vector that captures the speaker's vocal identity. These embeddings are the backbone of speaker verification (is this the claimed speaker?) and identification (which speaker is this?).

Agent Scenarios

  • Voice authentication agent: verify a user's identity by comparing a live utterance embedding against a stored voiceprint before granting access
  • Personalization agent: adapt a voice assistant's responses or TTS voice profile based on recognized speaker identity
  • Fraud detection agent: flag calls where the speaker embedding diverges from the account holder's enrolled voiceprint
  • Speaker-aware RAG agent: retrieve documents personalized to a known speaker's history or preferences, identified from an audio query

ModelKit Integration

Models must pass the full wmk pipeline on all EPs:

wmk config → wmk build (ONNX export) → wmk perf → wmk eval

Acceptance Criteria

  • pyannote/wespeaker-voxceleb-resnet34-LM
  • pyannote/embedding

Activity

  1. xieofxie commented on Apr 20, 2026

    @xieofxie
    Contributor

    Although have ones with many downloads https://huggingface.co/models?other=speaker-embedding&sort=downloads not sure which to pick

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Medium — minor bug or non-critical improvementmodel / task scaleModel and task scale work itemtriagedIssue has been triaged

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions