✍️
LipSync Pro
  • Introduction
  • FAQ
  • Contact Us
  • Getting Started
    • Installation & Setup
    • Your First Character
    • AutoSync Guide
  • Concepts & Components
    • LipSync
    • Eye Controller
    • AutoSync
      • AutoSync Modules
      • AutoSync Presets
      • Phoneme Maps
    • Blend Systems
    • LipSyncData
      • Markers
    • Phoneme Sets
  • Editor Windows & Inspectors
    • Clip Editor
      • AutoSync Window
      • Clip Settings Window
      • Marker Settings Window
      • Emotion Mixer Window
    • LipSync Inspector
      • Phoneme & Emotion Poses
      • Pose Extractor Wizard
      • Gesture Setup Wizard
    • Project Settings
    • Extensions Window
  • Extensions
    • Official Blend Systems
    • Official AutoSync Modules
      • Montreal Forced Aligner
      • Microsoft Azure Speech Recognition
    • Miscellaneous
Powered by GitBook
On this page

Was this helpful?

  1. Concepts & Components
  2. AutoSync

Phoneme Maps

PreviousAutoSync PresetsNextBlend Systems

Last updated 4 years ago

Was this helpful?

Phoneme Maps are assets used by to convert Phonemes between two formats. These can either be actual LipSync assets, or an external phoneme set used by another library. For example, the Montreal Forced Aligner module's English language model outputs phonemes using the phoneme set - in order to use this data, there is an included Phoneme Map to convert from this format into the Preston Blair set that is used in LipSync Pro by default. This Phoneme Map can be found in the AutoSync/Phoneme Maps folder.

Custom Phoneme Maps can be created either by duplicating and modifying an existing one, or from the Create Asset menu, under LipSync Pro/AutoSync/External Phoneme Map.

The top of the Inspector for a Phoneme Map allows you to set a Display Name, which is used for listing Phoneme Maps in some circumstances. Below that are Phoneme Set A and Phoneme Set B - these are the names of the Phoneme Sets this map converts between. If referring to a asset, make sure this exactly matches the scripting name set there.

The rest of the Inspector is taken up with the Phoneme List. This is a simple list of all phonemes in Set A and their equivalent phoneme in Set B. Any phonemes not found in the list when mapping will be ignored. The same Phoneme Map can be used in both directions, but A -> B will be favoured when automatically matching using AutoSyncUtility.FindBestFitPhonemeMap. If the same label appears more than once when doing a lookup, the first instance will always be used. Because of this, maps will generally have a single intended direction and while multiple phonemes in either set can map to the same phoneme in the other, they will usually only have each label in Set A appear once.

AutoSync
PhonemeSet
ARPABET
PhonemeSet
The Arpabet-Prestonblair Phoneme Map