✍️
LipSync Pro
  • Introduction
  • FAQ
  • Contact Us
  • Getting Started
    • Installation & Setup
    • Your First Character
    • AutoSync Guide
  • Concepts & Components
    • LipSync
    • Eye Controller
    • AutoSync
      • AutoSync Modules
      • AutoSync Presets
      • Phoneme Maps
    • Blend Systems
    • LipSyncData
      • Markers
    • Phoneme Sets
  • Editor Windows & Inspectors
    • Clip Editor
      • AutoSync Window
      • Clip Settings Window
      • Marker Settings Window
      • Emotion Mixer Window
    • LipSync Inspector
      • Phoneme & Emotion Poses
      • Pose Extractor Wizard
      • Gesture Setup Wizard
    • Project Settings
    • Extensions Window
  • Extensions
    • Official Blend Systems
    • Official AutoSync Modules
      • Montreal Forced Aligner
      • Microsoft Azure Speech Recognition
    • Miscellaneous
Powered by GitBook
On this page

Was this helpful?

  1. Concepts & Components

Phoneme Sets

PreviousMarkersNextClip Editor

Last updated 4 years ago

Was this helpful?

A Phoneme Set is an asset used by LipSync Pro to determine what phonemes are available in your project. In this sense it's similar to the lists of Emotions and Gestures available in the asset, but is a self-contained asset as a single phoneme usually forms one part of a coherent set, and breaking up a set doesn't make much sense.

The current Phoneme Set can be set in the Project Settings. Custom Phoneme Sets can be created from the Create Asset menu in the Project panel by going to LipSync Pro > Phoneme Set.

The format for Phoneme Sets was changed in version 1.53 of LipSync Pro. If you have an older custom Phoneme Set in your project, it will need updating.

You can do this by either selecting the Phoneme Set in the Project panel and clicking the Update button at the top, or updating all Phoneme Sets in your project from the Window > Rogo Digital > LipSync Pro > Update PhonemeSets option.

New phonemes can be added to the list by clicking the + button at the bottom, or removed by selecting one entry in the list and clicking the - button. Phonemes can also be re-ordered by dragging the handle on the left-hand side of an item up or down.

Warning: Re-ordering the phonemes in a Phoneme Set will change the index + flag for those phonemes and any after them in the list. This has a high likelihood of breaking any existing clips in the project, and may cause data loss. It's highly recommended to only change Phoneme Set at the start of a project or add additional ones, taking care to not disturb the existing order.

To the left of each Phoneme is its Index, determined by its position the list, and its Flag in parentheses. The Index is used to reference this phoneme in assets, and the Flag is used when filtering out Phonemes in the . These values cannot be set manually, but you should be aware of them to avoid breaking existing clips or poses in components.

On the right of the Phoneme's name is a Texture2D field for setting the guide image - this is the image that shows up in the lower-right-hand corner of the Scene View when editing a Phoneme pose. To the right of this is the Is Important checkbox. This is for marking Phonemes as visually important. While this doesn't affect animation directly, it is used by certain to protect important markers from being removed or modified.

Finally, at the bottom of the Inspector is the Scripting Name field. This is a simple string that represents this Phoneme Set for scripting purposes. It is used by AutoSync modules to determine which to use when creating Phoneme Markers. In a custom Phoneme Set, this can be anything you like - just make sure it's unique and that you match it exactly if you also create a matching Phoneme Map.

LipSyncData
LipSyncData
Clip Editor
LipSync
AutoSync Modules
Phoneme Map
Project Settings
The default Preston Blair Phoneme Set as shown in the Inspector