xVASynth v3.0.0
DanRutasteam_community_announcementspatchnotes
Headline changes:
- Added support for v3 models
- Added multi-lingual support, with dropdown setting for the base language to process v3 TTS input as
- Purged old speech-to-speech system. Replaced with new v3 voice conversion system, with new python-based mic recording
- Added emotion sliders for: Angry, Happy, Sad, Surprised
- Added rich text prompt editor with code-editor-like autocompletes for languages and ARPAbet
- Added backslash lang control in sub-prompt components, allowing multiple languages per prompt
- Added voice crafting system, and support for json-only voice models
- Added style sliders, and management system
- Added backwards-compatible audio 48khz super-resolution post-processing via nuwave2 diffusion model
- Added deepfilternet2 'Clean-up' post-processing model alongside super-resolution
Post-processing:
- Added ffmpeg settings for noise reduction, with configurable parameters
- Added SR and clean-up post-processing support to batch mode
- Added de-clipping and de-clicking post-processing ffmpeg filters
- Added de-essing post-processing filter
UI Changes:
- Upgrade from Electron v2 to v19
- Added right click menu on output editor to copy ARPAbet sequence to clipboard
- Added error modals for problems with Nexus API use, printing out the full response
- More reactive Voice Conversion UI
- Auto-insert spaces at start/end of text prompts
- Made the automatic space padding configurable via user setting, and not affect the prompt box or output filename
- Ensured temporary files are cleaned out after every synthesis
- Added Tab autocompletion for selected text to ARPAbet via the g2p backend
- Added explicit error message for unsupported ARPAbet symbol
- Improved batch mode window design
- Changed default ffmpeg Hz to 44100
- Filtered out * asterisks from prompts
- Cleared old sliders editor TTS data when voice conversion is used
- Disabled useless json output for voice conversion samples
- Added more obvious styling for disabled inputs
- Removed batch fast mode
- Removed now useless 'Automatically generate voice' Voice Conversion setting
- Removed ffmpeg pre-apply setting, use as enabled going forward
- Made sliders and checkboxes theme coloured
- Added pagination to the output records, with user setting for pagination size
- Filtered out non-audio files from the output records (Keeping only wav, mp3, ogg, opus, wma, xwm)
- Removed game-specific app title changes. Only xVASynth going forward
- Changed model details (i) info window opening to click, instead of hover to enable interactivity
- Added v2 and v3 UI switching for ARPAbet symbol list displays
- Added CC-BY-4.0 category
- Added splash page with YouTube links, before the EULA
- Hidden the Endorsements/Downloads counters from the Nexus Manage Repos menu, as they do not update
Under-the-hood:
- Re-built backend environments with Python 3.9
- Add 'pfft' entries into the cmudict
- Updated 3d emb visualizer to use better v3 embedding space model
- Added ability to load multiple model instances for programmatic use of the app via local http
- Added fallback model installation debugging mode for when models are loaded with missing asset files
- Added the clean-up model as a pre-processing step for voice conversion
Fixes:
- Stopped start-up error messages being very quickly dismissed by the start-up process
- Fixed Jitter button not doing anything for zero values
- Fixed microphone recording not working for mono-only microphones
- Stopped using cached g2p words if prediction failed (blank prediction)
- Added more explicit and hopefully more robust device switching for synthesis (incl for super-resolution)
- Improved/fixed error display/logging for batch mode
- Fixed batch mode bug where pitch_amp only affects first batch line
- Fixed batch mode output_path not being shown properly
- Fixed editor issue where disabled sliders could still be moved if clicked in the right place
- Fixed dashes being ignored in ARPAbet dictionary replacements
- Fixed not all settings being reset
- Fixed manual ARPAbet input being broken in the text processing pipeline
- Fixed 3D voice embeddings visualizer not displaying gender information correctly
- Lots and lots of other misc tweaks, fixes, and polishing
