Planned Features

Planned Features

Planned features are upcoming features that will be added as production continues, however, there’s no guarantee that these will be added. They are organized as they are seen in the README

2.1. Core Features

• Custom hotkeys for triggering expressions and gestures
• Wake-word detection using Pocketsphinx

2.2. Text-to-Speech Integration

• Integration with Azure TTS for text-to-speech functionality
  • Step-by-step guide for users to obtain and set up an API key
• TTS to voice Twitch chat messages
• Alternative for VTubers to type instead of talking, using TTS for vocalization

2.3. Streaming Platform Integration

• Interactive features using Twitch bits or reward points, such as throwing objects at the model

2.4. Expression and Gesture Presets

• Library of pre-set expressions and gestures (e.g., surprise, anger, joy)
• Custom hotkeys and wake words for triggering presets

2.5. Scene Transitions and Effects

• Library of pre-made scene transitions and effects
• Customizable transitions for a professional and polished presentation

2.6. Mouse Tracking for Eye and Body Movements

• Post-processing pass and body morphing based on mouse position, creating an effect where the body of the model follows the mouse

2.7. Audio Analysis for Animation Triggers

• Audio amplitude analysis to use different sets of mouth shapes based on the loudness or quietness of the VTuber's speech
• Pitch analysis for detecting excitement or screaming

2.8. Voice Anonymization

• Speech-to-text (STT) conversion to transcribe the streamer's voice into text
• Text-to-speech (TTS) system to vocalize the transcribed text with a synthetic voice, concealing the streamer's real voice
• Various synthetic voice options for customization and personalization

By incorporating the voice anonymization feature, you can cater to a a wider audience of streamers, including those who are concerned about privacy or prefer not to reveal their actual voice. This added functionality can make your PNGTuber software even more versatile and appealing to a diverse range of users.

Unorgonized Ideas & Unprioritized ideas

• Puppeteer interface with keyboard and mouse
• Puppeteer interfacing with the game controller
• AI co-streamer

Channel Point/Bit/Chat Ideas.

Vtuber/chat tts affected

1. Outfit change/hair style change (Vtuber) 1.A outfit/change on chat tts 1.B change vtubers/chat tts color (like a multiple or screen rgb/hex code.
2. Mouth fall off
3. Throw/fall objects at vtuber/chat
4. Part of model grows or shrinks

Minigames

1. Gacha outfit/asset (secret accessories to unlock via gacha) 1.A claw machine (Credit idea to ValeofHearts)
2. Take care of chat tts (tamagotchi)
3. Chat duel?
4. Guess the amount (how much is in the jar) 5.* FISHING MINIGAME (I have no idea, but fishing minigame) 6.* COOKING/BAKING MINIGAME (Wichit loves cooking minigames.)

extension necessary ideas

• • items from previous list that may or may not benefit from this

1. Draw the streamer a asset or shirt decal in browser. (will be approved by the streamer before being uploaded.)
2. Move the vtuber or chat tts anywhere on the screen.