Skip to content

[Feature Request]:Real-Time AI Voice Dubbing with User API Support #6015

Description

@Salavatqweu

Feature Request: Real-Time AI Voice Dubbing with User API Support

I would like to request a feature that I believe would make SmartTube one of the best YouTube clients available.

Please consider adding real-time AI voice dubbing for videos. Instead of only translating subtitles, SmartTube could translate the spoken audio and play it back in the user's selected language while the original video continues to play.

Desired features:

  • Real-time speech-to-speech translation.
  • AI-generated natural voice in the selected language.
  • Option to lower or mute the original audio while the dubbed voice is playing.
  • Support for multiple languages.
  • Optional support for user-provided AI API keys (such as Google Gemini Live or other compatible providers), so users can use their own API instead of requiring your own servers.

This would be especially useful for educational videos, podcasts, live streams, interviews, and content that doesn't have translated audio.

A Chrome extension called LivDub already demonstrates that this concept is practical in a browser. Bringing a similar capability directly into SmartTube would provide a much better TV experience without needing a PC or browser.

https://chromewebstore.google.com/detail/livdub/egoacpkbpnnjfebaadejafadmocfhenp

Describe the solution you'd like

Additional information

Describe alternatives you've considered

Additional information

Additional information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions