Leveraging BabelStreamer to enhance your stream

The basics - captioning

OK - despite what I said above, let's talk about captioning for a bit. Did you know that if you're using OBS, BabelStreamer will allow you to add burnt-in captions to your stream even without a subscription? Just add a text field to your OBS and point the BabelStreamer plugin at it through its control panel, and you're done! You get all the enhanced speech-to-text facilities of BabelStreamer with zero cost, and you're ready for translation at any time.

Of course once you have a subscription you have near-zero latency to loads of languages and the viewer gets to choose their language, not a limited set of burnt-in translations.

Enhanced speech recognition

So we have speech recognition and caption generation, what next? Well what about enhanced speech recognition? BabelStreamer has a rich set of features to tailor speech recognition to your own speech patterns and gaming preferences, so that you can fine tune to get the best possible rendering of your captions as true as possible to what you actually meant.

Gaming Vocab

Gamers have their own language and each game has its own set of terms. A key issue is properly recognising and translating these vocabularies, which BabelStreamer solves by

• Built-in standard game vocab which is preferentially recognised
• Per game selectable vocab which is preferentially recognised and passed through without translation
• User definable lexicon of preferentially recognised terms

Tune to your speech

BabelStreamer offers a whole range of features for the advanced user to tune it to their own speech patterns

• Timings of pauses, speech length, snipping of long sentences, noise thresholding
• Choice of several different speech recognition models, whichever works best for your voice
• You can also use your own speech model which has been specifically trained to your own voice, particularly useful for IRL. This is obviously mega-advanced so we are building a service to do this for you

Multilingual Multi Person streams

BabelStreamer allows several people to connect audio to the same session and have it all captioned and translated to the same stream, just by adding more audio inputs to your OBS stream. Even better - each streamer can speak their own language and the viewer will see the captions in their preferred language, with the speaker tagged

So what if the streamers all have their own feed, but are cooperating on a game? Don't worry - BabelStreamer has your back. (Full disclosure: this feature is under development and not yet generally available). Multiple streamers can link into the same captioning stream and viewers will see all the captions for all the streamers as if they were all together in the same feed. This allows players in multiple locations speaking multiple languages to collaborate in a game and have clean translations for their viewers in their own language.

What about the video?

When your livestream is done you want to put up the video and add some captions. If you used BabelStreamer during the live feed then when it's over you can download translated subtitles immediately, saving time and expense. More to the point, if you never had the time to do this before now, then it's available to enhance your videos and make them available to a wider global audience

Putting it together

To summarise: the path to going global has two parts: getting international viewers onto your stream and getting them to stay by feeding them content in their own language.