Is Moonshine still supported for useSpeechToText?

[abdelrahmansaid31]

Description

I've noticed that the docs for newer versions stopped mentioning Moonshine despite it still being up on software-mansion's HuggingFace Page. Passing the encoder/decoder/tokenizer sources for moonshine_tiny and running the model causes "Error during streaming transcription: [Error: Forward pass failed during encoding, error code: 16]". Is it no longer supported or am I missing something?

thanks

Steps to reproduce

Passing the encoder/decoder/tokenizer sources for moonshine_tiny obtained from https://huggingface.co/software-mansion/react-native-executorch-moonshine-tiny causes "Error during streaming transcription: [Error: Forward pass failed during encoding, error code: 16]".

Snack or a link to a repository

No response

React Native Executorch version

0.6.0

React Native version

0.81.5

Platforms

Android

JavaScript runtime

None

Workflow

Expo Dev Client

Architecture

Fabric (New Architecture)

Build type

Debug mode

Device

Real device

Device model

No response

AI model

Moonshine Tiny

Performance logs

No response

Acknowledgements

Yes

[chmjkb]

Hi @abdelrahmansaid31,

We actually phased out Moonshine support a while back to focus on Whisper, as maintaining two different streaming algorithms became quite a hurdle. However, we can consider bringing it back. Would that be useful for your workflow? We’d love to know what the specific 'selling point' or advantage of Moonshine is for you over Whisper.

[abdelrahmansaid31]

Thanks for your reply @chmjkb
Bringing back support for moonshine would be really valuable actually. Its performance is outstanding for its small size and it ranks highly on the open ASR leaderboard beating models multiple times bigger in parameter count. Also, there isn't a plug and play way to run it in a react native app (as far as I know) while there's whisper.rn for example. So, hopefully you guys find the time to bring back support for it and maybe even moonshine_base.

[chmjkb]

Hey @abdelrahmansaid31, thanks for your feedback. I agree that Moonshine is interesting in terms of performance and we will most likely work on it. For now we're focusing on improving perf / stability of Whisper as it's possible to push it a bit further. Once we're done with that, we will take a look at Moonshine.