this post was submitted on 20 Jan 2025
19 points (91.3% liked)

F-Droid

8513 readers
42 users here now

F-Droid is an installable catalogue of FOSS (Free and Open Source Software) applications for the Android platform. The client makes it easy to browse, install, and keep track of updates on your device.

Website | GitLab | Mastodon

Matrix space | forum | IRC

founded 4 years ago
MODERATORS
 

Found Translate You for text translation, but it uses online services. Is there any offline app for that?

Sayboard allows offline speech to text translation. It's quite cool.
It supports English and seems useful.
Was looking to see if there are models for Malayalam and other languages.

Saw a Malayalam vosk GMM model in gitlab. Tho, it can't be imported. It seems to need a chain training model.

Does anyone know any resources on that?
Or any other app that can do it?

Or is there some way using Termux or so?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 2 weeks ago* (last edited 2 weeks ago)

Thinking a bit outside the box, if your phone is capable of it, you could find a way to run a small local LLM on it. Maybe it can even be done in Termux?

If that's not an option and/or you need a bigger, more capable model, you could host a local Ollama instance, and connect to it from the Ollama (IzzyOnDroid) or GPTMobile (F-Droid). This way you will only connect to yourself instead of some 3rd party translation or LLM provider.

I think that, with a well-written system prompt, you could make it more efficient by concisely instructing it to expect your text input and a language (or include permanent language instructions in system prompt), to then only output the translated version of your input in that language. This will keep the number of input+output tokens low, thereby saving some inference. You can also get creative and instruct it to output multiple variations, change the style/tone/formatting, provide an example sentence containing a single translated word, etc...