Firefox

18452 readers

93 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago

MODERATORS

[email protected]

[Answered] How can I use local LLM in the firefox AI chatbot (piefed.social)

submitted 1 week ago* (last edited 6 days ago) by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Today I saw the AI chatbot in the sidebar for the first time (I remember turning the setting of in the Labs settings, but they turned it on IG). Looking the options, it supports a number of models, but all of them seems to be on a remote servers. Is there any way to use an LLM run on my own machine?

top 2 comments

sorted by: hot top controversial new old

[–] [email protected] 9 points 1 week ago (1 children)

Go to about:config and set the pref browser.ml.chat.hideLocalhost to false Afterwards you can select localhost as the provider in Settings > Firefox Labs

[–] [email protected] 2 points 1 week ago

Thanks