Local Models take up substantial space and memory for operation. This info is posted under Account -> Local Models on the desktop app. The RAM requirements here are conservative estimates.
You will need 1 Embed model and 1 Chat model to use Local chats.
To use the models, make sure it is set as "Active" before you open or create a chat.
The models are stored here on your device:
2 months ago