# GPT4All Documentation

Source: https://docs.gpt4all.io/gpt4all_desktop/models.html

---

[ ![logo](../assets/nomic.png) ](../index.html "GPT4All") GPT4All

[ nomic-ai/gpt4all  ](https://github.com/nomic-ai/gpt4all "Go to repository")

  * [ GPT4All Documentation  ](../index.html)
  * [ Quickstart  ](quickstart.html)
  * [ Chats  ](chats.html)
  * Models  [ Models  ](models.html) Table of contents 
    * Download Models 
    * Explore Models 
    * Example Models 
      * Search Results 
    * Connect Model APIs 
  * [ LocalDocs  ](localdocs.html)
  * [ Settings  ](settings.html)
  * [ Chat Templates  ](chat_templates.html)
  * Cookbook  Cookbook 
    * [ Local AI Chat with Microsoft Excel  ](cookbook/use-local-ai-models-to-privately-chat-with-microsoft-excel.html)
    * [ Local AI Chat with your Google Drive  ](cookbook/use-local-ai-models-to-privately-chat-with-google-drive.html)
    * [ Local AI Chat with your Obsidian Vault  ](cookbook/use-local-ai-models-to-privately-chat-with-Obsidian.html)
    * [ Local AI Chat with your OneDrive  ](cookbook/use-local-ai-models-to-privately-chat-with-One-Drive.html)
  * API Server  API Server 
    * [ GPT4All API Server  ](../gpt4all_api_server/home.html)
  * Python SDK  Python SDK 
    * [ GPT4All Python SDK  ](../gpt4all_python/home.html)
    * [ Monitoring  ](../gpt4all_python/monitoring.html)
    * [ SDK Reference  ](../gpt4all_python/ref.html)
  * Help  Help 
    * [ FAQ  ](../gpt4all_help/faq.html)
    * [ Troubleshooting  ](../gpt4all_help/troubleshooting.html)

Table of contents

  * Download Models 
  * Explore Models 
  * Example Models 
    * Search Results 
  * Connect Model APIs 

# Models

GPT4All is optimized to run LLMs in the 3-13B parameter range on consumer-
grade hardware.

LLMs are downloaded to your device so you can run them locally and privately.
With our backend anyone can interact with LLMs efficiently and securely on
their own hardware.

## Download Models

Download Models

1. | Click `Models` in the menu on the left (below `Chats` and above `LocalDocs`) | ![Models Page Icon](../assets/models_page_icon.png)  
---|---|---  
2. | Click `+ Add Model` to navigate to the `Explore Models` page | ![Add Model button](../assets/add.png)  
3. | Search for models available online | ![Explore Models search](../assets/explore.png)  
4. | Hit `Download` to save a model to your device | ![Download Models button](../assets/download.png)  
5. | Once the model is downloaded you will see it in `Models`. | ![Download Models button](../assets/installed_models.png)  
  
## Explore Models

GPT4All connects you with LLMs from HuggingFace with a
[`llama.cpp`](https://github.com/ggerganov/llama.cpp) backend so that they
will run efficiently on your hardware. Many of these models can be identified
by the file type `.gguf`.

![](../assets/search_mistral.png)Explore models

## Example Models

Many LLMs are available at various sizes, quantizations, and licenses.

  * LLMs with more parameters tend to be better at coherently responding to instructions

  * LLMs with a smaller quantization (e.g. 4bit instead of 16bit) are much faster and less memory intensive, and tend to have slightly worse performance

  * Licenses vary in their terms for personal and commercial use

Here are a few examples:

Model | Filesize | RAM Required | Parameters | Quantization | Developer | License | MD5 Sum (Unique Hash)  
---|---|---|---|---|---|---|---  
Llama 3 Instruct | 4.66 GB | 8 GB | 8 Billion | q4_0 | Meta | [Llama 3 License](https://llama.meta.com/llama3/license/) | c87ad09e1e4c8f9c35a5fcef52b6f1c9  
Nous Hermes 2 Mistral DPO | 4.11 GB | 8 GB | 7 Billion | q4_0 | Mistral & Nous Research | [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) | Coa5f6b4eabd3992da4d7fb7f020f921eb  
Phi-3 Mini Instruct | 2.18 GB | 4 GB | 4 billion | q4_0 | Microsoft | [MIT](https://opensource.org/license/mit) | f8347badde9bfc2efbe89124d78ddaf5  
Mini Orca (Small) | 1.98 GB | 4 GB | 3 billion | q4_0 | Microsoft | [CC-BY-NC-SA-4.0](https://spdx.org/licenses/CC-BY-NC-SA-4.0) | 0e769317b90ac30d6e09486d61fefa26  
GPT4All Snoozy | 7.37 GB | 16 GB | 13 billion | q4_0 | Nomic AI | [GPL](https://www.gnu.org/licenses/gpl-3.0.en.html) | 40388eb2f8d16bb5d08c96fdfaac6b2c  
  
### Search Results

You can click the gear icon in the search bar to sort search results by their
# of likes, # of downloads, or date of upload (all from HuggingFace).

![](../assets/search_settings.png)Sort search results

## Connect Model APIs

You can add your API key for remote model providers.

**Note** : this does not download a model file to your computer to use
securely. Instead, this way of interacting with models has your prompts leave
your computer to the API provider and returns the response to your computer.

![](../assets/add_model_gpt4.png)Connect APIs