About Ollama

• It's free
• Runs locally on a user's PC
• It can be made available on a network for use by multiple users but this is outside of the scope of this document
• Supports many different "models"
• A model is a single file that can be downloaded for Ollama to use
• Think of a "model" as the brain which is used to interpret a user prompt. Some brains may produce better results than others in response to different questions
• Models are not part of Ollama itself and can be downloaded from many different locations

Installing Ollama

For finPOWER Connect to use Ollama, it requires that you:

1. Install the Ollama application on a user's PC
2. Download a model file (brain) for Ollama to use

Here's how to install the Ollama application:

• Download
  Go to the official Ollama download page and click Download for Windows
• Install
  Run the .exe installer you just downloaded
• Verify
  Once installed, Ollama will appear in your system tray
  
  

Next, you must install a model for Ollama to use.

A model is the "brain". Think ChatGPT. The model may be either "gpt4", "gpt5" etc. Some models are better than others at specific tasks.

Without a brain, Ollama cannot do anything.

By default, if you type anything into the Ollama window, it will download a model. This will probably not be the model we want to use.

At the time of writing, the default model finPOWER Connect will use is called llama3.2:3b.

Below are instructions on how to install this model from the Windows Command Prompt:

• Open a Windows Command Prompt
• Press Windows + R
• Type cmd
• Press Enter
• Run the command
  
• Type ollama run llama3.2:3b
• Press Enter
• Wait
  The model file may take a few minutes to download during which time you'll see a progress bar in the Command Prompt window
• Verify
  
• Open Ollama by clicking the icon in the Windows System Tray
• Ensure llama3.2:3b is selected in the bottom-right dropdown
• Ask a question and hit Enter
  
  

Configuring Cost Centres

Ollama is configured on the Cost Centres form under the AI - Ollama page.

• Use Service
• Check the 'Use Service' checkbox and save the record
• Verify
• Click Verify
• If everything is working correctly, after a few seconds, you should see a summary

Now you can configure the Cost Centre to use Ollama. This is done from the General page.

• Default Services
• Select Ollama from the 'AI (Simple)' dropdown

finPOWER Connect is now configured to use Ollama for simple AI tasks such as summarising Document Manager files.