Chat with local LLMs using n8n and Ollama

Chat with local LLMs using n8n and Ollama This n8n workflow allows you to seamlessly interact with your self-hosted Large Language Models (LLMs) through a user-friendly chat interface. By connecting to Ollama, a powerful tool for managing local LLMs, you can send prompts and receive AI-generated responses directly within n8n. How it works 1. When chat message received: Captures the user's input from the chat interface. 2. Chat LLM Chain: Sends the input to the Ollama server and receives the AI-

Integrations Used (3)

Chat

Lmchatollama

Chainllm

Workflow Structure (3 nodes)

100%

Langchain.chat Trigger

When chat message received

Langchain.chain Llm

Chat LLM Chain

Langchain.lm Chat Ollama

Ollama Chat Model

Node Types:

trigger

default

Requires credentials

Prerequisites

Required Credentials (1)

Ollama

Used by: Ollama Chat Model

Docs

Complexity

Simple

Great for beginners. Few nodes, straightforward setup.

Setup time: ~15 min

Score: 10/100

When to Use This Workflow

AI-Powered Content Creation

Automate content generation, summarization, or analysis using AI capabilities.

Save hours of manual work while maintaining quality and consistency.

Real-time Response

React instantly when events happen - new orders, form submissions, or API calls.

Zero delay between trigger and action for time-sensitive workflows.

Error Reduction

Eliminate human error from routine processes with consistent automation.

Improve accuracy and reliability across your workflows.

workflow.json

{
  "id": "af8RV5b2TWB2LclA",
  "meta": {
    "instanceId": "95f2ab28b3dabb8da5d47aa5145b95fe3845f47b20d6343dd5256b6a28ba8fab",
    "templateCredsSetupCompleted": true
  },
  "name": "Chat with local LLMs using n8n and Ollama",
  "tags": [],
  "nodes": [
    {
      "id": "475385fa-28f3-45c4-bd1a-10dde79f74f2",
      "name": "When chat message received",
      "type": "@n8n/n8n-nodes-langchain.chatTrigger",
      "position": [
        700,
        460
      ],
      "webhookId": "ebdeba3f-6b4f-49f3-ba0a-8253dd226161",
      "parameters": {
        "options": {}
...