Curated

(5/5)

Narrating over a Video using Multimodal AI

Try It Out! This n8n template takes a video and extracts frames from it which are used with a multimodal LLM to generate a script. The script is then passed to the same multimodal LLM to generate a voiceover clip. This template was inspired by [Processing and narrating a video with GPT's visual capabilities and the TTS API](https://cookbook.openai.com/examples/gptwithvisionforvideounderstanding) Video is downloaded using the HTTP node. Python code node is used to extract the frames using Open

Integrations Used (6)

Workflow Structure (14 nodes)

100%

Manual Trigger

When clicking ‘Test workflow’

Http Request

Download Video

Code

Capture Frames

Split Out

Split Out Frames

Split In Batches

For Every 15 Frames

Convert To File

Convert to Binary

Edit Image

Resize Frame

Aggregate

Aggregate Frames

Langchain.chain Llm

Generate Narration Script

Wait

Stay Within Service Limits

Aggregate

Combine Script

Langchain.open Ai

Use Text-to-Speech

Google Drive

Upload to GDrive

Langchain.lm Chat Open Ai

OpenAI Chat Model

Node Types:

default

code

logic

http

transform

trigger

action

Requires credentials

Prerequisites

Required Credentials (2)

Google Drive

Used by: Upload to GDrive

Docs

OpenAI

Used by: OpenAI Chat Model, Use Text-to-Speech

Docs

Complexity

Advanced

Expert level. Custom code, complex logic, many integrations.

Setup time: ~45 min

Score: 67/100

Custom Code

Loops

6 Integrations

When to Use This Workflow

AI-Powered Content Creation

Automate content generation, summarization, or analysis using AI capabilities.

Save hours of manual work while maintaining quality and consistency.

Real-time Response

React instantly when events happen - new orders, form submissions, or API calls.

Zero delay between trigger and action for time-sensitive workflows.

Error Reduction

Eliminate human error from routine processes with consistent automation.

Improve accuracy and reliability across your workflows.

workflow.json

{
  "meta": {
    "instanceId": "408f9fb9940c3cb18ffdef0e0150fe342d6e655c3a9fac21f0f644e8bedabcd9"
  },
  "nodes": [
    {
      "id": "6d16b5be-8f7b-49f2-8523-9b84c62f2759",
      "name": "OpenAI Chat Model",
      "type": "@n8n/n8n-nodes-langchain.lmChatOpenAi",
      "position": [
        1960,
        660
      ],
      "parameters": {
        "model": "gpt-4o-2024-08-06",
        "options": {}
      },
      "credentials": {
        "openAiApi": {
          "id": "8gccIjcuf3gvaoEr",
...