This workflow is a highly advanced multimodal AI assistant designed to operate through WhatsApp. It can understand and respond to text, images, voice messages, and PDF documents by combining OpenAI models with smart logic to adapt to the content received. 🎯 Core Features 📥 1. Automatic Message Type Detection Using the Input type node, the bot detects whether the user has sent: Text Voice messages Images Files (PDF) Other unsupported content 💬 2. Smart Text Message Handling Text messages are processed by an OpenAI GPT-4o-mini agent with a customized system prompt. Replies are concise, accurate, and formatted for mobile readability. 🖼️ 3. Image Analysis & Description Images are downloaded, converted to base64, and analyzed by an image-aware AI model. The output is a rich, structured description, designed for visually impaired users or visual content interpretation. 🎙️ 4. Voice Message Transcription & Reply Audio messages are downloaded and transcribed using OpenAI Whisper. The transcribed text is analyzed and answered by the AI. Optionally, the AI reply can be converted back to voice using OpenAI's text-to-speech, and sent as an audio message. 📄 5.
Tags
Related workflows
See all AI Automation→Run a voice-enabled AI assistant on Telegram with OpenAI, Gmail and Notion
Quick overview This workflow turns a Telegram bot into a personal assistant that handles text and voice messages using OpenAI, can read Gmail and Google Calendar, looks up tasks and contacts in Notion, and can draft and send emails with a required approval step in Telegram. How it works Triggers when a new Telegram message is received by your bot. Detects whether the message is a voice note or text, and if it is voice, downloads it from Telegram and transcribes it with OpenAI. Sends the resulting user text to an OpenAI-powered agent that keeps a short conversation memory per chat. When needed, the agent fetches recent emails from Gmail, lists upcoming events from Google Calendar, and pulls tasks or contacts from Notion to answer the request. If the agent decides to send an email, it asks for approval in Telegram and only proceeds after you approve within the time limit. Sends the assistant’s final response back to the same Telegram chat. Setup Create a Telegram bot with @BotFather, add the Telegram credentials in n8n, and use the workflow’s Telegram trigger to connect the bot. Add an OpenAI API credential for both chat responses and voice transcription, and set your preferred model
Handle WhatsApp support chats with OpenRouter, Pinecone, and Gemini
Quick overview This template implements a WhatsApp support suite that logs inbound events to a dashboard API, routes conversations through an OpenRouter-powered AI agent with Pinecone RAG and memory, exposes a webhook for human outbound replies, and provides a webhook to summarize recent chats for handoff. How it works Triggers on WhatsApp Cloud API events and routes status updates (sent/delivered/read) to a dashboard API endpoint for storage. For inbound messages, looks up the contact in the dashboard API and normalizes the message into a consistent schema (sender, type, timestamp, and best-effort content). If the message contains media (image/video/audio/document), fetches the WhatsApp media URL, downloads the file, uploads it to the dashboard’s media endpoint, and attaches the resulting media URL and MIME type. Stores inbound messages and reactions in the dashboard API, then checks via the cases endpoint whether the sender already has an open case. If the inbound message is text and no open case is found, queries Pinecone as a tool (using Google Gemini embeddings), uses an OpenRouter chat model with conversation memory to draft a reply or create a new case via the dashboard API,
Create AI product video ad Shorts from Telegram photos with OpenAI and AtlasCloud
Quick overview This workflow takes a product photo sent via Telegram, uses OpenAI Vision to describe it and OpenAI to write a short-form video ad prompt, generates a vertical video via AtlasCloud, then (after two approvals in Telegram) publishes the Short to YouTube via Blotato. How it works Triggers when a user sends a product photo (optionally with a caption/campaign) to a Telegram bot. Downloads the image from Telegram and uses OpenAI Vision to extract an advertising-focused product description. Uses OpenAI to generate a single cinematic text-to-video prompt plus a YouTube Shorts title and description. Sends the proposed prompt to Telegram and waits for your approval before proceeding. If approved, requests video generation from AtlasCloud and polls the render status until the video is completed. Sends the generated video back to Telegram for preview and waits for a second approval to publish. If approved, publishes the video to YouTube as an unlisted Short via Blotato and notifies you in Telegram (otherwise it stops and sends a decline message). Setup Create and connect a Telegram bot credential, then start a chat with the bot so it can receive photos and send approval prompts.