STEPS · 36
Starts on an incoming request
▶ Animate flow1 Webhook Entry → Set Variables Set Fields maps and normalizes fields for the next step 2 Set Variables → Cache Check Redis get 3 Cache Check → Check Cache Hit IF branches on a condition 4 Check Cache Hit → Return Cached Result Respond to Webhook returns the HTTP response to the caller 5 Check Cache Hit → Log Cache Hit Data Table append 6 Check Cache Hit → Rate Limit Check Code runs custom code on the items 7 Rate Limit Check → Multi-Step Reasoning Agent AI Agent runs the AI agent with its attached model, memory and tools 8 Multi-Step Reasoning Agent → Split Sub-Queries Split Out splits a list into individual items 9 Split Sub-Queries → Query Optimizer Agent AI Agent runs the AI agent with its attached model, memory and tools 10 Query Optimizer Agent → Multi-Source Search Agent AI Agent runs the AI agent with its attached model, memory and tools 11 Multi-Source Search Agent → Split URLs for Parallel Scraping Split Out splits a list into individual items 12 Split URLs for Parallel Scraping → Parallel Web Scraping HTTP Request POST https://api.brightdata.com/request 13 Parallel Web Scraping → Advanced Data Extraction & Analysis LLM Chain processes the incoming items 14 Advanced Data Extraction & Analysis → Source Validation Agent AI Agent runs the AI agent with its attached model, memory and tools 15 Source Validation Agent → Filter Valid Sources IF branches on a condition 16 Filter Valid Sources → Aggregate All Results Aggregate aggregates items into one 17 Aggregate All Results → Smart Summarizer with Context AI Agent runs the AI agent with its attached model, memory and tools 18 Smart Summarizer with Context → Store in Cache Redis set 19 Store in Cache → Prepare Outputs Set Fields maps and normalizes fields for the next step 20 Prepare Outputs → Respond to Webhook Respond to Webhook returns the HTTP response to the caller 21 Prepare Outputs → Send Slack Notification Slack posts a message 22 Prepare Outputs → Send Email Report Email sends an email — “={{ $json.emailSubject }}” 23 Prepare Outputs → Log to DataTable Data Table append 24 GPT-4o (Search) → Multi-Source Search Agent OpenAI Model provides the language model (gpt-4o) — attached as the language model. 25 GPT-4o (Reasoning) → Multi-Step Reasoning Agent OpenAI Model provides the language model (gpt-4o) — attached as the language model. 26 GPT-4o (Extraction) → Advanced Data Extraction & Analysis OpenAI Model provides the language model (gpt-4o) — attached as the language model. 27 GPT-4o (Summarizer) → Smart Summarizer with Context OpenAI Model provides the language model (gpt-4o) — attached as the language model. 28 Bright Data MCP Tool → Multi-Source Search Agent Mcp Client Tool processes the incoming items — attached as the tool. 29 Search Output Parser → Multi-Source Search Agent Output Parser parses the model output into structured data — attached as the output parser. 30 Summary Output Parser → Smart Summarizer with Context Output Parser parses the model output into structured data — attached as the output parser. 31 GPT-4o Mini (Optimizer) → Query Optimizer Agent OpenAI Model provides the language model (gpt-4o-mini) — attached as the language model. 32 Optimizer Output Parser → Query Optimizer Agent Output Parser parses the model output into structured data — attached as the output parser. 33 Reasoning Output Parser → Multi-Step Reasoning Agent Output Parser parses the model output into structured data — attached as the output parser. 34 Extraction Output Parser → Advanced Data Extraction & Analysis Output Parser parses the model output into structured data — attached as the output parser. 35 GPT-4o Mini (Validation) → Source Validation Agent OpenAI Model provides the language model (gpt-4o-mini) — attached as the language model. 36 Validation Output Parser → Source Validation Agent Output Parser parses the model output into structured data — attached as the output parser.
RedisOpenAISlack
Email (SMTP)
