Skip to content
FlowHub
FluxonLab
W
AI Writing & Generationfree

Process Multiple Prompts in Parallel with Azure OpenAI Batch API

by Greg EvseevUpdated Aug 2026
Share Post Share
EWWhen Executed by Another WorkflowWhen Executed b…CoParse responseIfIf ended processingIf ended proces…WaBatch Status Poll IntervalBatch Status Po…MaRun exampleSeOne query exampleOne query examp…SeDelete original propertiesDelete original…AgConstruct 'requests' arrayConstruct 'requ…CoBuild batch 'request' object for single queryBuild batch 're…MBSimple Memory StoreSimple Memory S…MMFill Chat Memory with example dataFill Chat Memor…CoBuild batch 'request' object from Chat Memory and execution dataBuild batch 're…MMLoad Chat Memory DataLoad Chat Memor…EDFirst Prompt ResultFirst Prompt Re…EDSecond Prompt ResultSecond Prompt R…SOSplit Out Parsed ResultsSplit Out Parse…FiFilter Second Prompt ResultsFilter Second P…FiFilter First Prompt ResultsFilter First Pr…MeJoin two example requests into arrayJoin two exampl…MMTruncate Chat MemoryTruncate Chat M…CoJSON requests to JSONLJSON requests t…CoChange file name and mimetypeChange file nam…IfIf upload processedIf upload proce…WaFile Upload Poll IntervalFile Upload Pol…HRTrack file upload statusTrack file uplo…HRCreate batch jobHRTrack batch job progressTrack batch job…HRRetrieve batch job output fileRetrieve batch …SeSet desired 'api-version'Set desired 'ap…MeMerge File and API VersionMerge File and …SeRemove original requestsRemove original…CTConvert requests jsonl to FileConvert request…SeAppend custom_id for single query exampleAppend custom_i…SeAppend custom_id for chat memory exampleAppend custom_i…SeSetup defaultsCoSet defaults if not set alreadySet defaults if…EWExecute Workflow 'Process Multiple Prompts in Parallel with Azure OpenAI Batch API'Execute Workflo…HRUpload batch fileUpload batch fi…123456789101112131415161718192021
1/5
FLOWS
STEPS · 21
Called by another workflow

When called, submits multiple prompts to the Azure OpenAI Batch API via HTTP, polls until complete, and aggregates the results.

Tags

eventadvancedEngineeringMultimodal AIdiscoveredpending-review
CategoryAI Writing & Generation
Triggerevent
Complexityadvanced
Nodes38
AddedJun 27, 2026