RAG & Knowledge Basesfree

URL Officer - Respect robots.txt and Avoid Undesirable Sources

by HybrohtUpdated Aug 2026

RequiresMistralGroqGoogle Gemini

Postgres

1/5

FLOWS

STEPS · 1

Runs on a schedule

On a schedule, checks URLs against robots.txt, extracts data using Mistral, Groq, or Gemini, and stores results in Postgres.

Drive and MySQL RAG Agent

On a schedule, indexes Google Drive and MySQL data into Pinecone, then answers questions with a Gemini agent writing to Google Docs.

On a schedule, fetches App Store reviews, embeds them into Pinecone, and posts an OpenAI-generated summary to Slack.

On a schedule, answers clinic queries with a GPT-4o-mini agent using Pinecone RAG, logging to Google Sheets and Docs and sending Gmail alerts.