Data Ingestion Pipeline Builder And Database Architect
Client - North America, 🇺🇸 USA, New York
The job entails building a data ingestion pipeline for processing a historical archive of 25,000 mixed-format files, populating a database accurately, and handling complex data relationships. Key responsibilities include scripting batch processing, LLM extraction and normalization, database architecture setup, error handling, and rate limiting. Required expertise in LlamaParse, Anthropic API, Supabase, PostgreSQL, Model Context Protocol (MCP), and JSON schema enforcement. Applicants must demonstrate practical, scalable execution skills.