Building a multi-source ingestion pipeline with Ray (thehyperplane.substack.com)

The odd thing is that the solution with llamaindex or something else of that type would probably wind up being more code.