Ingestion Engineer

About the role

NewsMesh ingests thousands of feeds continuously and turns them into clean, structured articles that customers query in real time. You would own that pipeline end to end: the fetchers, the proxy layer, the dedup, and the observability that tells us the moment a source breaks or drifts. It is unglamorous, high-leverage work, and everything else we sell is built on it.

About NewsMesh

NewsMesh turns the world's news into clean, structured, real-time data. We ingest thousands of sources continuously, enrich every article with category, topics, people, and country relevance, and serve it through an API used by developers and, increasingly, by AI agents that discover and pay for it on their own. We are a small, senior team, and the work is measured by one thing: whether the data is right, current, and easy to use.

What you'll do

• Own and improve the Celery-based ingestion pipeline across thousands of changing sources
• Keep articles fresh, deduplicated, and correct as source count grows
• Harden fetching against blocks, rate limits, and feeds that quietly change shape
• Build the monitoring that catches a broken source in minutes, not days
• Own reliability: this pipeline runs continuously and customers notice when it stops

What we look for

• Strong backend engineering, fluent in Python and SQL
• Experience with high-volume ETL, queues, or distributed workers
• A real bias for correctness, and the instinct to measure before trusting
• Comfortable owning a system end to end, from fetch to stored record

Bonus points

• Worked with RSS, crawling, or document parsing at scale
• Experience with Celery, RabbitMQ, or similar task queues
• A history of hunting down the gnarly, intermittent data-quality bug

Compensation

Depending on experience, the expected pay range is $165K–$220K.

What we offer

• Competitive pay, in the range listed above
• Remote across the US
• Real ownership: you will ship work customers depend on
• A small, senior team with high standards and little process

How we hire

We read every application. If there is a fit, expect a short intro call, a practical exercise rooted in the kind of work you would actually do, and a few conversations with the people you would work with. A link to something you have built beats a resume.