Senior Data Engineer (Golang)_RJ
Description
We are looking for Data Engineer/Golang.
Details:
Engagement: Full-time contract, 6 months to start, with a strong chance of extension
Fully remote
Monday to Friday, 8 hours a day, with overlap with the team’s core working hours
Start: as soon as possible
Tech stack
Go (orchestration), PostgreSQL with pgvector, embedding models served through Amazon Bedrock.
What you’ll do
Take over the current ingestion flow and document how it works: sources, transformations, weak points and failure scenarios
Automate ingestion, validation, deduplication and incremental updates, and turn onboarding of new data sources into a repeatable process
Build safe recovery mechanisms (retries, checkpoints, replay and backfill, quarantine) so that no data is lost or duplicated
Track record counts, metadata, source identifiers and data lineage; catch schema changes and run quality checks
Support the interfaces of the matching service and take part in improving
Skills
Sign in to read and join the discussion.