Senior Data Engineer
clera
Job description
About the role
A data and infrastructure team is looking for a Senior Data Engineer to build a platform that turns information from many sources into reliable, up-to-date company intelligence. You will own the platform end-to-end, from architecture and ingestion to production operations, so that downstream products get trusted data.
Key responsibilities
- Design and build a multi-source data platform for concurrent ingestion, event-driven processing and orchestrated batch workflows.
- Ingest data from APIs, webhooks, files and web scraping, with rate limits and robust failure handling.
- Orchestrate scheduled workflows and historical backfills with tools such as Airflow, Dagster or Prefect.
- Build messaging and task queue workflows with retries, dead-letter queues and controlled replay.
- Store original payloads in cloud object storage and transform data with dbt into raw, standardized and curated layers.
- Implement idempotent upserts, data contracts, automated validation, pipeline tests and monitoring for freshness and failures.
- Design and optimize PostgreSQL schemas and loading patterns, and integrate enrichment and LLM-based structured extraction.
Required profile
- At least 5 years building and operating production data platforms, with ownership from architecture through deployment and ongoing operations.
- Production experience with Google Cloud Platform, dbt and workflow orchestration tools such as Airflow, Dagster, Prefect or Temporal.
- Experience with event-driven systems, messaging or task queues, asynchronous processing and failure recovery.
- Startup or small-team experience is valuable; web scraping, entity resolution, data enrichment and LLM-based extraction are also useful.
Required skills
- Strong Python, including asynchronous HTTP and concurrent processing with asyncio, aiohttp or HTTPX.
- Strong SQL and PostgreSQL, including data modeling, query optimization and incremental loading.
What we offer
- Base salary of $80,000 to $120,000 USD annually.
- Remote position based in Latin America; visa sponsorship is not available.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Antigua and Barbuda.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 17 hours ago
Expires 1 month from now
11 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
clera