About this role
Senior Data Engineer role at Trust Wallet, remote, focused on building and scaling the data platform that powers analytics across the company. You will design, develop and maintain data pipelines and data models, collaborating with data analysts and engineering teams, using Databricks, Spark, dbt and Python to turn data into a strategic asset.
What you would do
- Architect and maintain Databricks-based data infrastructure for streaming and batch workloads.
- Design, develop and maintain Python and Spark data pipelines for ingestion and transformation from internal systems, external providers and on-chain sources.
- Design and maintain dimensional data models and transformation layers in dbt, with tests and documented contracts.
- Oversee data lake and lakehouse layers, ensuring storage efficiency, partitioning, data quality, and monitoring and alerting.
- Integrate Databricks with various data sources, including change data capture, APIs and blockchain data, and adapt data flows to business needs.
- Optimise pipelines and storage for performance, reliability and cost, and apply governance and security practices.
What they are asking for
- 3+ years as a Data Engineer with production pipelines and lakehouse or data warehouse architecture.
- Strong experience with Databricks, Delta Lake and Spark for streaming and batch processing.
- Solid understanding of dimensional modelling and data warehouse design, with ability to define the grain of models.
- Experience with dbt or an equivalent transformation framework for testing and lineage.
- Cloud fundamentals including IAM, object storage, networking and infrastructure as code; AWS is preferred; Azure or GCP experience is a plus.
- Proficiency in Python and SQL for production transformations and services.
Listing details are summarised from the source. Always confirm the role and the employer on the original posting before applying, and never pay to apply for a job.