Senior Data Engineer

As a Senior Data Engineer, you will be responsible for architecting, implementing, and leading the development of our next-generation data platform. You will work across multiple workstreams to establish the standardised data integration framework, implement our core iGaming data model, and build efficient transformation processes that will form the foundation of our advanced analytics and recommendation engine.

Key Responsibilities

• Design and implement efficient data pipelines for batch, streaming, and real-time data processing.
• Build and maintain ETL/ELT processes using dbt, AWS services, and other modern data tools.
• Develop connectors for various iGaming platforms and data sources.
• Implement streaming data processing for real-time events using Kafka and related technologies.
• Create data validation processes to ensure data quality and integrity.
• Optimise pipeline performance and resource utilisation.

Data Modeling & Transformation

• Implement dimensional data models following best practices and team standards.
• Develop standardised transformations for iGaming data domains (player data, gameplay, financials).
• Create reusable transformation components and testing frameworks in dbt.
• Design efficient schema structures optimised for analytical workloads.
• Implement incremental processing strategies for high-volume data.
• Document data models and transformations thoroughly.

Data Quality & Governance

• Implement comprehensive data quality validation at ingestion and transformation stages.
• Develop automated data quality checks and monitoring solutions.
• Build reconciliation processes to ensure data consistency across systems.
• Implement data lineage tracking for key data elements.
• Support data governance initiatives by implementing metadata management.
• Create data quality metrics and dashboards for continuous monitoring.

Infrastructure & DevOps

• Implement infrastructure-as-code for data platform components.
• Build CI/CD pipelines for data transformation code and infrastructure.
• Configure and optimise database resources for performance and cost.
• Implement proper security controls and multi-tenant isolation.
• Contribute to monitoring and observability solutions.
• Troubleshoot and resolve complex data infrastructure issues.

Client Implementation Support

• Adapt standard pipelines for client-specific requirements.
• Assist with data migration and integration for new clients.
• Support UAT and validation of client implementations.
• Develop and document client-specific data transformations.
• Help optimise client-specific performance issues.
• Support production deployments and provide technical guidance.

Required Qualifications

Technical Skills

• 5+ years of experience in data engineering roles.
• Strong proficiency with SQL and data modelling concepts.
• Experience with dbt or similar transformation frameworks.
• Hands-on experience with AWS data services (Redshift, S3, Glue, Lambda).
• Proficiency with Python for data processing and pipeline development.
• Experience with workflow orchestration tools like Airflow or similar.
• Knowledge of streaming data technologies such as Kafka.
• Familiarity with infrastructure-as-code tools (Terraform, CloudFormation).
• Experience with version control systems (Git) and CI/CD practices.
• Understanding of data quality best practices and implementation.

Domain Knowledge

• Experience working with high-volume data pipelines.
• Understanding of dimensional modelling for analytics.
• Familiarity with multi-tenant data architecture.
• Experience with real-time data processing.
• Knowledge of data governance principles.
• Experience with clickstream or event data is a plus.
• Familiarity with iGaming or similar transactional platforms is a plus.

Professional Skills

• Strong analytical and problem-solving abilities.
• Excellent communication skills with both technical and non-technical stakeholders.
• Ability to work effectively in an agile, collaborative environment.
• Keen attention to detail and commitment to code quality.
• Self-motivated with the ability to work independently when needed.
• Willingness to mentor junior team members.
• Experience working in cross-functional teams.

What We Offer

• Opportunity to shape the architecture of a cutting-edge data platform in the iGaming industry.
• Competitive salary and benefits package.
• Collaborative, innovative work environment with the latest tools and technologies.
• Professional growth opportunities and continuous learning.
• Remote-friendly work arrangements with flexible hours.

If you're passionate about building innovative data platforms that drive real business value and are excited about tackling complex technical challenges in a fast-growing industry, we want to hear from you!