Senior Data Engineer

At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. We’re proud to share our story and Make Amazing Happen at CDW.

DEPARTMENT: Enterprise Data

LOCATION: One New Change, London, EC4M 9AF

SHIFT PATTERN: Monday to Friday, 09:00-17:30 - Hybrid working (3 days in Office per week)

RESPONSIBLE FOR: Leading (and carrying out) Data Engineering activities for and not limited to the Data Platforms and Services.

BACKGROUND: CDW is a leading technology solutions provider to business, government, education and healthcare organisations in the United Kingdom, Canada, and the United States. Our relationships are fuelled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same.

KEY DUTIES: CDW is constantly evolving our Data and technology landscape and are looking for a Senior Data Engineer to join a growing team to ingest, cleanse and model data into single source of truth, Kimball datasets, used for Business Intelligence reporting, ML, DS & AI and more. A Senior Data Engineer to manage, lead, guide, advice and develop technology and people. Responsible to lead the work, activities, oversight and management of Data Engineers reporting into this role.

• Design and develop homogenous data repositories to deliver data led decision making.
• Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc.
• Define and apply cleansing rules to the data to ensure meets quality expectations.
• Define and model data for its appropriate use including into single source of truth Kimball datasets, e.g. dimensions and facts.
• DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, repositories, CI/CD, peer reviews, etc.
• Drive and Integrate into the data team’s WOW, including backlog refinement, sprint planning, demonstrations, and retrospectives.
• Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc.
• Ownership of Work Items and works with data owners / stewards to ensure high quality, aligned deliveries, and compliance with legislation, such as GDPR.
• Support all data platforms and ensure its smooth running.

KNOWLEDGE AND EXPERIENCE:

Must Have:

• At least 7 years as an Engineer in a Data Field
• Strong Azure data skills, including: Azure Data Factory V2, Azure Data Lake Storage V2, Azure Databricks, Azure Function Apps & Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell)
• Strong PySpark, Delta Lake, Unity Catalog and Python skills.
• Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc.
• Strong repositories, CI/CD skills.
• Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc.
• Strong SQL skills.
• Strong data analysis skills.
• Excellent written and verbal communication skills.
• A demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.
• A passion for technology and its ability to have a positive impact on business.

Nice To Have:

• Azure DevOps (git, multistage YAML, etc.)
• Other languages, such as C#, PowerShell
• Test driven development (TDD)
• Streaming technologies, such as Azure Stream Analytics, Spark Structured Streaming, etc.
• Power BI Engineering experience
• Certified SCRUM Developer (CSD)
• Data Governance tool experience e.g. Purview
• Machine learning and Artificial intelligence

CDW is committed to being an AI-fluent organization. We’re looking for people who bring curiosity, a learner’s mindset, and a willingness to engage with ever-evolving technology and tools.

Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications.

About Us: CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what’s possible through technology. At CDW we act as one—building trust, speaking candidly, and working together to achieve more.

CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.