At a Glance
- Tasks: Lead the design and build-out of innovative data services across multiple product lines.
- Company: Join Black Duck Software, a pioneer in application security and data solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and career advancement.
- Why this job: Make a real impact by enhancing data reliability and powering AI automation.
- Qualifications: Extensive experience in building production data platforms and strong SQL/Python skills.
The predicted salary is between 60000 - 80000 £ per year.
Black Duck Software, Inc. helps organizations build secure, high-quality software, minimizing risks while maximizing speed and productivity. Black Duck, a recognized pioneer in application security, provides SAST, SCA, and DAST solutions that enable teams to quickly find and fix vulnerabilities and defects in proprietary code, open source components, and application behaviour.
What you’ll do:
- Lead the design and build-out of cross-product data services for multiple product lines from one governed data plane.
- Define the “customer data plane” model: canonical customer identifiers, shared dimensions, and consistent facts used across products.
- Build and operationalize ingestion patterns for batch, streaming, and event data, with repeatable onboarding for new sources.
- Own the operational playbook for data reliability: data contracts, quality checks, lineage, monitoring, and incident response.
- Implement and run access methods that make data usable: curated datasets, secure query interfaces, and product-ready data APIs where needed.
- Productize customer-facing data products (datasets, metrics, exports, and feeds) with versioning, documentation, and clear ownership.
- Design data models that fit both operational systems (RDS) and analytics stores (columnar/OLAP), including performance and cost tuning.
- Ensure data products also power ML workflows: trusted training datasets, feature-ready outputs, and consistent definitions for decision-making.
- Enable AI automation by delivering reliable, low-latency, governed data products that can be used safely in automated workflows.
- Partner closely with product, engineering, and security stakeholders to align data products to roadmap priorities and customer outcomes.
- Raise the technical bar through architecture reviews, standards, and mentoring—while staying hands-on in key systems.
Required:
- Significant experience building and operating production data platforms at scale, including on-call and operational ownership.
- Strong SQL skills and strong Python skills, used to build pipelines, services, and automation.
- Hands-on experience running cloud systems on AWS and Google Cloud (IaaS level: compute, storage, networking, IAM).
- Practical experience with both operational databases (RDS-style) and analytics stores (columnar/OLAP), including performance tuning.
- Strong data modeling ability, including schema evolution, conformed dimensions, and “one source of truth” metric definitions.
- Track record of delivering data products that other teams or customers depend on, with clear contracts and reliability expectations.
- Ability to make sound engineering tradeoffs across latency, accuracy, cost, and security without creating brittle complexity.
- Experience with lakehouse patterns and open table formats (or similar), including governance and table maintenance.
- Experience with orchestration and streaming systems used in production (batch + real-time), and managing backfills safely.
- Familiarity with ML data needs (training/serving splits, feature-ready datasets, evaluation datasets) and AI-adjacent workflows.
Preferred:
- Experience building self-service data platforms (catalog, discoverability, access controls) used by multiple teams.
- Experience in regulated or security-sensitive environments, including retention, auditing, and data access controls.
Work model, location overlap with UK and US time zones. Travel: Minimal.
Principal Data Engineer in Belfast employer: Francisco Partners
Verifone is an exceptional employer that fosters a dynamic and inclusive work culture, where innovation and collaboration thrive. As a Senior DevOps Engineer, you'll have the opportunity to work with cutting-edge technologies in a role that not only encourages professional growth but also allows you to make a significant impact on global payment solutions. With a commitment to employee development and a focus on creating a diverse environment, Verifone stands out as a place where your contributions are valued and your career can flourish.
