Lead Big Data Engineer - Contract

Your Opportunity to Define Possible. Our Opportunity to Deliver the Nation’s Security. Together.

Role clearance type: Must already hold highest level of government clearance.

Location: London

About Your Opportunity: As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes. On-site presence required a minimum of 4 days per week.

Your Benefits:

• Flexible working schedules - we offer flexible and hybrid working arrangements. Talk to us at the application stage about any scheduling preferences you may have.
• Flexible Benefits Package – choose which NGUKL benefits you want to satisfy your personal needs. Core Benefits provided for you are Healthcare, Dental, Life Assurance and Pension. Benefits you can flex include Critical Illness Cover, Health Cash Plan, and Health Assessments.
• Employee Incentive Programme – exceptional performance is recognized through our annual incentive programme which is awarded to top performers who excel.
• Career Development – opportunity for ongoing professional development and career growth opportunities.

Your Responsibilities:

• Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
• Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
• Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
• Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
• Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
• Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
• Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy.
• Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively.
• Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
• Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing.
• BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.

Your Experience:

• Proven experience in scripting languages such as Python, Bash, or similar.
• Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
• Experience with integration testing and ensuring seamless tool integration.
• In-depth knowledge of Linux internals and system administration.
• Understanding of TCP/IP and OSI models.
• Hands-on experience with data pipeline tools like NiFi and Airflow.
• Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
• Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
• Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
• Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
• Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
• Excellent communication and collaboration skills.

Preferred Experience:

• Certification in AWS or other cloud platforms.
• Experience with additional data orchestration tools.
• Familiarity with other big data tools and technologies (Hadoop, Cloudera).
• Previous experience in a similar role within a dynamic and fast-paced environment.

Your Future Team: The teams in this space work on some of the toughest challenges that are key to our client’s success, as such they carry a heavy load and require the ability to be able to dip in and share the workload. Success in this area requires flexibility in tasking, adapting to the problem at hand and picking up the skills along the way. This work is predominantly on client site and will vary between integrating with development and test teams, as well as taking on standalone tasks when needed. We believe that creating a team that values diversity and fosters inclusion is essential to great performance. We know the best ideas come from diversity of thought, background, perspective, culture, gender, race, age and many other elements. We welcome candidates from all backgrounds and particularly from communities currently under-represented within our industry. We treat everyone with respect and foster safe and inclusive environments.

About Our Responsibilities: Our customers operate in unique environments which offer new and exciting challenges every day, cultivating a place where you can learn and thrive, working alongside the best minds in industry. We’ll give you space to develop your career, where your ideas can shape the future of our dynamic business. We promote collaboration to achieve more than we could imagine, together. And within a respectful and inspirational environment, we value what you say and do.

How to Apply: Interested in our opportunity? Yes – then simply submit your application online. Your application will be reviewed by one of our expert recruiters who’ll then respond advising you of the outcome and next steps for successful candidates. Possibly, I’d like to find out more – then connect direct with, where one of our recruitment business partners will be happy to support you with any enquiries. Background checks and potentially security clearance form part of the recruitment process, our team will inform you of the procedures when required.

Northrop Grumman UK: Work with a global brand that makes a real contribution to our nation’s security and future. At Northrop Grumman UK, the brightest minds come together to push the boundaries and Define Possible. As leaders in the digital transformation of Aerospace, Defence and Intelligence we are providing ground-breaking outcomes for our customers.

UK Cyber & Intelligence Business: Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.