Senior Data Engineer in Glasgow

Senior Data Engineer at Fsp.

About the role Fsp is seeking a highly skilled Senior Data Engineer to join our dynamic team. This position is ideal for someone with a strong background in data engineering who is eager to tackle complex data challenges and contribute to innovative solutions. You will play a crucial role in designing and implementing data pipelines, ensuring data quality, and supporting data-driven decision-making across the organization. The successful candidate will work closely with cross-functional teams to enhance our data infrastructure and deliver impactful insights.

Key facts

Location: Glasgow or Newbury / Reading, Berkshire Engagement: Full-time

What you'll do

• Design, develop, and maintain robust data pipelines that facilitate the collection, storage, and processing of large datasets from various sources.
• Collaborate with data scientists and analysts to understand their data needs and provide them with the necessary tools and infrastructure.
• Implement data quality checks and monitoring systems to ensure the accuracy and reliability of data.
• Optimize existing data processes for performance and scalability, identifying areas for improvement and implementing best practices.
• Work with cloud-based data solutions, leveraging platforms such as AWS, Azure, or Google Cloud to enhance data accessibility and security.
• Participate in the architecture and design of data models that support analytical and operational needs.
• Develop and maintain documentation for data pipelines, processes, and systems to ensure knowledge sharing and compliance.
• Assist in troubleshooting and resolving data-related issues, providing timely support to stakeholders.
• Stay updated on industry trends and emerging technologies in data engineering, recommending new tools and methodologies to improve our data capabilities.
• Mentor junior data engineers, providing guidance and support in their professional development.
• Engage in agile development practices, participating in sprint planning, reviews, and retrospectives to continuously improve team performance.
• Contribute to the establishment of data governance policies and best practices within the organization.

Requirements

• A minimum of 5 years of experience in data engineering or a related field.
• Proficiency in programming languages such as Python, Java, or Scala, with a strong understanding of data structures and algorithms.
• Extensive experience with ETL processes and tools, including data ingestion, transformation, and loading techniques.
• Familiarity with SQL and NoSQL databases, with the ability to write complex queries and optimize database performance.
• Experience with cloud platforms (AWS, Azure, or Google Cloud) and their data services, such as Redshift, BigQuery, or Azure Data Lake.
• Strong understanding of data warehousing concepts and experience with data modeling techniques.
• Knowledge of data governance and compliance standards, ensuring data security and privacy.
• Excellent problem-solving skills and the ability to work independently as well as collaboratively in a team environment.
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Nice to have

• Experience with big data technologies such as Hadoop, Spark, or Kafka.
• Familiarity with machine learning frameworks and tools, enabling collaboration with data science teams.
• Knowledge of data visualization tools such as Tableau or Power BI, enhancing data presentation and storytelling capabilities.
• Experience in DevOps practices, including CI/CD pipelines for data applications.
• Understanding of containerization technologies such as Docker or Kubernetes, facilitating scalable data solutions.

Skills & tools

• Programming languages: Python, Java, Scala
• Databases: SQL, NoSQL, Redshift, BigQuery, Azure Data Lake
• Cloud platforms: AWS, Azure, Google Cloud
• Data processing frameworks: Hadoop, Spark
• ETL tools: Apache NiFi, Talend, or similar
• Data visualization: Tableau, Power BI

Practical notes

• This position is based in either Glasgow or Newbury / Reading, Berkshire, providing flexibility for the right candidate.
• The salary for this role is competitive and commensurate with experience, reflecting the importance of this position within our organization.
• Fsp is committed to fostering a diverse and inclusive work environment, and we welcome applications from all qualified individuals.
• Visa sponsorship may be available for the right candidate, depending on their qualifications and experience.

Join Fsp as a Senior Data Engineer and be part of a team that values innovation, collaboration, and excellence in data engineering.

If you are passionate about leveraging data to drive business success and meet the challenges of a rapidly evolving industry,