At a Glance
- Tasks: Architect and optimise data pipelines for B2B services and financial initiatives.
- Company: Leading tech firm focused on innovative data solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on cutting-edge technologies.
- Why this job: Join a dynamic team and make a significant impact on financial data systems.
- Qualifications: Bachelor's degree in Computer Science and extensive Data Engineering experience required.
The predicted salary is between 63000 - 77000 £ per year.
- Data Engineer
- Sr AWS Data Engineer, Malvern, PA, US
- Data Engineer
Medallion Architecture. Infrastructure
Cloud Formation/Terraform, CI/CD with Git Hub Actions.
Core
Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.
Qualifications
Bachelor’s degree in Computer Science or related field.
- Strong hands-on experience with Apache Spark and Glue.
- Proven ability to work with Python-based data pipelines.
- Experience with Git and Git Hub Actions is mandatory.
- Required Qualifications
Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
- 7+ years of enterprise Data Engineering experience. Strong Python development experience. Advanced SQL programming skills.
- Extensive experience with Apache Spark and Py Spark.
- Hands-on experience with AWS data services including: S3 AWS Glue Athena Lambda Step Functions Event Bridge Experience building enterprise ETL and ELT pipelines.
- Strong understanding of distributed data processing.
- Experience working with large-scale cloud data platforms. Strong knowledge of dimensional data modeling.
- Experience implementing CI/CD pipelines. Familiarity with Agile/Scrum methodologies.
- Excellent communication and stakeholder management skills.
- Preferred Qualifications
- Financial Services or Asset Management industry experience.
- Experience with Snowflake or Databricks.
- Knowledge of Apache Iceberg, Delta Lake, or Hudi.
- Experience with Airflow. Knowledge of Kafka or Kinesis streaming.
- Experience supporting AI/ML and advanced analytics platforms. AWS Professional or Specialty Certifications.
- Job Responsibilities
- We are seeking high-caliber Data Engineers to drive the B2B Service Experience and Financials initiatives.
- In this pivotal role, you will architect, implement, and optimize sophisticated data pipelines, partnering with business analysts to guarantee the seamless availability and absolute integrity of data powering our core financial engines and reporting ecosystems.
- #J-18808-Ljbffr
Senior Data Engineer: AWS & Spark Pipelines in Malvern employer: Intellibee Inc
As a Microsoft 365 Copilot Engineer at our Malvern, PA location, you will join a forward-thinking team that prioritises innovation and collaboration. We offer a dynamic work culture that fosters continuous learning and professional growth, alongside competitive benefits that support your well-being. Our commitment to leveraging cutting-edge technology ensures that you will play a pivotal role in enhancing productivity and creativity across the organisation, making this an exciting opportunity for meaningful and rewarding employment.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Data Engineer: AWS & Spark Pipelines in Malvern
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Intellibee Inc!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Data Engineer: AWS & Spark Pipelines at Intellibee Inc.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Intellibee Inc.
✨Apply Directly through Our Website
When you find a suitable opening like Senior Data Engineer: AWS & Spark Pipelines at Intellibee Inc, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Senior Data Engineer: AWS & Spark Pipelines in Malvern
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Intellibee Inc, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Intellibee Inc. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Intellibee Inc
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Intellibee Inc!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
