At a Glance
- Tasks: Design and develop scalable data solutions using Azure Databricks.
- Company: Join a global tech organisation delivering cloud data platforms.
- Benefits: £425/day, fully remote, long-term contract, immediate interviews.
- Other info: Work independently in a dynamic, technical team environment.
- Why this job: Tackle complex challenges and make an impact in cloud data engineering.
- Qualifications: Strong Python, PySpark, and Azure Databricks experience required.
The predicted salary is between 60000 - 80000 £ per year.
- Senior Python / Py Spark Data Engineer (Azure Databricks)
- Remote (UK)
- Outside IR35
- Long-Term Contract
About the Role
We're partnering with a global technology organisation delivering enterprise-scale cloud data platforms for major international clients.
We're looking for an experienced
Senior Python / Py Spark Data Engineer to join an established Azure Data Engineering team, working on the design, development and optimisation of scalable data solutions within Azure Databricks.
This is a hands-on engineering role suited to someone who enjoys solving complex technical challenges, writing high-quality code and taking ownership of technical delivery.
Key Responsibilities
- Design and develop data solutions using Azure Databricks.
- Build scalable data pipelines with Python and Py Spark.
- Develop batch and streaming data processing solutions.
- Analyse complex datasets and build efficient data models.
- Deliver robust, production-ready ETL/ELT pipelines.
- Collaborate with other engineers to deliver high-quality cloud data solutions.
Essential Skills
- Strong commercial experience with Azure Databricks.
- Excellent Python and Py Spark skills.
- Strong SQL and core Data Engineering experience.
- Experience building enterprise-scale data pipelines.
- Experience with batch and streaming data processing.
- Understanding of Unity Catalog and core Databricks functionality.
Desirable
- Azure Dev Ops.
- CI/CD pipelines.
- Infrastructure as Code.
- Experience working within enterprise Azure environments.
What We're Looking For
We're looking for engineers who
- Have strong technical and problem-solving skills.
- Can work independently with minimal supervision.
- Produce clean, maintainable, production-quality code.
- Enjoy working in highly technical engineering teams.
- Take ownership and pride in delivering high-quality solutions.
- Technology Stack
Azure Databricks • Python • Py Spark • SQL • Azure Data Lake • Unity Catalog • Databricks Jobs • Batch & Streaming Processing • Git • Azure Dev Ops
- What's on Offer
- Outside IR35.
- Fully remote within the UK.
- Long-term contract.
- Immediate interview process.
Opportunity to work on large-scale cloud data engineering programmes.
Interested?
- If you're an experienced
- Python / Py Spark Data Engineer with strong
- Azure Databricks experience and you're looking for your next
Outside IR35 contract, we'd love to hear from you.
Apply today or send your CV for a confidential discussion. We're reviewing applications as they come in, with interviews taking place on a rolling basis.
Senior Python / PySpark Data Engineer (Azure Databricks) in Cardiff employer: Venturi
As an Azure Integrations Engineer in Manchester, you'll be part of a dynamic team driving a significant technology transformation. Our company fosters a collaborative work culture that values innovation and professional growth, offering hybrid working arrangements to ensure a healthy work-life balance. With opportunities for continuous learning and development, you will play a crucial role in shaping modern cloud-native integrations while enjoying the benefits of working in a vibrant city known for its rich culture and community spirit.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Python / PySpark Data Engineer (Azure Databricks) in Cardiff
✨Showcase Your Skills with a Public Portfolio
As a freelancer in data science, having a killer portfolio is essential. Showcase your projects on platforms like GitHub or create a personal website that details your work and techniques. This gives potential clients a clear picture of what you can do and helps you stand out from the competition.
✨Get Involved in Data Science Communities
Tap into online forums like Kaggle or Stack Overflow. Not only can you showcase your expertise, but you can also connect with other data scientists and potential clients. Plus, participating in competitions and discussions can elevate your profile in the field.
✨Leverage Local Networking Opportunities
Keep an eye out for local data science meetups or tech events in your area. These are golden opportunities to meet potential clients and collaborators face-to-face. Plus, who doesn't love a bit of networking over pizza and drinks?
✨Pitch Your Services Directly to Companies
Don't just wait for freelancing platforms to bring clients to you—be proactive! Research companies that could benefit from data science services and craft tailored pitches. Mention specific pain points you can address for them. Let’s get that freelance hustle going!
We think you need these skills to ace Senior Python / PySpark Data Engineer (Azure Databricks) in Cardiff
Some tips for your application 🫡
Showcase Your Projects:When applying for a freelance data science role like Senior Python / PySpark Data Engineer (Azure Databricks) at Venturi, it’s crucial to highlight your projects. Include a portfolio that features at least two or three projects involving data analysis, machine learning, or visualisation. Make sure to describe the tools and methodologies you used, so we can see your skills in action!
Quantify Your Achievements:Freelance gigs, especially in data science, often ask for proven results. In your CV, include any relevant metrics or outcomes from your previous work. Did your analysis help reduce costs by a certain percentage? Or did your predictive model improve performance? Numbers speak volumes!
Introduce Your Style:Since freelancing is all about your individual style and approach, use your cover letter to share how you tackle data problems. This is your chance to let us know how you think, your creative problem-solving methods, and how you would approach a project at Venturi.
Be Real About Your Rates:When you send in your application, don’t forget to mention your freelance rates and availability. We appreciate clarity up front, and it helps us gauge if you fit within our budget and timeline. Being transparent in this aspect shows professionalism and readiness!
How to prepare for a job interview at Venturi
✨Show Off Your Data Wizardry
As a freelancer in data science, you'll want to present a portfolio that showcases your best projects. We should pull together examples where you tackled real problems with data analytics, machine learning models, or visualisations. It's all about demonstrating your skills in action!
✨Be Ready to Dive Deep into Technical Questions
Expect to encounter some technical grilling during the interview. Prepare to discuss statistical methods, algorithms, or maybe even tackle a live coding challenge. We should brush up on tools like Python, R, or SQL—those are key players in the data science field. Don't just know them; be ready to explain your thought process!
✨Help Them Understand Your Work Style
Freelance gigs often mean you'll be working independently, so we need to convey our self-motivation and time management skills. Be prepared to talk about how you’ve handled multiple projects or met tight deadlines before. Sharing your approach to client communication can also give them confidence in your ability to deliver remotely.
✨Pitch Your Value Proposition
When freelancing, it’s crucial to clearly articulate what makes you unique. We should highlight not just technical skills but also the business impact of our projects. Think of a couple of stories where your data insights drove decision-making—this can be a game changer in showing why they should choose you for their freelance needs!
