At a Glance
- Tasks: Implement data solutions and automate data provisioning for innovative projects.
- Company: Leading-edge tech company focused on AI and machine learning.
- Benefits: Flexible work environment, health benefits, and a collaborative team culture.
- Other info: Opportunity for continuous learning and career growth in a dynamic setting.
- Why this job: Join a passionate team and make a real impact in data engineering.
- Qualifications: Experience in data systems and proficiency in SQL, Python, and Java.
The predicted salary is between 36000 - 60000 £ per year.
Company Overview
Stream Systems (www.streamsystems.ca) is a leading-edge technology company that enables enterprises to optimize and make better decisions. Our SimOpti intelligence platform brings AI, machine learning and simulation to power business intelligence across complex operations, in any industry.
Position Summary
Reporting to the Software Development Manager, we are looking for a Data Developer experienced in continuous data process improvement across a range of data systems and subsystems. For this role, you will work closely with our data producers and consumers to enable Stream to automate data provisioning across data domains for multiple data use cases. Your data engineering expertise will implement data architectures, most importantly data mesh. Your ability to implement data technologies quickly and efficiently for any data layer is critical to our agile data flow.
What you’ll be doing
- Implement data ingestion and data integration solutions to support Stream’s simulation platform on AWS as part of a data mesh strategy.
- Manage and build ETL processes, extraction & integration of data from various data sources enabling a continuous data value stream.
- Oversee data quality monitoring, including processing, management and cleaning of data flows leveraged for analytics purposes while ensuring federated governance.
- Create custom data models for automated analysis, training machine learning, and enabling embedded BI reporting with row level security.
- Leverage best practices and best-in-class products and services to build cost-effective, scalable, and reliable data pipelines, data domains and data consumer APIs.
- Define and manage relational and distributed semi-structured NoSQL data warehouses and schemas that form the core of data mesh or fabric architectures.
- Translate data requirements into detailed designs and pipeline architecture, ensuring proper documentation of methodologies including deployable data services with a data mesh.
- Define best practices around data lineage, versioning, services deployment, extraction, modeling, consumption & governance at Stream.
Requirements
To ensure success in the role, you will need the following:
- Experience and formal qualifications in a STEM related discipline, such as Engineering or Computer Science, or certification and extensive work experience in a data centric development role with an understanding of how to implement data system architectures (distributed data mesh preferred).
- Experience designing and implementing data pipeline solutions accessing data from big data frameworks (AWS, GCP BigQuery) as well as hybrid architectures with on-premise data connectors (SQL Server, PostgreSQL, Historian, Timeseries).
- Data stack working proficiency in SQL, Python, Java, and API development utilizing GraphQL. Experience with messaging platforms like Kafka or RabbitMQ, data ingestion tools such as Airbyte, DBT, Databricks, MLflow an asset.
- Experience in data analytics engineering, orchestrating data pipelines, performance tuning, and script and test automation development.
- Experience architecting ETL solutions for a wide variety of sources, data abstractions, and data pipelines for real-time, streaming, batch, and on-demand workloads.
- Experience with data security strategies, configuring security for reporting, and certifications such as SOC 2.
Work environment/Hours/Location
This is a full-time position based on a 40-hour work week. We are driven by objectives, however, not timesheets. Stream’s head office is located in Calgary, Alberta with remote workers located across the country in British Columbia, Ontario, and Quebec. We are happy to provide a hybrid work environment, enabling you to work remotely as needed. We encourage a strong collaborative culture and provide workspaces in office for team collaboration, design, planning sessions and social activities.
Benefits
Company benefits are available to our full-time, permanent employees and include extended health care, dental, long-term disability, AD&D, and life insurance for you and your dependents. The real benefits, in our opinion exist in the ability to become part of a flexible, passionate, and dedicated team where we continue to learn from one another every day. If you love that small-company feel with big-company goals, Stream just might be a fit for you.
Come do great things with us!
testsdfsd in Manchester employer: Nessie
Stream Systems is an innovative technology company based in Calgary, Alberta, offering a dynamic work environment that fosters collaboration and continuous learning. With a strong emphasis on employee well-being, we provide comprehensive benefits including extended health care and life insurance, alongside a flexible hybrid work model that allows for remote work. Join our passionate team where you can grow your skills in data engineering while contributing to impactful projects in a supportive culture that values both individual and collective success.
StudySmarter Expert Advice🤫
We think this is how you could land testsdfsd in Manchester
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Prepare for interviews by practising common questions and showcasing your skills. We recommend doing mock interviews with friends or using online platforms to get comfortable with the process.
✨Tip Number 3
Don’t just apply blindly! Tailor your approach for each company. Research Stream Systems, understand their values, and align your skills with what they’re looking for. Show them you’re genuinely interested!
✨Tip Number 4
Apply through our website for the best chance of landing that dream job! It’s a direct line to us, and we love seeing candidates who take that extra step to connect.
We think you need these skills to ace testsdfsd in Manchester
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the Data Developer role. Highlight your experience with data architectures, especially data mesh, and any relevant technologies like AWS or SQL. We want to see how your skills align with what we’re looking for!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how your background makes you a great fit for Stream Systems. Let us know what excites you about our SimOpti platform!
Showcase Your Projects:If you've worked on any cool data projects, don’t hold back! Include links or descriptions of your work that demonstrate your ability to implement data pipelines or ETL solutions. We love seeing real-world applications of your skills.
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It helps us keep track of your application and ensures you get all the updates directly from us. Plus, it’s super easy!
How to prepare for a job interview at Nessie
✨Know Your Data Mesh
Make sure you understand the concept of data mesh and how it applies to the role. Brush up on your knowledge of distributed data architectures and be ready to discuss how you've implemented similar solutions in the past.
✨Showcase Your Technical Skills
Prepare to demonstrate your proficiency in SQL, Python, and Java. Have examples ready that highlight your experience with ETL processes and data pipeline solutions, especially those involving AWS or hybrid architectures.
✨Understand the Company Culture
Familiarise yourself with Stream Systems' collaborative culture and their approach to flexible work environments. Be prepared to discuss how you can contribute to this culture and work effectively in a hybrid setting.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's data strategies and future projects. This shows your genuine interest in the role and helps you gauge if the company aligns with your career goals.
