Senior Software Engineer

Job Title: Senior Software Engineer – Data Engineering Location: UK, Ireland OR Israel About Us: We are a Series A-funded, fast-growing startup revolutionizing data-driven decision-making for platform and security teams in Fortune 500 companies. Our innovative solutions transform raw data into actionable insights that drive efficiency, improve security, and optimize operations. We are seeking a passionate Senior Software Engineer – Data Engineering to join our dynamic team and help us build world-class data platforms. Role Overview: As a Senior Software Engineer – Data Engineering, you will play a pivotal role in designing and implementing robust, scalable data systems that enable real-time processing and large-scale data transformation. You will collaborate with cross-functional teams to develop innovative solutions, optimize existing pipelines, and ensure data quality and integrity. This is an opportunity to work with cutting-edge technologies and directly influence our core platform, enhancing its capability to deliver actionable insights for enterprise clients. Responsibilities: Design, develop, and optimize large-scale data pipelines to process, transform, and manage high-volume datasets, ensuring reliability, scalability, and performance. Collaborate with product, engineering, and leadership teams to build data systems that align with business objectives and deliver actionable insights for clients. Implement and maintain real-time data streaming and batch processing solutions using tools like Kafka, Spark, and Airflow. Contribute to the development and maintenance of core SDKs and APIs, supporting the integration and utilization of our open-source data platform. Manage and enhance data storage and processing systems, including Snowflake, AWS S3, RDS, and Redshift, optimizing performance for analytical workloads. Ensure data quality and integrity through validation frameworks, automated testing, and monitoring pipelines. Mentor and guide junior team members, fostering best practices in software development and data engineering. Drive continuous improvements in development processes, deployment pipelines, and system monitoring to enhance team velocity and system reliability. Requirements: Experience: 6+ years of professional experience in software and data engineering, with a proven track record of building and maintaining scalable data systems. Programming Skills: Proficiency Go (Golang); experience with additional languages like Python/Java or Scala is a plus. Data Processing: Expertise in real-time data streaming (Kafka) and batch processing frameworks (Spark, Airflow). Data Warehousing: Hands-on experience with Snowflake, Redshift, or similar cloud-based data warehouses. Cloud Technologies: Strong experience with AWS (Lambda, S3, RDS, Redshift, Athena) or other major cloud providers (GCP, Azure). Database Expertise: Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, MongoDB). Development Practices: Familiarity with CI/CD, version control (Git), and infrastructure as code (Terraform, Kubernetes). Problem-Solving: Strong analytical and debugging skills, with the ability to optimize system performance and troubleshoot complex issues. Communication: Excellent written and verbal communication skills, with the ability to document processes clearly and collaborate across teams. Adaptability: Self-motivated and resourceful, with the ability to thrive in a fast-paced, dynamic environment. Preferred Qualifications: Worked in a lean/agile team or startup (You will be the only data focused engineer) Experience contributing to or managing open-source projects. Familiarity with machine learning workflows and data preprocessing for ML models. Experience with tools like Snowplow, DBT, or other modern data stack components. Knowledge of asset inventory management systems or related domains. What We Offer: Competitive salary and equity options. Opportunity to work with cutting-edge technologies and make a significant impact on our core platform. Flexible working hours and a remote-first environment. Professional growth opportunities, including mentorship and access to industry-leading tools and resources. Collaborative, inclusive company culture with a focus on innovation and employee well-being.