At a Glance
- Tasks: Design and build web crawlers to acquire high-quality data for AI model training.
- Company: Join a pioneering team at Poolside, shaping the future of Artificial General Intelligence.
- Benefits: Remote work, competitive salary, and a supportive, collaborative culture.
- Other info: Dynamic environment with opportunities for growth and innovation.
- Why this job: Be at the forefront of AI development and make a real impact on technology.
- Qualifications: Experience in data acquisition, web crawling, and strong problem-solving skills.
The predicted salary is between 60000 - 80000 £ per year.
ABOUT POOLSIDE
In this decade, the world will create Artificial General Intelligence. There will only be a small number of companies who will achieve this. Their ability to stack advantages and pull ahead will define the winners. These companies will move faster than anyone else. They will attract the world's most capable talent. They will be on the forefront of applied research, engineering, infrastructure and deployment at scale. They will continue to scale their training to larger to balance this intensity, we’ve assembled a team of low ego and kind-hearted individuals who have built the special culture Poolside has. By building collaboratively and with intention, we create a compounding effect that moves the entire company forward towards our mission: reaching AGI through intelligence systems built for software development.
ABOUT THE ROLE
You'll be working alongside our pre-training data team, focused on one of the most foundational challenges in training frontier LLMs: acquiring the best possible pre-training data. The data we collect is upstream of everything. It directly shapes the capability of the models we train. As our first dedicated data acquisition engineer, you will spearhead and evolve systems that crawl the web at massive scale, rapidly ingest data from strategic partnerships, and build specialized tooling to maximize recall from high-value sources. You'll collaborate closely with pre-training data researchers and engineers to ensure that our sourcing of data maps to our training needs, to ensure we have the most capable pre-trained models.
YOUR MISSION
To deliver the highest-quality, diverse, and most comprehensive data corpus to fuel the pre-training of frontier models for software development.
RESPONSIBILITIES
- Design, build, and operate a large-scale web crawler responsible for acquiring all openly accessible data on the internet.
- Develop specialized deep crawlers targeting high-value sources to improve recall and coverage.
- In collaboration with data researchers, own a long-term road map for data acquisition.
- Build observability, monitoring, and debugging tooling to ensure reliability and transparency across crawl infrastructure.
- Collaborate with pre-training, post-training, and evaluations teams to align data acquisition priorities with model training needs.
- Build high-throughput ingestion pipelines for rapidly onboarding partner data and evaluating it for quality.
Remote Member of Engineering (Pre-training / Data Acquisition) in Milton Keynes employer: poolside
Poolside is an exceptional employer that fosters a collaborative and kind-hearted work culture, attracting top talent in the field of Artificial General Intelligence. As a Remote Member of Engineering, you'll have the opportunity to work on groundbreaking projects that shape the future of software development while enjoying flexible working arrangements and a commitment to employee growth through continuous learning and innovation. Join us in our mission to reach AGI, where your contributions will directly impact the evolution of intelligent systems.
StudySmarter Expert Advice🤫
We think this is how you could land Remote Member of Engineering (Pre-training / Data Acquisition) in Milton Keynes
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, especially those already at Poolside. A friendly chat can open doors and give you insights that a job description just can't.
✨Tip Number 2
Show off your skills! If you've got a portfolio or any projects related to data acquisition or web crawling, make sure to highlight them during interviews. We love seeing what you can do!
✨Tip Number 3
Prepare for technical challenges! Brush up on your coding skills and be ready to tackle some real-world problems. We want to see how you think and solve issues on the spot.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you're genuinely interested in joining our awesome team.
We think you need these skills to ace Remote Member of Engineering (Pre-training / Data Acquisition) in Milton Keynes
Some tips for your application 🫡
Show Your Passion for Data:When you're writing your application, let us see your enthusiasm for data acquisition and engineering. Share any relevant projects or experiences that highlight your skills in building systems for data collection. We love seeing candidates who are genuinely excited about the role!
Tailor Your Application:Make sure to customise your application to align with our mission at Poolside. Highlight how your background and skills can contribute to acquiring high-quality pre-training data. We want to know how you can help us reach our goal of developing frontier models!
Be Clear and Concise:Keep your application straightforward and to the point. Use clear language to describe your experiences and skills. We appreciate candidates who can communicate effectively, as it reflects how you'll work with our team!
Apply Through Our Website:Don't forget to submit your application through our website! This helps us keep everything organised and ensures your application gets the attention it deserves. We can't wait to see what you bring to the table!
How to prepare for a job interview at poolside
✨Know Your Stuff
Make sure you understand the fundamentals of data acquisition and web crawling. Brush up on the latest technologies and methodologies in this field. Being able to discuss specific tools or frameworks you've used will show that you're not just familiar with the theory but have practical experience too.
✨Show Your Collaborative Spirit
Since this role involves working closely with researchers and engineers, be prepared to discuss your teamwork experiences. Share examples of how you've successfully collaborated on projects in the past, especially in fast-paced environments. Highlighting your low ego and kind-hearted approach will resonate well with their culture.
✨Prepare for Technical Questions
Expect some technical questions related to building web crawlers and data ingestion pipelines. Practice explaining your thought process and problem-solving strategies. You might even want to run through a few coding challenges or system design scenarios to get comfortable with articulating your ideas.
✨Align with Their Mission
Familiarise yourself with Poolside's mission of reaching AGI through intelligent systems. Be ready to discuss how your skills and experiences can contribute to this goal. Showing genuine enthusiasm for their vision will help you stand out as a candidate who is not only qualified but also passionate about the work.
