The Ray Data team currently develops and maintains Ray Data https://docs.ray.io/en/latest/data/data.html. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.
As part of this role, you will
Improve the performance of Ray Data https://docs.ray.io/en/latest/data/data.html and multi-modal batch inference use cases.
Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.
Building data loading solutions for production training workloads.
Focus on stability and fault tolerance at high scale
Working with customers and new age AI native companies in scaling their AI workloads.
We'd love to hear from you if have
At least 3-4 years of relevant work experience
Solid background in building scalable and fault-tolerant distributed systems
Experience with data processing, database internals.
Passionate about large scale systems and performance for AI.
WHY ANYSCALE
We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
We offer flexible time off, paid parental leave, and mental health support
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.
Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing