Cedana

Save, move and resume compute jobs in real-time

Simulation, Optimization and Data Engineer

$80K - $120K / 0.10% - 0.30%
Location
Los Angeles, CA, US / Remote (US)
Job Type
Full-time
Experience
3+ years
Connect directly with founders of the best YC-funded startups.
Apply to role ›
Neel Master
Neel Master
Founder

About the role

Respectfully, no recruiters please!

What you will do

  • You can code across the stack and are interested in learning more about the OS, containers, GPUs, and distributed systems
  • You’ll develop data pipelines that observe and build a robust dataset of our system’s performance to explore our unique insights in compute - across machines and microservice systems.
  • You’ll help develop a simulation platform to simulate the complex challenges that Cedana seeks to solve, allowing us to battle-test systems before deployment and run experiments on changes.
  • You'll eventually work on our core infrastructure code, using insights from the simulation platform to optimize performance and fix bugs
  • You’ll build visualizations and reports, from orchestration dynamics of compute across regions of the world, to pricing dynamics of compute across cloud providers, to developing insights into GPU supply and demand from second order data.
  • You’ll gain understanding of the technical and performance requirements and help develop new simulations and visualizations. You’ll work closely with both founders (CEO/CTO).

What we are looking for

  • A research-oriented, creative mindset that uses first principles to understand our system. Some of the problems we’re looking to further explore and visualize we’d like to do so from a data-driven perspective, so developing novel ways of looking at and collecting data is valuable.
  • Ability to build and manage long running data pipelines. Think BigQuery and Airflow. We don’t force a tool - feel free to pick the best tool for the job.
  • You love to write your insights down and educate the team with humility. You should expect the same from us!
  • Creative problem solving, multidisciplinary experience.
  • Demonstrated ability to collaborate with others.

Preferred Qualifications

  • Strong understanding of Linux and UNIX fundamentals (standard libraries, services, networking, kernel/user-space interaction).
  • Strong python programming experience.
  • Experience developing across the stack: OS/kernel, systems, containers, services, C, C++
  • Experience building data pipelines to ship and collect data from multiple sources.
  • Familiarity with visualization tools and frameworks.

Nice to Have

  • Have helped build a service on a large cloud provider (AWS/GCP/Azure/etc)
  • Have worked on a high-availability system
  • Familiarity with GPUs, AI training/inference, HPC, scientific computing
  • Familiarity with machine learning and forecasting.

Even if you don’t meet all the above qualifications, we strongly encourage you to apply! We’re building some unique systems, and strongly believe in a multidisciplinary approach to engineering. Some of the most interesting challenges are solved by some of the most interesting people. We value people who are passionate, love to learn and are high velocity over any single qualification.

About Cedana

Cedana is pause/migrate/resume for compute workloads. We're working on building a global, real-time system for compute. This means a paradigm shift in how we allocate resources to things like high performance computing, numerical simulation and training and running machine learning models. We do so by taking a systems-level and deep-tech approach to these problems, working at the Linux Kernel layer and with hardware.

Cedana
Founded:2023
Team Size:4
Location:New York
Founders
Neel Master
Neel Master
Founder
Niranjan Ravichandra
Niranjan Ravichandra
Founder