Astronomer

Compensation

Full Description

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 700 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io. About this role At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. We’re looking for a Senior Software Engineer to join our Data Plane Management team, whose mission is to efficiently operate, and develop new features for, the cloud compute foundation that our customer Airflow deployments are hosted upon. This is a particularly fascinating role for someone who loves the challenge of managing a large scale fleet of 500+ Kubernetes clusters with a true software engineering mindset. This team owns the compute & network primatives in our Astro platform, developing the APIs that our customers to stand up their environments. It has a full roadmap to add new self-service features such as failover cluster support, VPC/VNet peering, Transit Gateway wiring, and metric/log shipping. What you get to do: Own key endpoints and features of our flagship product, Astro, to extend our offering to more complex customer networking options. Work across domains to develop diverse features for our core infrastructure (ie: workload identity, multitenancy, cross region disaster recovery, cloud quota management, private network access). Evolve our fleet orchestration system to allow us to be able to safely make (and roll back) changes across our infrastructure, and to enable us to scale from the 500+ clusters we have now to thousands in the future. Develop your experience working in a multi-cloud environment, working with managed K8S offerings and network/authnz primitives from AWS, Azure, GCP. Deepen your operational knowledge of k8s-based workloads, managing the data pipelines of many of the largest companies in the world. What you bring to the role: Experience building and operating SaaS infrastructure, or experience managing a large scale internal compute platform. Software engineering expertise with Golang, or similar languages with a desire to learn Golang. A passion for reliability and operational excellence. A low tolerance for toil, alert fatigue, and other nonsense. Production experience with a container based orchestration system (Kubernetes preferred, but not essential). Understanding of how to build with security and isolation in mind, so that Astronomer’s managed platform can securely integrate with any customer environment, and to ensure strict isolation between customer workloads. Strong communication skills, both written and verbal, with experience in working with a globally distributed team in delivery. Proactive approach to identifying and addressing issues, with a focus on ownership and accountability. Experience as part of an on-call rotation - this role involves periodic on-call for the services and system we own. Bonus points if you have: Experience working on a SaaS/PaaS product across multiple cloud providers, with a ‘single tenant data plane’ model. Programmatically administered Kubernetes in multiple clouds. Experience designing systems for resiliency, scale and security. A familiarity with Non-Abstract Systems design is a major plus. A passion for finding and addressing inefficiencies in code, infrastructure costs, , tooling and processes. Experience with our particular tech stack components and technologies (deep breath): Calico/Cilium, PostgreSQL/Aurora/CloudSQL/etc, OpenTelemetry, Chronosphere (Prometheus), Splunk,, Istio, Karpenter, Falco, Experience of the innards and quirks of AWS, GCP and Azure. Experience with Apache Airflow. The estimated salary for this role ranges from $180,000 - $210,000 based on leveling and geography, along with an equity component and a comprehensive benefits package. This range is merely an estimate; actual compensation may deviate from this range based on skills, experience, and qualifications. #LI-Remote At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Astronomer is a remote-first company.