Software Engineer, Airflow

We are seeking a Senior Software Engineer with expertise in Apache Airflow to join our Batch Operations team.This is a platform engineering role that presents an opportunity to provide Airflow as a Service and enable hundreds of internal users to coordinate diverse workflows across multiple marketplace domains! You will build foundational platform capabilities and craft how thousands of workflows provide business value across eBay’s global marketplace.What You'll DoDevelop, deploy, and maintain Airflow-as-a-service to fulfill eBay’s batch processing demands, ensuring consistent availability and security.Lead the deployment and management of Airflow clusters, focusing on reliability and scalability.Design and implement observability, monitoring, and operational solutions to offer deep insights into DAG/task executions and system health.Evaluate, spec, and implement feature gap between UC4 and Airflow.Automate and maintain operational standards across multiple environments.Support horizontal scaling and high availability across cloud infrastructure clusters.What You'll BringBachelor’s degree in Computer Science or related field plus 7 or more years of experience or Master’s degree in Computer Science or related field with 5 years of software engineering experienceDemonstrated experience in providing Apache Airflow as a managed service within enterprise settings supporting extensive user groups.Expertise in architecting, managing, and scaling Airflow ...