Weekday AI

Compensation

Full Description

This role is for one of the Weekday's clients Min Experience: 6 years Location: USA, Bay Area, New York City JobType: full-time We are seeking an experienced Python Developer with deep expertise in workflow orchestration frameworks including Celery and Temporal, to join our high-performance engineering team. This role requires strong backend development capabilities, hands-on experience building scalable distributed systems, and the ability to design resilient, fault-tolerant workflows that power complex business processes. The ideal candidate is a self-starter who enjoys solving challenging problems, thrives in fast-paced product environments, and can collaborate effectively across cross-functional teams. Key Responsibilities Design, develop, and maintain backend services using Python with a focus on performance, reliability, and maintainability. Build and implement distributed task execution and workflow orchestration pipelines using Celery, Temporal, or similar frameworks. Architect scalable workflow solutions and event-driven systems capable of handling high-volume transactions and asynchronous processing. Optimize task scheduling, worker management, queue handling, and checkpointing strategies to ensure high availability. Write clean, testable, reusable, and efficient code following engineering best practices and internal guidelines. Collaborate with product managers, architects, SRE teams, and other developers to translate business requirements into engineering solutions. Integrate workflows with external systems, including microservices, message queues (e.g., Kafka, RabbitMQ, SQS), databases, and APIs. Manage production deployments, monitor service health, troubleshoot complex issues, perform root-cause analysis, and improve reliability metrics. Maintain documentation including workflow diagrams, technical designs, system architecture details, and knowledge-base records. Mentor junior engineers, participate in peer code reviews, and contribute to continuous improvement initiatives. Stay updated with new technologies in workflow orchestration, distributed computing, cloud platforms, and process automation. Required Skills & Experience 6–13 years of professional software development experience, with a strong focus on backend development. Expertise in Python including asynchronous programming, concurrent execution, multiprocessing, and performance tuning. Strong hands-on experience in Celery and/or Temporal, including workflow creation, signal handling, retry logic, and DAG-based orchestration. Solid understanding of distributed systems, microservices, event-driven architecture, and message queueing concepts. Experience with relational and NoSQL databases such as PostgreSQL, MySQL, MongoDB, Redis, or Cassandra. Experience integrating and deploying services using Docker and Kubernetes is a strong advantage. Familiarity with logging, observability, monitoring tools (Grafana, Prometheus, ELK/EFK, OpenTelemetry). Strong understanding of design patterns, software architecture principles, API development, and performance optimization. Ability to work independently, make technical decisions, and manage priorities in dynamic environments. Strong analytical thinking, problem-solving skills, and excellent communication ability. Preferred Qualifications Prior experience in workflow orchestration for large-scale data processing or automation platforms. Cloud experience (AWS, GCP, or Azure) including serverless or container-based deployments. Experience with CI/CD pipelines and DevOps best practices. Exposure to fault-tolerant distributed frameworks or data streaming tools.