via Careerplug
$90K - 140K a year
Design and develop scalable cloud-native data pipelines and microservices using AWS and Kafka.
8+ years experience with 4+ years in AWS, Kafka, Python or Java, container orchestration, CI/CD, and database modeling.
Role: Senior Developer — Cloud-Native Data, AWS + Kafka - Remote Years of Experience: 8+ years Location: Remote Job Description: Role Overview We are seeking an experienced Senior Developer with strong hands-on experience developing cloud-native, configuration-driven, event-based, and data-processing solutions using AWS, Kafka, Python, and Java. This role requires the ability to design scalable data pipelines, configurable business-rule frameworks, APIs, microservices, and containerized applications while ensuring performance, reliability, observability, and maintainability. Experience • 8+ years of experience in software engineering and application development. • 4+ years of hands-on experience building AWS-based solutions, Kafka integrations, and data pipelines. • Demonstrated experience designing and developing distributed, cloud-native applications. Key Responsibilities • Design, develop, and maintain scalable components. • Build AWS-based data pipelines, event-driven workflows, APIs, microservices, and integration services. • Develop Kafka producers and consumers, including appropriate topic, partitioning, schema, offset-management, retry, and error-handling strategies. • Design and implement configuration-driven systems, including: o Metadata-driven pipelines and workflows o Dynamic business-rule engines o Configurable APIs and data-integration frameworks o Template-based code-generation solutions o Parameterized services and reusable components • Design and optimize configuration interpreters using JSON, YAML, and XML. • Implement configuration validation, versioning, auditing, rollback, backward compatibility, and error-handling capabilities. • Develop high-quality, reusable, and maintainable software using Python and/or Java. • Design SQL and NoSQL data models for storing, retrieving, auditing, and versioning business rules and system configurations. • Build and integrate solutions using Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB. • Develop REST APIs, asynchronous services, batch-processing components, and event-based integrations. • Implement automated unit, integration, component, and contract testing. • Integrate application components with CI/CD pipelines and GitOps deployment workflows. • Build, package, and deploy applications using Docker and Kubernetes. • Implement application logging, monitoring, distributed tracing, dashboards, and alerting using Dynatrace. • Troubleshoot production issues and perform root-cause analysis across application, integration, data, and infrastructure layers. • Conduct code reviews and enforce engineering, security, performance, and maintainability standards. • Collaborate with architects, product owners, quality analysts, data engineers, DevOps engineers, and other developers. • Use Windsurf and other AI-assisted engineering tools to accelerate development, refactoring, automated testing, troubleshooting, and technical documentation. Required Technical Skills • Strong proficiency in Python or Java; hands-on experience with both is preferred. • Strong experience developing AWS-based pipelines and cloud-native applications. • Hands-on experience with Apache Kafka and event-driven architectures. • Proven experience building: o Metadata-driven pipelines and workflows o Dynamic business-rule engines o Configuration-driven applications o Configurable API and data-integration frameworks o Template-based code-generation frameworks o Parameterized and reusable services • Strong experience designing and optimizing JSON-, YAML-, and XML-based configuration interpreters. • Strong understanding of configuration schemas, validation, versioning, auditability, backward compatibility, and rollback. • Strong knowledge of SQL and NoSQL database modeling. • Experience designing data models for business rules, metadata, configuration versioning, and audit history. • Hands-on experience with: o Amazon EKS o AWS Lambda o Amazon ECS o Amazon S3 o Amazon RDS o Amazon DynamoDB • Strong understanding of REST APIs, microservices, asynchronous processing, and distributed systems. • Experience with CI/CD pipelines, Git, and GitOps practices. • Hands-on experience with Docker, Kubernetes, and container orchestration. • Strong working knowledge of Dynatrace for observability, monitoring, performance analysis, and troubleshooting. • Working knowledge of Windsurf or similar AI-assisted development tools. Preferred Qualifications • Experience developing high-volume, fault-tolerant, distributed platforms. • Experience with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf. • Knowledge of data lineage, schema evolution, data contracts, and data-quality controls. • Experience with infrastructure-as-code and deployment tools such as Terraform, Helm, Argo CD, or equivalent technologies. • Familiarity with design patterns for retry management, dead-letter queues, idempotency, caching, and fault tolerance. • Experience implementing secure APIs and cloud services using authentication, authorization, encryption, and secrets-management practices. • AWS Developer, AWS Solutions Architect, Kubernetes, Java, or Python certifications are an advantage. Key Competencies • Strong software-design and problem-solving abilities. • Ability to translate business requirements into configurable and reusable technical solutions. • Strong understanding of scalable and resilient distributed-system design. • Effective debugging and root-cause-analysis skills. • Commitment to clean code, automated testing, documentation, and engineering standards. • Ability to work independently and mentor junior developers. • Strong collaboration and communication skills. • Ability to deliver effectively within an Agile product-engineering environment. This is a remote position.
This job posting was last updated on 9/11/2026