Streamline

Compensation

Full Description

Job Description: • Design, develop, and deploy Azure Functions and broader Azure data services to extract, transform, and load data into Snowflake data models and marts. • Implement automated data quality checks, monitoring, and alerting to ensure accuracy, completeness, and timeliness across all pipelines. • Optimize workloads to reduce cloud hosting costs, including right-sizing compute, tuning queries, and leveraging efficient storage and caching patterns. • Build and maintain ELT/ETL workflows and orchestration to integrate multiple internal and external data sources at scale. • Design data pipelines that support both near real-time streaming data ingestion and scheduled batch processing to meet diverse business requirements. • Collaborate with engineering and product teams to translate requirements into robust, secure, and highly available data solutions. Requirements: • Strong expertise with Azure data stack (e.g., Azure Functions, Azure Data Factory, Event/Service Bus, storage) and Snowflake for analytical workloads. • Proven experience designing and operating production data pipelines, including CI/CD, observability, and incident response for data systems. • Advanced SQL and performance tuning skills, with experience optimizing transformations and Snowflake queries for cost and speed. • Solid programming experience in Python or similar for building reusable ETL components, libraries, and automation. • Experience with streaming and batch ingestion patterns (e.g., Kafka, Spark, Databricks) feeding Snowflake. • Familiarity with BI and analytics tools (e.g., Power BI, Grafana) consuming Snowflake data models. • Background in DevOps practices, including containerization, CI/CD pipelines, and infrastructure-as-code for data platforms. • Experience with modern data transformation tools (e.g., dbt) and data observability platforms for monitoring data quality, lineage, and pipeline health. Benefits: • A challenging and rewarding role in a dynamic and international environment. • Opportunity to be part of a growing company with a strong commitment to innovation and excellence. • A supportive and collaborative team culture that values personal growth and development. • Competitive compensation and benefits package.