PURE Insurance

Compensation

Full Description

Role Overview We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and optimization of scalable data pipelines using Databricks on Azure. This role will be instrumental in driving data architecture initiatives, enhancing data quality, and enabling advanced analytics across the enterprise. Key Responsibilities Databricks Development & Optimization: Build and optimize distributed data processing jobs using Apache Spark on Databricks. Implement Delta Lake, DLT pipelines, and Medallion architecture for scalable and reliable data workflows. ETL & Data Integration: Design and automate ETL pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Integrate data from diverse sources including Salesforce, Workday, Duckcreek, and external APIs. Data Modeling & Warehousing: Develop dimensional models (Star/Snowflake schemas), stored procedures, and views for data warehouses. Ensure efficient querying and transformation using SQL, T-SQL, and PySpark. Cloud & DevOps Integration: Leverage Azure DevOps, CI/CD pipelines, and GitHub for version control and deployment. Utilize Azure Logic Apps and ML Flow for workflow automation and model training. Security & Governance: Implement role-based access control (RBAC), data encryption, and auditing mechanisms. Ensure compliance with enterprise data governance policies. Collaboration & Leadership: Work closely with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. Mentor junior engineers and contribute to code reviews and architectural decisions. Required Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. 5+ years of experience in data engineering with at least 2 years on Databricks. Proficiency in Python, Scala, SQL, and Spark. Hands-on experience with Azure Data Services (ADF, ADLS, Synapse). Strong understanding of ETL, data warehousing, and data modeling concepts. Experience with Power BI, including DAX and advanced visualizations. Familiarity with MLflow, LangChain, and LLM integration is a plus. Preferred Certifications Databricks Data Engineering Professional Azure/AWS Data Engineering Certifications The base salary for this role can range from $120,000 to $145,000 based on a full-time work schedule. An individual’s ultimate compensation will vary depending on job-related skills and experience, geographic location, alignment with market data, and equity among other team members with comparable experience Want to Learn More? [Our Values] [Our Benefits] [Our Community Impact] [Our Leadership] PURE Insurance is a property and casualty insurance company—think homes, cars, fine art and collections—designed exclusively for financially successful individuals and families. We're dedicated to delivering an exceptional experience to our members by alleviating stress, solving challenges and removing conflict, wherever possible, from the insurance process. We are deeply committed to fostering a work environment where everyone has an equitable chance to learn, develop and succeed, and where all feel welcome, safe, and supported to do their best work and bring their whole self to PURE. Our team is comprised of empathetic, passionate and curious individuals who are #PUREproud of the work we do and milestones we achieve together. We’re constantly looking for bright individuals with ambitions as high as our own to join our community and contribute to our journey. Joining PURE means creating your own journey, too. We encourage our team members to pursue their personal passions and provide them resources and support to see them come to fruition. Learn more about our culture on LinkedIn. Interested in PURE but don’t see a role that fits? Introduce yourself and we’ll get in touch if an opportunity opens up that seems like a good match.