About the Company
Our client is a well-established global insurance and financial services organization known for its strong reputation, financial stability, and long-term commitment to innovation. The company is investing heavily in modern technology and data platforms to transform how insurance products are delivered to professionals and small businesses.
Within this organization, a rapidly growing digital product team is focused on simplifying insurance through modern technology, data-driven decision making, and scalable cloud infrastructure. The team operates in a collaborative, fast-paced environment and places a strong emphasis on engineering excellence, ownership, and continuous improvement.
About the Role
Our client is seeking a Senior Data Engineer to join their Platform Engineering team in Boston. This role will play a key part in designing, building, and scaling a modern cloud-native data platform used to support analytics, business intelligence, and data-driven decision making across the organization.
This individual will work closely with engineering leaders, data teams, and business stakeholders to develop scalable data integration pipelines and build the foundation for enterprise analytics. The role is highly hands-on and ideal for someone who enjoys building data platforms, working with cloud technologies, and enabling self-service analytics.
The team operates in an Agile environment and values collaboration, ownership, and continuous improvement.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server
- Build configuration-driven ingestion processes to support batch and near real-time data pipelines
- Integrate and transform data from multiple sources including APIs, JSON, CSV, XLS, and other structured and semi-structured formats
- Design and document data models, data flows, and data dictionaries to support enterprise analytics
- Implement Lakehouse architecture using Medallion data modeling patterns
- Develop datasets and reporting pipelines supporting Power BI and enterprise analytics
- Maintain the health, security, and scalability of the Azure-based data platform
- Implement best practices for data governance, metadata management, lineage, and access control
- Build and maintain CI/CD pipelines for data infrastructure using tools such as GitHub Actions or CircleCI
- Implement monitoring, alerting, and observability for data pipelines and platform performance
- Optimize data pipelines for performance, scalability, and cost efficiency
- Work cross-functionally with engineering, product, and business teams to define and deliver data products
- Participate in Agile ceremonies including sprint planning, backlog refinement, and delivery cycles
- Mentor junior engineers and contribute to the ongoing development of the data engineering team
- Stay current on emerging technologies and best practices in data engineering
Qualifications
- 7+ years of professional experience in data engineering or data platform development
- Strong experience working in Azure environments, particularly: Azure Data Factory, Databricks, SQL Server / T-SQL
- Experience building scalable ETL / ELT data pipelines
- Experience integrating data from multiple sources including APIs, JSON, XML, CSV, and other formats
- Strong understanding of data warehousing, dimensional modeling, and Lakehouse architecture
- Experience with Power BI, SSRS, or other reporting platforms
- Hands-on experience with CI/CD pipelines and DataOps practices
- Familiarity with data governance, data quality, metadata management, and MDM
- Experience working in Agile development environments
- Strong communication and collaboration skills with the ability to work across technical and business teams
- Experience mentoring or guiding other engineers is a plus
