Lead Software Engineer – Data Platform & AI
Pay Range: $80/hour to $93/hour
Overview
We are seeking an experienced Lead Software Engineer to join a high-impact Data Foundation Platform team supporting large-scale data engineering and analytics initiatives. This role focuses on building cloud-based tools, services, and platforms used by data engineers, analysts, and data scientists to process and manage large-scale streaming and web data environments.
The ideal candidate brings deep expertise in software engineering, data infrastructure, metadata governance, and AI-enabled platform development. This position requires strong technical leadership, hands-on engineering capabilities, and experience designing scalable solutions end-to-end.
Key Responsibilities
- Design, develop, and maintain scalable full-stack data infrastructure and platform services.
- Build and enhance internal tools supporting metadata management, governance, lifecycle management, and cost management.
- Architect reusable APIs, shared libraries, and UI component frameworks across data platform ecosystems.
- Develop user-facing applications and dashboards using modern frontend technologies.
- Implement cloud-native solutions and automated deployment pipelines within AWS or comparable cloud environments.
- Collaborate with cross-functional teams including product managers, architects, data scientists, analysts, and engineering teams.
- Drive technical strategy, system design decisions, and platform scalability initiatives.
- Mentor engineers through code reviews, architecture reviews, and technical leadership.
- Support operational excellence, platform reliability, and agile development processes.
- Contribute to AI-enabled platform capabilities using technologies such as Bedrock, Cortex AI, or similar solutions.
Required Qualifications
- 12+ years of professional software engineering experience delivering production-scale systems.
- Strong experience in both software engineering and data engineering environments.
- Expertise with metadata management and data governance systems.
- Hands-on experience with AI tools and AI-powered engineering platforms such as Bedrock, Cortex AI, or related technologies.
- Strong programming skills in at least one core language such as Python, TypeScript, or Java.
- Experience building and operating distributed systems at scale.
- Experience with AWS cloud services, CI/CD pipelines, infrastructure-as-code, and deployment automation.
- Ability to design and implement features end-to-end across backend, frontend, and infrastructure layers.
- Strong leadership, communication, and collaboration skills.
Preferred Qualifications
- Experience with internet-scale platforms and high-throughput distributed systems.
- Hands-on experience with technologies such as:
- Airflow
- Spark
- Databricks
- Snowflake
- Delta Lake
- OpenSearch
- Neptune
- GraphQL
- React
- TypeScript
- Experience with data catalog and governance platforms such as Acryl DataHub or Alation.
- Familiarity with PII governance, compliance, and data lifecycle management.
- Experience with knowledge graph systems and graph-based architectures.