Job Title: Data Engineer
Key Skills: Power BI, Azure Data Bricks, Python
Location: Plano, TX- In person only
Job Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and management.
Responsibilities:
• Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databricks
• Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storage)
• Build and optimize data transformation logic using Spark (Databricks), SQL, and Python
• Develop and maintain data models supporting analytics, reporting, and machine learning use cases
• Collaborate with analytics teams to enable Power BI datasets and reporting solutions
• Ensure data quality, reliability, and consistency through validation frameworks and monitoring
• Optimize performance of pipelines, storage, and compute resources in Azure
• Implement data governance practices, including lineage, cataloging, and documentation
• Support CI/CD deployment pipelines for data engineering workflows
Minimum Qualifications
• 5+ years of experience in Data Engineering roles
• Strong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modelling
• Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture
• Experience with other SQL databases, relational databases and NoSQL databases
• Understanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables) Experience working with large-scale structured and semi-structured datasets
• Ability to work with cross-functional teams and translate business requirements into technical solutions