Our client is looking Data Engineer for Long term project in Plano, TX (Onsite) Below is the detail requirement.
Job Title: Data Enginee
rPlano, TX- Onsite
Key Skills: Power BI, Azure Data Bricks, Pyth
onJob Summary: We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and managemen
t.Responsibilitie
- s:Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databric
- ksImplement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storag
- e)Build and optimize data transformation logic using Spark (Databricks), SQL, and Pyth
- onDevelop and maintain data models supporting analytics, reporting, and machine learning use cas
- esCollaborate with analytics teams to enable Power BI datasets and reporting solutio
- nsEnsure data quality, reliability, and consistency through validation frameworks and monitori
- ngOptimize performance of pipelines, storage, and compute resources in Azu
- reImplement data governance practices, including lineage, cataloging, and documentati
- onSupport CI/CD deployment pipelines for data engineering workflo
ws
Minimum Qualificati
- ons5+ years of experience in Data Engineering ro
- lesStrong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modell
- ingProficient in using Azure Databricks (PySpark/Spark SQL) and medallion architect
- ureExperience with other SQL databases, relational databases and NoSQL databa
- sesUnderstanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables) Experience working with large-scale structured and semi-structured datas
- etsAbility to work with cross-functional teams and translate business requirements into technical soluti
ons