Role: Senior PySpark Developer / Engineer
Location: Dallas, TX (3 Days onsite/ week)
Job Type: Fulltime
Job Description:
Must-Have Technical Skills: PySpark, SQL
PySpark Expertise-
Strong hands-on experience with PySpark architecture understanding
Clear understanding of how PySpark jobs execute in the background
Ability to read, write, analyze, and enhance PySpark scripts and configurations
SQL Proficiency:
Strong SQL skills
Experience working with SQL as part of data processing and PySpark job execution
Unix Shell Scripting:
Should have good understanding of Unix shell scripting.
Ability to understand backend Unix scripts supporting PySpark workflows
Experience in reading, analyzing, writing, and modifying shell scripts for PySpark integration
ETL Knowledge:
Hands-on experience with ETL processes using any programming language or framework
Ability to understand and work with complementary ETL workflows alongside PySpark