Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship*
Employment TYPE: Contract W2 - NO C2C
Local or Nearby candidates only
Junior Data Engineer
Location: Wilmington, DE
Job Description
We are seeking a Junior Developer with strong experience in big data technologies, cloud platforms, and scalable data pipeline development. The ideal candidate should have hands-on expertise in PySpark, Spark, ETL/Streaming pipelines, and AWS cloud services, along with strong programming skills in Python or Java.
Key Responsibilities
- Develop and maintain ETL and streaming data pipelines using PySpark, Spark, and Java/Python.
- Build and support scalable data processing solutions on AWS cloud platforms.
- Work with Databricks and Airflow for workflow orchestration and data engineering tasks.
- Develop, test, and optimize distributed data processing applications.
- Collaborate with cross-functional teams to support data integration and analytics initiatives.
- Monitor, troubleshoot, and improve performance of existing data pipelines and applications.
- Follow software engineering best practices, CI/CD processes, and Agile methodologies.
Required Skills
- Hands-on experience with PySpark, Java/Spark, and ETL/Streaming pipelines.
- Experience with AWS services including EMR, Lambda, S3, and RDS.
- Experience working with Databricks and Apache Airflow.
- Strong programming skills in Python and/or Java.
- Understanding of distributed systems and big data processing concepts.
Nice to Have
- Experience with Shell scripting and Unix/Linux environments.
- Knowledge of Terraform for infrastructure automation and management.
- Exposure to modern LLM concepts and practical AI/LLM use case development.
Qualifications
- 3+ years of software engineering or data engineering experience.
- Bachelor’s degree in Computer Science, Computer Engineering, Mathematics, or related technical field.
- Strong analytical, problem-solving, and communication skills.