Data Engineer

MW Partners
San Jose, CA

Responsibilities and duties:

  • Design, build, optimize, and maintain scalable data pipelines that support Growth Monetization initiatives.
  • Write complex SQL queries to analyze A/B experiment results
  • Develop and enhance ETL/ELT workflows for large-scale structured and unstructured datasets.
  • Optimize pipeline performance, reliability, scalability, and data quality across distributed systems.
  • Work with Big Data technologies and best practices to process high-volume datasets efficiently.
  • Build automated monitoring, alerting, and validation frameworks for pipeline health and data integrity.
  • Partner with Data Science, Product, Marketing, and Engineering teams to deliver actionable insights and scalable data solutions.

Requirements:

  • Strong SQL expertise with the ability to write and optimize complex queries on large datasets.
  • Hands-on experience with Big Data technologies such as Hadoop, Hive, Spark, or similar distributed processing frameworks.
  • Experience building and optimizing scalable data pipelines in cloud and enterprise environments.
  • Proficiency in ETL orchestration and workflow management tools.
  • Experience with data quality, pipeline monitoring, and performance tuning.
  • Ability to collaborate effectively with technical and non-technical stakeholders in a fast-paced environment.


// // //