Please go through the below req and reply me back with your updated resume, minimum expected hourly rate, visa status, related visa copy, DL copy and let us know your availability. I have an urgent position for Sterling B2B Developer. Please fill up all the details including your linked in ID so that I can submit your resume to my client for further process. Please email the resume to varma@hermitageinfotech.com
Role: Senior Data Engineer
Location: Dallas, TX or Mountain View, CA
Duration: Long Term Contract
As part of the Mail Analytics Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse, and analytics systems, enabling mission critical decision making, downstream, AI-powered capabilities, and more.
If you're passionate about building data infrastructure and platforms that power modern Data- and AI-driven business at scale, we want to hear from you!
Your Day- Partner with Data Science, Product, and Engineering to collect requirements to define the data ontology for Mail Data & Analytics
- Lead and mentor junior Data Engineers to support Mail’s ever-evolving data needs
- Design, build, and maintain efficient and reliable batch data pipelines to populate core data sets
- Develop scalable frameworks and tooling to automate analytics workflows and streamline users interactions with data products
- Establish and promote standard methodologies for data operations and lifecycle management
- Develop new or improve and maintain existing large-scale data infrastructures and systems for data processing or serving, optimizing complex code through advanced algorithmic concepts and in-depth understanding of underlying data system stacks
- Create and contribute to frameworks that improve the efficacy of the management and deployment of data platforms and systems, while working with data infrastructure to triage and resolve issues
- Prototype new metrics or data systems
- Define and manage Service Level Agreements for all data sets in allocated areas of ownership
- Develop complex queries, very large volume data pipelines, and analytics applications to solve analytics and data engineering problems
- Collaborate with engineers, data scientists, and product managers to understand business problems, technical requirements to deliver data solutions
- Engineering consulting on large and complex data lakehouse data
Must Have- BS in Computer Science/Engineering, relevant technical field, or equivalent practical experience, with specialization in Data Engineering
- 8+ years of experience building scalable ETL pipelines on industry standard ETL orchestration tools (Airflow, Composer, Oozie) with deep expertise in SQL, PySpark, or scala.
- 5+ years leading data engineering development directly with business or data science partners
Varma | Sr. IT Recruiting Manager l 732-338-7524(D) | (F) 732-289-6103
Hermitage Info Tech, LLC |
www.hermitageinfotech.com200 Centennial Ave, Suite # 153 Piscataway, New Jersey 08854
