Azure Data Engineer

Avance Consulting
Cincinnati, OH

Role:-Azure Cloud Databricks Developer.

Location:- Cincinnati, OH, Indianapolis, IN

Job Type:-FullTime


Job Description

Required Qualifications:

  • At least 4 years of experience with Information Technology
  • Proven years of hands-on experience in architecting solutions on Azure, Databricks and Spark
  • Proficiency in data engineering tools: Spark, Kafka, Airflow, SQL, Python
  • Familiarity with vector search and semantic retrieval for retail use cases
  • Expertise in data privacy and compliance in consumer-facing environments
  • Good experience in end-to-end implementation of data warehouse and data marts
  • Strong understanding of Data Warehousing concepts of Data Vault, Dimensional modelling, OLAP design
  • Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, Azure Pipelines, and Jenkins
  • Experience designing and implementing complex solutions for distributed systems
  • Experience in leading and mentoring teams

Preferred Qualifications:

  • Strong understanding of retail or CPG data domains
  • Experience in Relational Modeling, Dimensional Modeling and Modeling of Unstructured Data
  • Familiarity with log and monitoring solutions
  • Experience in utilizing development containers, unit testing/code quality review/linting - standard best practice
  • Good understanding of Agile software development frameworks
  • Strong communication and Analytical skills
  • Ability to work in teams in a diverse, multi-stakeholder environment comprising of Business and Technology teams
  • Experience and desire to work in a global delivery environment
  • Experience with Generative AI frameworks: OpenAI, Hugging Face, LangChain
  • Knowledge of Model Context Protocol (MCP) or similar AI integration standards.
  • Experience and detailed knowledge with Master Data Management, ETL, Data Quality, metadata management, data profiling, micro-batches, streaming data loads