Vice President AI/ML

Job Title: Vice President – AI/ML Engineer (Individual Contributor)

Location: Jersey City, Dallas, Menlo Park, Seattle (Onsite)

Employment Type: Full-Time

About the Company

Our client is a leading global investment banking, securities, and investment management firm serving a diverse client base including corporations, financial institutions, governments, and high-net-worth individuals. Headquartered in New York, the firm has a strong global presence across major financial centers. The organization is known for its strong culture built on integrity, excellence, innovation, and teamwork, with a focus on delivering best-in-class solutions to its clients.

Business Unit Overview

Enterprise Technology Operations (ETO) is part of the firm’s Core Engineering division, focused on delivering scalable production management services. The unit emphasizes operational excellence, automation, and risk reduction through advanced engineering and data-driven solutions.

Within ETO, the Production Runtime Experience (PRX) team leverages software engineering, machine learning, and automation to improve monitoring, alerting, and operational workflows across large-scale systems.

Team Overview

The Machine Learning and AI team within PRX focuses on applying advanced Machine Learning and Generative AI (GenAI) to optimize large-scale infrastructure and application environments.

By combining statistical modeling, anomaly detection, predictive analytics, and LLM-driven agentic systems, the team delivers scalable, reliable, and cost-efficient production management solutions.

Role Overview

This is a hands-on individual contributor role focused on designing and implementing GenAI-powered agentic solutions to improve production operations.

You will work on building intelligent systems capable of diagnosing issues, reasoning through complex scenarios, and executing automated actions in large-scale production environments.

Key Responsibilities

• Design and develop Agentic AI systems using LLMs, retrieval, and secure execution frameworks
• Build and productionize LLM-based solutions, including RAG pipelines and evaluation frameworks
• Integrate AI solutions with observability, incident management, and deployment systems
• Develop systems for automated diagnostics, remediation, and workflow optimization
• Collaborate with engineering and operations teams to translate business needs into AI solutions
• Implement governance, safety, and reliability mechanisms for AI systems
• Optimize performance, scalability, and cost efficiency of AI applications
• Drive engineering best practices, design reviews, and continuous improvement

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Applied Mathematics, or a related field (Master’s/PhD preferred)
• 7+ years of experience in software engineering and/or machine learning

Required Skills

• Strong programming experience in Python, Java, Go, or C/C++ (Python preferred)
• 3+ years building and deploying production-grade machine learning systems
• Hands-on experience with Large Language Models (LLMs) including prompt engineering, fine-tuning, and RAG pipelines
• Experience building agent-based AI systems and tool integrations
• Solid understanding of machine learning algorithms, statistics, and data structures
• Experience with REST APIs, distributed systems, and microservices architecture
• Strong problem-solving skills and ability to work in high-impact environments

Preferred Skills

• Experience with cloud platforms (AWS preferred)
• Familiarity with containerization and orchestration (Docker, Kubernetes)
• Experience with MLOps, model deployment, and monitoring frameworks
• Exposure to financial services or large enterprise environments

Key Competencies

• Strong analytical and problem-solving mindset
• Ability to communicate complex concepts clearly
• Collaborative and team-oriented approach
• High ownership and accountability