Leverage Public/Private Cloud solutions for massive processes
Establish best practices to support time critical processes and ensure resilient, scalable & maintainable solution
Participate in design and code reviews, incorporate security requirements into design, and provide input to information/data flow.
Identify applicable system platform, components, dependencies, document application specifications.
Analyze performance issues and resolution recommendations
Actively participating in Agile Process, keen on learning new technologies.
Work with multiple business teams to fully understand business requirements and translate them into data structures.
As a developer you will participate in establishing application design and development, create and maintain technical documentation, architecture designs and data flow diagrams
Required qualifications, capabilities, and skills
5 plus years of hands on working experience in Spark, Python and Hadoop components.
Good understanding of different cluster setups and performance tuning of spark jobs
Experience on scheduling tools
Cloud implementation experience with AWS EMR, Kinesis, AWS S3
Experience on Optimization of big data, Data Pipeline implementations and columnar data formats.
Experience with Snowflake and Redshift nice to have, experience on building data warehouse.
BFSI (Banking Finance Service and Insurance) experience preferred
Should be able to translate business requirements into high level design, detail technical design and implementation
The individual will need to be very flexible with ability to react quickly to changing business needs.
Excellent written and verbal communication skills
Proactively identify and communicate issues leveraging standard monitoring and alerting tools, and work to resolve issues liaising with 3rd party resolver teams as necessary.
A good listener and should articulate ideas in writing and verbally to any audience in a way where these are understood and achieve the goals intended with that communication
Have ability to work effectively with teams/people having different skill sets, personalities, work styles, or motivation level
Process & Management, maintain documentation on issues, corrective actions in-line with best practice to ensure knowledge accessibility and continuous learning within team
Look to proactively develop operate knowledge and skills by sharing experiences and attending relevant training
Preferred qualifications, capabilities, and skills
Proactively improve support services by building upon best practice and tools
Awareness of industry standard SDLC processes for quality management