Maintain, Enhance and Monitor a highly scalable infrastructure for data processing platform using Kubernetes, Hadoop and AWS services
Ensure the 24/7 availability of the system, with proper alerting and monitoring
Identify and fix bugs and performance issues in the platform
Utilize continuous delivery (CI/CD) with Gitlab CI, Jenkins, Docker
Data pipeline and application monitoring and failure recovery
Setup and monitor application access and connectivity
Advocate for a DevOps culture of automation, self-service, and engineering best practices to enable development teams
Performing all SRE activities such as availability and reliability monitoring and reports
Tune, Monitor and configure tools such as Kafka, Spark, SQL, Airflow etc.
Use infrastructure as a service with Terraform
operate and maintain code repository with GitLab
Qualifications
Comprehensive experience with AWS including a solid understanding Amazon S3, EC2, IAM, EMR, EKS, Networking,Security and Lake Formation
Experience with CI/CD and DevOps and Terraform
Experience with streaming application monitoring and maintenance
Bachelor or Masters in Computer Science or relevant experience
Minimum 5+ years of experience in SRE or DevOps engineering
Proven experience working with large scale big data platforms
Experience with tools such as Jenkins to build automation, CI/CD, Self-Service pipelines
Experienced in design and implement reliable, scalable, and performant distributed systems and data pipelines
Extensive programming experience, especially in Spark and SQL
Experience with Containerization, including Docker
JPMorgan Chase & Co., one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. In accordance with applicable law, we make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as any mental health or physical disability needs.
