Senior Lead Software Engineer - SRE/Databricks

Job Description

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity, and security of the company's data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm’s commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly.

As a Senior Lead Software Engineer at JPMorgan Chase within the AIML Data Platforms and Chief Data and Analytics Team , you will develop and deliver advanced technology products focused on data and analytics. Tackle complex cloud data platform challenges, especially around Datalakes Tools. In this role you will work in an agile environment, collaborating with cross-functional teams.

Job responsibilities

• Designs, implements, and maintains a managed AWS Databricks platform, and provides engineering and operational support for the platform to SRE and app teams.
• Performs platform design, set-up and configuration, workspace administration, resource monitoring, providing engineering support to data engineering teams, Data Science/ML, and Application/integration teams.
• Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture.
• Drives continuous improvement in system observability, alerting, and capacity planning.
• Collaborates with engineering and data teams to optimize infrastructure and deployment processes, focusing on automation and operational excellence.
• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
• Develops secure high-quality production code, and reviews and debugs code written by others.
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems.
• Adds to team culture of diversity, opportunity, and respect.
• Implements Site Reliability Engineering (SRE) best practices to ensure reliability, scalability, and performance of data platforms.
• Develops and maintains incident response procedures, including root cause analysis and postmortem documentation.

 Required qualifications, capabilities, and skills 

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Extensive experience with AWS Databricks platform administration and engineering support is a MUST.
• Strong understanding of SRE principles, including SLIs, SLOs, error budgets, and incident management.
• Experience with monitoring tools, automation frameworks, and CI/CD pipelines.
• Proficient in Python and/or Java application program development with use of automated unit testing.
• Experience with terraform development and understanding of terraform enterprise.
• Experience in delivering system design, application development, testing, and operational stability.
• Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc.
• Excellent troubleshooting, analytical, and communication skills.

Preferred qualifications, capabilities, and skills 

• Experience in Data pipelines using Spark.
• Exposure to AWS & Databricks Platform administration.
• Knowledge of containerization (Docker, Kubernetes) and orchestration.
• Familiarity with distributed systems and large-scale data processing.

#LI-RB3

About Us

Chase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

Equal Opportunity Employer/Disability/Veterans

About the Team

Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We’re proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions – all while ranking first in customer satisfaction.

Operations teams develop and manage innovative, secure service solutions to meet clients’ needs globally. Developing and using the latest technology, teams work to deliver industry-leading capabilities to our clients and customers, making it easy and convenient to do business with the firm. Teams also drive growth by refining technology-driven customer and client experiences that put users first, providing an unparalleled experience.