Sr Lead Software Engineer - Data Platforms
- Executes creative software & data solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Designs and implements scalable data architectures, data modeling, ETL processes, and data warehousing solutions.
- Understands data governance, data quality, and data security principles.
- Develops secure high-quality production code, and reviews and debugs code written by other engineers
- Leads communities of practice across Data Engineering to drive patterns, awareness and use of new and leading-edge technologies
- Adds to team culture of diversity, opportunity, inclusion, and respect
- Integrates large language models (LLMs) into data processing workflows.
- Develops solutions with natural language processing (NLP) techniques and tools.
- Develops and deploys machine learning models for data engineering tasks.
- Formal training or certification on Data Engineering concepts and 5+ years applied experience
- Hands-on practical experience delivering data systems design, application development, testing, and operational stability.
- Advanced in one or more big data programming language(s) - Spark, PySpark, and Kafka.
- Experience in engineering data products using Databricks and/or snowflake technologies.
- Proficient in data pipeline and workflow management tools (e.g., Apache Airflow, Flink)
- Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
- Demonstrated proficiency in developing software applications within technical domains such as cloud, data artificial intelligence, machine learning.
- In-depth knowledge of the financial services industry and data
- Practical cloud native experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Strong collaboration skills to work effectively with cross-functional teams and stakeholders.
- Ability to lead, influence and mentor team of data engineers on adopting right technical solutions.
- Hands-on experience with cloud services such as S3, IAM, Glue, EKS, ECS, Athena
- Certifications in Databricks or Snowflake technologies
Recommended Jobs
Consulting - Technology Consulting - Cyber Security - IAM - Manager - Multiple Positions - 1638790
EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities. At EY, you’ll have the chance to build a career as unique as you a…
Customer Success Account Coordinator
Customer Success Account Coordinator Location Somerset, NJ : Roadtex Transportation has become a leader in the nationwide LTL industry, specializing in transporting time and temperature-sensitive prod…
Principal Biostatistician - Remote
Are you looking to join a company where your contributions truly matter, and where you'll be part of a supportive, innovative team? MMS is a award-winning, data-focused clinical research organization…
Facility Maintenance Supervisor - Woodstock Farms - Edison, NJ
Job Overview The Maintenance Facility Supervisor will be responsible for the prompt repair and ongoing daily maintenance of all production equipment. The position will coordinate activities with t…
Mortgage Loan Originator
Job Title: Mortgage Loan Originator (Remote) Salary: Commission-based. Typical earnings range from $80,000 to $120,000+, depending on production and market. MLOs with our client average a closing…
Principal Internal Controls & Compliance - Strategic Programs
Requisition ID: 108830 Share Our Purpose. Be Yourself. Feel Valued. People are the heart of our business. As an American Water employee, you will be offered a competitive salary and hea…
High Reach FORKLIFT OPERATOR (Weekend Shift)
RLS is a nationally recognized 3PL cold chain solutions provider. We offer warehousing, transportation, and fulfillment services to the frozen and refrigerated food industry. Founded in 1968, we’re a …
Accounts Payable Professional
Job Description Job Description Premier Apartment Management Organization is seeking an energetic, organized, experienced Accounts Payable professional to join our hardworking team in Fort Lee, N…
INTERVENTIONAL RAD TECHNOLOGIST
About us At Cooper University Health Care, our commitment to providing extraordinary health care begins with our team. Our extraordinary professionals are continuously discovering clinical innovat…
Supply Chain Analytics Engineer
About Redwood Materials Redwood Materials was founded in 2017 to create a circular supply chain for electric vehicles and clean energy products, making them more sustainable and driving down the c…