Senior Data Engineer
Hybrid commute, 2 days on-site in Central NJ Locations and 3 day remote per week. This is a permanent FT career opportunity, with base salary range 170 - 190K DOE, plus around 20% bonus and great benefits package. Looking for Senior Data Engineer in banking/financial industry. Major Responsibilities:
- Building and maintaining data pipelines to ingest data from source systems into Databricks
- Designing, Building and maintaining generic frameworks to ingest data through the medallion layers
- Working with the core data platform team to integrate the framework with reference architecture
- Assisting the data mesh teams with best practices and on-boarding to the new framework
- 10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the cloud
- 5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
- 5+ years of experience building robust and scalable data pipelines in Databricks Lakehouse platform on any key cloud platform provider, preferably Azure cloud
- Experience with implementing Medallion architecture for data processing
- Experience with implementing Streaming data ingestion using Kafka
- Test driven development experience
- Proven experience in solution design and applying best design practices
- Data modeling and ER/UML diagram skills
- Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc..
- Experience with implementing API based data integration pipelines
- Experience with source control and DevOps for CI/CD
- Experience working in Agile/scrum methodologies
- Experience with Jira, confluence for project work and documentation
- Experience with Service now for incident management
- Finance domain knowledge in Investment Banking (Securities, Capital markets) and Security reference data knowledge
- Nice to have ADF and SSIS experience
- College degree required.
Check ALL our Jobs: Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap
Recommended Jobs
Software Engineer, Observability
Job Description Job Description CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leadin…
System Design Engineer
Job Description Job Description Holtec International and its subsidiary companies are designing an unfailingly safe and secure source of clean energy using nuclear fission, called the SMR-300 sma…
Pharmacist (Per Diem Evenings), Lakewood, NJ
Job Title: PD Pharmacist Location: MMC Southern Campus Department: Pharmacy Req#: 0000192990 Status: Per Diem Shift: Evening Pay Range: $65.34 - $65.34 per hour Pay Transparency:…
Clinical Dietitian I, Women's Health Center
Job Title: Clinical Dietitian I Location: Trinitas Regional Medical Ctr Department: Women's Health Center Req#: 0000169535 Status: Full-Time Shift: Day Pay Range: $62,400.00 - $72,80…
Warehouse Worker
Job Description Job Description Job Title: Warehouse Worker Job Description Join our dynamic team as a Warehouse Worker where you will play a vital role in the seamless operation of our wareh…
100% Remote Sales Consultant
Uncapped Earning Potential | High-Powered Solar Sales Opportunity Join SecureMyPower x The Solar Team (TST) - The Future of Solar Sales SecureMyPower has partnered with The Solar Team (TST) to b…
Pavement & Asphalt Maintenance Technician / Line Striper
Job Description Job Description Benefits: Competitive salary Flexible schedule Training & development What We Offer Competitive wages PMT Certification Program - Training, Skill…
Primary Care Physician
Job Description Job Description Are you a workaholic and energetic Physician and like being on the go? We are seeking a Primary Care Physician to do patient care in a nursing homes located in…
Groundskeeper - Burlington Twp School District - Facilities
The Groundskeeper is responsible for maintaining and improving site grounds. Assigned work such as mowing, trimming, leaf removal and duties related to inclement weather, such as snow removal, which …
Associate Chemist (3rd Shift)
Description Job Title: Associate Chemist I & II Location: Lakewood, NJ 08701 Shifts: 2nd & 3rd Join Our Team: At Accupac, we are Makers. From formulation to manufacturing, we serve t…