Integration Data Engineer
Hybrid commute, 3 days on-site in Central NJ Locations and 2 day remote per week. This is a permanent FT career opportunity, with base salary range 110 -135K DOE, plus around 20% bonus and great benefits package. Looking for Integration Data Engineer with a background in SQL and data warehousing for enterprise level systems. The ideal candidate is comfortable working with business users along with business analyst expertise. Major Responsibilities:
- Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
- Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
- Demonstrated proficiency with Data Analytics, Data Insights
- Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
- Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
- Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
• 5+ years - Enterprise Data Management
• 5+ years - SQL Server based development of large datasets
• 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have
• 3+ years Python (Numpy, Pandas) coding experience
• 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints.
• Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
• Capable of discussing enterprise level services independent of technology stack
• Experience with Cloud based data architectures, messaging, and analytics
• Superior communication skills
• Cloud certification(s) preferred
• Any experience with Regulatory Reporting is a Plus Education
• Minimally a BA degree within an engineering and/or computer science discipline
• Master’s degree strongly preferred Please email your resume or use this link to apply directly: Or email: [email protected]
Check ALL our Jobs: Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap
Recommended Jobs
Daycare Infant Assistant Teacher
Job Description Job Description Benefits/Perks Career Advancement Opportunities Great Work Environment Job Summary We are seeking an experienced and energetic Daycare Infant Assistan…
MEP Superintendent
At AECOM, we’re delivering a better world. We believe infrastructure creates opportunity for everyone. Whether it’s improving your commute, keeping the lights on, providing access to clean wat…
Future Medical Aesthetician
Greenwich Medical Spa (GMS) is an industry leading, award winning medical spa providing non-invasive cosmetic treatments. GMS was established in 2005 with the unwavering mission to inspire confidenc…
Part-Time Assistant Manager
Apply in ~60 Seconds Join Our Team: A career at Cinemark means you'll have epic opportunities to immerse yourself in our industry. But that's just the beginning — a front row seat means incredi…
Owner-Operators Needed - Work With Our Freight Dispatch Service - $7,500 to $12,500 gross
Subject: Owner-Operators Needed – Work With Our Freight Dispatch Service We are a freight dispatch service looking for experienced Owner-Operators to partner with us and maximize their loads.…
Legal Technology Training Specialist
Our client is seeking a Legal Technology Training Specialist for our Hackensack, New Jersey office to join our IT team and support the Firm's technology training initiatives. In this hybrid ro…
Counselor - Adolescent Partial Care
Job Description Job Description Bayside is a partial care program assisting youth, ages 11-17 years old, with emotional and behavioral needs through psycho-education, counseling, and support 5 da…
Full-Time Traveling Construction Foreman
Job Description Job Description We are seeking a Full-Time Traveling Construction Foreman to join our team! You will oversee project execution, scheduling, and subcontractor management. Duties al…
HHA/CNA Medical Respite Unit
Home Health Aide (HHA) or Certified Nursing Assistant (CNA) in Trenton, NJ Unique position in a 4-bed medical respite unit evenings and nights. Under the direction of an RN, and partnering with a…
INSIDE COUNTER SALES POSITION
Job Description Job Description Local lumber & building supplies dealer seeking a person with a positive attitude and pleasant disposition to assist in professional contractor & retail consumer sa…