Integration Data Engineer
Hybrid commute, 3 days on-site in Central NJ Locations and 2 day remote per week. This is a permanent FT career opportunity, with base salary range 110 -135K DOE, plus around 20% bonus and great benefits package. Looking for Integration Data Engineer with a background in SQL and data warehousing for enterprise level systems. The ideal candidate is comfortable working with business users along with business analyst expertise. Major Responsibilities:
- Design, develop, and deploy Databricks jobs to process and analyze large volumes of data.
- Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines.
- Optimize Databricks jobs for performance and scalability to handle big data workloads.
- Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
- Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
- Demonstrated proficiency with Data Analytics, Data Insights
- Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process
- Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend and SnowSQL) to develop data pipeline solutions to ingest and exploit new and existing data sources.
- Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
• 5+ years - Enterprise Data Management
• 5+ years - SQL Server based development of large datasets
• 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Snowflake experience is good to have
• 3+ years Python (Numpy, Pandas) coding experience
• 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints.
• Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
• Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills
• Capable of discussing enterprise level services independent of technology stack
• Experience with Cloud based data architectures, messaging, and analytics
• Superior communication skills
• Cloud certification(s) preferred
• Any experience with Regulatory Reporting is a Plus Education
• Minimally a BA degree within an engineering and/or computer science discipline
• Master’s degree strongly preferred Please email your resume or use this link to apply directly: Or email: [email protected]
Check ALL our Jobs: Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap
Recommended Jobs
Registered Nurse Per Diem
Job Description Job Description We are hiring an RN for home care assessments. This is a per diem position. Flexible schedule. Requirements: Must have RN in NJ Current PPD Drivers …
Mammography Technologist
Job Description Job Description Responsibilities Join Our Team: $7,500 Sign-On Bonus or Student Loan Payment Plan! Artificial Intelligence; Advanced Technology; The very best in patient …
PC Technician
Job Description Job Description Description : doesn’t have to be a ton of experience. The hiring manager really likes candidates who are go-getters and self-starters/take action. Soft skills are…
Plant Operations Manager - Manufacturing
Job Description Job Description Company Description manufacturing company Job Description Packaging and container manufacturer in New York’s southern tier (Near Pennsylvania's northe…
Division 8 Project Manager - New Jersey or Remote
Job Description Job Description Solid Rock Recruiting- The #1 Specialty Construction Recruiting Firm in The USA Seeking Experienced Project Manager and Assistant Project Manager – Remote Oppor…
Service Representative - Eyewash/WaterBreak
Requisition Number: 207061 Job Description Cintas is seeking a Service Representative - Eyewash/WaterBreak for our First Aid and Safety division. Responsibilities include servicing and maintai…
Scaffold Standby and Operator
Job Description Job Description We are looking for qualified individuals who have past experience performing standby and/or operating permanent/temporary swing stage units. We offer a flexib…
Surgical Tech CWR - SURGTECH 25-24180
Job Title: Surgical Technologist (Surgical Tech) Location: Neptune, NJ Shift: 7:00 AM – 7:30 PM | 3x12 Hour Shifts | Every Other Weekend Required Contract Type: 13-week Assign…
Sales Consultant
Job Description Job Description We are looking for a Minimum of 2 Years Auto Sales Experience, An enthusiastic and motivated Car Sales Consultant to join our dynamic sales team. In this role, you…
Quarry Maintenance Mechanic
Job ID: 512409 Safety, Integrity, Quality are the foundation or core values on which Tilcon New York Inc., a CRH company operates. Located in New York and New Jersey, Tilcon New York Inc. …