Actively Looking for a ETL Data Engineer
Role: ETL Data Engineer
Location: Jersey City, NJ/ NY onsite Day 1 (need only Locals)
Please don t share Fake Consultants
Mail:
Job Description:
- 8+ yrs. in Azure Databricks technologies.
- Good understanding of ETL, BI and DW technologies.
- Hands-on experience on JSON or XML files as sources.
- Experience in autoloader for incremental loading and explode options for flattening data
- Experience in loading Delta live tables
- Experience in PySpark or Spark using data frames.
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
- Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Utilizing Azure Databricks to create and maintain ETL (Extract, Transform, Load) operations.
- Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
- Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
- Monitoring and resolving data pipeline problems to guarantee consistency and availability of the data.
- Good communication skills Oral & Written
Recommended Jobs
Senior Energy Procurement Specialist
Requisition ID: 108307 Share Our Purpose. Be Yourself. Feel Valued. People are the heart of our business. As an American Water employee, you will be offered a competitive salary and hea…
Managing Director - Airport Operations Customer Service
Achieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using…
Billing Coordinator
Job Description Job Description TITLE: BILLING COORDINATOR Job Summary: Compiles, manages, and executes attorney billing. Creating and sending invoices, tracking payment processes, keepi…
Customer Care Rep-Special Markets
Description What sets us apart? ~ Competitive compensation plan, base salary, and annual incentive ~ Health Benefits: medical, dental, vision, short term and long- term disability and wellness pr…
Dental Hygienist
Job Description Job Description Starting at $65,400 MAJOR FUNCTION Under the general supervision of a Dental Director, work closely with the dentist to diagnose, prevent and treat oral disea…
Cleaner - Day Shift
Visión general: Imperial Cleaning es una de las empresas de limpieza de propiedad independiente más grandes del país, que brinda servicios de limpieza profesional a minoristas, oficinas, instalaci…
End User Support Manager
Kering is seeking an End User Support Manager in Wayne, NJ to oversee IT support operations for retail and corporate users. This role involves managing budgets, ensuring service quality, and maintaini…
Server
Job Description Job Description Benefits/Perks Flexible Scheduling Competitive Compensation Career Advancement Opportunities Job Summary We are seeking an experienced Server t…
Senior Director, Global Clinical Operations - Early Phase
Join a Legacy of Innovation 125 Years and Counting! Daiichi Sankyo Group is dedicated to the creation and supply of innovative pharmaceutical therapies to improve standards of care and address dive…
Flow Cytometry Specialist
Flow Cytometry Specialist The Valley Hospital, Ridgewood, USA POSITION SUMMARY: Responsible for the technical activities and the research and clinical services of the Flow Cytometry Laboratory. The…