Databricks Data Engineer
Company Description
Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.
With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.
Job Description
Role: Databricks Data Engineer
Location: NJ/ PA onsite
About the job
We are seeking a Databricks Data Engineer with experience in designing and developing data pipelines using Azure Databricks, Data Factory, and Datalake. The role involves managing large volumes of data, building complex ETL solutions, and working closely with business teams to deliver robust data transformations and analytics solutions.
Responsibilities:
- Design and develop ETL pipelines using ADF for data ingestion and transformation.
- Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
- Write SQL, Python, and PySpark code for efficient data processing and transformation.
- Understand and translate business requirements into technical designs.
- Develop mapping documents and transformation rules as per project scope.
- Communicate project status with stakeholders, ensuring smooth project execution.
Requirements Must have:
- 10-12 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
- Hands-on experience with Azure services: ADLS, Azure Databricks, Data Factory, Synapse, Azure SQL DB.
- Experience in SQL, Python, and PySpark for data transformation and processing.
- Familiarity with DevOps and CI/CD deployments.
- Strong communication skills and attention to detail in high-pressure situations.
- Experience in the insurance or financial industry is preferred.
Regards,
Manoj
Derex Technologies INC
Contact : 973-834-5005 Ext 206
Additional Information
All your information will be kept confidential according to EEO guidelines.
Recommended Jobs
Physical Therapist, F&W Carteret-Physical Therapy
Job Title: Physical Therapist Location: RWJ Rahway Department Name: F&W Carteret-Physical Therapy Req #: 0000231628 Status: Hourly Shift: Day Pay Range: $68.55 - $68.55 per hour P…
Sales Representative
Drive Your Career Forward Join Snap-on as a Route Sales Representative! Are you ready to sell tools, build relationships, and grow your career? At Snap-on, our Mobile Company Stores are more than v…
Private Aviation Security Screener EWR
Part-Time, Seasonal OPENING IN EWR AIRPORT AND SURROUNDING LOCAL AREA Retirees and veterans are encouraged to apply! Security minded? Be Elite – Secure the Skies with Elite Team Logistics!…
Guest Service - Restaurant 201536 - 535 W. Elizabeth, Brownsville, TX 78520
Reports To (Title): Restaurant General Manager Department: Field Operations Job Summary: To serve each guest courteously, quickly and efficiently while adhering to…
Tool & Die Maker
Job Title: Tool and Die Maker Job Summary: We are looking for a highly skilled Tool and Die Maker with a strong background in injection mold building to join our precision manufacturing team. T…
Professional Coding Provider Educator & Reviewer
Job Title: Educator Location: System Business Office Department Name: HIM - Professional Req #: 0000220852 Status: Salaried Shift: Day Pay Range: $75,597.00 - $106,780.00 per year …
CNA
Job Description: Responsibilities (CNA) Certified Nursing Assistant: Perform ADLs such as bathing, dressing, serving meals, feeding, ambulating, turning, positioning, etc. Maintain clean livin…
Registered Nurse (RN) Float Pool Critical Care, Livingston, NJ, Full-Time, Evening (7P-8A)
Job Title: Registered Nurse (RN), 12.5 Specialty Float, Critical Care Location: Cooperman Barnabas Medical Ctr Department Name: Float Critical Care Req #: 0000235808 Status: Hourly Shif…
Dental Hygienist (Jersey City)
We offer a competitive hourly rate plus a monthly performance bonus tied to your production and clinical excellence. Our top-earning Hygienists make up to $73/hour in Brooklyn NY, combining base pay …
Package and Delivery Driver
Join our team as a Part-Time Weekend Package & Delivery Driver with a FedEx Ground Contractor. We are seeking reliable and motivated individuals to deliver packages efficiently and safely. This role …