Databricks Engineer
Role Summary
We are seeking an experienced Databricks Engineer with strong expertise in data engineering, big data processing, and cloud platforms. The ideal candidate will have hands-on experience in Databricks, PySpark, and building scalable data pipelines in Azure or AWS environments.
Key Responsibilities
-
Design, develop, and optimize scalable data pipelines using Azure Databricks / AWS Databricks
-
Develop data transformation logic using PySpark / Spark SQL
-
Build and maintain ETL/ELT workflows for structured and unstructured data
-
Work with data lakes and cloud storage (Azure Data Lake / AWS S3)
-
Optimize Spark jobs for performance and scalability
-
Implement data quality checks and validation processes
-
Collaborate with Data Architects, BI teams, and business stakeholders
-
Support CI/CD pipelines and DevOps practices for data deployments
-
Troubleshoot production data issues and provide long-term solutions
Required Skills
-
7+ years of Data Engineering experience
-
3+ years of hands-on experience with Databricks
-
Strong experience in PySpark & Spark SQL
-
Experience with Azure Data Factory or AWS Glue
-
Experience working with Delta Lake
-
Strong SQL skills
-
Experience with cloud platforms (Azure or AWS)
-
Knowledge of data warehousing concepts
-
Experience in performance tuning Spark jobs
-
Familiarity with Git, Jenkins, Azure DevOps
Nice to Have
-
Databricks Certification
-
Experience with Snowflake
-
Knowledge of streaming (Kafka / Spark Streaming)
-
Experience with Terraform or Infrastructure as Code
-
Banking/Finance domain experience (preferred for NY/NJ roles)
Recommended Jobs
Local Class B CDL Truck Driver
Job Description Centerline is your one access point to limitless truck driving opportunities. Our job is to connect you with safe, rewarding work at top companies while maintaining your flexibilit…
Field Service Technician- AmazonTEB6- Cranbury, NJ
Field Service Technician Status: Non-Exempt (hourly) Department: Field Service Position Summary The Field Service Technician will support our fuel cell products currently installed in ele…
Health Care Specialist/Combat Medic
The Health Care Specialist /Combat Medic (MOS 68W) is the primary Health Care representative for the United States Army both in a clinical and a tactical environment. The Healthcare Specialist in a c…
Production Supervisor (2nd Shift)
Preco is now hiring a Full-Time Production Supervisor (2nd Shift) for their Metals Department in Somerset, WI. The Production Supervisor would have all production personnel on that shift as direc…
Legal Marketing Manager
Legal Marketing Manager Practice Area : Various with focus in Dental Industry Legal Services Location : Roseland, NJ 07068 Schedule : Hybrid | Full-Time | Exempt | Immediate Start Sa…
Banking Relationship Specialist (Cresskill)
Description: About us: ConnectOne Bank proves that putting people first is a better way to do business. At ConnectOne, we’re builders — of businesses, communities, and equity. Most importantly, …
Job Offer: LPN 1-1 Patient Care (Tarrytown)
Become an Angel LPN 1-1 Patient Care (Tarrytown) Join an award winning home care agency with amazing opportunities today!! Angels on Call is currently looking for a Part time Licensed Practic…
Physical Therapist IP Diem - rates based on weekend commitment. Consistent schedules available
Capital Health is the region's leader in providing progressive, quality patient care with significant investments in our exceptional physicians, nurses and staff, as well as advance technology. Capit…
People Experience Specialist (Wayne, NJ)
With a passion for life Join our diverse teams of passionate people and a career that allows you to develop both personally and professionally. At Getinge we exist to make life-saving tech…
Nurse Case Manager III
Job Responsibilities: ~ The care manager is responsible for assessing and evaluating members with potential care management needs through telephonic and face to face assessments in various settings…