Databricks Architect
Responsibilities
- Develop modern data solutions and architecture for cloud-native data platforms.
- Build cost-effective infrastructure in Databricks and orchestrate workflows using Databricks/ADF.
- Lead data strategy sessions focused on scalability, performance, and flexibility.
- Collaborate with customers to implement solutions for data modernization.
- Create training plans and learning materials to upskill VM associates.
- Build a smart operations framework for DataOps and MLOps.
Requirements
- Should have 14+ years of experience with last 4 years in implementing Cloud native end-to-end Data Solutions in Databricks from ingestion to consumption to support variety of needs such as Modern Data warehouse, BI, Insights and Analytics
- Experience in architecture and implementing End to End Modern Data Solutions using Azure and advanced data processing frameworks like Databricks
- Experience with Databricks, PySpark, and modern data platforms.
- Proficiency in cloud-native architecture and data governance.
- Strong experience in migrating from on-premises to cloud solutions (Spark, Hadoop to Databricks).
- Understanding of Agile/Scrum methodologies.
- Demonstrated knowledge of data warehouse concepts. Strong understanding of cloud-native databases, columnar database architectures.
- Ability to work with Data Engineering teams, Data Management Team, BI and Analytics in a complex development IT environment.
- Good appreciation and at least one implementation experience on processing substrates in Data Engineering - such as ETL Tools, Kafka, ELT techniques
- Data Mesh and Data Products designing, and implementation knowledge will be an added advantage.
Recommended Jobs
New Account Installer - Part Time - Temporary
Requisition Number: 233116 Job Description Cintas is seeking a New Account Installer to successfully ensure that new customers are highly satisfied with Cintas's products and services. Respons…
Physician Assistant - Neurology
Description Physician Affiliate Group of New York (PAGNY) is adding a Physician Assistant - Neurology to the group at NYC Health + Hospitals/South Brooklyn Health. South Brooklyn Health is a rede…
Quality Inspection Supervisor
Providing Engineering and Manufacturing solutions since 1955, Triangle specializes in precision engineering and manufacturing of highly complex, tight-tolerance machined parts and assemblies. Triangle…
Dev Ops Engineer - Project Delivery Specialist Analyst
DevOps Engineer - Project Delivery Specialist Analyst Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced DevOps Engineer …
Java Software Engineer III
Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorganChase within Commercial &…
Lead Data Scientist - VP - Home Lending Data & Analytics
Job Description As a valued member of our Home Lending Data & Analytics Applied AI/ML team, you will be at the forefront of our firm-wide initiatives to innovate and enhance Data & Analytics functio…
Registered Behavior Technician
Job description Salary: $23 - 26 per hour Reference: Breakthrough BT Behavior Technician (BT) Location: Bound Brook, NJ (In-home services within a 15-mile radius) Employment Type: Part-Tim…
Dedicated Class A CDL Truck Driver - Home Weekly!
SWIFT DEDICATED REFRIGERATED OPPORTUNITY $5000 Sign on Bonus HOME WEEKLY! NO TOUCH FREIGHT Advantages of Swift Dedicated Refrigerated Fleet ~Average $1,100 + per week! ~Home Daily! ~No-touch …
Pediatric Allergist/Immunologist - Long Branch, NJ
Pediatric Allergist/Immunologist - Long Branch, NJ Contact a Physician Recruiter Job ID: 984551 Location Opportunity Criteria Specialty: Pediatrics Profession: Physician (MD,DO, Res…