Sr. Data Engineer (AWS/Databricks)

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Sr. Data Engineer (AWS/Databricks) to join our innovative and dynamic team.

This is a hybrid role requiring onsite presence 3 days per week at an office location in either New York, NY or Lawrence Township, NJ.

Sr. Data Engineer (AWS/Databricks) | About You

As a Sr. Data Engineer (AWS/Databricks), you are responsible for designing and optimizing scalable data platforms that power analytics and business insights. You thrive in cloud-native environments and bring expertise across AWS, Databricks, and PySpark to build efficient, high-performing data pipelines. You are passionate about solving complex data challenges, improving reliability, and driving best practices in modern data engineering. You collaborate seamlessly with data scientists, analysts, and business leaders, ensuring end-to-end workflows deliver accurate and trusted data. With strong technical and architectural skills, you provide guidance and help shape the standards for a modern, scalable data ecosystem.

Sr. Data Engineer (AWS/Databricks) | Day-to-Day

• Architect and maintain scalable data pipelines leveraging AWS (Glue, EMR, Lambda, Redshift, Athena) and Databricks.
• Optimize data workflows to improve performance, reliability, and data quality across diverse data sources.
• Drive best practices in data engineering, including code quality, automation, and CI/CD processes.
• Collaborate with data science, product, and business teams to translate requirements into technical solutions.
• Evaluate and integrate big data tools and frameworks (Hadoop, Talend, SparkSQL) to enhance the data ecosystem.
• Provide technical guidance and establish engineering standards to ensure scalable, maintainable solutions.

Sr. Data Engineer (AWS/Databricks) | Skills & Experience

• 10+ years of experience in data engineering, with proven expertise in building and optimizing large-scale data pipelines.
• Deep proficiency in AWS cloud services (Redshift, Glue, Athena, EMR, ECS, Lambda) and Databricks.
• Strong hands-on skills with PySpark, SparkSQL, and advanced SQL for performance tuning and optimization.
• Experience with Hadoop ecosystems and ETL tools such as Talend.
• Demonstrated ability to architect end-to-end data solutions, ensuring scalability, data quality, and system reliability.
• Excellent communication skills with the ability to provide technical leadership and influence best practices across teams.