Databricks Data Engineer - Senior - Consulting - Location Open

Location: Anywhere in Country

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

Technology – Data and Decision Science – Data Engineering – Senior

We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and communication skills, along with a proven track record of successful end-to-end implementations in data engineering projects.

The opportunity

In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle.

Your Key Responsibilities

As a Senior Data Engineer, you will play a pivotal role in transforming data into actionable insights. Your time will be spent on various responsibilities, including:

• Designing, building, and operating scalable on-premises or cloud data architecture.
• Analyzing business requirements and translating them into technical specifications.
• Optimizing data flows for target data platform designs.
• Design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
• Collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives.
• Lead end-to-end data pipeline development, including data ingestion, transformation, and storage.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Provide technical guidance and mentorship to junior data engineers and team members.
• Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts.
• Manage client relationships and expectations, ensuring high levels of satisfaction and engagement.
• Stay updated with the latest trends and technologies in data engineering and cloud computing.

This role offers the opportunity to work with cutting-edge technologies and stay ahead of industry trends, ensuring you gain a competitive advantage in the market. The position may require regular travel to meet with external clients.

Skills And Attributes For Success

To thrive in this role, you will need a blend of technical and interpersonal skills. Your ability to communicate effectively and build relationships will be crucial. Here are some key attributes we look for:

• Strong analytical and decision-making skills.
• Proficiency in cloud computing and data architecture design.
• Experience in data integration and security.
• Ability to manage complex problem-solving scenarios.

To qualify for the role, you must have

• A Bachelor’s degree in Computer Science, Engineering, or a related field required (4-year degree). Master’s degree preferred
• Typically, no less than 2 - 4 years relevant experience in data engineering, with a focus on cloud data solutions.
• 5+ years of experience in data engineering, with a focus on cloud data solutions.
• Expertise in Databricks and experience with Spark for big data processing.
• Proven experience in at least two end-to-end data engineering implementations, including:
• Implementation of a data lake solution using Databricks, integrating various data sources, and enabling analytics for business intelligence.
• Development of a real-time data processing pipeline using Databricks and cloud services, delivering insights for operational decision-making.
• Strong programming skills in languages such as Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and the ability to work independently and as part of a team.
• Strong communication and interpersonal skills, with a focus on client management.

Required Expertise for Senior Consulting Projects:

• Strategic Thinking: Ability to align data engineering solutions with business strategies and objectives.
• Project Management: Experience in managing multiple projects simultaneously, ensuring timely delivery and adherence to project scope.
• Stakeholder Engagement: Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively.
• Change Management: Skills in guiding clients through change processes related to data transformation and technology adoption.
• Risk Management: Ability to identify potential risks in data projects and develop mitigation strategies.
• Technical Leadership: Experience in leading technical discussions and making architectural decisions that impact project outcomes.
• Documentation and Reporting: Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients.

Ideally, you’ll also have

• Experience with data quality management.
• Familiarity with semantic layers in data architecture.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

What We Look For

We seek individuals who are not only technically proficient but also possess the qualities of top performers. You should be adaptable, collaborative, and driven by a desire to achieve excellence in every project you undertake.

FY26NATAID

What We Offer You

At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more.

• We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $106,900 to $176,500. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $128,400 to $200,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.
• Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.
• Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter/Summer breaks, Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

Are you ready to shape your future with confidence? Apply today.

EY accepts applications for this position on an on-going basis.

For those living in California, please click here for additional information.

EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law. 

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at [email protected].