Senior Databricks Data Engineer

At EY, we're committed to empowering your career. Join us and shape a better working world with a team that values diversity and collaboration.

Technology - Data and Decision Science - Data Engineering - Senior

We're looking for a talented Senior Consultant Data Engineer with a focus on cloud data engineering, particularly Databricks. Ideal candidates will possess outstanding client management and communication skills, along with a strong track record in delivering successful data engineering projects.

The opportunity

In this exciting role, you'll design and construct analytics solutions that create substantial business value. Collaborating with other data professionals and stakeholders, you'll ensure technical requirements align with business goals, creating scalable data architecture and modeling solutions to support the full data lifecycle.

Your key responsibilities

• Design and build scalable on-premises or cloud data architecture.
• Analyze business requirements and translate them into technical specifications.
• Optimize data flows for target data platform designs.
• Develop and implement data engineering solutions using Databricks on cloud platforms (AWS, Azure, GCP).
• Collaborate with clients to understand data needs and deliver tailored solutions.
• Lead end-to-end data pipeline development, including ingestion, transformation, and storage.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Provide technical mentorship to junior data engineers and team members.
• Communicate complex data concepts effectively to stakeholders at all levels.
• Manage client relationships to guarantee high satisfaction and engagement.
• Stay updated with the latest advancements in data engineering and cloud computing.

This role provides the chance to work with cutting-edge technologies and stay ahead of industry trends, giving you a competitive advantage in the market. Be prepared for occasional travel to meet external clients.

Skills and attributes for success

To excel in this role, you will need a combination of technical and soft skills, particularly the ability to communicate effectively and build strong relationships. Key attributes include:

• Strong analytical and decision-making skills.
• Proficiency in cloud computing and data architecture design.
• Experience in data integration and security.
• A knack for solving complex problems.

To qualify for the role, you must have

• A Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.
• 2-4 years of relevant experience in data engineering focused on cloud solutions.
• 5+ years of experience in data engineering, specializing in cloud solutions.
• Expertise in Databricks and hands-on experience with Spark for big data processing.
• Proven track record in two end-to-end data engineering implementations.
• Strong programming skills in Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and the ability to work autonomously and within a team.
• Strong communication skills with a focus on client management.

Required Expertise for Senior Consulting Projects:

• Strategic Thinking: Ability to align data solutions with business strategies.
• Project Management: Experience in managing multiple projects, ensuring timely delivery and scope adherence.
• Stakeholder Engagement: Proficiency in engaging with stakeholders to understand their needs and present solutions.
• Change Management: Skills in guiding clients through data transformation processes.
• Risk Management: Ability to identify and mitigate potential risks in data projects.
• Technical Leadership: Experience leading discussions and making decisions that impact projects.
• Documentation and Reporting: Proficiency in creating detailed documentation and reports for clients.

Ideally, you'll also have

• Experience with data quality management.
• Familiarity with semantic layers in data architecture.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Understanding of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

What we look for

We seek adaptable, collaborative individuals who are driven to achieve excellence in their work.

What we offer you

Join EY for a comprehensive compensation and benefits package. Your performance will be recognized, and you'll experience a culture of professional growth and flexibility.

• Competitive base salary range (US locations): $106,900 to $176,500. New York City Metro, Washington State, and California range: $128,400 to $200,600.
• Team-led hybrid model, with expectations for in-person collaboration 40-60% of the time.
• Flexible vacation policy allowing you to manage your own time off based on individual needs.

Are you ready to take your career to the next level? Apply today and be part of our mission to shape a better working world.

We strive for high ethical standards and expect all candidates to share these values.

EY | Building a better working world