Senior Manager, Databricks Architect, AI&Data, FS
About the role
The opportunity
The EY Financial Services AI & Data team is continuing to grow and develop unique advisory propositions aligned to market needs and demand. We are currently looking for an exceptional Senior Manager to lead on developing our Data Engineering Capability with an initial focus on Databricks. This is a senior architecture role and will require an individual with an exceptional track record of delivering data transformation programs in the Financial Services sector.
The AI & Data practice works collaboratively with our clients to enhance their ability to solve complex business problems by exploiting data and analytics strategies and solutions. We provide expertise and delivery in three core areas which all work closely together:
- Data Architecture & Engineering - Focusing on next generation data solution architecture design and implementation
- Data Management & Strategy - Supporting our clients with Data Strategy, Data Governance Data and Analytics Target Operating Model Design and wider Data Office and CDO support functions
- Data Science and Information Analysis - Working with our clients to design build and integrate Machine Learning and AI solutions into their core business platforms and processes to drive greater insight and increased process efficiency and automation. We also help them design and implement modern data visualisation and reporting solutions
Your key responsibilities
- Lead the design and implementation of scalable data architecture solutions using
Databricks on Azure
.
- Architect and optimize
data pipelines
for structured and unstructured financial data, ensuring performance, reliability, and compliance.
- Demonstrate
prior experience in standing up and operationalizing Databricks platforms
, including workspace setup, cluster configuration, and CI/CD integration.
- Lead and execute
large-scale lift-and-shift data migrations
from legacy platforms to Databricks, ensuring minimal disruption and high data fidelity.
- Collaborate with cross-functional teams to align data architecture with
financial regulations
(e.g., GDPR, Basel III, MiFID II).
- Drive adoption of
Delta Lake
Apache Spark
MLflow
for advanced analytics and machine learning use cases.
- Provide technical leadership and mentoring to data engineers and analysts across financial domains such as risk, trading, and compliance.
- Establish best practices for
data governance
, lineage, and metadata management within the Databricks environment.
- Translate business needs into robust
data products
that support real-time decision-making and predictive modeling.
- Lead performance tuning, cost optimization, and
security hardening
of Databricks on Azure.
To qualify for the role, you must have
- A track record of delivering large Databricks data transformations & appropriate Databricks industry certifications
- A deep understanding of Financial Services to develop the right AI, Data and Analytics solutions to meet their needs
- Experience of building high performing teams and exceptional leadership and interpersonal skills
- Deep understanding of the emerging technology trends including adoption of cloud-based technologies and advance data technologies with a clear perspective on where the market is going.
- Ability to successfully deliver across multiple engagements, exceed client expectations, manage commercial aspects and manage quality and risk
- Ability to engage with senior stakeholders and manage large cross functional projects
- Intellectual strength / flexibility to rapidly understand complex problems and rationalise these into workable solutions which can then be delivered
- Exceptional storytelling, communication, presentation, business writing and professional skills, including being able to liaise with both technical and business contacts at our clients.
- Previous consulting experience will be greatly valued
- A university degree, 2:1 (or equivalent) or above is usually preferred, however we would be open to outstanding candidates who may have followed an alternative academic path.
What we look for
What working at EY offers
We offer a competitive remuneration package where you'll be rewarded for your individual and team performance. Our comprehensive Total Rewards package includes support for flexible working and career development, and with FlexEY you can select benefits that suit your needs, covering holidays, health and well-being, insurance, savings and a wide range of discounts, offers and promotions. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that's right for you
About EY
Please note
EY | Building a better working world
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.