Resident Solutions Architect (Databricks)

Some of the major responsibilities for an RSA are:

• Engage with customers on short- to mid-term professional services projects using the Databricks platform (data engineering, data science, cloud).

• Design and build reference architectures, help with production-level use cases and deployments of big data / AI applications.

• Collaborate with engagement/project managers, customer teams, and internal engineering/support teams to ensure technical delivery meets customer needs

• Provide escalated technical support or operational assistance for customer engagements, helping to resolve issues or unblock customers

• Work hands-on: write code (e.g., Python, Scala), work with distributed compute (Apache Spark), integrate across cloud ecosystems.

• Possibly scope new engagements, support sales or pre-sales (depending on region/team) by estimating effort, defining deliverables.

• Provide feedback to product/engineering from customer engagements (help improve platform, features

Required Skills & Qualifications

• Several years (often 8+ years) in data engineering, analytics, platform roles.

• Strong coding ability in Python or Scala, and comfortable with distributed processing (Spark).

• Experience working across at least one cloud provider (AWS, Azure, GCP) and preferably familiarity with multiple.

• Knowledge of production deployments: CI/CD, MLOps, data architectures.

• Good client-facing / consulting / customer engagement skills (communicating technical ideas, scoping projects, working with customer teams).

•

• It's

: you'll often be working as a consultant/embedded engineer with customers, delivering real implementations rather than purely strategy.

• The role is technically deep: you'll not only design solutions but often build them, debug issues, optimize performance.

Because it is delivery-oriented, you may deal with customer escalations and operational issues, not just green-field new builds.

• You'll need adaptability: customers across industries, various workloads (ETL, streaming, AI/ML), different cloud platforms.

• The role also helps the customer adopt Databricks, so you're enabling change in how they think about data/AI, not just delivering code

• Role of an RSA
• Be a

.

• Set expectations and

with their concerns.

• Always

.

• Strategic Nature of PS Consulting
• Focus on solving problems to

.

• Use

.

• Identify stakeholders, understand drivers of change, and

.

• Offer

to free up customer bandwidth for strategic tasks.

• Build vs. Buy Mitigation
• Assess if building aligns with the company's

.

• Ask: Does owning this make you money, or is it a cost center?

• Highlight

in scalability and maintainability.

• Empathize - custom solutions are often someone's baby.

• Offer

to demonstrate Databricks' strengths.

• Position Databricks as a

over maintaining fragile systems.

• Spark Performance & Business Disruption Concerns

•

- understand the specifics: data size, current framework, future scaling needs.

• Clarify if Spark is truly the bottleneck.

• Offer

on speed, performance, and cost.

• Build a clear, phased

with deliverables.

• Coordinate with the

to align messaging and reinforce trust.

• UC Feature Gaps & Overpromising
• Determine if missing features are

on PUPR (Public Preview) vs. GA (General Availability).

• If necessary,

to bridge gaps.

• Re-align customer expectations with reality and roadmap.

7+ years experience in data eng, data platforms & analytics,