Databricks Technical Architect
About the role
- Lead the logical and physical design of 7 Silver dimension tables and 15 Gold certified data assets (8 fact, 7 dimension) with EM's D&A modeling team
Define Medallion layer standards for naming, partitioning, incremental loads, and data quality checks Build and review complex pipeline and transformation code for the Bronze-to-Silver and Silver-to-Gold flows Tune query and pipeline performance so Gold assets meet Power BI SLA expectations Implement security and governance controls for sensitive HR data, including access policies and masking Work with EM's DevOps team on CI/CD, environment promotion, and Databricks workspace management Guide the design of Spark Declarative Pipelines for new and migrated workloads Review the work of the Databricks Engineer and Systems Analysts, and run code and design reviews Present architecture decisions and trade-offs to EM technical leadership Document designs and run knowledge transfer so EM can operate the platform after the engagement Technical Skills:
- • Databricks (Delta Lake, Unity Catalog, Workflows, SQL warehouses)
Spark Declarative Pipelines (formerly Delta Live Tables) PySpark and Spark SQL, with advanced performance tuning Medallion architecture and dimensional modeling (star schema, slowly changing dimensions) Azure Data Factory and Azure Data Lake Storage Gen2 Azure DevOps (repos, pipelines, release management) Data governance, row-level security, and PII handling Power BI as a consumer of certified datasets (semantic model and DirectQuery or Import considerations) HRIS source familiarity: Workday, Dayforce, PeopleSoft Databricks certification (Data Engineer Professional or equivalent)
Perficient full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs including billable bonus opportunities. Encouraging a healthy work/life balance and providing our colleagues great benefits are just part of what makes Perficient a great place to work.
WHO WE ARE
WHAT WE BELIEVE
Disclaimer
Not included in the source posting: qualifications, benefits.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.