Data Engineering Manager
Data Engineering Manager
Work you'll do
A Data Engineering Manager will lead solution architecture for a PySpark-based enterprise data processing framework, improving scalability and standardizing transformation patterns across programs. Migrate major projects from on-premises platforms to AWS-based cloud data lake ecosystems, improving platform flexibility and modernization readiness. Design and implement a metadata-driven processing framework using PySpark, Python, Databricks, and AWS, reducing project go-live timelines. Build data lineage capabilities and conducted POCs in data observability, improving change impact analysis and accelerating enhancement delivery. Develop ingestion frameworks in Talend and later migrated orchestration to Apache Airflow, improving data onboarding efficiency. Performance tuning complex data quality rules, improving processing efficiency and reducing run-cost and maintenance overhead. Work across the full SDLC, including client discussions, requirements gathering, architecture design, development oversight, and production deployment. The successful candidate would possess these skills:
- Ability to work independently and collaborate as part of a team
- Effective written and verbal communication skills
- Meticulous attention to detail and quality of work product
- Ability to build and sustain professional relationships
- Ability to lead projects or workstreams
- Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
- Strong interpersonal skills and professional demeanor
- Ability to meet deadlines
- Ability to provide clear guidance to others
The Team
Required Qualifications
- 8+ years of AWS cloud services and data lake build & support
- Strong experience in PySpark-based data engineering and ETL development
- SQL (Snowflake) pipeline build, data analysis, and data validation
- Requirements gathering and stakeholder coordination
- Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience
- Limited immigration sponsorship may be available.
- Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve
Preferred
- Strong analytical, problem-solving, communication, stakeholder-management, offshore coordination, documentation, and knowledge-transfer skills
- Analytical ability to manage multiple projects and prioritize tasks into manageable work product
- Can operate independently or with minimum supervision
- Excellent Written and Communication Skills
- Ability to deliver technical demonstrations
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
Deloitte is committed to providing reasonable accommodations for people with disabilities. If you require a reasonable accommodation to participate in the recruiting process, please direct your inquiries to the Global Call Center (GCC) at USTalentCICInbox@deloitte.com.
Recruiting tips
Benefits
Our people and culture
Our purpose
Professional development
Not included in the source posting: what you'll do.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.