Data Science Specialist
HCLTech
Chennai, Karnataka, IndiaPosted 14 days agoDiscoveredMatch locked
Full-time
Job Summary
Lead the architecture, design, and implementation of enterprise-scale Microsoft Fabric data platforms. Responsible for building and managing end-to-end data solutions using OneLake, Lakehouse, Data Warehouse, Data Factory, and PySpark-based data engineering frameworks. Drive data integration, governance, security, and analytics enablement while supporting scalable, high-performance data platforms for manufacturing and enterprise reporting use cases.
Key Responsibilities
- Architect and implement end-to-end Microsoft Fabric solutions across OneLake, Lakehouse, Data Warehouse, and Data Factory.
- Design and develop Bronze, Silver, and Gold data layers using Medallion Architecture principles.
- Build and optimize scalable data ingestion, transformation, and orchestration pipelines.
- Develop ETL/ELT frameworks using Fabric Data Pipelines, Notebooks, and SQL endpoints.
- Design enterprise data models and ensure data quality, governance, lineage, and metadata management.
- Integrate data from multiple enterprise systems, APIs, manufacturing platforms, and industrial IoT sources.
- Implement security controls, monitoring, performance tuning, and operational best practices.
- Collaborate with business stakeholders, analytics teams, and reporting teams to deliver trusted data assets.
- Manage source control, CI/CD pipelines, and deployment processes using Azure DevOps and Git.
- Support enterprise analytics, reporting, and decision-making through scalable data platform solutions.
Required Skills
- Microsoft Fabric End-to-End Architecture
- OneLake
- Fabric Data Factory
- Fabric Data Pipelines
- Fabric Lakehouse
- Fabric Data Warehouse
- Fabric SQL Endpoint
- Fabric Notebooks (PySpark)
- Medallion Architecture (Bronze, Silver, Gold)
- Data Ingestion and Orchestration
- ETL/ELT Framework Development
- Delta Lake
- Advanced SQL Development and Performance Tuning
- Enterprise Data Modeling
- Data Governance, Data Lineage, and Metadata Management
- API and REST-based Data Integration
- Azure DevOps and CI/CD
- Git Version Control
- Performance Monitoring and Optimization
Preferred Skills
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Python Programming
- Kusto Query Language (KQL)
- Power BI Semantic Models
- Manufacturing, MES, or Industrial IoT Data Platforms
- Real-time Analytics and Event Processing
Other Requirements
- 8-12+ years of overall Data Engineering and Analytics experience.
- Minimum 2+ years of hands-on Microsoft Fabric implementation experience.
- Strong experience in enterprise-scale data platform architecture and modernization initiatives.
- Experience working with manufacturing, production, or industrial data environments is preferred.
- Microsoft Certifications:
- DP-700: Microsoft Certified - Fabric Data Engineer Associate (Required/Preferred)
- DP-600: Microsoft Certified - Fabric Analytics Engineer Associate (Added Advantage)
- Strong stakeholder management, problem-solving, and communication skills.
- Ability to lead technical discussions, architecture reviews, and design workshops.
- Experience working in Agile delivery environments and cross-functional teams.
Not included in the source posting: about the role, benefits.
Skills
azuresqlci-cddevopsetlgitagilepower-bipythonrest-api
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.