Rahul Khairnar

Hi, I’m a Senior Azure Data Engineer with strong experience in designing and developing scalable ETL/ELT data pipelines and data engineering solutions on Azure.

My core expertise includes Azure Data Factory, Azure Databricks, PySpark, Apache Spark, Python, SQL, Oracle/PL-SQL, and Delta Lake. I have worked extensively on building batch and incremental/CDC pipelines, data transformation, data validation, and integrating data from multiple sources.

In Azure Data Factory, I have experience designing parameterized and metadata-driven pipelines, handling dependencies, error handling, retries, monitoring, and implementing reusable pipeline frameworks.

On the Databricks side, I work with PySpark and Spark for large-scale data processing, including performance tuning, handling data skew, partitioning, caching, optimizing joins, and managing Spark workloads efficiently. I also have experience with Delta Lake, schema evolution, fault tolerance, and data quality.