Deepak Yadav
Data Engineer | PySpark, Airflow, Snowflake, AWS
Gurugram · +91 98xxx xxxxx · deepak.yadav@email.com
Summary
Data engineer with 3 years building batch and streaming pipelines for payments data. Focused on reliable, well-modelled data that analysts can trust.
Experience
Data Engineer, SwiftPay, Gurugram
Jul 2023 – Present
- Built PySpark and Airflow pipelines loading 2 TB/day of payment events into Snowflake; cut end-to-end latency from 6 hours to 40 minutes.
- Modelled core finance tables in dbt with tests, reducing data incidents raised by analysts by half.
- Streamed transaction events via Kafka for near-real-time fraud features.
Education
- B.Tech Information Technology, NIT Kurukshetra, 2022
Skills
- Data: Python, SQL, PySpark, Airflow, Kafka, dbt
- Platforms: Snowflake, AWS (S3, Glue, EMR), Databricks