Data Engineering Associate

I built the data foundation behind reporting and machine learning: Python, SQL, and Spark pipelines handling more than 2 million records a day at 99.9% reliability. I helped bring more than 12 sources into a shared Delta Lake layer and checked its outputs against the legacy system before cutover. One of my most useful fixes was small but consequential: I found a SQL join that overstated a daily metric by 8%, explained the 14 days it affected, and corrected and backfilled the history within three hours.