Senior Data Engineer
- Designed and maintained ETL and ELT pipelines in Postgres and Snowflake using dbt, Snowpark, and PySpark; introduced custom macros and incremental strategies to automate DDL/DML and Slowly Changing Dimension (SCD) loads.
- Built large-scale ingestion and transformation pipelines in Python/Spark; tuned Snowflake warehouses and queries to improve performance and reduce compute spend by 35%.
- Implemented an event-driven data lake on AWS and GCP and exposed curated datasets via FastAPI endpoints to power dashboards and downstream applications.
- Developed robust SQL for data quality and cleaning, with automated checks and retries for resiliency.
- Partnered with Data Science / ML teams in a Scrum setting to productionize features and datasets; contributed to sprint planning and estimations, and communicated roadmaps and results to stakeholders.