Curriculum Vitae

Forward-Deployed Telecommunications Engineering · Delta Lake Modernization

• Informatica Migration: Architected and deployed scalable PySpark pipelines on Databricks to replace legacy Informatica (IICS) and Oracle ETL workflows, cutting pipeline runtime by 42% and successfully decommissioning legacy infrastructure.
• Stakeholder POCs: Embedded directly with telecommunications stakeholders to engineer custom Databricks POCs, translating complex operational requirements into automated tracking frameworks and production-ready data pipelines.
• Store-and-Forward Ingestion: Designed store-and-forward batch ingestion frameworks processing multi-gigabyte compressed .gz files into Delta Lake Medallion architectures, optimizing partition pruning and Z-Ordering to accelerate queries by 3.5x.
• Automated Reconciliation Engine: Built an automated production diff and reconciliation engine using PySpark to perform primary key validation, schema drift detection, and discrepancy logging across billions of records between on-prem EDW and cloud storage.
• SLA Optimization: Configured modular Databricks Multi-Task Workflows utilizing YAML-based task definitions, conditional job execution, and automated alerting protocols to achieve 99.9% pipeline SLA reliability.
• Data Governance & Compliance: Implemented end-to-end OneTrust and CCPA automated deletion pipelines across Databricks Unity Catalog storage volumes and object stores, ensuring 100% enterprise regulatory compliance.

Enterprise Data Analytics · Cross-System Reconciliation

• Cross-System Reconciliation: Led cross-system data reconciliation, writing complex SQL and PySpark scripts to investigate log file count mismatches, identify data type conversion errors, and resolve severe timestamp filtering anomalies.
• Query-Ready Modeling: Engineered highly optimized, query-ready data models specifically structured for downstream dashboard exploration, directly accelerating business intelligence query response times for executive stakeholders.
• Pipeline Monitoring: Developed a dynamic tracking framework that ingested unstructured operational logs into consolidated reporting tables, generating automated KPI discrepancy reports to monitor end-to-end pipeline health.
• Historical Backfill: Wrote advanced SQL queries utilizing complex date-filtering options and window functions to isolate missing historical records, executing targeted backfill procedures to ensure 100% financial data completeness.