Senior Principal Architect – Data Engineering & Analytics

Lead the end-to-end design, governance, and optimization of a federated lakehouse architecture (Azure Fabric + Databricks Delta ecosystem) supporting multi-domain analytics, near real-time ingestion (CDC/streaming/API), and enterprise-grade semantic consumption layers. This role requires hands-on architectural authority across Medallion architecture, Unity Catalog governance, cost-performance engineering, and GenAI-enabled analytics interfaces (Text-to-SQL / knowledge agents). Key Responsibilities Architect multi-layered lakehouse (Bronze–Silver–Gold) with strict data contracts and lineage enforcement Drive platform consolidation and workload optimization (compute/storage separation, query pruning, caching strategies) Establish governance guardrails (RBAC, auditability, cataloging, data quality SLAs) Lead high-impact transformations (legacy RDBMS → Delta Lake migration, report rationalization, semantic layer redesign) Implement GenAI-driven analytics interfaces with controlled prompt orchestration and feedback loops Own cost-to-value metrics (infra reduction, query efficiency, report minimization, productivity uplift) Requirements 10+ years in enterprise data architecture / distributed data systems Proven ownership of large-scale lakehouse or data platform modernization Deep expertise in : Databricks (workflows, Delta Lake optimization, Unity Catalog) Azure Fabric / Synapse ecosystem PySpark performance tuning, query plan optimization Demonstrated experience in : Report rationalization at scale (≥ 1,000 reports) Data quality incident reduction (>90%) via architecture controls Cost optimisation (>40%) through platform redesign Exposure to GenAI in enterprise analytics (Text-to-SQL, copilots, knowledge systems) Strong governance orientation (data contracts, lineage, audit frameworks) SKILLS Analytics & Architecture: Analytics solution design, Data Platform Modernization, Data Strategy & Operating Model Design, Target Architecture & Roadmap Definition, Architecture Governance & Decision Frameworks, Platform Evaluation & Selection Data Engineering & BI: Data Engineering, Data Modeling, Business Intelligence, Data Governance, Database Optimization, Cost Optimization, Query Tuning, CI/CD, Cloud Data Platforms, Enterprise Data Architecture Leadership & Collaboration: Stakeholder Management, Cross-functional Collaboration, Team Leadership, Data-centric AI, GenAI Technical Tools & Languages: SQL, Python, Databricks, Azure Fabric, Power BI, Metabase, Excel, Delta Lake, PySpark, TiDB, MySQL, SQLServer, PostgreSQL, ElasticSearch, Git, Shell scripting, Text-to-SQL, PandasAI, Fabric Data Agents, Google Apps Script