Databricks Architect

JD for Databricks Architect   Role Overview We are seeking an experienced Databricks Architect to design and lead enterprise-scale data platform solutions on Databricks. The role requires strong architectural ownership, cross-team leadership, and the ability to independently drive end-to-end solution design across business, engineering, and vendor ecosystems. The architect will define scalable Lakehouse architectures, ensure secure and governed data exchange, and enable high-performance, cost-optimized data platforms across the enterprise.   Key Responsibilities Design and implement enterprise Lakehouse architecture using Medallion framework (Bronze, Silver, Gold) with reusable and configurable design patterns. Architect batch and streaming pipelines using Delta Live Tables ensuring data quality, lineage, and reliability. Build scalable ingestion frameworks integrating multiple enterprise sources including SFTP, relational databases (Oracle, SQL Server, PostgreSQL), APIs, and SaaS systems. Integrate MDM platforms such as Reltio for golden record management and enterprise data consistency. Design secure and scalable storage architecture on Azure Data Lake Storage with lifecycle, partitioning, and cost optimization strategies. Implement enterprise data governance using RBAC, Unity Catalog, and fine-grained access control models. Enable secure data exchange using Delta Sharing and lakehouse interoperability connectors. Design orchestration frameworks using Apache Airflow integrated with CI/CD pipelines. Define cluster strategies including autoscaling, workload isolation, job clusters, and Spark performance tuning. Optimize compute and storage costs through workload tuning, caching strategies, and right-sizing approaches. Design Disaster Recovery (DR) and Business Continuity (BCP) architectures ensuring multi-region resilience and high availability. Implement enterprise data quality frameworks including validation rules, anomaly detection, SLA monitoring, and pipeline observability. Establish monitoring, logging, lineage, and observability frameworks for end-to-end data pipelines. Leadership & Collaboration Expectations Strong ability to create and communicate architecture diagrams and end-to-end solution designs. Act as a cross-team architecture owner driving alignment across data engineering, business, and platform teams. Independently lead technical discussions, design reviews, and architecture decision-making forums. Collaborate effectively with external vendors and implementation partners to ensure compliance with enterprise architecture standards. Strong stakeholder management and communication skills, with ability to translate technical architecture into business outcomes. Ability to drive execution across multiple teams with minimal supervision and strong accountability