Data Platform Lead
Group AMANA
Description
Amana is seeking an experienced Data Platform Lead with deep expertise in Databricks, the Microsoft Azure ecosystem, and modern lakehouse architectures. The ideal candidate will play a central role in Amana's ongoing platform refresh, moving workloads from Synapse Analytics to a Databricks lakehouse with Unity Catalog, and building the technical foundation that powers analytics, AI, and governance across the enterprise. This role sits within Amana's Data Science, Governance & AI Centre of Excellence, working alongside architects, engineers, analysts, data scientists, and AI engineers, with future growth opportunities into senior platform leadership.
Why This Role Matters
Amana operates across capital-intensive sectors where data reliability, cost discipline, and speed of insight are business-critical. The enterprise data platform is the backbone of every downstream analytics, AI, and governance initiative — from ERP-integrated reporting and predictive models to Agentic AI and Copilot rollouts across the group.
You will be at the technical centre of this transformation, designing, building, and hardening the lakehouse that the rest of the function depends on.
Core Responsibilities
Lakehouse Architecture & Delivery
- Design and deliver end-to-end Databricks lakehouse components — ingestion, transformation, semantic layer, and serving.
- Set and enforce Delta Lake and medallion architecture standards across bronze, silver, and gold layers.
- Lead the technical execution of the Synapse Analytics to Databricks migration, including parallel run, cutover, and decommissioning.
- Contribute to and sign off on reference designs, integration patterns, and architecture decision records.
Data Engineering & Integration
- Build and maintain robust ingestion and transformation pipelines from Amana's core enterprise systems: Oracle Fusion (Finance, HCM, P2P, CRM), Hyperion, CMiC, project and operations systems, SharePoint, and Power Platform.
- Apply strong CI/CD, DataOps, and infrastructure-as-code practices using Git, Azure DevOps, and Terraform or Bicep.
- Ensure platform reliability through monitoring, alerting, and structured incident response.
AI/ML & Analytics Enablement
- Build and operate feature store, MLOps, and LLMOps foundations on Databricks.
- Enable production-grade RAG, agent, and Copilot patterns in partnership with the Data Scientist and AI Engineer.
- Deliver Power BI semantic models, certified datasets, and self-service guardrails supporting the Amana Digital Academy and enterprise adoption.
Data Governance & Trustworthy Data
- Implement lineage, cataloguing, access control, data quality, and PDPL controls inside the platform using Unity Catalog and Microsoft Purview.
- Partner with the Data Governance Office to translate live policies into enforceable platform controls.
- Support regulatory, ethical, and internal compliance obligations across the data estate.
Cloud & Cost Discipline
- Own FinOps hygiene on the platform: cluster policies, workload tiering, rightsizing, and chargeback readiness.
- Translate cloud cost outcomes into commercial terms understood by finance and business stakeholders.
Collaboration & Technical Leadership
- Work closely with the Data Architect, Data Engineer, Data Analyst, Data Scientist, and AI Engineer to set and uphold technical standards.
- Provide hands-on technical guidance and code review across the team.
- Translate business requirements into technical designs with clear delivery outcomes.
Required Qualifications
- Minimum of 7 years in data engineering or data platform work, with strong hands-on delivery experience.
- At least 3 years hands-on with Databricks, Apache Spark, and Delta Lake at enterprise scale. Snowflake or BigQuery experience is acceptable where the CV shows a real Databricks migrati