Skip to main content

Cloud Data & AI Engineer

Haystack

EssenOn-siteFull-Time1w ago

Description

We're working with a leading consulting firm that specializes in building modern data and AI platforms in the cloud, helping clients transform their data strategies. They are seeking passionate, hands-on individuals to build scalable, maintainable, and production-ready solutions.

The Role

  • Develop modern data and AI solutions based on Databricks
  • Build robust batch and streaming pipelines using Python, SQL, Spark, and PySpark
  • Contribute to Lakehouse architectures for analytics, ML, and GenAI use cases
  • Utilize central Databricks components like Delta Lake, Unity Catalog, Workflows, MLflow, Model Serving, and Vector Search
  • Support the implementation and further development of ML, LLM, and GenAI use cases
  • Implement solutions for Data Quality, Security, Governance, and Observability
  • Apply Git, CI/CD, and Infrastructure as Code for productive deployments

What You'll Need

  • Practical experience in Data Engineering, Machine Learning Engineering, AI Engineering, or a comparable role
  • Strong knowledge of Databricks, Python, SQL, Spark, and PySpark
  • Hands-on experience with at least one cloud platform (Azure or AWS)
  • Experience in building or developing modern data platforms in the cloud
  • Familiarity with MLflow, Model Serving, and Vector Search, ideally within the Databricks environment
  • Basic to good understanding of modern AI/LLM concepts (e.g., RAG, Retrieval, Evaluation, Serving, productive GenAI applications)
  • Good understanding of Lakehouse architectures, data modeling, and productive data processes
  • Experience with Git and ideally CI/CD and Infrastructure as Code
  • Completed studies in Business Informatics, Computer Science, Data Science, or a comparable field

What's On Offer

  • Focus on clean engineering, quality, and pragmatism in building cloud data & AI platforms
  • Targeted support for professional development from specialist to trusted advisor, including certifications (Databricks, Azure, AWS)
  • Work with state-of-the-art cloud technologies and premium equipment
  • Flexible work environment with home office options and individual models to support work-life balance

Apply via Haystack today!

More jobs in Essen