Cloud Data & AI Engineer
Haystack
EssenOn-siteFull-Time1w ago
Description
We're working with a leading consulting firm that specializes in building modern data and AI platforms in the cloud, helping clients transform their data strategies. They are seeking passionate, hands-on individuals to build scalable, maintainable, and production-ready solutions.
The Role
- Develop modern data and AI solutions based on Databricks
- Build robust batch and streaming pipelines using Python, SQL, Spark, and PySpark
- Contribute to Lakehouse architectures for analytics, ML, and GenAI use cases
- Utilize central Databricks components like Delta Lake, Unity Catalog, Workflows, MLflow, Model Serving, and Vector Search
- Support the implementation and further development of ML, LLM, and GenAI use cases
- Implement solutions for Data Quality, Security, Governance, and Observability
- Apply Git, CI/CD, and Infrastructure as Code for productive deployments
What You'll Need
- Practical experience in Data Engineering, Machine Learning Engineering, AI Engineering, or a comparable role
- Strong knowledge of Databricks, Python, SQL, Spark, and PySpark
- Hands-on experience with at least one cloud platform (Azure or AWS)
- Experience in building or developing modern data platforms in the cloud
- Familiarity with MLflow, Model Serving, and Vector Search, ideally within the Databricks environment
- Basic to good understanding of modern AI/LLM concepts (e.g., RAG, Retrieval, Evaluation, Serving, productive GenAI applications)
- Good understanding of Lakehouse architectures, data modeling, and productive data processes
- Experience with Git and ideally CI/CD and Infrastructure as Code
- Completed studies in Business Informatics, Computer Science, Data Science, or a comparable field
What's On Offer
- Focus on clean engineering, quality, and pragmatism in building cloud data & AI platforms
- Targeted support for professional development from specialist to trusted advisor, including certifications (Databricks, Azure, AWS)
- Work with state-of-the-art cloud technologies and premium equipment
- Flexible work environment with home office options and individual models to support work-life balance
Apply via Haystack today!
More jobs in Essen
Architect for Finance Domain d/f/m
RWE · Essen
Architect for Finance Domain d/f/m
RWE · Essen
Channel & Retail Marketing Manager m/f/d – Germany, Austria, Switzerland
Lenovo · Essen
Data Scientist - Flex Trading Strategy Development (f/m/d)
E.ON · Essen
QA Tester
Hyra · Essen
Finance Manager – EU Region (m/f/d)
iMile Logistics Germany GmbH · Essen
Backend Developer
Haystack · Essen
Product Compliance Specialist (m/w/d)
Brenntag · Essen