Azure Data Engineer

• Help design, build and continuously improve the clients online platform.
• Research, suggest and implement new technology solutions following best practices/standards.
• Take responsibility for the resiliency and availability of different products.
• Be a productive member of the team.

Requirements

• Strong experience designing, developing, and maintaining complex data pipelines using Azure Data Factory and Azure Databricks.
• Hands-on experience building and optimizing large-scale data processing solutions using PySpark and Databricks.
• Experience collaborating with cross-functional teams to gather data requirements and deliver scalable data engineering solutions.
• Proficiency in implementing CI/CD pipelines using Azure DevOps for automated build, testing, integration, and deployment.
• Strong programming skills in Python with experience developing, testing, and maintaining ETL processes for data extraction, transformation, and loading.
• Experience monitoring, troubleshooting, and optimizing data pipelines to ensure performance, scalability, and reliability.
• Knowledge of data security, governance, and compliance best practices within Azure environments.
• Up-to-date knowledge of Azure cloud services and modern data engineering best practices.
• Hands-on experience with Azure Data Factory for data orchestration and transformation.
• Strong expertise in Azure Databricks for developing scalable data processing solutions.
• Proficiency in Python and PySpark for big data processing.
• Experience with Azure DevOps and CI/CD pipeline implementation.
• Strong SQL skills for querying, transforming, and managing large datasets.
• Excellent analytical, problem-solving, communication, and documentation skills.
• Ability to work independently and collaboratively within cross-functional teams.

Benefits

• A challenging, innovating environment.
• Opportunities for learning where needed.