Data Engineer

• Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform.
• Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value.
• Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
• Required to participate in early state design and feature definition activities.
• Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem.
• Responsible for creating reusable and scalable data pipelines
• Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements

• Advanced working knowledge and experience with relational and non-relational databases
• Experience building and optimizing Big Data pipelines, architectures, and data sets
• Strong analytic skills related to working with unstructured datasets
• Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL.
• Azure DevOps experience mandatory to deploy the data objects.
• 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience.
• Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform.
• Automotive domain experience is a must.
• Knowledge/Experience with Azure cloud stack.
• Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage.
• Certification on Azure platform toolset will be considered as added advantage
• Bachelor’s degree in Computers or allied field of study.