Bigdata ETL Engineer

• -Based on demand build ETL architecture transferring structured and non-structured data into a Hitachi Content Platform (HCP) Object store as the back end for archiving
• Build bespoke archives of data to satisfy point business solutions such as regulation and compliance
• Build a generic framework to ingest decommissioned application data into searchable archives such that applications may present their data from e.g. a database in a pre-determined format to be ingested in a searchable form
• Deliver a standard interface for searching such archives securely
• Anticipate demand and innovate existing solutions
• Code, test, document, and maintain standardised, automated data pipelines
• Help design and build the infrastructure required for optimal extraction, transformation, and loading of data from a variety of data sources
• Build analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Responsible for testing, documentation and handover to the customer.
• Delivery to meet aggressive timescales.
• Communication of progress and risk to the team

Must Have:

• C#
• Javascript
• Powershell
• Python
• React
• UI development