Elasticsearch Data Architect in London

Contract Role – Elasticsearch Data Architect – Remote – 06 months initial – Inside IR35

Role Overview:

• You will be working as the Data Architect for a high profile bespoke software solution that is entering Phase 2 of the design work.
• You will design the data architecture by dealing with specific business problems and aligning it to enterprise-wide standards and principles, setting the vision for the use of data.
• It is critical that the Data Architect has hands-on experience in designing Elasticsearch document data models (e.g. indices, documents and fields) and worked with large datasets in the realms of terabytes (including extract, ingest, map, transform data).
• You will review the data model for the existing solution and lead on extending the design of for Phase 2 using industry standard data modelling techniques, providing guidance and best practice for the adoption of data standards aligning to the organisation’s data strategy.
• Your design and outputs will be key to the successful delivery of the Phase 2 solution, working closely with the development and technical teams to support software development and the implementation of the data architecture and design as the go-to person for data related queries.

At this role level, you will:

• Design, support and provide guidance for the upgrade, management, decommission and archive of data in compliance with data policy.
• Provide input into data dictionaries.
• Define and maintain the data technology architecture, including metadata, integration and business intelligence or data warehouse architecture.

Key Tasks:

• Review and analyse the source data (Digital Media and Communications Data), and work with the business and technical representatives to define mapping and transformation.
• Produce data mapping documents, and a data dictionary for the software development team.
• Review and assess existing document data model against candidate application development features to understand the data model gap.
• Design the approach to fulfilling this gap by assessing the suitability of the latest version of IES and extending to work with POLE.
• Produce and present ‘to-be’ logical data model for discussion with project team.
• Define definition of any new Elasticsearch indexes and a document data model that supports the new and existing indexes.
• Produce implementation suggestions on how the indexes support the joining of Elasticsearch queries to fulfil application development features.
• Draft and size the activities required to develop the ‘to-be’ state of the ElasticSearch indexes and document data model.
• Draft and agree Elasticsearch index delivery approach for this Agile software development project, especially if the new Elasticsearch indexes does not support existing data held within the Elasticsarch data store.
• Collaborate with the project team and be the ‘go-to’ person for data related queries.

Essential Skills:

• Experience of designing document data models in Elasticsearch (including indices, documents, fields).
• Experience of designing and working with large datasets in the realms of terabytes (including extracting, ingesting, mapping, transforming data).

Desirable Skills:

• Policing domain knowledge especially around the POLE data model.
• Experience of working with the UKIC Information Exchange Standard (IES).

Please feel free to contact myself – Daisy Nguyen at Gibbs Consulting/Atrium UK for a confidential chat to know more details about the role.

Please also note: Due to the volume of applications received for positions, it will not be possible to respond to all applications and only applicants who are considered suitable for interview will be contacted.