Data Engineer

RPS Group

View: 111

Update day: 11-06-2024

Location: Abingdon South East

Category: Architecture / Interior Design

Industry: Energy Utilities

Loading ...

Job content

Overview

As part of the Global Technology Team, RPS has established a central Data & Analytics function reporting into the Chief Data Officer. This team is responsible for delivering data processing, reporting and analytics solutions and services to the business as well as to external clients. In addition, the team supports the data architecture, data engineering, and data visualisation aspects of new application developments.

The Role


We are looking for a Data Engineer with good experience in BI development to join our growing team of analytics experts.

This role will be responsible for expanding and optimizing our data and data pipeline architecture for near real time and streaming data, as well as optimizing data flow and collection for cross functional teams. The Data Developer will support the Data & Analytics Solution Architect and Software Delivery Director on developing, delivering, and operating data solutions and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products must have an excellent understanding of both classic and modern data architecture and have solid experience in business intelligence development and BI analysis.

Key to the role is an understanding and hands-on experience of Azure technologies, Data Factory, Azure Data Lake, Python, SQL, Event Hub, Streaming Analytics, DevOps, Azure serverless components and Power BI.

This role can be based from any of our UK offices but with regular reporting to Abingdon HQ.

Your Responsibilities


  • Requirement gathering, solution design, and mentoring
  • Engaging with business stakeholders to support the gathering of functional and non-functional requirements for data solutions
  • Support the Data & Analytics Architect in designing data solutions aligned to the design principles and security standards as set by the EA function and the Cyber Security team
  • Deputising for the Data & Analytics Architect as and when required such as in TDA sessions, Software Solution Design workshops and resource planning.
  • Mentoring and supporting the technical development of the BI Developers in data engineering principles and practices
  • Collaborate and support software development initiatives which involves insights and analytics reporting.
  • Create Azure based data storage solutions and data movements.
  • Continuous Integration, continuous delivery, continuous deployment of the BI Solution such a Data Lake, Data Factory, Data Warehouse, Semantic Models using Azure DevOps.
  • Continuous developing the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure and other ‘data’ technologies.
  • Develop Data Factory and other data movement processes as required to support modern BI solutions and Software solutions, auditing, and other data needs in the business.
  • Identify and implement suitable data quality management and meta data management solutions.
  • Develop and apply data archiving, purging, and GDPR compliance processes.
  • Ensure the Azure environment is proactively monitored, data flows from source systems are robust with adequate fault tolerance, the reporting layer is consistent, and new developments are designed in a modular fashion.
  • Maintain and performance tune the cloud-based data storage solutions to support the operational as well as the BI application environment.
  • Implement the technical aspects of data governance and access control policies.
  • Ensure work is fully documented and referenced in line with agreed processes and formats
  • Build big data, data streaming, and AI infrastructure solutions.
  • Translate business requirements into technical data solutions.
  • Collaborate with and support the Data Scientist community and Software Delivery team with the development of AI solutions.
  • Collaborate and support on implementation of pilots and proof of concepts using azure technologies.
  • Work with the Data & Analytics Solution Architect and Cloud Solution Architect to ensure data elements of any solution are design and maintained to perform in the most cost effective and optimal level.

Your Education and Experience

  • Degree in computer science or equivalent level of work experience, information systems, or another related technical field
  • A background in software and/or database development and engineering, data architecture, and/or developing data solutions
  • Experience in DevOps and Agile methodologies
  • Experience in preparing data for data science and ML.
  • Experience of developing data pipelines using IoT/streaming data.
  • Experience in Event Hub and Streaming Analytics
  • Experience in DevOps CI/CD
  • Experience in coding in Python / R / or equivalent languages.
  • Experience deploying solutions to the Azure Cloud.
  • Experience developing Modern Data Warehouses and Data Lakes using Azure.

Your Knowledge

  • Design and development of best practice ETL flows, data stores, dimensional models, cubes
  • Data preparation (sourcing, acquisition, integration)
  • Knowledge of Serverless component like Logic Apps and Azure functions
  • Infrastructure as Code technologies such as Microsoft ARM templates and the tools to automate their deployment.
  • In-depth understanding of data management (e.g. permissions, recovery, security, and monitoring)
  • Strong professional and ethical judgement in choosing methods that give rapid, high quality, actionable results.
  • Ability to embrace and drive change, with a proactive and collaborative attitude.
  • Proven ability to solve problems of varied technical backgrounds.
  • Awareness of best practice, trends, and evolutions in the IT industry and most particularly MS Azure technology stack including intelligent edge technologies.
  • Knowledge of MS Dynamics 365 technology stack (desirable)
  • Knowledge of PolyBase (desirable)
  • Knowledge of Data Bricks (desirable)

What we offer you


We will provide you with a flexible, friendly and creative environment to develop your skills and challenge yourself. We support our people to innovate, collaborate and build meaningful careers. Our network of people and knowledge will expand your horizons and give you access to a variety of interesting projects.


Our employees are rewarded with competitive salaries, opportunities to invest and many other benefits including: Option to purchase up to 5 extra days per year, Company pension scheme, Share Incentive Scheme, Life Assurance, Cycle to Work Scheme, Health Screening, Employee Assistance Programme, Professional Memberships and commitment to on-going CPD.

About RPS Group


RPS is a leading global professional services firm of c.4,500 people. We define, design and manage projects that create shared value in a complex, urbanising and resource-scarce world.

Connecting with our global expertise we make it easy for our clients to create winning solutions for their communities and their clients. By being confidently pragmatic we solve problems that matter. We make complex easy.

Our commitment to Diversity and Inclusion
Mindful that a truly inclusive organization must make appropriate use of talent on a global basis and without unnecessary barriers, we are committed to embedding diversity and inclusion principles in all People processes in order to be as diverse as the communities and clients we work with, thereby securing, developing, and retaining the best available talent for the company’s future.

Our approach to Diversity and inclusion
Our people live our purpose, deliver our promise, and demonstrate our behaviours every day. Our behaviours define who we are. Developed by our people, they underpin everything that we do. They create the memorable experiences we are known for and make RPS a great place to do great work.

‘Stronger Together’ is one of our five core behaviours and it is inherent in creating an inclusive workplace:
‘We are respectful, acknowledge diversity, and recognise the potential and contribution of everyone. We bring out the best in one another, always assuming best intent. People who learn and grow thrive in our business, sharing in our success.’

Recruitment Agencies
We have a Preferred Supplier List of trusted partners to assist us when required and do not acknowledge any speculative CVs or unsolicited candidate introductions from agencies not on this list. Please refer to the careers page on our website if you require any further information.

Loading ...
Loading ...

Deadline: 26-07-2024

Click to apply for free candidate

Apply

Loading ...
Loading ...

SIMILAR JOBS

Loading ...
Loading ...