Data Engineer

  • Location: Reigate
  • Type: Contract
  • Payment: £600 - 650
  • Per: Day
  • Role: Other

Posted by : Amy Simpson

Email : amy.simpson@intecselect.com

Data Engineer – £650 Per Day (Inside IR35) – 6 Months – Insurance – Remote

An excellent opportunity has arisen with our client, who are a market leading Financial Services organisation. We are seeking a talented Data Engineer to focus on enhancing the company’s ability to extract greater value from operational data. The programme looks to implement a cloud based data analytics platform to deliver prescriptive and predictive analytics capabilities to all areas of the organisation. Our client have a flexible approach to home working but will require occasional trips to the Reigate HQ.

Responsibilities

  • Architect and build distributed, scalable, and reliable data pipelines to ingest, process and distribute data with Erwin DI or similar for use in Snowflake or similar.
  • Familiar and practitioner of data vault architecture principles.
  • Successful deployment of data pipeline solution on AWS.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data’ technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Keep data separated and secure across divisional and jurisdiction boundaries.
  • Collaborate closely with stakeholders and researchers to support machine learning, analytical and product use cases.
  • On-board, document and curate external datasets for internal usage.
  • Engage in data interpretation and forensic data analysis and troubleshooting.

Skills

  • Understanding of algorithms and data structures. Structure and Unstructured
  • Experience of data orchestration platforms (e.g. Erwin DI, DM)
  • Proficiency in scripting languages (especially Python)
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Commercial experience of writing and optimizing SQL queries
  • Experience in feature engineering for Machine Learning applications
  • Knowledge of data versioning libraries/ methods (e.g. DVC)
  • Experience of cloud data warehouses (e.g. Snowflake)
  • Experience with stream-processing systems: Storm, Spark-Streaming
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
  • Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)
  • Experience of data testing data pipelines
  • Delivering iterative data pipelines and products

Nice to have

  • Experience building streaming pipelines (e.g. Kafka, Kinesis)
  • Familiarity with continuous deployment
  • Experience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)

Data Engineer – £650 Per Day (Inside IR35) – 6 Months – Insurance – Remote

Apply for this role

Other vacancies

Other

  • Reigate
  • £600 - 650
  • Contract
  • 19th Oct

J3151

Other

  • Reigate
  • £600 - 650
  • Contract
  • 19th Oct

J2844

Other

  • Reigate
  • £600 - 650
  • Contract
  • 19th Oct

J3076