*Outside Contract* AWS Data Engineer – £600 – £700 PD – 12 Months – Oil & Gas – Fully Remote
Overview:
A FTSE100 Oil & Gas organisation are looking for an experienced AWS Data Engineer to join one of their growing teams in London on a fully remote basis.
Role & Responsibilities:
• Drive the vision for modern data platform to deliver well architected and engineered data and analytics products leveraging AWS cloud tech stack and third party products.
• Collaborate with multiple internal and external teams to align appropriate integration of functions to meet goals, and identify necessary enhancements needed to deploy new products.
• Architect, Design and publish multiple integrations (acquisition and ingestion) and data transformation patterns and serve data as a centralized capability for use/re-use across the product family.
• Publish standardized approach and methodology tailored to business needs for varying stages of data lifecycle management.
• Develop standards for coding, testing, debugging, and implementation to build production-grade solutions.
• Define the processes that need in place for operational excellence and high system reliability.
• Provide in-depth exploration with interpretive thinking to define issues and develop innovative solutions.
• Manage one or more Applications Development teams in an effort to accomplish established goals.
• Adopt and enhance quality gates implementation across projects to ensure projects deliver in-line with the overall strategic Architecture blueprint.
• Liaise with managing internal & external data providers, and risk associated with it.
Role Requirements:
• Strong hands-on experience architecting Big Data integration and data transformation design patterns solutions leveraging AWS tech stack and third party products.
• Very strong hands on development skills with Python.
• Expertise with at least one distributed data processing framework e.g. Spark (Core, Streaming, SQL), Storm, Flink etc.
• Knowledge of the pros and cons of various database technologies like Relational, NoSQL, MPP, Columnar databases.
• Experience in designing solutions across a diverse range of data sources and handling structured, semi-structured, and unstructured datasets including spatial and sensor data.
• Working knowledge of DevOps capabilities to support deliver data capabilities, driven by code versioning, CI/CD processes implementation, release management leveraging AWS DevOps stack.
• Working practitioner with AGILE development, SCRUM and Application Lifecycle Management to deliver at a rapid pace.
Rate & Duration:
•£700 Outside.
• 12 Months
*Outside Contract* AWS Data Engineer – £600 – £700 PD – 12 Months – Oil & Gas – Fully Remote
