AWS Senior Data EngineerSalary: Negotiable to £80,000 Dependent on ExperienceLondon: Hybrid working 3 days per week in the office 2 days home-basedJob Ref: J12931 A leader in consumer behaviour analytics, seeks a driven Senior Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs).This is an exciting opportunity for someone looking to challenge themselves in a collaborative environment, working with a breadth of diverse data and cutting edge technologies. You’ll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL. Key Responsibilities<ul><li>Develop and optimize ETL/ELT processes to support data transformation and integrity for analytics.</li><li>Explore and evaluate new data warehousing solutions, including Snowflake, to improve data accessibility and scalability.</li><li>Partner with product and engineering teams to define data architecture and best practices for reporting.</li><li>Ensure data security, compliance, and governance across data systems.</li><li>Implement and maintain CI/CD pipelines to automate data workflows and enhance system reliability.</li><li>Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance.</li></ul> Essential Skills and Experience:<ul><li>Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3.</li><li>Strong SQL skills for data transformation, cleaning, and loading.</li><li>Strong coding experience with Python and Pandas.</li><li>Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc.</li><li>Build processes supporting data transformation, data structures, metadata, dependency and workload management.</li><li>Experience supporting and working with cross-functional teams in a dynamic environment.</li><li>Strong communication skills to collaborate with remote teams (US, Canada)</li></ul> Nice to Have<ul><li>Familiarity with LLMs including fine-tuning and RAG.</li><li>Knowledge of Statistics</li><li>Knowledge of DataOps best practices, including CI/CD for data workflows.</li></ul> Additional RequirementsCandidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available. If this sounds like the role for you then please apply today! Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: <a>www.datatech.org.uk</a>

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National Framework)£45,456- £55,149 (London Framework - if you are London or homebased and live within the boundary of the M25)Homeworking allowance of £581 per annumAdditional allowance for exceptional candidates - Max Salary - £62,000 outside London and £67,000 for London (within the M25) Job Ref: J12917 The role of the Senior Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs.The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Accountabilities: <ul><li>Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products.</li><li>Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding tools and languages as required.</li><li>Work closely with colleagues across the Data & Insight Unit to effectively translate requirements into solutions, and accurately communicate across technical and non-technical stakeholders as well as facilitating discussions within a multidisciplinary team.</li><li>Deliver robust, supportable and sustainable data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.</li><li>Understand the concepts and principles of data modelling and produce, maintain and update relevant physical data models for specific business needs, aligning to the enterprise data architecture standards.</li><li>Design and implement data solutions for the ingest, storage and use of sensitive data within the organisation, including designing and implementing row and field-level controls as needed to appropriately control, protect and audit such data.</li><li>Clearly, accurately and informatively document and annotate code, routines and other components to enable support, maintenance and future development.</li><li>Work with QA Engineers to execute testing where required, automating processes as much as possible.</li><li>Keep abreast of opportunities for innovation with new tools and uses of data.</li><li>Learn from what has worked as well as what has not, being open to change and improvement and working in ‘smarter’, more effective ways.</li><li>Work collaboratively, sharing information appropriately and building supportive, trusting and professional relationships with colleagues and a wide range of people within and outside of the organisation.</li><li>Provide oversight and assurance of suppliers and team members, coaching and mentoring colleagues to create a highly-performant and effective team.</li><li>Design and undertake appropriate quality control and assurance for delivery of output.</li><li>Provide direction and guidance to peers and junior colleagues, including line management and development of teams, where required.</li></ul> Essential Skills and Experience: <ul><li>Educated to degree level or have equivalent professional experience.</li><li>Experience translating business requirements into solution design and implementation.</li><li>Experience of MS Azure Databricks</li><li>Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL.</li><li>Experience following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling (e.g., version control, task tracking).</li><li>Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally.</li><li>Experience in other programming languages for data manipulation (e.g., Python, Scala).</li><li>Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies.</li><li>Understanding of the principles of data modelling and data flows with ability to apply this to design of data solutions.</li><li>Experience of supporting and enabling AI technologies.</li><li>Experience implementing data flows to connect operational systems, data for analytics and BI systems.</li><li>Experience documenting source-to-target mappings.</li><li>Experience in assessing and analysing technical issues or problems in order to identify and implement the appropriate solution.</li><li>Knowledge and experience of data security and data protection (e.g., GDPR) practices and application of these through technology.</li><li>Strong decision-making, leadership and mentoring skills</li><li>Ability to identify problems and lead the delivery of solutions and preventative measures, escalating where appropriate.</li><li>Proven ability to understand stakeholder needs, manage their expectations and influence at all levels on the use of data and insight.</li></ul> DesirableKnowledge and understanding of the health and care sectors.Experience of using Power BI and creating reports/analysing data. Additional Requirements:Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available. If this sounds like the role for you then please apply today! Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National Framework)£45,456- £55,149 (London Framework - if you are London or homebased and live within the boundary of the M25)Homeworking allowance of £581 per annumAdditional allowance for exceptional candidates - Max Salary - £62,000 outside London and £67,000 for London (within the M25) Job Ref: J12917 The role of the Senior Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs.The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Accountabilities: <ul><li>Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products.</li><li>Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding tools and languages as required.</li><li>Work closely with colleagues across the Data & Insight Unit to effectively translate requirements into solutions, and accurately communicate across technical and non-technical stakeholders as well as facilitating discussions within a multidisciplinary team.</li><li>Deliver robust, supportable and sustainable data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.</li><li>Understand the concepts and principles of data modelling and produce, maintain and update relevant physical data models for specific business needs, aligning to the enterprise data architecture standards.</li><li>Design and implement data solutions for the ingest, storage and use of sensitive data within the organisation, including designing and implementing row and field-level controls as needed to appropriately control, protect and audit such data.</li><li>Clearly, accurately and informatively document and annotate code, routines and other components to enable support, maintenance and future development.</li><li>Work with QA Engineers to execute testing where required, automating processes as much as possible.</li><li>Keep abreast of opportunities for innovation with new tools and uses of data.</li><li>Learn from what has worked as well as what has not, being open to change and improvement and working in ‘smarter’, more effective ways.</li><li>Work collaboratively, sharing information appropriately and building supportive, trusting and professional relationships with colleagues and a wide range of people within and outside of the organisation.</li><li>Provide oversight and assurance of suppliers and team members, coaching and mentoring colleagues to create a highly-performant and effective team.</li><li>Design and undertake appropriate quality control and assurance for delivery of output.</li><li>Provide direction and guidance to peers and junior colleagues, including line management and development of teams, where required.</li></ul> Essential Skills and Experience: <ul><li>Educated to degree level or have equivalent professional experience.</li><li>Experience translating business requirements into solution design and implementation.</li><li>Experience of MS Azure Databricks</li><li>Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL.</li><li>Experience following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling (e.g., version control, task tracking).</li><li>Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally.</li><li>Experience in other programming languages for data manipulation (e.g., Python, Scala).</li><li>Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies.</li><li>Understanding of the principles of data modelling and data flows with ability to apply this to design of data solutions.</li><li>Experience of supporting and enabling AI technologies.</li><li>Experience implementing data flows to connect operational systems, data for analytics and BI systems.</li><li>Experience documenting source-to-target mappings.</li><li>Experience in assessing and analysing technical issues or problems in order to identify and implement the appropriate solution.</li><li>Knowledge and experience of data security and data protection (e.g., GDPR) practices and application of these through technology.</li><li>Strong decision-making, leadership and mentoring skills</li><li>Ability to identify problems and lead the delivery of solutions and preventative measures, escalating where appropriate.</li><li>Proven ability to understand stakeholder needs, manage their expectations and influence at all levels on the use of data and insight.</li></ul> DesirableKnowledge and understanding of the health and care sectors.Experience of using Power BI and creating reports/analysing data. Additional Requirements:Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available. If this sounds like the role for you then please apply today! Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

Senior Azure Data Engineer - Remote Working UK Home-based with occasional travel into the office £39,784 - £49,477 (National Framework)£45,456- £55,149 (London Framework - if you are London or homebased and live within the boundary of the M25)Homeworking allowance of £581 per annumAdditional allowance for exceptional candidates - Max Salary - £62,000 outside London and £67,000 for London (within the M25) Job Ref: J12917 The role of the Senior Azure Data Engineer is to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs.The role holder will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Accountabilities: <ul><li>Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products.</li><li>Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding tools and languages as required.</li><li>Work closely with colleagues across the Data & Insight Unit to effectively translate requirements into solutions, and accurately communicate across technical and non-technical stakeholders as well as facilitating discussions within a multidisciplinary team.</li><li>Deliver robust, supportable and sustainable data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof.</li><li>Understand the concepts and principles of data modelling and produce, maintain and update relevant physical data models for specific business needs, aligning to the enterprise data architecture standards.</li><li>Design and implement data solutions for the ingest, storage and use of sensitive data within the organisation, including designing and implementing row and field-level controls as needed to appropriately control, protect and audit such data.</li><li>Clearly, accurately and informatively document and annotate code, routines and other components to enable support, maintenance and future development.</li><li>Work with QA Engineers to execute testing where required, automating processes as much as possible.</li><li>Keep abreast of opportunities for innovation with new tools and uses of data.</li><li>Learn from what has worked as well as what has not, being open to change and improvement and working in ‘smarter’, more effective ways.</li><li>Work collaboratively, sharing information appropriately and building supportive, trusting and professional relationships with colleagues and a wide range of people within and outside of the organisation.</li><li>Provide oversight and assurance of suppliers and team members, coaching and mentoring colleagues to create a highly-performant and effective team.</li><li>Design and undertake appropriate quality control and assurance for delivery of output.</li><li>Provide direction and guidance to peers and junior colleagues, including line management and development of teams, where required.</li></ul> Essential Skills and Experience: <ul><li>Educated to degree level or have equivalent professional experience.</li><li>Experience translating business requirements into solution design and implementation.</li><li>Experience of MS Azure Databricks</li><li>Experience working with Database technologies such as SQL Server, and Data Warehouse Architecture with knowledge of big data, data lakes and NoSQL.</li><li>Experience following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling (e.g., version control, task tracking).</li><li>Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally.</li><li>Experience in other programming languages for data manipulation (e.g., Python, Scala).</li><li>Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies.</li><li>Understanding of the principles of data modelling and data flows with ability to apply this to design of data solutions.</li><li>Experience of supporting and enabling AI technologies.</li><li>Experience implementing data flows to connect operational systems, data for analytics and BI systems.</li><li>Experience documenting source-to-target mappings.</li><li>Experience in assessing and analysing technical issues or problems in order to identify and implement the appropriate solution.</li><li>Knowledge and experience of data security and data protection (e.g., GDPR) practices and application of these through technology.</li><li>Strong decision-making, leadership and mentoring skills</li><li>Ability to identify problems and lead the delivery of solutions and preventative measures, escalating where appropriate.</li><li>Proven ability to understand stakeholder needs, manage their expectations and influence at all levels on the use of data and insight.</li></ul> DesirableKnowledge and understanding of the health and care sectors.Experience of using Power BI and creating reports/analysing data. Additional Requirements:Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available. If this sounds like the role for you then please apply today! Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme. Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

Data Engineer Datatech Analytics Jobs

Aws Senior Data Engineer
March 19, 2025

Senior Azure Data Engineer
March 5, 2025

Senior Azure Data Engineer
February 27, 2025

Senior Azure Data Engineer Remote Working
February 24, 2025

Quick filters

Top companies

Data Engineer Datatech Analytics Jobs

Aws Senior Data EngineerMarch 19, 2025

Senior Azure Data EngineerMarch 5, 2025

Senior Azure Data EngineerFebruary 27, 2025