The Jnit Technologies Data Engineer interview guide, interview questions, salary data, and interview experiences.

Jnit Technologies Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Jnit Technologies? The Jnit Technologies Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Jnit Technologies Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Jnit Technologies.</li>
<li>Practice real Jnit Technologies Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Jnit Technologies Data Engineer interview.


Getting ready for an Data Engineer interview at Jnit Technologies? The Jnit Technologies Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Jnit Technologies Data Engineer roles.
- Gain insights into the Data Engineer interview process at Jnit Technologies.
- Practice real Jnit Technologies Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Jnit Technologies Data Engineer interview.
        

Overview

Challenge

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Jnit Technologies Data Engineer Interview Process

Interview Tips

<h3>Job Description</h3><div>Job Description<div>SENIOR DATA ENGINEER   Location; Newport Beach, CA, Omaha, NE or Charlotte, NC   JOB DESCRIPTION   As a Data Engineer you'll move the company, and your career, forward by accelerating our data initiatives by bringing modern technical solutioning forward. You will fill a new role that sits on the data team in the technology organization. Your colleagues will include scrum masters and data analyst and fellow Data, AI, Governance, and QA professionals. Join our highly collaborative, innovative team.   KEY RESPONSIBILITIES  <ul><li>Partner with data architects, analysts, engineers, and stakeholders to understand data requirements and deliver solutions.</li><li>Help build scalable products with robust security, quality and governance protocols.</li><li>Create low-level design artifacts, including mapping specifications.</li><li>Build scalable and reliable data pipelines to support data ingestions (batch and /or streaming) and transformation from multiple data sources using cloud-based technologies.</li><li>Create unit/integration tests and implement automated build and deployment.</li><li>Participate in code reviews to ensure standards and best practices.</li><li>Deploy, monitor, and maintain production systems.</li><li>Use the Agile Framework to organize, manage and execute work.</li><li>Demonstrate adaptability, initiative and attention to detail through deliverables and ways of working. </li></ul>  QUALIFICATIONS  <ul><li>Bachelor's degree in Computer Science, Data Science or Statistics.</li><li>5+ years of experience in analysis, design, development, and delivery of data.</li><li>5+ years of experience and proficiency in SQL, ETL, ELT, leading cloud data warehouse technologies, data transformation, and data management tools.</li><li>Understanding of data engineering best practices and data integration patterns.</li><li>2+ years of experience with DevOps and CI/CD.</li><li>1+ years of experience (not just POC) in using Git and Python.</li><li>Experience in agile methodologies.</li><li>Effective communication and facilitation; both verbal and written.</li><li>Team-Oriented: Collaborating effectively with team and stakeholders.</li><li>Analytical Skills: Strong problem-solving skills with ability to breakdown complex data solutions. </li></ul>  WHAT MAKES YOU STAND OUT  <ul><li>Experience working with Azure Dev Ops (ADO), Build and Release CI/CD pipelines and orchestration.</li><li>Experience working with AWS.</li><li>Experience with automation, scripting, and testing in data delivery environment.</li><li>Understanding of data catalogs, glossary, data quality, and effective data governance.</li><li>Financial Services/Investments/Insurance domain knowledge.</li><li>Experience working in complex data systems.</li><li>Master Data Management/Reference Data experience. </li></ul>      </div>Company Description<div>Platinum Resource Group is a professional level consulting firm, providing resources to Fortune 1000 client companies in the areas of technology, human resources, accounting, finance, business systems and supply chain, on a contract and interim basis. PRG has operations in Orange County, San Diego, Los Angeles and San Francisco. As a W-2 employer we offer our consultants direct deposit bi-weekly payroll, health, dental, vision benefits, and referral bonuses.</div></div><h3>Company Description</h3><div>Platinum Resource Group is a professional level consulting firm, providing resources to Fortune 1000 client companies in the areas of technology, human resources, accounting, finance, business systems and supply chain, on a contract and interim basis. PRG has operations in Orange County, San Diego, Los Angeles and San Francisco. As a W-2 employer we offer our consultants direct deposit bi-weekly payroll, health, dental, vision benefits, and referral bonuses.</div>

Job Summary: We are looking for a Senior Azure Data Engineer with strong hands-on expertise in building and managing large-scale data pipelines and cloud-based data solutions on Microsoft Azure. The ideal candidate is a self-starter who can hit the ground running with minimal ramp-up time. Key Responsibilities<ul><li>Design, develop, and maintain end-to-end data pipelines using Azure Data Factory and Azure Synapse Analytics</li><li>Build and optimize data warehouses, data lakes, and lakehouse architectures on Azure</li><li>Write complex SQL queries, stored procedures, and scripts for data transformation and processing</li><li>Develop Python-based scripts and automation for data ingestion, transformation, and orchestration</li><li>Work with Azure Synapse Analytics to deliver high-performance analytical solutions</li><li>Collaborate with data architects, business analysts, and stakeholders to understand data requirements</li><li>Ensure data quality, reliability, and security across all pipelines and storage layers</li><li>Monitor, troubleshoot, and optimize existing data workflows for performance and cost efficiency</li></ul>

Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food retailers and distributors. With more than 37,000 Team Members and $9.7billion in revenue, we are committed to investing in people, technology, and data to elevate our customer’s experience across multiple touchpoints. It helps us follow on our commitment to serving others and improving our communities. About Giant Eagle Bangalore The Giant Eagle GCC in Bangalore is our global capability center. Our team of more than 350 members at the GCC enables us to expand internal capabilities in the areas such as data analytics, merchandising and eCommerce, quality engineering, and automation to generate insights for faster decision-making and help us accelerate our business strategy. Our team in India plays a pivotal role in helping the company transition to new ways of working by redefining the food and grocery shopping experience for over 4.6 million customers. Job Description Summary We are looking for a Senior Data Engineer who combines deep technical expertise with strong architectural judgment and leadership influence. This person will design and optimize large-scale data platforms, guide engineering best practices, mentor other data engineers, and help shape the future-state data architecture for analytics, marketing technology, and AI-driven use cases.The ideal candidate brings hands-on experience with Databricks, Apache Spark, Python, and modern orchestration/ETL tools such as Azure Data Factory (ADF) or Airflow. The ideal candidate should be comfortable working with high-volume, complex datasets, improving performance and cost efficiency, and collaborating across product, analytics, and engineering teams to translate business needs into scalable technical solutions. Experience supporting or enabling agentic AI workflows is highly valued, and familiarity with the MarTech ecosystem (such as customer activation, audience platforms, personalization, campaign systems, or downstream marketing integrations) is a strong plus. Key Responsibilities <ul><li>Lead the design, development, and optimization of scalable data pipelines and data products for analytics, operational, and AI-driven use cases.</li><li>Influence architectural decisions across the data platform, including ingestion, transformation, orchestration, storage, governance, and consumption patterns.</li><li>Partner with engineering leaders, architects, analysts, product managers, and business stakeholders to define technical direction and implementation strategies.</li><li>Build and maintain robust batch and/or near-real-time pipelines using Databricks, Spark, Python, and modern orchestration tools such as ADF or Airflow.</li><li>Drive best practices in data engineering, including modular design, observability, testing, version control, CI/CD, and release management.</li><li>Guide and mentor other data engineers through code reviews, technical design discussions, troubleshooting, and standards adoption.</li><li>Optimize large-scale data workloads for performance, reliability, scalability, and cost efficiency.</li><li>Design and improve data models and storage patterns that support downstream reporting, advanced analytics, personalization, and machine learning/AI applications.</li><li>Contribute to platform modernization efforts, including migration of legacy pipelines or workflows to modern cloud-native and lakehouse architectures.</li><li>Support data governance, lineage, privacy, and secure handling of sensitive data across the pipeline lifecycle.</li><li>Collaborate on AI-enablement initiatives, including data foundations for agentic AI, intelligent automation, recommendation systems, or decision-support capabilities.</li><li>Work closely with cross-functional teams to enable data consumption across analytics, operational systems, and marketing technology platforms.</li></ul> Required Qualifications <ul><li>Bachelor’s degree in Computer Science, Engineering, Mathematics, Information Systems, or a related technical field (or equivalent practical experience).</li><li>7+ years of experience in data engineering, software engineering, or related technical roles.</li><li>Strong hands-on experience with Databricks in a production environment.</li><li>Strong proficiency in Python and Apache Spark for large-scale data processing.</li><li>Experience with enterprise ETL/orchestration tools such as Azure Data Factory (ADF), Airflow, or similar workflow orchestration platforms.</li><li>Proven experience building and supporting data pipelines for large, complex, high-volume datasets.</li><li>Experience in data optimization, including query tuning, Spark performance tuning, partitioning strategies, job design, cost optimization, and efficient data storage patterns.</li><li>Strong knowledge of modern data architecture concepts including lakehouse/data lake/warehouse patterns, ELT/ETL frameworks, and scalable data platform design.</li><li>Experience with SQL, relational and analytical data modeling, and schema design for downstream consumption.</li><li>Ability to influence technical direction and make sound architecture recommendations across teams.</li><li>Strong communication skills with the ability to explain technical tradeoffs to both engineering and business stakeholders.</li><li>Demonstrated experience mentoring or guiding other engineers in a senior or lead capacity.</li></ul> Preferred Qualifications <ul><li>Experience building or supporting agentic AI or AI/ML-enabled data workflows.</li><li>Familiarity with LLM-enablement patterns, vector-ready data preparation, prompt/input data orchestration, or event-driven data support for AI agents.</li><li>Experience in the MarTech ecosystem, including customer data platforms, campaign systems, personalization platforms, audience activation, customer behavior data, or marketing analytics pipelines.</li><li>Experience with cloud-native platform services in Azure and enterprise data governance capabilities.</li><li>Experience with streaming/event-based architectures and APIs.</li><li>Familiarity with DevOps/DataOps practices including CI/CD, automated testing, infrastructure-as-code, and monitoring.</li><li>Exposure to privacy-sensitive data domains and secure processing patterns for regulated or customer-related data.</li></ul>

Job Description: Senior Data Engineer (SDE) – MadridExperience: 5+ Years (with strong specialization in Big Data & Cloud Data Platforms)Location: MadridWork Type - Remote with once a week travel to Madrid The OpportunityAs a Senior Data Engineer (SDE) at Celebal Technologies, you will play a key role in delivering scalable, high-performance data solutions for global clients.This is a hands-on role focused on building, optimizing, and maintaining modern data systems. You will work across the full data lifecycle—from ingestion to analytics—while ensuring reliability, scalability, and efficiency. What You Will Do (Key Responsibilities)Data Engineering & Pipelines<ul><li>Build and maintain scalable batch and streaming data pipelines</li><li>Develop robust workflows for data ingestion, transformation, and validation</li></ul>Production Support & Optimization<ul><li>Troubleshoot and resolve production issues in data pipelines</li><li>Optimize performance and ensure system reliability</li></ul>Architecture & Design<ul><li>Contribute to data architecture design and implementation</li><li>Support migration and modernization of legacy data systems</li></ul>Data Quality & Governance<ul><li>Implement data validation, monitoring, and governance practices</li><li>Ensure compliance with data security and privacy standards</li></ul>Cloud & Platform Integration<ul><li>Work with cloud platforms (AWS / Azure / GCP)</li><li>Integrate data systems with cloud storage and services</li></ul>DevOps & Automation<ul><li>Support CI/CD pipelines and automated deployments</li><li>Contribute to improving operational efficiency and monitoring</li></ul>Collaboration & Delivery<ul><li>Work with cross-functional teams to deliver end-to-end data solutions</li><li>Support client requirements and ensure timely delivery</li></ul> The Ideal Profile (Must-Have Skills)Experience<ul><li>5+ years of experience in:</li><li>Data Engineering</li><li>Data Warehousing & Analytics</li><li>Big Data and distributed systems</li></ul>Programming<ul><li>Strong skills in Python and SQL</li><li>Experience with PySpark</li><li>Familiarity with version control (Git)</li></ul>Cloud & Data Platforms<ul><li>Experience with AWS / Azure / GCP</li><li>Understanding of data lakes and distributed processing systems</li></ul>Data Modeling & Pipelines<ul><li>Experience with ETL/ELT pipelines and data modeling techniques</li><li>Knowledge of batch and streaming architectures</li></ul> Nice-to-Have Skills<ul><li>Familiarity with modern data warehousing platforms</li><li>Experience with data quality and monitoring frameworks</li><li>Exposure to ML/AI pipelines</li><li>Experience with support and ticketing tools (JIRA, ServiceNow)</li><li>Relevant certifications in data engineering or cloud technologies</li></ul>

Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also.As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimizing data workflows, and ensuring data availability and quality for production technology.The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key to success in this role.Qualifications:Experience:<ul><li>5+ years of experience in data engineering and solution delivery, with a strong track record of technical leadership.</li><li>Deep understanding of data modeling, data warehousing concepts, and distributed systems.</li><li>Excellent problem-solving skills and ability to progress with design, build and validate output data independently.</li><li>Deep proficiency in Python (including PySpark), SQL, and cloud-based data engineering tools.</li><li>Expertise in multiple cloud platforms (AWS, GCP, or Azure) and managing cloud-based data infrastructure.</li><li>Strong background in database technologies (SQL Server, Redshift, PostgreSQL, Oracle).</li></ul> Desirable Skills:<ul><li>Familiarity with machine learning pipelines and MLOps practices.</li><li>Additional experience with Databricks and specific AWS such as Glue, S3, Lambda </li><li>Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps)</li><li>Hands-on experience with web scraping, REST API integrations, and streaming data pipelines.</li><li>Knowledge of JavaScript and front-end frameworks (e.g., React)</li></ul> Key Responsibilities:<ul><li>Architect and maintain robust data pipelines (batch and streaming) integrating internal and external data sources (APIs, structured streaming, message queues etc.).</li><li>Collaborate with data analysts, scientists, and software engineers to understand data needs and develop solutions.</li><li>Understand requirements from operations and product to ensure data and reporting needs are met </li><li>Implement data quality checks, data governance practices, and monitoring systems to ensure reliable and trustworthy data.</li><li>Optimize performance of ETL/ELT workflows and improve infrastructure scalability.</li></ul>Working Conditions:<ul><li>Full-time. </li><li>Limited travel may be required depending on team needs.</li><li>Flexibility to operate in a global organization.</li></ul>

<h3>Job Description</h3><div>Job Description<div>OverviewJob Title: Digital Enterprise Jr. Data EngineerLocation: Arnold AFB, TNJob Family Code: O - EngineeringFunction/Branch: Engineering /Digital EnterpriseDirectorate: Engineering and Tech SupportPosition Type: Regular, Full-Time Pay Type: ExemptGrade: L06 (OA0672) – L07 (OA0769)Salary Range or Starting Hourly Rate (provided by HR): $74,000 - $125,000 / year OverviewBeyond New Horizons, LLC (BNH) has an exciting opportunity for a Digital Enterprise Jr. Data Engineer, supporting TOS II, at Arnold Air Force Base, TN. As a Digital Enterprise Jr. Data Engineer, you will work as a member of the Digital Enterprise group (DE) in the Mission Support Branch to lead implementation of data-centered projects to improve the AEDC ground test data infrastructure, facility operations, and business systems. The person selected for this role will work closely with multidisciplinary work teams throughout the Beyond New Horizons (BNH) organization to identify opportunities for leveraging data to drive decisions and will help design and implement a data architecture working with the Digital Enterprise team. Open to internal and external candidates. The selected candidate for this requisition may be required to occasionally (e.g. application upgrades) work outside normal business hours.Job SummaryBeyond New Horizons, LLC (BNH) is the team selected by the U.S. Air Force to conduct Test and Operations Sustainment at the Arnold Engineering Development Complex (AEDC) at Arnold Air Force Base in Tennessee. AEDC operates more than 55 aerodynamic and propulsion wind tunnels, rocket and turbine engine test cells, space environmental chambers, arc heaters, ballistic ranges and other specialized units located in six states. Many of the complex's test units have capabilities unmatched elsewhere in the United States; some are unique in the world. AEDC is one of three installations which are part of the Air Force Test Center (AFTC), one of six subordinate commands of the Air Force Materiel Command organization, and an important national resource.AEDC’s mission is to conduct developmental test and evaluation for the Nation through modeling, simulation, and ground and flight test. Execution of the mission requires a large team of highly qualified and dedicated professionals from multiple technical disciplines to effectively accomplish the objectives of our test customers.Job Duties:<ul><li>Assist in analyzing data from various sources to identify insights and support analytics initiatives.</li><li>Contribute to building, automating, and maintaining data pipelines and ETL (Extract, Transform, Load) processes.</li><li>Support the team in implementing and monitoring machine learning models.</li><li>Collaborate with multidisciplinary teams on data-related projects and tasks under the guidance of senior staff.</li><li>Assist the data analysts in creating automation of data pipelines and dashboards. </li><li>Learn and apply new data engineering techniques and technologies to support project goals.</li><li>It is a condition of employment to wear company issued PPE (Personal Protective Equipment) in accordance with supervisory direction and company policy</li><li>Perform other related duties as required</li></ul> Basic Qualifications:<ul><li>B.S. in Computer Science, Statistics, Mathematics, Engineering or another relevant engineering field from an accredited university program or at least 4 years of relevant work experience.</li><li>Current U.S. Citizenship is required. </li></ul>Preferred Qualifications:<ul><li>Experience with development lifecycle methodologies such as Agile DevSecOps. </li><li>Experience with data scripting language software like Python, Java, C++, or Ruby and SQL.  </li><li>Experience with data extraction tools and processes, data ingestion, ETL, data mining, API’s and data warehousing. </li><li>Demonstrated experience in a data engineering role. </li><li>Knowledge of a variety of machine learning techniques and their real-world advantages/drawbacks.</li><li>Coding knowledge and experience with multiple languages.</li></ul> What We Offer<ul><li>Competitive salaries</li><li>Continuing education assistance</li><li>Multiple healthcare benefits packages</li><li>401K with employer matching</li><li>Paid time off (PTO) along with a federally recognized holiday schedule</li></ul> Who We AreU.S. Citizenship is required. At this time BNH will not sponsor any applicants for employment authorization or offer any immigration related support for this position (i.e. H1b, F1 OPT, F-1 STEM OPT, F-1 CPT, J-1, E-2, E-3, L-1, or other forms of work authorization that require immigration support from an employer). The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations and refers to the amount BNH is willing to pay at the time of this posting. Salaries for part-time jobs will be adjusted based upon the number of hours agreed to work. Arnold Airforce Base $74,000 - $125,000 / year BNH is an Equal Employment Opportunity Employer. We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, veteran status, and any other grounds for discrimination prohibited by applicable law.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.Join our Team!BNH is an Equal Employment Opportunity Employer. We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, veteran status, and any other grounds for discrimination prohibited by applicable law.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.</div></div>

About the Role We are looking for a Senior Data Engineer with 6–9 years of experience to lead cloud-based data engineering initiatives. This role includes project execution, presales involvement, stakeholder management, and guiding small teams within larger data platform engagements. What You'll Do & The Impact You'll Have <ul><li>Participate in RFI/RFP processes, contribute to proposals, and help define SOWs.</li><li>Apply industry expertise (Telco, Banking, FSI) to deliver business-relevant solutions.</li><li>Lead small teams or workstreams (3–5 members) within larger data platform projects.</li><li>Collaborate with stakeholders to handle escalations, risk assessments, and resolve project issues.</li><li>Maintain a Cloud Data Engineer or Architect Associate-level certification.</li><li>Lead Data Engineering projects in cloud environments.</li></ul> Responsibilities Must-Have Skills: <ul><li>6–9 years of experience in data engineering with cloud platforms.</li><li>Proven ability to lead workstreams or small teams in cloud-based data projects.</li><li>Experience in presales activities (RFI/RFP responses, proposal writing, SOW creation).</li><li>Strong stakeholder alignment and communication skills to manage risks and escalations.</li><li>Industry exposure in at least one vertical such as Telco, Banking, or FSI.</li><li>Certified Cloud Data Engineer / Architect Associate (AWS, GCP, or Azure).</li><li>Candidate should demonstrate strong experience in Python, OOP and should have worked on production-grade codebases.</li></ul> Nice-to-Have Skills: <ul><li>Hands-on experience with Databricks or Snowflake.</li><li>Familiarity with AWS Glue, Kafka, EMR, PySpark, and DBT.</li><li>Strong knowledge of modern data architectures (lakehouse, streaming, batch).</li><li>Ability to contribute to cloud modernization and migration projects.</li></ul>

Senior Data Engineer - VC Data Intelligence Platform - Python, AWS, Airflow, FastAPI, ClickHouse Oliver Bernard have partnered with an industry leading, VC Data Intelligence Platform, who are going through a sustained period of growth, due to increased market share, and are looking to bring on a highly skilled Senior Data Engineer to their team. This role will sit across Data, Backend & AI, with Data Engineering being the core focus, and responsibilities spanning across building Data Pipelines, owning the end-to-end build of AI powered systems, contributing to architectural decisions, and working closely with stakeholders across the business. Senior Data Engineer - VC Data Intelligence Platform - Python, AWS, Airflow, FastAPI, ClickHouse Required skills and experience: 5+ years of commercial experience in a Data Engineering role or similarStrong Python experienceKnowledge of a backend framework - you'll be using FastAPIPandas & PostgreSQLClickHouse or BigQueryAWSAirflowExperience with LLMs & AI tools nice to have Salary - Pays £100k-£140k + discretionary bonus (depending on skills and experience) Office - On-Site role, with 5-days required in Central London Visa Sponsorship available for exceptional candidates, however you MUST be UK/London based to be considered Senior Data Engineer - VC Data Intelligence Platform - Python, AWS, Airflow, FastAPI, ClickHouse

Senior Data EngineerSalary: £100,000 + Benefits Own the rebuild of a modern data platform from the ground up.We’re working with a business in the middle of a high-impact data transformation—moving away from legacy constraints towards a scalable, cloud-first architecture. They’re looking for a Principal Data Engineer to take a leading role in that journey.This isn’t a role where you inherit a polished environment. It’s an opportunity to shape, modernise, and influence—from refactoring legacy pipelines to building best-in-class data products using tools like Databricks, Azure, and GCP.You’ll operate as the technical authority within the data function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners.The RoleData Engineering & Pipeline Development<ul><li>Transform legacy batch processes into scalable, observable data pipelines</li><li>Build and deliver high-quality data products in line with architectural designs</li><li>Work across modern cloud platforms including Databricks, Azure, and GCP</li></ul>Engineering Leadership & Collaboration<ul><li>Act as the technical authority for third-party and contract engineers</li><li>Contribute to engineering communities and help define best practices</li><li>Drive adoption of global standards across security, performance, and code quality</li></ul>Operational Performance<ul><li>Troubleshoot and resolve critical data issues with urgency</li><li>Deliver long-term fixes rather than short-term patches wherever possible</li><li>Optimise pipelines and queries to improve performance and control cloud costs</li></ul>Stakeholder Engagement & Mentorship<ul><li>Partner with Business Analysts to ensure data solutions deliver real value</li><li>Mentor and support engineers through pairing and knowledge sharing</li><li>Champion engineering excellence across the team</li></ul>About You<ul><li>Degree in Computer Science, Data Science, or a related field (or equivalent experience)</li><li>Strong experience (typically 5+ years) in data engineering roles</li><li>Advanced skills in Python and SQL</li><li>Hands-on experience with Databricks, Azure, and GCP/BigQuery</li><li>Proven ability to work across both legacy systems and modern cloud environments</li></ul>Key Skills<ul><li>DevOps mindset – you automate wherever possible and write clean, testable code</li><li>Pragmatic approach – focused on delivering value without overengineering</li><li>Strong communicator – confident engaging with stakeholders across the business</li></ul>Why Apply?<ul><li>High-impact role with real ownership of platform direction</li><li>Opportunity to modernise and shape a large-scale data estate</li><li>Work in a collaborative, engineering-led environment</li><li>Influence tooling, standards, and long-term strategy</li></ul>

Senior Data Engineer - Contract - London - 3 days on site - £520-550pd via Umbrella Contract until Feb 27 Key ResponsibilitiesETL Pipeline Architecture: Design, build, and maintain scalable ETL pipelines using Apache Airflow, Python, PySpark, and AWS Glue to transform complex financial datasets into actionable insights.Data Integration: Lead the integration of diverse data sources, ensuring data consistency, accuracy, and timely delivery to downstream systems.Containerization & Deployment: Utilize Docker for containerization and manage deployments within an AWS cloud environment (utilizing EKS or ECS).Technical Leadership: As a Principal Engineer, provide technical guidance, code reviews, and mentorship to the engineering team, ensuring best practices in coding, architecture, and documentation.Optimization: Drive performance tuning and continuous improvement of data ingestion and transformation processes.Required SkillsETL Development: Extensive experience building, testing, and deploying production-grade ETL pipelines in a cloud environment.Python: Expert-level proficiency in Python for data processing, automation, and Scripting.PySpark: Strong hands-on experience with PySpark for large-scale data transformation and processing.AWS Data Stack: Deep hands-on experience with AWS Glue and related AWS services (S3, Lambda, Athena, Glue Catalog).Orchestration: Proven experience with Apache Airflow for scheduling, monitoring, and managing complex workflows.Docker: Proficiency in containerization using Docker and experience with AWS container services. Nice-to-Have SkillsCapital Markets Experience: Prior experience in the financial sector, particularly in Pricing, Market Data, or Trade Processing.Domain Knowledge: Familiarity integrating complex financial data sources, specifically regarding Discounting data (eg, BroCalc), DSO, Energy & Commodities data (FACTS), and Cash/Credit product data.UI Awareness: Familiarity with modern UI frameworks (React, Next.js, TypeScript) to facilitate better collaboration with Front End delivery teams.