FSA Store Azure Data Engineer and Data Architect REMOTE Contract-to-hire They are "resource strapped" right now and need additional head count. These individuals will be wearing a lot of hats. This data team works very closely with the Business Intelligence team (PowerBI). They have a Engineer on the team now that is a bit Jr.-Mid that is decent in Python but they need 2 more seasoned professionals as they just lost someone. Interview Process: <ul> <li>Interview: 30-45 minutes with the Manager </li> <li>Second round panel </li> <li>Architect they might want to have speak to the CTO as well. Data Engineer just the 2 rounds. </li> </ul> Tech Stack: <ul> <li>Azure Synapse Analytics </li> <li>Serverless SQL </li> <li>Spark </li> <li>Python </li> <li>Very strong SQL skills needed</li> <li>Experience integrating API's </li> <li>Datalake Storage experience </li> <li>ETL knowledge </li> <li>Experience implementing CI/CD a bonus </li> <li>Need to also be seasoned in Production Support and maintaining pipelines </li> <li>Medallion Architecture experience needed for the Data Architect opening </li> </ul> Nice to haves: <ul> <li>They are a big Salesforce shop. Any exposure here would be a huge plus. </li> <li>Healthcare experience a plus, an added bonus would be Ecomm or retail on top of that </li> </ul> Methodology: Agile (not militant) <ul> <li>3 week sprints </li> <li>M-W-F the Data Engineering team meets on their own </li> <li>T-Th - the Data Engineering and Business Intelligence team all meet </li> </ul>

Client / Group: Walmart Title: Dev: Big Data This is a contract to hire role, and the client does not provide any form of visa sponsorship. To qualify, candidates must be eligible to work in US without sponsorship now or in future. ++++++++++++++++++++++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++++++++++++ Project Scope: Data Ventures - Luminate suite of products. They focus on providing data to suppliers for eComm - more specifically online data. Walmart.com, Walmart App and Walmart plus Get data generated, crunch it and then provide it to suppliers. "Path to Purchase" - How many viewing / adding to cart / purchasing Team Size & Breakdown: Two Teams - 6-8 & 8-10 respectively - React / Java / Embedded Data Scientists etc. Development Methodology: Agile - 2 week sprints High-Level Individual Duties: <ul><li>Helping run / grow the business because it's a revenue generating project </li><li>New Product Development </li><li>Building POCs </li><li>Data Analysis </li></ul> Must-Haves (Concepts & Tools): <ul><li>Looker - Data Engineer Background so not looking for someone to build reports </li><li>LookML - Looking for someone with more of a Data Engineering background</li><li>SQL skills - huge complex queries </li><li>Spark / Scala (could be flex for Python or Java instead) / HDFS / Hadoop </li></ul> Required Skills : Must-Haves (Concepts & Tools): Looker - Data Engineer Background so not looking for someone to build reports LookML - Looking for someone with more of a Data Engineering background SQL skills - huge complex queries Spark / Scala (could be flex for Python or Java instead) / HDFS / Hadoop Notes : Selling points for candidate : Project Verification Info :The information provided below is for Apex Systems AV use only and is not to be distributed publicly, or to any third party. Any distribution of the below information will result in corrective action from Apex Systems Vendor Management. MSA: Blanket Approval Received Client Letter: Will Provide Candidate must be your W2 Employee :Yes Exclusive to Apex :No Face to face interview required :No Candidate must be local :No Candidate must be authorized to work without sponsorship ::No Interview times set : :No Type of project :Development/Engineering Master Job Title :Big Data: Dev Branch Code :Bentonville

Location: Birmingham, AL ** Only open to US Citizens and Green Card holders Our enterprise client is seeking a Data Engineer to join their dynamic team. The selected candidate will be instrumental in enhancing data-driven decision-making and operational efficiency across various business units. This role involves close collaboration with data scientists and operating within a cloud environment, requiring proficiency in data engineering, cloud technologies, and team-based problem-solving. If you are enthusiastic about using data to drive business insights and innovation, and have expertise in Power BI visualization and data cataloging, this opportunity is for you! What you'll be doing: Data Modeling and Architecture: <ul> <li>Develop and implement data models and architectures optimized for data analytics, ensuring efficiency, scalability, and data integrity.</li> <li>Implement best practices for data storage, partitioning, and indexing to optimize performance and facilitate analysis.</li> </ul> Data Pipeline Development: <ul> <li>Assist in designing, building, and maintaining scalable data pipelines to ingest, transform, and store large volumes of data from various sources.</li> <li>Collaborate with data scientists to ensure seamless integration of data pipelines with analytical models and AI processes.</li> </ul> Data Cataloging and Documentation: <ul> <li>Catalog and document data sources, datasets, and metadata to facilitate data discovery, lineage, and governance.</li> <li>Implement data cataloging best practices to ensure the availability and accessibility of data assets.</li> </ul> Cloud Environment Management: <ul> <li>Work within cloud environments - Azure to deploy, manage, and optimize data engineering solutions.</li> <li>Collaborate with cloud architects and administrators to ensure security, compliance, and cost-effectiveness of cloud infrastructure.</li> </ul> Visualization and Reporting: <ul> <li>Develop and maintain Power BI dashboards and reports to visualize data insights and facilitate data-driven decision-making.</li> <li>Create custom UI/UX applications</li> <li>Ensure the accuracy, reliability, and usability of visualizations to meet business requirements.</li> </ul> Collaboration and Support: <ul> <li>Collaborate with cross-functional teams to understand data requirements and support analytical initiatives.</li> <li>Provide technical support and troubleshooting for data-related issues, ensuring the reliability and availability of data infrastructure.</li> </ul> What you need to have: <ul> <li>Bachelor's degree in Computer Science, Information Technology, or related field.</li> <li>3+ years of experience in data engineering or related roles, preferably in a cloud environment.</li> <li>Proficiency in programming languages such as Python, SQL, and Scala.</li> <li>Proficiency with Power BI for data visualization and reporting.</li> <li>Experience with cloud-based data platforms (e.g., Azure Databricks, AWS EMR).</li> <li>Strong understanding of data modeling, ETL processes, and data warehousing concepts.</li> <li>Familiarity with big data technologies</li> <li>Innovative and adaptable, with a passion for continuous learning and improvement.</li> <li>Strong communication and collaboration skills, with the ability to work effectively across teams.</li> <li>Results-oriented and committed to delivering high-quality solutions that meet business needs.</li> <li>Ethical conduct and commitment to safety in all aspects of work.</li> </ul>

I am looking for another very advanced resource - 10+ YOE. Must be available to go onsite day 1. Please focus on local candidates/Ohio candidates. Kroger - Advanced Data Engineer Location: Cincy OH (they're going to convert this person and will be hybrid in office) Visa: USC or GC Perm - must be able to convert after 6 months Adv Data Engineer: Databricks, Azure, GCP. Streaming Interfaces: Kafka, Azure Eventhubs. Python, Pyspark, CI/CD. Soft skills: leadership/mentorship mentality, great communication & documentation Additional notes: Databricks solution to ingest streaming data to provide data tables. "Data Lake Philosophy". Need true Engineer, hands on building and developing. Pay Rate: C2C: $75/HR max Interview process: <ol> <li>Q/A Tech screening with recruiter (15 mins) Scheduled for 9am EST on Monday. Sending calendar invite. <ol> <li> <ol> <li>Please close out of any communication applications or web browsers prior to the screening. Please be prepared to screen share Task Manager at beginning of interview to make sure no other applications are running. </li> <li>Please use computer audio. No headsets. </li> <li>PLEASE PREP YOUR CANDIDATES PRIOR TO THIS CALL NOT TO RECEIVE ANY OUTSIDE HELP. WE CAN TELL THE DIFFERENCE BETWEEN SOMEONE SPEAKING GENUINELY OR READING OFF A SCREEN. THANKS </li> </ol> </li> </ol> </li> <li>Technical Interview with Solutions Architect (60 min)</li> <li>Final M&G Interview with Kroger (60 min) </li> </ol> Job Description / Deliverables: <ul> <li>Present opportunities with cost/benefit analysis to leadership to shape sound architectural decisions</li> <li>Interpreting data, analyzing results using statistical techniques</li> <li>Developing and implementing data analyses, data collection systems and other strategies that optimize statistical efficiency and quality</li> <li>Acquiring data from primary or secondary data sources and maintaining databases</li> <li>Experience in administration and configuration of API Gateways (e.g. Apigee/Kong) Apply cloud computing skill to deploy upgrades and fixes</li> <li>Design, develop, and implement integrations based on use feedback.</li> <li>Troubleshoot production issues and coordinate with the development team to streamline code deployment.</li> <li>Implement automation tools and frameworks (Ci/CD pipelines).</li> <li>Analyze code and communicate detailed reviews to development teams to ensure a marked improvement in applications and the timely completion of products.</li> <li>Collaborate with team members to improve the company's engineering tools, systems and procedures, and data security.</li> <li>Deliver quality customer service and resolve end-user issues in a timely manner</li> <li>Draft architectural diagrams, interface specifications and other design documents</li> <li>Participate in the development and communication of data strategy and roadmaps across the technology organization to support project portfolio and business strategy</li> <li>Innovate, develop, and drive the development and communication of data strategy and roadmaps across the technology organization to support project portfolio</li> <li>Drive the development and communication of enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses</li> <li>Drive digital innovation by leveraging innovative new technologies and approaches to renovate, extend, and transform the existing core data assets, including SQL-based, NoSQL-based, and Cloud-based data platforms</li> <li>Define high-level migration plans to address the gaps between the current and future state, typically in sync with the budgeting or other capital planning processes</li> <li>Lead the analysis of the technology environment to detect critical deficiencies and recommend solutions for improvement</li> <li>Mentor team members in data principles, patterns, processes and practices</li> <li>Promote the reuse of data assets, including the management of the data catalog for reference</li> <li>Draft and review architectural diagrams, interface specifications and other design documents</li> </ul>

The Data Engineer role they are looking for: <ul> <li>Resource should have strong experience with PySpark and should have Data engineering experience.</li> <li>They will work to take NextGen to the next level - integrations, bug fixes, expansions, improvements.</li> <li>Background: Azure Databricks, Azure Data Factory, Azure Data Lake with core Python programming, scripting experience.</li> <li>Resource should have expertise in PySpark, Sprak, SQL, CI/CD and Databricks but not just hands on.</li> </ul> The role description is as follows: <ul> <li>Proven strong experience on building re-usable framework, libraries, and data platform capabilities</li> <li>Azure and Databricks experience</li> <li>Strong experience in Python, building re-usable Python based frameworks</li> <li>Experience with data lake environment must</li> <li>Work independently and demonstrates system design thinking</li> <li>Experience with REST API and GraphQL APIs</li> <li>Experience building re-usable DQ capabilities is a big plus</li> </ul>

Manager Notes: "The first is for Guidewire BODS data engineering. As we move employees into new products, we are looking for onshore support for our existing GuideWire BODS logic." 1. Develops, tests, and maintains complex prioritized engineering (design/build/test) work as a member of a data analytics product pipeline architecture and infrastructure team: •Investigates and analyzes feasibility of data integration prototypes and program requirements •Develops specifications and plans the full range of programming actions to produce data integration components •Develops and maintains complex automated ETL/ELT pipeline architecture that cleans, transforms, and aggregates data from disparate sources using architecturally approved tools, programming languages, and services to deliver a data mesh approach •Develops and maintains complex automated ETL/ELT monitoring and alarming solutions using architecturally approved languages and services •Monitors, troubleshoots, and optimizes data pipelines for quality, performance, and reliability creating a single source of truth providing business customers with highly reliable and quality data •Builds complex unit tests to enable test driven development and automation to drive code reliability •Develops, maintains, tests, and deploys code with architecturally approved toolsets using Dev Ops practices, ETL/ELT pipelines, data catalogs and data queries •Maintains data solutions in a divest state to ensure business functionality until replaced with new technology •Balances and designs data analytics product solutions based on cost and performance to meet data needs and business requirements •Guides business customers to develop, troubleshoot, and optimize complex SQL and ETL/ELT solutions to solve reporting, metrics, and analytics problems 2. Data analysis: Collaborates with cross-functional teams to understand data requirements for data analytics products and translate them into scalable and efficient data solutions: •Leads moderately complex projects or supports larger initiatives as part of a team •Partners with users and stakeholders to understand data needs and business requirements •Leads the team on conceptualizing and developing new data solutions to meet the business data needs and requirements •Researches, performs analysis, and proposes effective solutions related to system developments and enhancements through collaboration with Data Architecture •Analyzes and reviews potential adjustments or modifications for impacts on other programs •Leverages data governance, data security, and privacy principles to support data lineage and reference data needs •Collaborates with cross-functional teams to understand business and downstream application (BI reporting, Data Science, Data Governance, other System integrations) and consumer requirements to deliver data-driven solutions that implement best practices for data management, security, and governance 3. Data modeling: •Develops complex data objects for business analytics using data modeling techniques •Models front-end and back-end data sources to help draw a more comprehensive picture of user flows throughout the system and to enable powerful data analysis •Works with stakeholders to understand complex business needs and translates them into a conceptual data model, defining entities, attributes, and relationships •Builds complex detailed logical models based on the conceptual model, specifying data types, constraints, and keys to ensure data integrity •Implements complex logical models into appropriate database management systems, considering database features, storage optimization, and performance considerations •Designs complex data pipelines to extract data from source systems, transform it as needed based on the data model, and load it into the target database 4. Documentation: •Participates in creating and maintaining documentation related to the design of applications and interfaces to enterprise and third-party systems in accordance with departmental and team standards •Collaborates with data governance on ensuring what is being produced in data analytics products enables data governance to publish a data asset •Collaborates with data governance to develop and maintain data analytic products, artifacts and user documentation for business customers •Works with business customers and software development teams to gather and document requirements for data publishing and data consumption via data mesh architecture •Maintains systems documentation

Needs: SCALA- Not Python SPARK GCP preferred LLM AI Retail background Job Description : Will be doing Data Engineering work for a Marketing Technology Platform. <ul> <li>The resource will be pulling data from structured and unstructured data sources.</li> <li>Then ETL the data using Scala, SPark, and JAva. Everything is done in a GCP environment with usage of Hive tables. </li> <li>This member will also be looking at Next GEN AI strategies to be used by the platform.</li> <li>They are looking to integrate LLM models as well. This is both Engineering and Scientist work, but Engineering is more important!</li> </ul>

Hello, I am Mohammed Dastagir with Saxon Global Inc wanted to let you know about the job opportunity for Data Engineer Level III position if interested please share your updated resume along with expecting rate. Title: Data Engineer Level III Location: Cincinnati, OHHybrid Duration: Long term Only on w2/ H1 transfer Job Description: <ul> <li>Experience in Data modeling and advanced SQL techniques.</li> <li>Experience working on cloud migration methodologies and processes including tools like Databricks, Azure Data Factory, Azure Functions, and other Azure data services.</li> <li>Expert in SQL, Python, Spark, Databricks.</li> <li>Experience working with varied data file formats (Avro, json, csv) using PySpark for ingesting and transformation.</li> <li>Experience with DevOps process and understanding of Terraform scripting.</li> <li>Understanding the benefits of data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design.</li> <li>Experience designing and implementing ingestion processes for unstructured and structured data sets.</li> <li>Experience designing and developing data cleansing routines utilizing standard data operations.</li> <li>Knowledge of data, master data, metadata related standards, and processes.</li> <li>Experience working with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries</li> <li>Experience using Azure DevOps/Github actions CI/CD pipelines to deploy code</li> <li>Microsoft Azure certifications are a plus</li> <li>Minimum of 7 years of hands-on experience working on design, configuration, implementation, and data migration for medium to large sized enterprise data platforms.</li> </ul> Best Regards Mohammed Dastagir Resource Manager Saxon Global Inc. p: (972) 528 5929 Ext: 215 a: 1320 Greenway Drive, Suite #460, Irving, TX w: www.SaxonGlobal.com e: dastagir.m@saxonglobal.com

Role: Sr. Cloud (Azure) Data Engineer/ Architect Contract Length : 6 CTH Hybrid 3 days in office (Seffner, FL ) Pay Range : $75/hr on c2c Salary: $125,000-160,000 Work Auth : All Except H1B Environment & skillsets: <ul> <li>Around 200 databases </li> <li>Will work closely with devs</li> <li>Innovative and collaborative mindset</li> <li>Cloud experience (Azure); no on prem</li> <li>Databricks is a plus</li> <li>Data Azure Factory</li> <li>Azure SQL</li> <li>Azure VMs</li> <li>Moving towards platform as a service (Paas)</li> <li>Patching in Microsoft </li> <li>Performance training</li> <li>Peer reviews </li> <li>Supporting goal of automation/infrastructure as code (terraform)</li> <li>PowerShell scripting</li> <li>Will not be an ETL dev & will not be writing BI reports</li> </ul> Updates: Pivoting to a Azure Data Architect titles; 7+ years of experience Wiggle room with 100% on Azure as long as they can speak in depth with cloud experience/azure knowledge Questions in interview involve Paas offerings, Azure, T-SQL and thought leadership around best practices. Day to day is supporting developer code & trouble shooting performance issues Review & optimizing (dev mindset/T-SQL expert ) Work with security & up to date practices w/ azure stack

Additional notes from SME: <ol> <li>No-code/Low-code AI experience is a plus </li> <li>Experience with Informatica is a plus</li> <li>Experience with RapidMinder is a plus</li> <li>Experience with Data Visualization (Tableau, PowerBI)</li> <li>Very strong SQL Skills</li> </ol> JOB SUMMARY We are seeking a skilled Data Engineer to join our team and contribute to a crucial project aimed at identifying anomalies and issues within clinical trial audit data. This role is essential to ensuring data integrity through comprehensive audit trail reviews, which capture, modify, and delete data using metadata to give scale and meaning to the information. The Data Engineer will play a significant role in maintaining patient safety by ensuring the integrity of clinical trial data. KEY RESPONSIBILITIES <ul> <li>Develop algorithms and tools to identify anomalies and issues in audit trail data, enhancing data integrity.</li> <li>Design and implement data pipelines to collect, transform, and load clinical trial audit data.</li> <li>Conduct detailed analyses of metadata to ensure accurate data capture, modification, and deletion processes.</li> <li>Collaborate with cross-functional teams within CT2 team , to ensure alignment with project objectives.</li> <li>Perform regular audit trail reviews to assess data integrity and contribute towards patient safety.</li> <li>Create and maintain documentation related to data engineering processes and audit trail review findings.</li> <li>Contribute to the development of best practices for audit trail reviews in clinical trials.</li> </ul> REQUIRED QUALIFICATIONS <ul> <li>Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.</li> <li>Proven experience as a Data Engineer, with a focus on anomaly detection and data integrity.</li> <li>Proficiency in programming languages such as Python, SQL, and experience with ETL tools.</li> <li>Strong understanding of metadata analysis and its application in data capture, modification, and deletion.</li> <li>Proven experience with data modeling, AI, and Python.</li> <li>Familiarity with clinical trial processes and regulations is highly desirable.</li> <li>Excellent problem-solving skills and attention to detail.</li> <li>Strong communication and collaboration skills.</li> </ul> PREFERRED QUALIFICATIONS <ul> <li>Knowledge of machine learning techniques for anomaly detection.</li> <li>Previous experience working in the pharmaceutical or healthcare industry.</li> <li>Strong problem-solving skills and the ability to translate data into meaningful business outcomes.</li> <li>Excellent communication skills for interacting with cross-functional teams.</li> <li>Prior experience in a clinical trials, healthcare, or pharmaceutical environment is a plus.</li> </ul>

Data Engineer Freddie Mac McLean, VA (must be in VA or willing to relocate) 6+ month contract - $60hr Position Overview Freddie Mac's Investments & Capital Markets Division is currently seeking a Senior Data Engineer who enjoys data and building data storage platforms from ground up. The ideal candidate has a passion for data analysis, technology and helping people leverage the technology to transform their business processes and analytics. As a Data Engineer, you will be part of a team responsible for supporting a wide range of internal customers. You will draw on all the skills in your toolkit to analyze, design, and develop data storage and data analytic solutions using data lake patterns, that help our customers run more effective operations and make better business decisions. Your Work Falls Into Two Primary Categories: <ul> <li>Strategy Development and Implementation <ul> <li>Develop data filtering, transformational and loading requirements</li> <li>Define and execute ETLs using Apache Sparks on Hadoop among other Data technologies</li> <li>Determine appropriate translations and validations between source data and target databases</li> <li>Implement business logic to cleanse & transform data</li> <li>Design and implement appropriate error handling procedures</li> <li>Develop project, documentation and storage standards in conjunction with data architects</li> <li>Monitor performance, troubleshoot and tune ETL processes as appropriate using tools like in the AWS ecosystem.</li> <li>Create and automate ETL mappings to consume loan level data source applications to target applications</li> <li>Execution of end to end implementation of underlying data ingestion workflow.</li> </ul> </li> <li>Operations and Technology <ul> <li>Leverage and align work to appropriate resources across the team to ensure work is completed in the most efficient and impactful way</li> <li>Understand capabilities of and current trends in Data Engineering domain</li> </ul> </li> </ul> Qualifications <ul> <li>At least 5 years of experience developing in Java, Python</li> <li>Bachelor's degree with equivalent work experience in statistics, data science or a related field.</li> <li>Experience working with different Databases and understanding of data concepts (including data warehousing, data lake patterns, structured and unstructured data)</li> <li>3+ years' experience of Data Storage/Hadoop platform implementation, including 3+ years of hands-on experience in implementation and performance tuning Hadoop/Spark implementations.</li> <li>Implementation and tuning experience specifically using Amazon Elastic Map Reduce (EMR).</li> <li>Implementing AWS services in a variety of distributed computing, enterprise environments.</li> <li>Experience writing automated unit, integration, regression, performance and acceptance tests</li> <li>Solid understanding of software design principles</li> </ul> Key to success in this role <ul> <li>Strong consultation and communication skills</li> <li>Ability to work with and collaborate across the team and where silos exist</li> <li>Deep curiosity to learn about new trends and how to do things better</li> <li>Ability to use data to help inform strategy and direction</li> </ul> Top Personal Competencies to possess <ul> <li>Seek and Embrace Change - Continuously improve work processes rather than accepting the status quo</li> <li>Growth and Development - Know or learn what is needed to deliver results and successfully compete</li> </ul> Preferred Skills <ul> <li>Understanding of Apache Hadoop and the Hadoop ecosystem. Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, HCatalog, Solr, Avro).</li> <li>Deep knowledge on Extract, Transform, Load (ETL) and distributed processing techniques such as Map-Reduce</li> <li>Experience with Columnar databases like Snowflake, Redshift</li> <li>Experience in building and deploying applications in AWS (EC2, S3, Hive, Glue, EMR, RDS, ELB, Lambda, etc.)</li> <li>Experience with building production web services</li> <li>Experience with cloud computing and storage services</li> <li>Knowledge of Mortgage industry</li> </ul>

Data Engineer Saxon global, inc. Jobs

Azure Data Engineer
April 24, 2025

Remote Data Engineer
April 24, 2025

Data Engineer
April 24, 2025

Advanced Data Engineer
April 24, 2025

Senior Data Engineer Pyspark Spark Sql Cicd Databricks
April 23, 2025

Guide Wire Data Engineer
April 21, 2025

Data Engineer
April 21, 2025

Data Engineer Level Iii Cincinnati Ohhybrid
April 21, 2025

Sr Cloud Azure Data Engineer Architect
April 18, 2025

Data Engineer Life Sciencesbiotech
April 8, 2025

Data Engineer
April 5, 2025

Quick filters

Top companies

Data Engineer Saxon global, inc. Jobs

Azure Data EngineerApril 24, 2025

Remote Data EngineerApril 24, 2025

Data EngineerApril 24, 2025

Advanced Data EngineerApril 24, 2025

Senior Data Engineer Pyspark Spark Sql Cicd DatabricksApril 23, 2025

Guide Wire Data EngineerApril 21, 2025

Data EngineerApril 21, 2025

Data Engineer Level Iii Cincinnati OhhybridApril 21, 2025

Sr Cloud Azure Data Engineer ArchitectApril 18, 2025

Data Engineer Life SciencesbiotechApril 8, 2025

Data EngineerApril 5, 2025