Data Engineer Snaplogic (Only local to Dallas, TX) Work Location: Richardson, TX (Hybrid) Direct Client long term Contract Job Description: We are seeking a highly skilled and experienced Snaplogic to join our team. As a Snaplogic Lead, you will be responsible for designing, developing, implementing, and maintaining Snaplogic integration solutions to meet the business needs of our organization. You will lead a team of developers and engineers, providing technical guidance, mentoring, and support throughout the entire development lifecycle. The ideal candidate will have a strong background in integration technologies, particularly Snap logic, along with excellent leadership and communication skills.

Job Title: Data Engineer Location: Peoria, IL. Duration : Long term contract role Exp-10+ years. Mandatory Skills: -AWS Glue -Apache Spark / Pyspark -Java -Neo4j Graph DB.

Job Title : Data Engineer with QE Experience Job Type : Contract Location : Remote Client : INTUIT Job Description: •Data engineer with testing knowledge •PySpark/Python •Snowflake or other data warehouse experience •AWS

Position : ETL Data Engineer Location : 100% Remote Duration : Long term Required Skills: ETL Developer/Data Engineer. Need to be experienced in Snowflake, Matillion, SQL, Python, and AWS Lambda's Required: Must currently reside in one of the following states: AL, AZ, FL, GA, ID, IL (Saint Louis Metropolitan Area Only), IN, KS, KY, LA, MO, NC, NV, OH, OK, PA, SC, TN, TX, UT, VA, or WI 3+ years of experience working with Matillion 2+ years of experience with a scripting or programming language such as Python Experience with AWS lambda functions and data pipeline Experience implementing Change Data Capture (CDC)Demonstrated proficiency with Kimball dimensional modeling concepts Demonstrated proficiency developing technical skills and performing problem-solving Excellent verbal and written communications skills and ability to multi-task within a team-oriented environment Demonstrated proficiency developing and supporting extract, transform, and load (ETL) and extract, load, transform (ELT) processes Ability to maintain documentation on ELT process and procedures Experience conducting project-specific data analysis that includes analyzing and mapping required data and supporting all facets of the ELT process Ability to assist with the creation and maintenance of ELT specifications (e.g., source-to-target maps)Ability to develop, test, and maintain the code required to move data Ability to participate in production on-call support rotation schedule for ETL processing and completion Ability to assist with estimates for the ELT process and suggest improvements Must be committed to incorporating security into all decisions and daily job responsibilities Preferred: Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, Engineering, or related field 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools 5+ years of developing and supporting a data warehouse Oracle Database, AWS Postgres experience, MySQL, and SQL*Server experience Strong knowledge and experience calling APIs and handling JSON responses Strong knowledge and experience with SQL programming, including stored procedures, triggers, functions, and error trapping Prior experience extending or migrating existing data pipelines to cloud platforms such as AWS Experience with Oracle Data Integrator also a strong advantage Experience building self-service reporting solutions using business intelligence software (e.g., OBIEE, Looker, Power BI, etc.) Matillion Experinece also is must

Chicago, IL - Day one onsite Roles Hiring Process: Video Call Duration: Long Term Note: Cigniti Is Implementing this Project Role: Sr. Snowflake Data Engineer Project Overview: This project aims to modernize our data architecture by leveraging cloud technologies, specifically Snowflake and Databricks, to enhance our data storage, processing, and analytics capabilities. It involves migrating application data from an on-premises Oracle database to a more scalable, flexible and secure cloud-based environment, optimizing data flows and analytics to support real-time decision-making and insights. Key Responsibilities: Data Pipeline Development: Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model. Data Integration: Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using CDC tools. Support Data Modeling: Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements. Reporting Support: Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting. Technical Documentation: Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team. Qualifications Experience: Total 10+ years of experience as data engineer; proven experience as a Snowflake data engineer for 5+ years. Skills: Strong knowledge of SQL writing complex queries, performance tuning, Strong experience with Oracle, Snowflake, ETL/ELT tools Data engineering: proven track record of developing and maintaining data pipelines and data integration projects Orchestration Tools: Experience in Airflow for managing data pipeline workflows. Programming: proficiency in Python and SQL for data processing tasks. Data Modeling: Understanding of data modeling principles and experience with data warehousing solutions. Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake integration. Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms. CI/CD Implementation: Utilize CI/CD tools to automate the deployment of data pipelines and infrastructure changes, ensuring high-quality data processing with minimal manual intervention. Communication: Excellent communication and teamwork skills, with a detail-oriented mindset. Strong analytical skills, with the ability to work independently and solve complex problems. Certifications: Snowflake certification is a plus. Education: Bachelor's degree in Computer Science, Information Technology, or a related field

Role: Lead Data Engineer Client: Alimentation Couche-Tard Location: Remote Duration: 6-month contract Requirements: <ul> <li>Looking for 8+ years of experience <ul> <li>Building pods (about 4-5 different pods in org.) all reporting to Pradeep. This person will support one project at first (could be retail, finance operations, loyalty, etc.)</li> <li>Will have 2-6 Data Engineers under the Lead (still reporting to Pradeep)</li> </ul> </li> <li>Python, SQL and PySpark</li> <li>Azure preferred but open to other (GCP, AWS)</li> <li>Databricks, Snowflake, and Fabric <ul> <li>Batch and real-time streaming - building pipelines</li> <li>Gathering requirements from the business</li> <li>Mentoring some of the Data Engineers on the team - room for growth</li> </ul> </li> </ul> Any nice-to-have skills that would make them exceptional? Certifications , 2+ yrs data architecture, data engineering patters , git repo, self-starter and go-getter attitude, software engineering background , ML experience Job Description: As the Technical Lead Data Engineer, your primary responsibility will be to spearhead the design, development, and implementation of data solutions aimed at empowering our organization to derive actionable insights from intricate datasets. You will take the lead in guiding a team of data engineers, fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities Responsibilities: <ul> <li>Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.</li> <li>Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.</li> <li>Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.</li> <li>Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.</li> <li>Experience building enterprise systems especially using Databricks, Snowflake and platforms like Azure, AWS, GCP etc</li> <li>Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.</li> <li>Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.</li> <li>Implement data modeling techniques to design and optimize data schemas, ensuring data integrity and performance.</li> <li>Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.</li> <li>Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.</li> <li>Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.</li> </ul> Qualifications: <ul> <li>Bachelor's or master's degree in computer science, Engineering, or a related field.</li> <li>Proven experience (8+) in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses.</li> <li>Strong proficiency in SQL, Python and Spark programming languages.</li> <li>Strong experience with cloud platforms such as AWS, Azure, or GCP is a must.</li> <li>Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.</li> <li>Knowledge of data lake and data warehouse solutions, including Databricks, Snowflake, Amazon Redshift, Google BigQuery, Azure Data Factory, Airflow etc.</li> <li>Experience in implementing CI/CD pipelines for automating build, test, and deployment processes.</li> <li>Solid understanding of data modeling concepts, data warehousing architectures, and data management best practices</li> </ul>

Requirement: Cloud Infra Engineer (GCP) / TRIRIGA Administrator. We are seeking a highly skilled Cloud Infrastructure Engineer with expertise in Google Cloud Platform (GCP), proficiency in Ruby or Python, and experience in automation tools such as Ansible and Puppet. The successful candidate will play a pivotal role in maintaining and enhancing our infrastructure, specifically focusing on Tririga application upgrades, OS migrations, and Oracle PSU patch applications. Responsibilities •Infrastructure Maintenance: <ul> <li>Utilize Ansible playbooks for daily maintenance tasks, including OS upgrades and application migrations on the Tririga platform.</li> <li>Apply Oracle PSU patches in a timely and efficient manner to ensure system security and stability.</li> </ul> •Automation Expertise: <ul> <li>Collaborate with cross-functional teams to enhance and maintain Ansible playbooks for continuous improvement of infrastructure automation.</li> <li>Develop and implement automated solutions using Ruby or Python for increased efficiency.</li> </ul> •Cloud Platform Proficiency: <ul> <li>Demonstrate a strong understanding of Google Cloud Platform (GCP) and leverage its services to optimize our cloud infrastructure.</li> </ul> •Certification Requirement: <ul> <li>Possess a GCP certification to validate expertise and proficiency in Google Cloud technologies.</li> </ul> •Linux and Bash Scripting: <ul> <li>Possess in-depth knowledge of Linux systems and demonstrate expertise in bash scripting for automation and system configuration tasks.</li> </ul> Experience & Education •Bachelor's degree in Computer Science, Information Technology, or a related field. Technical Skills & Competencies •Proven experience working with Google Cloud Platform (GCP). •Possess GCP certification. •Proficiency in either Ruby or Python for scripting and automation tasks. •Strong expertise in configuration management tools such as Ansible and Puppet. •Hands-on experience with Linux systems and proficiency in bash scripting. •Familiarity with Tririga application upgrades and Oracle PSU patch applications is highly desirable. Soft Skills: •Strong problem-solving and analytical skills. •Excellent communication and collaboration skills. •Ability to work independently and as part of a team. •Adaptability to a fast-paced and evolving environment.

Position: Snowflake Data Engineer Location: Remote Exp: 12+ Years Must Have: *Snowflake Exp* Description: •Seeking an experienced Snowflake Data Engineer to assist in the building of a Snowflake Data Warehouse and help develop data analytics solutions and algorithms to analyze raw data. Responsibilities will include, but not be limited to the following: •Assist with Data architecture •Assist with building and validating data architecture •Data collection •Designing, building, and fine-tuning data pipelines to load data into Snowflake from sources like databases, cloud storage, or streaming platforms •Designing and developing scalable data models and warehouses •Implementing data security policies •Conducting research and finding trends in raw data sets •Identifying patterns and creating models •Automating tasks Basic Qualifications •Proficiency in SQL, JavaScript and Data Vault or Dimensional Data Model •Should have a strong grasp of SQL, as Snowflake uses this language for queries •Write complex queries and optimize for performance •Data modeling expertise - understanding data structures and being able to design efficient data models tailored to Snowflake architecture •Snowflake-specific knowledge - Engineer should be well versed in Snowflakes unique features, like handling semi-structured data and its approach to data sharing and security •ETL process knowledge - Engineer needs to manage data migrations to Snowflake •Includes extracting data from various data sourcing, transforming the data into usable formats and loading into the Snowflake platform •Snowflake is a cloud-native platform, so familiarity with cloud services, particularly Azure or AWS is required •Developer should be adept at tuning Snowflake settings to balance performance and costs •Skills in integrating Snowflake with various data sources, including APIs, databases, and cloud storage •Practiced at implementing data validation and cleansing processes to ensure data accuracy and consistency •Knowledge of Snowflakes security and compliance features, including role-based access control and secure data sharing •Analytical thinking - Engineer must be able to analyze complex data patterns and optimize data storage and retrieval •Need to be able to troubleshoot issues that arise within the Snowflake platform efficiently Ensures data accuracy and quality is paramount to this role •Engineer must keep up with new Snowflake features and best practices •Work with cross-functional team - good teamwork skills essential •Ability to clearly explain technical concepts to non-technical stakeholders

Requirement Details: Position: Data Engineer Location: Bentonville, Arkansas Duration: Longterm Primary Skills: SPARK,Java/Scala,SQL,Kafka,Airflow,GCP,BigQuery,Dataproc Knowledge & Experience: <ul> <li>Proficient in distributed computing ex: Spark with Java/Scala. Preferred to have Java over Scala Proficient in SQL Proficient in Kafka and Spark streaming Experience in Workflow management using Airflow or similar tool Experience in dealing with large volumes of data (Flat files, APIs and streaming) Google Cloud Platform with BigQuery and DataProc is a plus Knowledge in data modeling</li> </ul>

Role: Data Engineer # of Roles: 5 Location: 80% Remote with initial on-site requirements Duration: 1 year Overview: We are looking for a talented Data Engineer to join our team and help our banking client address ETL and coding discrepancies. The ideal candidate will have a strong background in ETL processes, coding, and data quality management. Responsibilities: <ul> <li>Design, develop, and maintain ETL processes to ensure the accuracy and integrity of data.</li> <li>Identify and resolve discrepancies in data pipelines.</li> <li>Collaborate with cross-functional teams to implement data quality solutions.</li> <li>Stay updated with the latest technologies and trends in data engineering.</li> </ul> Qualifications: <ul> <li>Bachelor's degree in Computer Science, Information Technology, or related field.</li> <li>Strong coding skills, particularly in languages such as Python, Java, or Scala.</li> <li>Experience with ETL tools and processes.</li> <li>Knowledge of data quality tools and methodologies.</li> <li>Strong problem-solving skills and attention to detail.</li> <li>Experience working in the banking or financial services industry is a plus.</li> </ul>

Data Engineer Technogen, Inc. Jobs

Data Engineer
December 8, 2024

Data Engineer
December 7, 2024

Data Engineer With Qe Experience
December 7, 2024

Etl Data Engineer
December 7, 2024

Snowflake Data Engineer
December 7, 2024

Lead Data Engineer
December 7, 2024

Gcp Data Engineer
December 7, 2024

Snowflake Data Engineer
December 6, 2024

Data Engineer
December 6, 2024

Data Engineer
December 3, 2024

Quick filters

Top companies

Data Engineer Technogen, Inc. Jobs

Data EngineerDecember 8, 2024

Data EngineerDecember 7, 2024

Data Engineer With Qe ExperienceDecember 7, 2024

Etl Data EngineerDecember 7, 2024

Snowflake Data EngineerDecember 7, 2024

Lead Data EngineerDecember 7, 2024

Gcp Data EngineerDecember 7, 2024

Snowflake Data EngineerDecember 6, 2024

Data EngineerDecember 6, 2024

Data EngineerDecember 3, 2024