Job Details: <ul><li>Title: Sr. Data Engineer</li><li>Salary: $220K - $240K</li><li>Requirements: airflow, dbt, Snowflake, AWS, Python, SQL</li><li>Location: 100% Remote </li></ul>Our client, a rapidly growing MarTech company, is seeking a Staff Data Engineer to join their team. This role entails spearheading the evolution and upkeep of the Enterprise Data Platform - this includes overseeing a cutting-edge Serverless Data Lake, a Cloud Data Warehouse hosted on AWS, and critical data and application pipelines. If you are looking to broaden your responsibilities, take on various leadership challenges, and propel your career growth, this is the opportunity you've been waiting for! Responsibilities: <ul><li>Develop advanced data pipelines leveraging dbt, Airflow, and Snowflake, prioritizing performance optimization and data integrity using Great Expectations</li><li>Lead architectural design sessions for our modern data stack, ensuring seamless integration with Snowflake, Airflow, dbt, Great Expectations, and AWS data services</li><li>Collaborate with data science and product management teams to design, prototype, and launch new data products swiftly</li><li>Tackle intricate challenges with innovative, streamlined solutions, prioritizing reliability, scalability, quality, and cost-effectiveness</li><li>Establish processes for data transformation, metadata management, and workload optimization</li><li>Partner with the team to conduct root cause analyses and audit internal and external data and processes to address specific business inquiries </li></ul>Requirements <ul><li>Master's (or B.S. with industry experience) in math, statistics, computer science, or related field</li><li>6+ years in Dimensional Data Warehousing/Data Modeling and ‘Big Data'</li><li>6+ years in pivotal Software/Data Engineering roles, with expertise in Snowflake, Airflow, dbt, and AWS</li><li>Proficient in Python and SQL for complex data operations and transformations</li><li>Experienced in data quality assurance frameworks, particularly Great Expectations</li><li>Collaborates with data analytics to align business needs</li><li>Familiar with AWS infrastructure</li><li>Strong problem-solving skills for agile environments</li><li>Excellent communication and teamwork</li><li>Curious and passionate about data and problem-solving</li><li>Challenges data validity and assumptions</li></ul>

A client of Insight Global is looking for a Data Engineer for a part time remote opportunity working eastern time zone. The Data Engineer to work with team members to develop, deploy, and improve data-intensive applications and processes. As part of a small cross-functional team, this individual will participate in product design and iterative development to support the mission of powering policy-relevant research by building shared infrastructure. Responsibilities:<ul><li>Develop and maintain data pipelines to ingest, process, and analyze large volumes of data efficiently.</li><li>Design and implement scalable distributed systems for data storage and processing.</li><li>Optimize and tune data systems for performance and reliability.</li><li>Utilize relational databases and Elasticsearch for data storage and retrieval.</li><li>Collaborate with data scientists and machine learning engineers to deploy PyTorch and TensorFlow models on both CPU and GPU targets.</li><li>Design and develop REST APIs.</li><li>Apply text processing and image processing techniques to extract insights from unstructured data.</li><li>Gather data from various online sources.</li></ul> Minimum Requirements:<ul><li>Proficiency in Python.</li><li>Experience with distributed systems.</li><li>Strong knowledge of data storage technologies; experience in data lakes and data mesh architectures is beneficial</li><li>Familiarity with relational databases and Elasticsearch.</li><li>Experience tuning data systems for performance and reliability.</li><li>Development experience with PyTorch and TensorFlow on both CPU and GPU targets.</li><li>Knowledge of text processing and image processing techniques.</li><li>Experience with extracting data from APIs; experience with web scraping as well is also beneficial </li></ul> Plusses: <ul><li>Relevant certifications (e.g., Azure certifications, TensorFlow Developer Certificate) </li></ul> Compensation: $45/hr - $60/hr

Job Details: <ul><li>Title: Sr. Data Engineer</li><li>Salary: $160K - $180K</li><li>Requirements: airflow, dbt, Snowflake, AWS, Python, SQL</li><li>Location: 100% Remote </li></ul>Our client, a personal finance startup, is seeking a Sr. Data Engineer to join their team. This role entails spearheading the evolution and upkeep of the Enterprise Data Platform - this includes overseeing a cutting-edge Serverless Data Lake, a Cloud Data Warehouse hosted on AWS, and critical data and application pipelines. If you are looking to broaden your responsibilities, take on various leadership challenges, and propel your career growth, this is the opportunity you've been waiting for! Responsibilities: <ul><li>Develop advanced data pipelines leveraging dbt, Airflow, and Snowflake, prioritizing performance optimization and data integrity using Great Expectations</li><li>Lead architectural design sessions for our modern data stack, ensuring seamless integration with Snowflake, Airflow, dbt, Great Expectations, and AWS data services</li><li>Collaborate with data science and product management teams to design, prototype, and launch new data products swiftly</li><li>Tackle intricate challenges with innovative, streamlined solutions, prioritizing reliability, scalability, quality, and cost-effectiveness</li><li>Establish processes for data transformation, metadata management, and workload optimization</li><li>Partner with the team to conduct root cause analyses and audit internal and external data and processes to address specific business inquiries </li></ul>Requirements <ul><li>Master's (or B.S. with industry experience) in math, statistics, computer science, or related field</li><li>5+ years in Dimensional Data Warehousing/Data Modeling and ‘Big Data'</li><li>5+ years in pivotal Software/Data Engineering roles, with expertise in Snowflake, Airflow, dbt, and AWS</li><li>Proficient in Python and SQL for complex data operations and transformations</li><li>Experienced in data quality assurance frameworks, particularly Great Expectations</li><li>Collaborates with data analytics to align business needs</li><li>Familiar with AWS infrastructure</li><li>Strong problem-solving skills for agile environments</li><li>Excellent communication and teamwork</li><li>Curious and passionate about data and problem-solving</li><li>Challenges data validity and assumptions</li></ul>

Title: Data Engineer - Remote Pay/Salary/Benefits/Perks: Up to $150k/yrWork from Home Policy: Fully Remote Interview Process: Streamlined process, 3 interviews Key Skills: 6+ years of experience in data engineering, Azure, ETLResponsibilities: <ul><li>Lead a team of engineers to develop data pipelines, ETL processes, and data storage solutions. </li><li>Provide technical guidance, mentorship, and support to team members. </li><li>Define and implement best practices, standards, and processes for data engineering. </li><li>Ensure adherence to industry standards and compliance with data governance policies.</li><li>Drive innovation and continuous improvement in data engineering practices.</li><li>Manage data infrastructure on cloud platforms such as AWS, Azure, or Google Cloud Platform.</li><li>Oversee data modeling, schema design, and data governance initiatives. </li><li>Lead troubleshooting efforts and resolve complex technical issues. </li><li>Collaborate with senior leadership to define data engineering strategy, roadmap, and priorities. </li><li>Manage projects to ensure successful delivery of data engineering projects.</li></ul>Qualifications:<ul><li>6+ years of experience in data engineering, with at least 2 years of experience in a leadership or managerial role.</li><li>Experience with: </li><ul><li>Data pipelines</li><li>ETL processes</li><li>Data storage solutions</li><li>Data warehousing </li><li>Data lake houses (Databricks or Snowflake)</li><li>Cloud-based data platforms such as AWS, Azure, or Google Cloud Platform</li><li>Python or similar languages for data manipulation, scripting, and automation.</li></ul><li>Solid understanding of data modeling, schema design, and data governance best practices.</li><li>Proven leadership and team management skills. </li><li>Excellent communication and collaboration skills, with the ability to interact effectively with technical and non-technical stakeholders.</li></ul>Preferred Qualifications: <ul><li>Master's degree in a related field.</li><li>Certification in cloud computing (e.g., AWS Certified Solutions Architect, Azure Data Engineer Associate, Google Cloud Certified - Professional Data Engineer).</li><li>Strong project management skills, with experience in managing complex data engineering projects from conception to completion.</li><li>Experience with:</li><ul><li>Framewords such as Hadoop, Spark, Kafka, etc.</li><li>AWS Technologies: RDS, Lambda, SNS, SQS, AppSync, EventBridge</li><li>Containerization and orchestration tools such as Docker and Kubernetes.</li></ul></ul>

Big Data EngineerBeaverton OR – Remote for some time - candidate open to relocating to be onsite in the future2+ Months Contract (Possible Extension)Job Description: Client is embracing Big Data technologies to enable data-driven decisions. We’re looking to expand our Big Data Engineering team to keep pace. As a Sr. Big Data Engineer, you will work with a variety of talented teammates and be a driving force in technical initiatives that will accelerate analytics at Client. You will be working on projects that build data artifacts to answer questions about consumer behavior, commerce trends, consumer touchpoint preferences and more! Here are some tasks that you could do day to day.<ul><li>Design and implement distributed data processing pipelines using Spark, Hive, Python, Airflow, and other tools and languages prevalent in the Hadoop ecosystem. You will be given the opportunity to own the design and implementation. You will collaborate with Product managers, Data Scientists, Engineering folks to accomplish your tasks.</li><li>Design, Develop, Modernize/Migrate pipelines to Databricks</li><li>Develop applications on Cloud preferably AWS</li><li>Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like Apache Spark, Kafka stream.</li><li>Take part in DevOps by building utilities, user defined functions and frameworks to better enable data flow patterns.</li><li>Work with architecture/engineering leads and other teammates to ensure high quality solutions through code reviews, engineering best practices documentation.</li><li>Experience in Business Rule management systems like Drools will also come in handy.</li></ul> Some combination of these qualifications and technical skills will position you well for this role:<ul><li>MS/BS degree in a computer science or related discipline</li><li>5+ years’ experience in large-scale software development/Big Data technologies</li><li>Programming skills in Java/Scala, Python, Shell scripting, and SQL</li><li>Development skills around Hadoop, Spark, PySpark, Hive</li><li>Expert knowledge and experience in Databricks, Lake House, Structured Streaming, Kafka, Delta Lake, Delta Live table, Delta shareetc.</li></ul> About US Tech Solutions:US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com. Recruiter Details:Adil Saifi - Team Lead (IT Recruitment)Telephone: (201) 524 9600 Ext: 7222 | Direct: (503) 207 6215Fax: (201) 524 9601Email: adil@ustechsolutionsinc.com

Title: Sr. Healthcare Data Engineer (100% remote work) Duration: Permanent/Fulltime Location: Remote work (Must reside and work from any of these states - OR / WA / CA / TX ) Salary: $110,000 to $125,000 DOE ****Must be eligible to work in the US. Not able to sponsor / transfer work visa now or in the future for this opportunity**** Summary: The Senior Health Care Data Engineer will be a member of an Agile software development team (Scrum or Kanban). As senior software developer they will be expected to work well within their agile team, foster collaboration, mentor teammates and other members of the IS Department, and provide opinion and expertise on technical issues all while embracing Agile Principles and Values. Responsibilities: <ul><li> Analyzes the business requirements for data file requests to design, develop, and deploy fully automated ETL jobs to produce data files. </li><li> Designs, develops, and deploys ETL programs to facilitate the receipt of data from various data sources and the loading of data into destination tables within the overall data architecture framework. </li><li> Collaborates to design end-to-end solutions for file creation and distribution, as well as supporting ETL production processes and operations. </li><li> Utilizes advanced understanding of healthcare data models to identify data sources and maps data to required file specifications. </li><li> Designs and automates data quality and data validation functions as part of the overall solution. </li><li> Leverages expertise in ETL and the MS SQL platform to perform performance tuning of technologies to manage data. </li><li> Experience in analysis, data relationships, data aggregation, and summarization. </li><li> Performs technical peer reviews and code reviews. </li><li> Participates in review of potential technical architectures and solutions to improve and enhance existing systems, processes, and data services.</li><li> Expertise in MS SQL server (T-SQL, SQL server) </li><li> Experience with MS Azure/AWS or other cloud-based data warehouse systems. </li><li> Experience in building Data Pipelines using Azure Data Factory </li><li> Proficient with ETL tools (SSIS/Active Batch) </li><li> Working Knowledge in job scheduling tools like Automic, Tidal </li><li> In-depth understanding of database structure principles and Data warehouse principles. </li><li> Knowledge of scripting languages like PowerShell </li><li> Expertise in database architecture, storage and Query Optimizer </li><li> Extensive background in business intelligence tools (e.g., SSIS, SSRS and SSAS) </li><li> Architectural understanding of reporting tools (e.g., Tableau, SSRS, Crystal Reports and PowerBI)</li><li> Experience in CI/CD pipelines using Azure DevOps</li><li> Experience with Git, Visual Studio, Visual Code are preferred. </li><li> Working knowledge in .NET 4.5 or greater would be an added advantage.</li></ul> Required qualifications: <ul><li>Associate degree plus 6 years of demonstrated software development experience in an enterprise environment; OR </li><li> Bachelor's Degree plus 4 years of demonstrated software development experience in an enterprise environment or equivalent education/experience. OR </li><li> 6-year degree plus 2 years of demonstrated software development experience in an enterprise environment. OR </li><li> 8 years demonstrated software development experience in an enterprise environment. </li></ul> Preferred qualifications: <ul><li>Healthcare Care experience </li><li> Expertise in MS SQL server (T-SQL, SQL server) </li><li> Experience with MS Azure/AWS or other cloud-based data warehouse systems. </li><li> Experience in building Data Pipelines using Azure Data Factory </li><li> Proficient with ETL tools (SSIS/Active Batch) </li><li> Working Knowledge in job scheduling tools like Automic, Tidal </li><li> In-depth understanding of database structure principles and Data warehouse principles. </li><li> Knowledge of scripting languages like PowerShell </li><li> Expertise in database architecture, storage and Query Optimizer </li><li> Extensive background in business intelligence tools (e.g., SSIS, SSRS and SSAS) </li><li> Architectural understanding of reporting tools (e.g., Tableau, SSRS, Crystal Reports and Power BI) </li><li> Experience in CI/CD pipelines using Azure DevOps</li><li> Experience with Git, Visual Studio, Visual Code are preferred. </li><li> Working knowledge in .NET 4.5 or greater would be an added advantage</li></ul> The following benefits are offered for this position: medical, dental, & vision insurance, short-term disability, life and AD&D insurance, and a 401(k) retirement plan. Everest Consultants is an equal opportunity employer and does not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by applicable local, state, or federal civil rights laws. (ETL OVER 5 YRS) AND ("AZURE DATA FACTORY" OVER 1 YRS) AND ("SSIS" OVER 5 YRS) AND ("SSRS" OVER 5 YRS) AND ("SSAS" OVER 5 YRS) AND (.NET) AND (GIT) AND ("AZURE DEVOPS")

Data Engineer Jobs in San Francisco, TX

Staff Data Engineer Remote Us Based
April 28, 2024

Part Time Remote Data Engineer
April 28, 2024

Senior Data Engineer Remote Us Based
April 28, 2024

Data Engineer Remote
April 27, 2024

Big Data Engineer Remote
April 20, 2024

Sr Healthcare Data Engineer 100 Remote Work
April 19, 2024

Mid To Senior Level Data Engineerconsulting Servicesmainly Remote Work Possible If Somewhat
April 12, 2024

Data Engineer Python Api Integration 100 Remote
April 12, 2024

Quick filters

Top companies

Data Engineer Jobs in San Francisco, TX

Staff Data Engineer Remote Us BasedApril 28, 2024

Part Time Remote Data EngineerApril 28, 2024

Senior Data Engineer Remote Us BasedApril 28, 2024

Data Engineer RemoteApril 27, 2024

Big Data Engineer RemoteApril 20, 2024

Sr Healthcare Data Engineer 100 Remote WorkApril 19, 2024

Mid To Senior Level Data Engineerconsulting Servicesmainly Remote Work Possible If SomewhatApril 12, 2024

Data Engineer Python Api Integration 100 RemoteApril 12, 2024