Role: Sr. Data Engineer

Location: Glendale, CA

Job Type: Full Time

Basic Qualifications

12+ years of data engineering experience developing large data pipelines

Strong SQL skills and ability to create queries to extract data and build performant datasets

Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data

Experience with at least one major MPP (elastic map reduce) or cloud database technology (Snowflake, Redshift, Big Query)

Experience with AWS Cloud technologies (S3 at a minimum)

Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

Core Skills:

AWS, Databricks, Snowflake, Pyspark, and SQL

A Sr. Data Engineer is responsible for creating tools and platforms that enable this mission:

Responsibilities:

Interfacing with the key stakeholders to understand the business requirements

Designing and Developing necessary data models, ETLs, reports, etc. as per requirements

Work with big data technologies such as Spark and cloud database technologies like Snowflake

Writing test scripts and automating where possible (using tools such as but not limited to Pyspark, bash scripting, python)

Participating in code reviews

Ensuring code is checked in as per company guidelines

Participate in weekly scrum meetings and daily stand-up meetings

Contributing to ensuring correct status in burn-down charts

Ensure QA sign-off is obtained, and fix any bugs as discovered

Support product signoff process and fix any issues/bugs discovered

Post-go-live support for fixing any P1 issues

by Jobble

Data Engineer Jobs in Glendale, CA