Overview: Why GMF Technology? GM Financial is set to change the auto finance industry and is leading the path of embarking on tech modernization we have a startup mindset, and preserve our small company culture, in a public company environment with financial stability and intense growth over a decade-plus history. We are data junkies and trust in data and insights to advance our business objectives. We take our goal of zero emission, zero collision, zero congestion, and zero friction very seriously. We believe as an auto finance market leader we are in the driver's seat to lead us in the GM EV mission to change the world. We are building global platforms, in LATAM, Europe, China, U.S. and Canada and we are looking to grow our high-performing team. GMF is comprised of over 10,000 team members globally. Join our fintech culture within a Blue-Chip company where we are changing the way we use technology to support our customers, dealers and business. Responsibilities: About the role: We are expanding our efforts into complementary data technologies for decision support in areas of ingesting and processing large data sets including data commonly referred to as semi-structured or unstructured data. Our interests are in enabling data science and search-based applications on large and low latent data sets in both a batch and streaming context for processing. To that end, this role will engage with team counterparts in exploring and deploying technologies for creating data sets using a combination of batch and streaming transformation processes. These data sets support both off-line and in-line machine learning training and model execution. Other data sets support search engine-based analytics. Exploration and deployment of technologies activities include identifying opportunities that impact business strategy, collaborating on the selection of data solutions software, and contributing to the identification of hardware requirements based on business requirements. Responsibility also includes coding, testing, and documentation of new or modified scalable analytic data systems including automation for deployment and monitoring. This role participates along with team counterparts to develop solutions in an end-to-end framework on a group of core data technologies. JOB DUTIES<ul><li>Work with internal business partners to identify, collect, and format data from external sources, internal systems and the data warehouse and lakehouse to extract features of interest</li><li>Contribute to evaluation, research, and experimentation efforts with batch and streaming data engineering technologies in a lab to keep pace with industry innovation</li><li>Work with data engineering related groups to inform on and showcase capabilities of emerging technologies and to enable the adoption of these new technologies and associated techniques</li><li>Coordinate with Privacy Compliance to ensure proper data collection and handling</li><li>Create and implement business rules and functional enhancements for data schemas and processes</li><li>Coordinate with Privacy Compliance to ensure proper data collection and handling</li><li>Perform data load monitoring and resolution</li><li>Work with internal business clients to problem solve data availability and activation issues</li></ul> Qualifications: What makes you a dream candidate?<ul><li>Experience with processing large data sets using Hadoop, HDFS, Spark, Kafka, Flume or similar distributed systems</li><li>Experience with ingesting various source data formats such as JSON, Parquet, SequenceFile, Cloud Databases, MQ, Relational Databases such as Oracle</li><li>Experience with Cloud technologies (such as Azure, AWS, GCP) and native toolsets such as Azure ARM Templates, Hashicorp Terraform, AWS Cloud Formation</li><li>Understanding of cloud computing technologies, business drivers and emerging computing trends</li><li>Thorough understanding of Hybrid Cloud Computing: virtualization technologies, Infrastructure as a Service, Platform as a Service and Software as a Service Cloud delivery models and the current competitive landscape</li><li>Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, S3, Minio, Ceph, ADLS etc</li><li>Experience with containerization to include but not limited to Dockers, Kubernetes, Spark on Kubernetes, Spark Operator</li><li>Working knowledge of Agile development /SAFe, Scrum and Application Lifecycle Management</li><li>Strong background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/ Continuous Deployment (Azure DevOps)</li><li>Experience with NoSQL data stores such as CosmosDB, MongoDB, Cassandra, Redis, Riak or other technologies that embed NoSQL with search such as MarkLogic or Lily Enterprise</li><li>Creating and maintaining ETL processes</li><li>Knowledgeable of best practices in information technology governance and privacy compliance</li><li>Experience with REST APIs</li><li>Working knowledge of Databricks platform and associated features including workflows, unity catalog, delta live tables, time travel, SQL statement execution API, etc</li><li>Understanding of Databricks medallion architecture</li><li>Proficient with programming concepts and languages including SQL and Python/PySpark</li></ul>Additional Skills<ul><li>Troubleshoot complex problems and works across teams to meet commitments</li><li>Excellent computer skills and proficiency in digital data collection</li><li>Ability to work in an Agile/Scrum team environment</li><li>Strong interpersonal, verbal, and writing skills</li><li>Digital technology solutions (DMPs, CDPs, Tag Management Platforms, Cross-Device Tracking, SDKs, etc)</li><li>Knowledge of Real Time-CDP and Journey Analytics solutions</li><li>Understanding of big data platforms and architectures, data stream processing pipeline/platform, data lake and data lake houses</li><li>SQL experience: querying data and sharing what insights can be derived</li><li>Understanding of cloud solutions such as Google Cloud Platform, Microsoft Azure & Amazon AWS cloud architecture & services</li><li>Understanding of GDPR, privacy & security topics</li></ul>Experience and Education<ul><li>2-4 years of hands-on experience with data engineering required</li><li>2-4 years of hands-on experience with processing large data sets required</li><li>2-4 years of hands-on experience with SQL, data modeling, relational databases and/or no SQL databases required</li><li>Bachelors Degree in related field or equivalent work experience required</li></ul> What We Offer: Generous benefits package available on day one to include: 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay and nine company holidays. Our Culture: Our team members define and shape our culture an environment that welcomes innovative ideas, fosters integrity, and creates a sense of community and belonging. Here we do more than work we thrive. Compensation: Competitive pay and bonus eligibility Work Life Balance: Flexible hybrid work environment, 2-days a week in office in Irving, TX#LI-SC1 Salary: The base salary range for this role is: USD $88,000.00 to $162,900.00. At GM Financial, we strive for transparency in all aspects of our business, including pay equity. This is the GM Financial pay range for this role and job level. The exact salary and compensation will vary based on factors like knowledge, skills, experience, and education. This role is eligible to participate in a performance-based incentive plan. Full time employees are eligible to participate in health benefits on day one of employment.

Overview Why GMF Technology? GM Financial is set to change the auto finance industry and is leading the path of embarking on tech modernization - we have a startup mindset, and preserve our small company culture, in a public company environment with financial stability and intense growth over a decade-plus history. We are data junkies and trust in data and insights to advance our business objectives. We take our goal of zero emission, zero collision, zero congestion, and zero friction very seriously. We believe as an auto finance market leader we are in the driver's seat to lead us in the GM EV mission to change the world. We are building global platforms, in LATAM, Europe, China, U.S. and Canada - and we are looking to grow our high-performing team. GMF is comprised of over 10,000 team members globally. Join our fintech culture within a Blue-Chip company where we are changing the way we use technology to support our customers, dealers and business. Responsibilities We seek a Data Engineer who brings a robust skill set and extensive experience in cloud-based data engineering experience particularly within the realm of Azure and Databricks using Python, PySpark and cloud SQL. Critical thinking and problem-solving abilities are paramount, as you will navigate evolving and complex requirements and collaborate with stakeholders across diverse technical backgrounds. Your primary focus will revolve around data engineering development tasks, serving as a visionary alongside Data Engineering leads to refine and expand reusable libraries and common framework, ensuring it can accommodate the growing volume of incoming projects. You will also engage into engineering tasks, such as constructing pipelines and deployments that bolster various programs, projects, and initiatives supporting multiple customer needs. What makes you an ideal candidate? <ul> <li>Work closely with data scientists, data architects, developers, other IT counterparts, and business partners to identify, capture, collect and format data from the external sources, internal systems, and the data warehouse to extract features of interest. </li><li>Designing and implementing internal process improvements including pipeline redesigns for greater scalability, optimizing data delivery, and automating manual processes. </li> <li>Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure and Databricks technologies </li><li>Experience with ingesting various source data formats such as JSON, Parquet, SequenceFile, Cloud Databases, MQ, No SQL, flat files, Event Hubs and Relational Databases such as Oracle </li><li>Experience with Cloud technologies (such as Azure, AWS, GCP) and native toolsets such as Azure ARM Templates, Hashicorp Terraform, AWS Cloud Formation </li><li>Thorough understanding of Hybrid Cloud Computing: virtualization technologies, Infrastructure as a Service, Platform as a Service and Software as a Service Cloud delivery models and the current competitive landscape </li><li>Working knowledge of Object Storage technologies to include but not limited to Data Lake Storage Gen2, Delta Lake, S3, Minio, Ceph, ADLS </li> <li>Working knowledge of NoSQL data stores such as CosmosDB, MongoDB, Cassandra, Redis, Riak or other technologies that embed NoSQL with search such as MarkLogic or Lily Enterprise </li><li>Working knowledge with containerization to include but not limited to Dockers, Kubernetes, Spark on Kubernetes, Spark Operator </li><li>Proficient in SQL and Python, with the ability to utilize these tools effectively </li><li>Seasoned in refining and enhancing existing data pipelines to unlock peak efficiency and exceptional performance </li><li>Self-motivated problem solver with a keen eye for identifying and rectifying data inaccuracies </li><li>Collaborative mindset, thriving in cross-functional teams by effectively sharing knowledge and contributing to the delivery of high-quality products </li><li>Collaborate with the team to identify opportunities for innovation and improvement, actively contributing to the continuous evolution of our data infrastructure and engineering capabilities </li><li>Working knowledge of Agile development /SAFe, Scrum and Agile Software Development methodologies </li><li>Ability to thrive in an Agile/Scrum team environment </li><li>Background with source control management systems (GIT or Subversion); Build Systems (Maven, Gradle, Webpack); Code Quality (Sonar); Artifact Repository Managers (Artifactory), Continuous Integration/ Continuous Deployment (Azure DevOps) </li><li>SQL experience: querying data and sharing what insights can be derived </li><li>Understanding of cloud solutions such as Google Cloud Platform, Microsoft Azure & Amazon AWS cloud architecture & services </li><li>Knowledgeable of best practices in information technology governance, privacy, compliance and security topics </li></ul>Qualifications Experience <ul> <li>Bachelor's Degree in related field or equivalent work experience required </li><li>4-6 years of hands-on experience with data engineering required </li><li>3-5 years of hands-on experience with processing large data sets required </li><li>3-5 years of hands-on experience with SQL, data modeling, relational databases and/or no SQL databases required </li></ul> What We Offer: Generous benefits package available on day one to include: 401K matching, bonding leave for new parents (12 weeks, 100% paid), tuition assistance, training, GM employee auto discount, community service pay and nine company holidays. Our Culture: Our team members define and shape our culture - an environment that welcomes innovative ideas, fosters integrity, and creates a sense of community and belonging. Here we do more than work - we thrive. Compensation: Competitive pay and bonus eligibility Work Life Balance: Flexible hybrid work environment, 2-days a week in office Note:Please note we are not able to consider candidates who require visa sponsorship for this position. #LI-Hybrid #LI-MH1

Data Engineer General Motors Jobs

Data Engineer
July 23, 2024

Principal Data Engineer Prognostics
July 16, 2024

Senior Data Engineer
July 16, 2024

Sr Manager Data Engineer Sre
July 14, 2024

Senior Data Engineer
July 6, 2024

Data Engineer Ii
July 1, 2024

Quick filters

Top companies

Data Engineer General Motors Jobs

Data EngineerJuly 23, 2024

Principal Data Engineer PrognosticsJuly 16, 2024

Senior Data EngineerJuly 16, 2024

Sr Manager Data Engineer SreJuly 14, 2024

Senior Data EngineerJuly 6, 2024

Data Engineer IiJuly 1, 2024