Description
Cutting edge big data technology with Spark, EMR, Glue, SageMaker, and Airflow? Check. Deep involvement with business strategy decisions? Check. Work across one of the world's largest and most complex data environments? Check.
Are you excited about the idea to work with big data resources and technologies? Are you up to the challenge of working with top PhD economics and data science researchers to bring front tier economic theories to production? Are you ready to build data pipelines and integrate AWS services that inform billion dollar business decisions across Amazon? If your answer is yes, come join us!
We are a hybrid research + engineering team that brings disruptive econometric models to life in the media entertainment and advertising domains. As an experienced Software Engineer, you will collaborate with economists, data scientists, and developers across the company to develop, test and deploy services that implement a wide range of econometric models. This requires the use of sophisticated distributed systems, application of advanced statistical techniques and the processing of big data. A successful candidate will have a passion for innovation, interest in cutting-edge technology, and excitement about working with data in a high-impact business domain.
This is an opportunity to create and build software for advanced data analytics to support and enable data-driven decision making inside Amazon’s fast growing digital media businesses.
Key job responsibilities
As a Data Engineer, you will/may:
Design, implement, and automate deployment of our distributed system for collecting and processing log events from multiple sources
Design data schema and operate internal data warehouses and SQL/NoSQL database systems
Own the design, development, and maintenance of ongoing metrics, reports, analyses, dashboards, etc. to drive key business decisions
Monitor and troubleshoot operational or data issues in the data pipelines
Drive architectural plans and implementation for future data storage, reporting, and analytic solutions
Work collaboratively with Business Analysts, Data Scientists, and other internal partners to identify opportunities/problems
Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of a problem
A day in the life
You'll spend most the day coding, possibly writing or testing Spark jobs, updating our reusable python libraries, or tweaking an Apache Airflow graph.
You'll join a daily standup and sync with your team mates, and maybe perform a code review or two. Depending on the project phase you may be finishing up your design document for review with your fellow engineers or scientists.
Finally you'll probably join a couple of meetings, either related to your project, Sprint Planning, or maybe even a fun team event!
About the team
We're a pretty atypical team at Amazon, with engineers outnumbered by scientists 3 to 1.
Our mission is to
1) productionize science prototypes into well tuned, scaled systems
and
2) support and improve data infrastructure for scientists to quickly prototype new ideas and models.
You'll be working closely on your projects not just with other data or software engineers, but with Business Intelligence Engineers, Economists, and Data Scientists.
Your engineering background and experience is critical to building reliable, cost effective products for our business partners and Amazon customers.
We are open to hiring candidates to work out of one of the following locations:
Culver City, CA, USA
Basic Qualifications
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience with Spark
Preferred Qualifications
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit mazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit boutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

Sr. Data Engineer, Benefits Experience and Technology (BXT) Job ID: 2681483 | Amazon.com Services LLC
The Benefits eXperience & Technology (BXT) team's mission is to make it easy for employees and their family to discover and use the benefits that apply to them. Today’s traditional benefit experiences rely heavily on content, explanations, and instructions for people to understand what’s available to them and how to use it. We are bringing personalized and friction-free benefits to the tip of the fingers of over five million people (our employees and their dependents). Amazon Benefits help them live richer and fuller lives, be it by helping them in a moment of medical need, saving for retirement, or helping them with a vacation. We are building a delightful mobile and web experience integrated with internal and external systems, so employees don’t have to go through hoops to get what they want. We are breaking new ground with this level of experience and personalization. We are looking for a Senior Data Engineer to support the BXT team in building efficient, flexible, extensible, and scalable ETA and reporting solutions. You should be an expert with data lake fundamentals around storage, compute, etc., familiar with multiple data processing stacks like Spark, EMR, and core data concepts (e.g. Data Modeling and Reporting). You should have deep understanding of the architecture for enterprise level data lake/mesh solutions using AWS stack or other cloud stacks. You should have expertise in the design, creation, management, and business use of large data-sets. The candidate is expected to be able to build efficient, flexible, extensible, and scalable ETL and reporting solutions. You should be enthusiastic about learning new technologies and be able to implement solutions using them to provide new functionality to the users or to scale the existing platform. Our ideal candidate thrives in a fast-paced environment, relishes working with large transactional volumes and big data, enjoys the challenge of highly complex business contexts (that are typically being defined in real-time), and, above all, is a passionate about data and analytics. This role requires a pragmatic problem solver comfortable with ambiguity, with deep expertise in building and maintaining the infrastructure to answer questions with data, using software engineering best practices, data management fundamentals, data storage principles, and recent advances in distributed systems. A candidate will need to leverage a wide range of skills and best practices including an emphasis on data collection, storage, processing and reporting at scale for customer-facing applications and business reporting. Additionally, we are seeking candidates with determination and rigor in engineering, deep curiosity and interest for applied sciences, creativity, and sound logic and reasoning. In summary, this is an exciting opportunity to work with a dynamic team and make a significant impact on the business. The successful candidate will have strong business acumen, experience in developing reporting and analytical infrastructures, effective communication skills, and the ability to work effectively with cross-functional teams in a fast-paced environment and highly ambiguous work space. Key job responsibilities
- Interface with Product Managers, Data/Applied Scientists, Software Engineers and Program Managers to determine requirements for data pipeline, storage, processing and reporting.
- Build scalable and production-ready data pipelines to extract features from petabytes of raw data.
- Manage data refreshes and perform systematic quality data checks at scale.
- Create metrics reports and dashboards to support business reporting, metrics deep dive, customer behavior analysis and feature engineering for ML applications.
- Design data sharing strategy, define data schema and develop tools to enable more efficient data sharing with partner teams which adhere to highly confidential and PII data handling guidelines.
- Serve as a tech lead of data engineering and manage cross-functional data related initiatives and collaborations.
- Recognizing and adopting best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation.
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
BASIC QUALIFICATIONS - 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
PREFERRED QUALIFICATIONS - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses
- Experience working with benefits systems, insurance/payor systems, and/or healthcare IT systems Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Posted: June 5, 2024 (Updated 3 days ago)
Posted: May 29, 2024 (Updated 8 days ago)
Posted: June 13, 2024 (Updated 9 days ago)
Posted: May 29, 2024 (Updated 10 days ago)
Posted: June 4, 2024 (Updated 13 days ago)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. #J-18808-Ljbffr

Description Prime Video offers customers a vast collection of movies, series, and sportsall available to watch on hundreds of compatible devices. U.S. Prime members can also subscribe to 100+ channels including Max, discovery+, Paramount+ with SHOWTIME, BET+, MGM+, ViX+, PBS KIDS, NBA League Pass, MLB.TV, and STARZ with no extra apps to download, and no cable required. Partner experience (PX) organization obsess over partners with a focus on delivering world-class partner tools to enable them to launch, grow and scale their businesses across PVs business lines. PX organization build various products to enable partners to 1) onboard and make their selection available to customers globally; 2) manage selection across PV business lines 3) acquire, engage, retain customers through self-service marketing, merchandising, promotion tools. By providing partners with best-in-class self-service capabilities throughout their engagement with Amazon, we power the flywheel through increased partner satisfaction and expanded the breadth of selection available to Amazon customers. PXBI (Partner Experience BI team) fulfills data needs for Partner Experience (PX) organization to provide big data to power reporting functions across five crucial partner-facing products, meeting reporting contractual obligations and powering Prime Video partners with performance data for measurement to grow their business in Prime Video; also build data pipelines to enable data to measurement effectiveness of organizations product deliveries and facilitate data-driven decision-making within PX organization. Key job responsibilities We are seeking a talented Sr. Data Engineer to enhance overall PXBI core data infrastructure by implementing AWS services to build the data pipelines, enhancing data accuracy, reducing data latency, increasing data service stability, and ensuring compliance with Amazon-wide data compliance regulations, Furthermore, the Sr Data engineer partner with SDE team to build Slate analytics product a new generation of reporting and analytics product to replace the existing VC reporting system and PVD reporting system. We will design and implement data lake to provide robust, scalable data infrastructure to deliver intra-day data to power slate analytics product. As a Sr. Data Engineer in the team, you will work on very large data sets in one of the world's largest and most complex data lake and data warehouse environments. You will design, build and maintain the robust data infrastructures to process large volumes of data (big data) from various sources. This includes writing clean, maintainable code that adheres to best practices, being familiar with AWS data processing services, possessing broad knowledge of when to utilize different types of data, and understanding data security and compliance standards to ensure alignment with company policies and regulations. A day in the life Write the design document to propose the solutions to resolve challenging data processing and data handling. Meet with your peers to discuss the solutions. Review your design doc with product managers, senior management, Sr SDE to communicate your thought and gather their feedback. Build up data infrastructure and data pipelines by using AWS services. Productionalize your solutions into products which will be used by WW Prime Video partners. About the team We are a centralized data team to support partner experience organization. We process big data by using advance AWS services. We work closely with PM, TPM, SDE, collaborate with other data teams outside of partner experience organization to deliver products for Prime Video partners. We are open to hiring candidates to work out of one of the following locations: Culver City, CA, USA | Seattle, WA, USA Basic Qualifications - 5+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with SQL - Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Preferred Qualifications - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data warehouses Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us. Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $139,100/year in our lowest geographic market up to $240,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.

Data Engineer Amazon Jobs

Data Engineer Gmac Economics_
July 2, 2024

Sr Data Engineer Benefits Experience And Technology Bxt
July 2, 2024

Senior Data Engineer Digital Acceleration
June 30, 2024

Sr Data Engineer Partner Experience
June 28, 2024

Quick filters

Top companies

Data Engineer Amazon Jobs

Data Engineer Gmac Economics_July 2, 2024

Sr Data Engineer Benefits Experience And Technology BxtJuly 2, 2024

Senior Data Engineer Digital AccelerationJune 30, 2024