<div> Sharing you the call notes: 3 openings - Jersey City - CTH M,T,W onsite but days are flexible. Liquidity Risk Reporting - fulfill Fed obligation - daily reporting. Stress Scenario report - generate report based on multiple scenarios then generate into Living Will of the firm - critical report. Deliverables in June and September Infra is on-prem Hadoop - this will be delivered on AWS. Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch. Interviews - 2 rounds focused on technical - Scala, Spark, write code, answer design questions. If someone knows Scala, then they would already know Java. Job Description: Additional Skills - BigData, Scala, Hadoop, AWS EMR, AWS EC2, AWS Airflow, Snowflake, AWS Athena, Spark, Python, PL/SQL, Tableau, Angular, CI/CD Expert in in Full Stack design technique as well as experience working across large environments with multiple operating systems/infrastructure for large-scale programs e.g. Expert Engineers starting to be firm-wide resources working on projects across business. Is multi-skilled with expertise across software development lifecycle and toolset. May be recognized as a leader in Agile and cultivating teams working in Agile frameworks, Sought out as coach for at least one technical skill Strong understanding of techniques such as Continuous Integration Continuous Delivery Test Driven Development Cloud Development resiliency security Stays abreast of cutting edge technologies/trends and uses experience to influence application of those technologies/trends to support the business may give speeches and outside the firm writes articles. </div>

<div>FTE - project location -: Seattle. WA or California Onsite 2 days in a week Note : Client is strictly needs a Senior Data Engineer Profile who can stand alone and work with all the Hadoop technology stack. Job Description Our Ads & Data Platforms team, a segment under my client is looking for a Lead Data Engineer. Data is essential for all our decision-making needs whether it's related to product design, measuring advertising effectiveness, helping users Client new content or building new businesses in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our users, advertisers and our content partners. Our Content Engineering team is seeking a highly hardworking Data Engineer with a strong technical background and passionate about diving deeper into Big Data to develop state of the art Data Solutions. Responsibilities <ul> <li>Contribute to the design and growth of our Data Products and Data Warehouses around Content Performance and Content Engagement data. </li> <li>Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data environments (cloud, on-prem, hybrid) </li> <li>Our tech stack includes AWS, Databricks, Snowflake, Spark and Airflow </li> <li>Help architect data solutions/frameworks and define data models for the underlying data warehouse and data marts </li> <li>Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions </li> <li>Maintain detailed documentation of your work and changes to support data quality and data governance </li> <li>Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams) </li> <li>Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team </li> </ul> Basic Qualifications <ul> <li>7+ years of data engineering experience developing large data pipelines </li> <li>Strong SQL skills and ability to create queries to extract data and build performant datasets </li> <li>Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data at large scale </li> <li>Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query) </li> </ul> Preferred Qualifications <ul> <li>Nice to have experience with Cloud technologies like AWS (S3, EMR, EC2) </li> <li>Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines </li> <li>Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices </li> <li>Good Scripting skills, including Bash scripting and Python </li> <li>Familiar with Scrum and Agile methodologies </li> <li>You are a problem solver with strong attention to detail and excellent analytical and communication skills </li> </ul> Required Education <ul> <li>Bachelor's degree in computer science, Information Systems or related field </li> </ul> Preferred Education <ul> <li>Master's degree in computer science, Information Systems or related field </li> </ul> </div>

Data Engineer Cybertec, Inc. Jobs

Java Developer With Data Engineer
April 17, 2024

Sr Data Engineer
April 8, 2024

Data Engineer
April 3, 2024

Quick filters

Top companies

Data Engineer Cybertec, Inc. Jobs

Java Developer With Data EngineerApril 17, 2024

Sr Data EngineerApril 8, 2024

Data EngineerApril 3, 2024

Quick filters

Top companies

Java Developer With Data Engineer
April 17, 2024

Sr Data Engineer
April 8, 2024

Data Engineer
April 3, 2024