Sam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives. Responsibilities for Data Engineer •Create and maintain optimal data pipeline architecture for data intensive applications. •Assemble large, complex data sets that meet functional / non-functional business requirements. •Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. •Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure SQL, Cosmo DB, Databricks and other legacy databases. •Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. •Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. •Keep our data separated and secure across national boundaries through multiple data centers and Azure regions. •Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. •Work with data and analytics experts to strive for greater functionality in our data systems. Qualifications for Data Engineer •Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. •Extensive Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake House Architecture. •Programming experience on Python, Shell scripting, PySpark, and other data programming language. •Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. •Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc. •Build processes supporting data transformation, data structures, metadata, dependency and workload management. •A successful history of manipulating, processing and extracting value from large disconnected datasets. •Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores. •Familiar with Deployment tool like Docker and building CI/CD pipelines. •Experience supporting and working with cross-functional teams in a dynamic environment. •8+ years' experience in software development, Data engineering, and •Bachelor's degree in computer science, Statistics, Informatics, Information Systems or another quantitative field. Postgraduate/master's degree is preferred. •Experience in Machine Learning and Data Modeling is a plus. Required Skills : Tech stack requirements: •High level Databricks experience •Python, bash, or shell scripting •Experience architecting data pipelines and providing strategy/guidance on how to build from scratch •SQL queries and building dashboards and reports (Databricks visualization preferred but ok with Tableau or PowerBI) Location: 2 days/week on site in Sunnyvale, CA or San Bruno, CA Basic Qualification : Additional Skills : Background Check :Yes Drug Screen :Yes Notes : Selling points for candidate : Project Verification Info : Candidate must be your W2 Employee :Yes Exclusive to Apex :Yes Face to face interview required :No Candidate must be local :No Candidate must be authorized to work without sponsorship ::No Interview times set : :No Type of project :Development/Engineering Master Job Title :Data Analyst Branch Code :San Francisco

Responsibilities

About TikTok U.S. Data Security
TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security ("USDS") is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more.

Why Join Us
Creation is the core of TikTok's purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

In order to enhance collaboration and cross-functional partnerships, among other things, at this time, our organization follows a hybrid work schedule that requires employees to work in the office 3 days a week, or as directed by their manager/department. We regularly review our hybrid work model, and the specific requirements may change at any time.

About the team
TikTok video system is a world-leading video platform that provides multimedia storage, delivery, transcoding services. As part of the USDS, the Video Platform team is responsible for building the next generation video processing platform which provides excellent experiences for billions of users around the world.
About the role:
As a Data Engineer, you will be instrumental in shaping strategic decisions within the TikTok video platform. This role emphasizes building, optimizing, and maintaining robust data processing architectures that support new data and ETL pipelines. Your expertise will ensure that data flows reliably and accurately across various systems, empowering stakeholders with high-quality, actionable insights that impact quality of service, quality of experience and cost optimizations.

Responsibilities
- Craft optimal end to end data processing architecture and systems for new data and ETL pipelines
- Design, build, and maintain efficient and reliable data pipelines to move and transform big datadata
- Implement and monitor quality control measures to ensure data accuracy, completeness, and consistency
- Drive internal process improvements and automate manual processes for data quality and service level agreement (SLA) management
- Create and maintain technical documentation, such as data dictionaries, data flow diagrams, and system documentation, to ensure efficient and effective data management and analysis.
- Work closely with data engineering and various vertical teams within the Video platform and cross-functional teams within TikTok USDS

Qualifications

Minimum Qualifications
- Bachelor's degree in Computer Science or a related technical background involving software/system engineering, or equivalent working experience
- 2+ years of experience working with data analytics and data engineering, including experience with data cleaning and preprocessing, data analysis and dashboard development.
- 2+ years of proficiency in distributed data processing using Big Data technologies such as Spark, Hadoop/HDFS, Flink, Hive, YARN, and Kafka
- Good programming experience with SQL and at least one of the following languages: Java, Python, Go, or Scala
- Experience in data analytics and data engineering ETL development, data pipeline design, implementation, and maintenance
Preferred Qualifications
- Demonstrated independent thinking capabilities and troubleshooting skills in large scale distributed systems
- Good communication and coordination skills
- Strong background in algorithms and data structures
- Experience in building data solutions with AWS, Google, Azure and other cloud services is a plus

Candidates for this position must be legally authorized to work in the United States. This position is not eligible for visa sponsorship or support.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/ktJP6

This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening.

Software Engineer 5Mountain View, CA (Hybrid)12 months contract **Hiring manager also open for candidates local of Dallas, TX** Beeline Summary:The main function of a software engineer is to apply the principles of computer science and mathematical analysis to the design, development, testing, and evaluation of the software and systems that make computers work. A typical software engineer researches, designs, develops and tests operating systems-level software, compilers, and network distribution software for medical, industrial, military, communications, aerospace, business, scientific and general computing applications.<ul><li>Responsibilities: Develop and implement advanced attribution models to analyze and attribute the impact of various marketing channels on user conversion.</li><li>Collaborate with data scientists, product managers, and other engineers to refine and improve attribution methodologies.</li><li>Design and maintain scalable and optimized data pipelines for efficient collection, processing, and storage of attribution-related data.</li><li>Work closely with stakeholders to understand and translate business requirements into technical solutions.</li><li>Conduct A/B testing and performance analysis to validate and iterate on attribution models.</li><li>Stay updated on industry trends and emerging technologies related to attribution modeling and ad tech.</li><li>Skills and QualificationsBachelor’s or master’s in computer science, Data Science, or a related field.</li><li>Requires at least 8 years of related experience and a bachelor’s degree; or 6 years and a Master's degree; or a PhD with 3 years</li><li>Proven experience in attribution modeling within the ad tech industry.</li><li>Strong programming skills in Python, Java, or Scala.</li><li>Experience in working with Kubernetes and stream data processing frameworks (Flink, Apache Ignite)</li><li>Proficient in working with big data technologies and databases (e.g., Hadoop, Spark, SQL, and MapReduce).</li><li>Hands-on experience with orchestration tools like Airflow or similar</li><li>Solid understanding of statistical concepts and experience with relevant tools.</li><li>Excellent problem-solving and communication skills.</li><li>Preferred QualificationsExperience with machine learning techniques for attribution modeling.</li><li>Familiarity with real-time data processing and streaming technologies.</li><li>Knowledge of end-to-end digital advertising ecosystems and industry standards.</li><li>Knowledge of Snowflake and related technologies</li></ul>Top 3 Skill Sets:Scala, Python, Snowflake

Intuit is looking for a Distinguished Data Engineer who will be responsible for Mailchimp’s data technology strategy, architecture, and our approach to leverage data to drive growth for the business. As a Distinguished Engineer, you will play a critical role in shaping the future of Intuit Mailchimp by providing architectural and thought leadership across multiple engineering teams, architects, systems, and offerings. You will drive the technology vision, direction, and strategy within your respective scope, ensuring that our technology is aligned with business outcomes and our customers' needs.
Responsibilities   Lead the data technology strategy and architecture for Mailchimp’s top initiatives (including our customer data platform (CDP)).
Bring executive level domain expertise to lead strategic initiatives and architecture including the CDP and how to leverage data effectively for AI/ML models.
Identify gaps/opportunities and establish data technology vision, direction, and strategy within respective scopes.
Lead Mailchimp’s strategy and approach to data architecture with the Intuit Data Strategy.
Partner closely with Intuit data technology leadership to drive Mailchimp outcomes.
Represent Mailchimp’s CDP, AI/ML Engine, Data Capabilities efforts internally and externally.
Be a talent steward across Intuit, role modeling diversity and inclusion.
Minimum Requirements   10+ years’ experience designing and leading architectural efforts for web, software, or mobile applications.
Experience with cloud/SaaS, big data, or analytics and Machine Learning.
Boundaryless leadership experience: Applying the nuances of influencing based on the situation, knowing when to push and when to ease, driving through designs, ideas, and roadmaps.
Seasoned and Ambidextrous leadership - able to balance short and long, inspire and coach.
Excellent communication skills: Demonstrated ability to present to all levels of leadership, including executives.
Experience in conceptualizing, launching, and driving business and product strategies and multi-year roadmaps.
Ability to question the status quo and galvanize people, teams, and organizations (Technology/Customer & Business problems).
Deep platform thinker that breaks down the problem into self-contained functionalities that work together.
Expertise with modern technology stacks, API strategies, microservices, public cloud, and programming languages.
Experience or familiarity with MarTech and/or Fintech industries would be a plus.
Expertise with Agile Development, SCRUM, or Extreme Programming methodologies.
BS/MS in computer science or equivalent work experience. Significant design/architecture experience.

#J-18808-Ljbffr

Data Engineer Jobs in Mountain View, CA

Senior Data Engineer
December 4, 2024

Video Platform Data Engineer Usds
November 28, 2024

Staff Data Engineer Samsung Ads
November 25, 2024

Data Engineer
November 24, 2024

Distinguished Data Engineer Mailchimp
November 23, 2024

Staff Data Engineer Samsung Ads
November 11, 2024

Seniorstaff Data Engineer
November 10, 2024

Quick filters

Top companies

Data Engineer Jobs in Mountain View, CA

Senior Data EngineerDecember 4, 2024

Video Platform Data Engineer UsdsNovember 28, 2024

Staff Data Engineer Samsung AdsNovember 25, 2024

Data EngineerNovember 24, 2024

Distinguished Data Engineer MailchimpNovember 23, 2024

Staff Data Engineer Samsung AdsNovember 11, 2024

Seniorstaff Data EngineerNovember 10, 2024