Work from office- 3 days/WeekLocation: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional data modelling Solid knowledge of data warehouse best practices, development standards and methodologies Experience with ETL/ELT tools like ADF, Informatica, Talend etc., and data warehousing technologies like Azure Synapse, Azure SQL, Amazon redshift, Snowflake, Google Big Query etc. Strong experience with big data tools (Databricks, Spark etc..) and programming skills in PySpark and Spark SQL.Be an independent self-learner with “let’s get this done” approach and ability to work in Fast paced and Dynamic environment.Excellent communication and teamwork abilities. Nice-to-Have Skills: Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Cosmo DB knowledge. SAP ECC /S/4 and Hana knowledge. Intermediate knowledge on Power BI Azure DevOps and CI/CD deployments, Cloud migration methodologies and processes About Bayone:BayOne is 12 Years old software consulting organization based out their headquarters in Pleasanton, California US. At BayOne, We specialize in providing Talent and Solutions & have a passion for diversity in tech #MakeTechPurple. We help companies build teams. We find leaders and team players experts in their domains to grow your business- talent who fit in your culture. We specialize in the following domains: Project & Program Management Cloud Computing & IT Infrastructure Management Big Data Services Software & Quality Engineering User Experience Design Visit Company Profile: <a>http://www.bayone.com</a> Visit Company Linkedin Profile: <a>linkedin.com/company/bayone-solutions/</a> Visit Company Glassdoor Profile <a>https://www.glassdoor.co.in/Reviews/BayOne-Solutions-Reviews-E783043.htm</a>

Data Engineer / Business Intelligence (BI) Engineer - Team Lead We are Outbrain We’re one of the world’s largest content recommendation platforms, delighting audiences with engaging, personalized content recommendations while serving as the primary engagement partner and platform for the world’s top digital media companies. Job Description: Are you an experienced Business Intelligence Engineer interested in an opportunity to help drive Outbrain performance and develop your A-to-Z business understanding? Outbrain’s BI department is looking for a highly skilled BI Engineering Team Lead to be part of our growing organization. As a BIE Lead at Outbrain, you will have the opportunity to work on some of the world's largest data sets, influence the long-term evolution of our data analytics platform and help build data driven operational workflows to enable the business to be successful in an ever-changing business environment. Key Job Responsibilities: <ul><li>Tableau and Looker site administration and operational support for the analytics teams</li><li>Work with analysts to scale value-creating capabilities, including data integrations and transformations, as well as productizing statistical and machine learning BI models.</li><li>Design, build, and optimize the data architecture and extract, transform, and load (ETL) pipelines to make them accessible for Business Data Analysts, Data Scientists, and business users.</li><li>Drive standards in data reliability, data integrity, documentation and data governance, enabling accurate, consistent, and trustworthy data sets, business intelligence products, and analyses.</li><li>Define technical requirements and aid implementation by collaborating with the Data Engineering team.</li><li>Work in a genuinely global environment.</li></ul> Basic qualifications <ul><li>Bachelor's degree in Computer Science, Engineering.</li><li>5+ years of experience working with large data sets and complex SQL queries.</li><li>3+ years of relevant experience in a Business Analyst or BI Engineer role.</li><li>3+ years of experience as Tableau site administrator.</li><li>Excellent communication in English (verbal and written) and interpersonal skills.</li></ul> Preferred qualifications <ul><li>Experience with Dimensional Models, Datamarts in Traditional Data Warehouses as well as in Big Data / Advanced Analytics domains.</li><li>Experience working with cloud database technologies such as Google’s BigQuery.</li><li>Experience with orchestration tools such as Airflow.</li><li>Proficiency in OOP language - python - is a big advantage.</li><li>Experience with Looker and LookerML is a big advantage.</li></ul> Hybrid working: three days a week from the office and two from home.

Job Summary:Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.Responsibilities:<ul><li>Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.</li><li>Create the data integration and data diagram documentation. </li><li>Lead the data validation, UAT and regression test for new data asset creation.</li><li>Create and maintain data models, including schema design and optimization.</li><li>Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.</li></ul>Qualifications and Skills:<ul><li>Strong knowledge on Python and Pyspark </li><li>Expectation is to have ability to write Pyspark scripts for developing data workflows.</li><li>Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum </li><li>Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.</li><li>Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.</li><li>Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.</li><li>Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.</li><li>Expectation is to have strong problem-solving and troubleshooting skills.</li><li>Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.</li><li>Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.</li><li>3-7 years of experience in Data Engineer.</li><li>Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.</li><li>Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.</li></ul>Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.

We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena and pySpark. Responsibilities:<ul><li>Design and implement data pipelines for extracting, transforming, and loading data from various sources to our data warehouses and data lakes.</li><li>Collaborate with data scientists and analysts to understand data requirements and ensure data quality and integrity.</li><li>Optimize and tune data pipelines for performance and scalability.</li><li>Develop and maintain documentation related to data pipelines, data models, and data flows.</li><li>Stay updated with the latest trends and technologies in data engineering and implement best practices.</li></ul> Requirements:<ul><li>Bachelor's degree in Computer Science, Engineering, or a related field.</li><li>2 to 4 years of experience in data engineering or a similar role.</li><li>Proficiency in SQL and experience with database technologies like Redshift, MySQL.</li><li>Experience with data warehousing concepts and ETL processes.</li><li>Hands-on experience with big data technologies like Athena and pySpark.</li><li>Strong analytical and problem-solving skills.</li><li>Excellent communication and collaboration skills.</li></ul> Work Experience: 2-4 YearsWorking days: 5Location: Gurugram, Haryana Perks:<ul><li>Friendly atmosphere</li><li>High learning & personal growth opportunity</li><li>Flexible Timings</li><li>Diverse work environment</li></ul> Why Nutrabay: We believe in an open, intellectually honest culture where everyone is given the autonomy to contribute and do their life’s best work. As a part of the dynamic team at Nutrabay, you will have a chance to learn new things, solve new problems, build your competence and be a part of an innovative marketing-and-tech startup that’s revolutionizing the health industry.Working with Nutrabay can be fun, and a place of a unique growth opportunity. Here you will learn how to maximize the potential of your available resources. You will get the opportunity to do work that helps you master a variety of transferable skills, or skills that are relevant across roles and departments. You will be feeling appreciated and valued for the work you delivered. We are creating a unique company culture that embodies respect and honesty that will create more loyal employees than a company that simply shells out cash. We trust our employees and their voice and ask for their opinions on important business issues. About Nutrabay:Nutrabay is one of the largest health & nutrition store in India. We are proudly a bootstrapped business with lakhs of customers that trust us. Our vision is to keep growing, having a sustainable business model and continue to be the market leader in this segment by launching many innovative products.

KeySkills:<ul><li>Strong hands-on experience Big Data Solutions like Apache Spark (Java/ Scala), Apache Flink, Google Dataproc, NoSQL Cassandra/ Mongo and BigQuery.</li><li>Strong knowledge of Google cloud is a big plus. </li><li>Strong systems design experience with DS/ Algo and GoF design-patterns </li><li>Hands-on Java, Multi-threading Concurrency and Performance Tuning approaches. </li><li>Event-driven architectures Kafka, Orchestration and Choreography architectures </li><li>Working knowledge of Java Microservices Spring Boot, cloud native architectures and Kubernetes based architectures. </li></ul> Minimum 10 years of exp is required as a data engineer

Key Responsibilities As a Data Engineer, you will:•Partner with KFC, Pizza Hut, Taco Bell & Habit Burger to identify opportunities to leverage company data to drive business outcomes.•Play a key role in our advanced analytics team - developing data-driven solutions, and responsible for driving Yum Growth.•Design and develop scalable streaming data integration frameworks to move and transform a variety of data sets.•Develop on the Yum! data platform by building applications using a mix of open-source frameworks (Py-Spark, Kubernetes, Airflow, etc.) and best in breed SaaS tools (Informatica Cloud, Snowflake, Domo, etc.).•Implement and manage production support processes around data lifecycle, data quality, coding utilities, storage, reporting and other data integration points. Skills and Qualifications•2+ years of data engineering experience.•2+ years of experience building cloud data solutions (e.g. on AWS) and using services such as storage, virtual machines, serverless technologies and parallel processing technologies. Cloud certifications are a plus.•Should have experience in IICS / Power centre etc.•Experience building solutions utilizing streaming or event processing (Kafka, Spark Streaming, Pulsar, etc.) is a plus.•Proficiency in Python and its supporting libraries for data processing [good to have]•Experience processing structured & semi-structured data.•Experience building serverless APIs (AWS preferred, but any cloud environment works)

About Impetus Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100 enterprises, headquartered in Los Gatos, California, with development centers in NOIDA, Indore, Gurugram, Bengaluru, Pune, and Hyderabad with over 3000 global team members. We also have offices in Canada and Australia and collaborate with a number of established companies, including American Express, Bank of America, Capital One, Toyota, United Airlines, and Verizon. Job DescriptionYou should have extensive production experience in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 2-3 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application development is a must Roles & Responsibilities<ul><li>Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.</li><li>Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.</li><li>Strong experience in Big Data technologies – Hadoop, Sqoop, Hive and Spark including DevOPs.</li><li>Good hands on expertise on either Python or Java programming.</li><li>Good Understanding of GCP core services like Google cloud storage, Google compute engine, Cloud SQL, Cloud IAM.</li><li>Good to have knowledge on GCP services like App engine, GKE, Cloud Run, Cloud Built, Anthos.</li><li>Ability to drive the deployment of the customers’ workloads into GCP and provide guidance, cloud adoption model, service integrations, appropriate recommendations to overcome blockers and technical road-maps for GCP cloud implementations.</li><li>Experience with technical solutions based on industry standards using GCP - IaaS, PaaS and SaaS capabilities.</li><li>Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technologies.</li><li>Act as a subject-matter expert OR developer around GCP and become a trusted advisor to multiple teams.</li></ul> QualificationDegree – Graduates/Postgraduate in CSE/IT or related field

Qualifications: <ul><li>Bigdata + Java: Java, Microservices, Spring boot, API, Bigdata, Python, Pyspark</li><li>Experience with design and coding across one or more platforms and languages (e.g. Java, Spark/SQL) as appropriate</li><li>Hands-on expertise with application design, software development and automated testing Proficient in Big Data technologies Designs, codes, tests, corrects and documents large and/or complex programs and program modifications from supplied specifications using agreed standards and tools, to achieve a well-engineered result Proficient and Hands-on Data Warehousing,</li><li>Experience with Agile development, Continuous Integration, and Continuous Delivery Ability to effectively interpret technical and business objectives and provide solutions Strong communication skills, with ability to articulate technical solutions effectively across diverse group of stakeholders</li><li>Need to be a fast learner willing to adapt to evolving needs of the developer community</li></ul> Roles & Responsibilities <ul><li>Collaborate with cross-functional teams, including Architects, product managers, and designers, to deliver high-quality software solutions.</li><li>Design, develop, test, and deploy efficient and maintainable systems using </li><li>Architect and implement RESTful APIs for seamless communication between frontend and backend components.</li><li>Troubleshoot and resolve performance issues, bottlenecks, and bugs to maintain system stability.</li><li>Stay up to date with industry trends and best practices to continuously improve development processes.</li></ul> Mandatory SkillsJava, Big data, Spark

Responsibilities: <ul><li>Develop high-quality software design and architecture </li><li>Identify, prioritize and execute tasks in the software development life cycle </li><li>Develop tools and applications by producing clean, efficient code </li><li>Automate tasks through appropriate tools and scripting </li><li>Review and debug code </li><li>Perform validation and verification testing </li><li>Collaborate with internal teams and vendors to fix and improve products </li><li>Document development phases and monitor systems </li><li>Ensure software is up-to-date with latest technologies </li></ul> Requirements: <ul><li>Proven experience as a Senior Software Engineer </li><li>Hands-on experience working with technologies like Hadoop, Hive, Pig, Oozie, Map Reduce, Spark, Sqoop, Kafka, Flume, etc. </li><li>Extensive experience in software development, scripting and project management </li><li>Experience using system monitoring tools (e.g. Grafana, Ganglia) and automated testing frameworks </li><li>Knowledge of selected programming languages (e.g. Python, JAVA, Scala , Python, C++) </li><li>In-depth knowledge of relational databases (e.g. PostgreSQL, MySQL) and NoSQL databases (e.g. MongoDB) </li><li>Familiarity with various operating systems (Linux, Mac OS, Windows) </li><li>Analytical mind with problem-solving aptitude </li><li>Ability to work independently </li><li>Excellent organizational and leadership skills</li></ul>

Data Engineer Jobs in Gurugram

Data Engineer Azure Data Engineer
July 22, 2024

Data Engineer Team Lead Strong Sql And Etl Experience
July 16, 2024

Data Engineer
July 16, 2024

Data Engineer
July 7, 2024

Data Engineer
July 7, 2024

Data Engineer
July 6, 2024

Data Engineer
July 5, 2024

Senior Data Engineer Bigdatajava
June 30, 2024

Data Engineer 37 Years
June 28, 2024

Quick filters

Top companies

Data Engineer Jobs in Gurugram

Data Engineer Azure Data EngineerJuly 22, 2024

Data Engineer Team Lead Strong Sql And Etl ExperienceJuly 16, 2024

Data EngineerJuly 16, 2024

Data EngineerJuly 7, 2024

Data EngineerJuly 7, 2024

Data EngineerJuly 6, 2024

Data EngineerJuly 5, 2024

Senior Data Engineer BigdatajavaJune 30, 2024

Data Engineer 37 YearsJune 28, 2024

Quick filters

Top companies

Data Engineer Azure Data Engineer
July 22, 2024

Data Engineer Team Lead Strong Sql And Etl Experience
July 16, 2024

Data Engineer
July 16, 2024

Data Engineer
July 7, 2024

Data Engineer
July 7, 2024

Data Engineer
July 6, 2024

Data Engineer
July 5, 2024

Senior Data Engineer Bigdatajava
June 30, 2024

Data Engineer 37 Years
June 28, 2024