ABOUT JOB:

Job Title: Data Engineer (Only Immediate Joiners)

Reports To: Lead Data Engineer

Position Location: Noida, Hyderabad

Experience: 2+ years

Number of Open Positions: multiple

ABOUT THE ROLE

The Data Engineer is an Individual who assists with the development and maintenance of the company’s data storage systems and data movement processes. The candidate’s responsibilities include expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for various projects and functional teams. The Data Engineer will build new data pipelines and engines using modern cloud data tools that support our software developers, database architects, data analysts, and data scientists. The Engineer will ensure optimal data delivery architecture is consistent throughout ongoing projects and generate new architecture to support our next generation of products and data initiatives. Candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. An enthusiast with good hands-on experience around the prospect of optimizing or even re-designing existing data architecture to continue to adapt to the latest technology.

PRIMARY RESPONSIBILITIES:

Develop, construct, test, and maintain data storage systems including traditional SQL databases, and No-SQL Solutions such as Mongo, BLOB Storage, and others.
Create and maintain optimal data pipelines leveraging SSIS, Data Factory, Databricks, and others.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Identify ways to improve data reliability, efficiency, and quality.
Work with data and analytics experts to strive for greater functionality in our data systems.
Integrate data tools for analytics and data scientist team members and assist them in building and optimizing our product into an innovative industry leader

KNOWLEDGE AND SKILLS REQUIREMENT:

Bachelor’s degree in computer science or related field.
2+ years of experience working with Microsoft SQL Databases
1+ years designing SQL Architecture including table design, index optimization, partitioning strategies, and others.
1+ years of experience developing data scripts using Python.
1+ years working in the Azure Cloud environment
Experience with Databricks is a plus

QUALIFICATIONS:

Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines utilizing ETL software including SSIS, Data Factory, and others.
Python experience with Pandas DataFrames, PySpark, NumPy, and other analytics libraries.
Experience with RESTful APIs, Service Bus, and other orchestration tools.
Understanding of working with containerized Apps utilizing Docker and Kubernetes a plus.
Experience building ETL solutions with non-SQL databases like Mongo DB.
Understanding of Azure cloud data technologies like Azure SQL, Data Factory, Parallel Data Warehousing, Azure Databricks, Azure Synapse, etc.
Ability to prioritize and manage work to critical project timelines in a fast-paced environment.
Proven ability to communicate at all levels with both business and technology leaders, with a strong understanding of business data requirements and technology capabilities.
Strong attention to detail.

Data Engineer Jobs in Noida, Uttar Pradesh

Gcp Data EngineerApril 29, 2024

Senior Data EngineerApril 28, 2024

Data EngineerApril 26, 2024

Data EngineerApril 19, 2024

Senior Data EngineerApril 19, 2024

Data EngineerApril 16, 2024

Senior Data EngineerApril 15, 2024

Data EngineerApril 14, 2024

Data EngineerApril 7, 2024

Sr Data EngineerApril 7, 2024

Gcp Data EngineerApril 7, 2024

Data EngineerApril 7, 2024

Quick filters

Top companies

Gcp Data Engineer
April 29, 2024

Senior Data Engineer
April 28, 2024

Data Engineer
April 26, 2024

Data Engineer
April 19, 2024

Senior Data Engineer
April 19, 2024

Data Engineer
April 16, 2024

Senior Data Engineer
April 15, 2024

Data Engineer
April 14, 2024

Data Engineer
April 7, 2024

Sr Data Engineer
April 7, 2024

Gcp Data Engineer
April 7, 2024

Data Engineer
April 7, 2024