Job Title: Azure Data EngineerLocation: Remote, IndiaJob Summary:We are seeking a talented Azure Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining data solutions on the Azure platform.Key Responsibilities:<ul><li>Design and implement data pipelines using Azure Data Factory.</li><li>Develop and manage data storage solutions using Azure SQL Database and Azure Data Lake.</li><li>Optimize data processes and ensure data quality.</li><li>Collaborate with data scientists and analysts to provide necessary data support.</li><li>Monitor and troubleshoot data pipeline issues.</li></ul>Required Skills and Qualifications:<ul><li>Proven experience as a Data Engineer.</li><li>Proficiency in Azure Data Factory, Azure SQL Database, and Azure Data Lake.</li><li>Strong SQL skills.</li><li>Familiarity with data warehousing concepts.</li><li>Excellent problem-solving and analytical skills.</li></ul>Preferred Qualifications:<ul><li>Experience with Azure Databricks and Azure Synapse Analytics.</li><li>Knowledge of Python or other programming languages.</li></ul>Education:<ul><li>Bachelor’s degree in Computer Science, Information Technology, or a related field.</li></ul>

Job Description:<ul><li>We are seeking a highly experienced Lead Data Engineer with over 9 years of expertise in data engineering.</li><li>As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.</li><li>Your proficiency in Python, PySpark, Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.</li></ul>Key Responsibilities:<ul><li>Lead and manage data engineering projects, overseeing the design and development of data pipelines.</li><li>Architect scalable and efficient data solutions using Python and PySpark.</li><li>Utilize cloud platforms such as Azure to build and maintain data infrastructure.</li><li>Work with Databricks or Snowflake for advanced data processing and warehousing.</li><li>Perform data modeling and design complex data structures.</li><li>Write and optimize SQL queries and scripts for data transformation.</li><li>Collaborate with cross-functional teams to define data strategies and deliver solutions.</li><li>Proficiency in Azure ADF for ETL processes.</li><li>Previous experience with ETL tools like Talend or Informatica is preferred.</li><li>Troubleshoot and optimize data pipelines for maximum performance and scalability.</li><li>Ensure data quality, accuracy, and reliability throughout the data lifecycle.</li><li>Stay updated on industry trends and emerging technologies in data engineering.</li></ul>Requirements:<ul><li>Bachelor's degree in Computer Science, Information Technology, or a related field.</li><li>Expertise in Python, PySpark, Azure, Databricks/Snowflake, and SQL.</li><li>Strong data modeling skills and deep understanding of data warehousing.</li><li>Proficiency in Azure ADF for ETL processes is preferred.</li><li>Previous experience with ETL tools like Talend or Informatica is a plus.</li><li>Proven leadership and project management skills.</li><li>Excellent problem-solving, analytical, and communication skills.</li></ul>

Responsibilities:Designing and implementing highly performant data ingestion pipelines from multiple sources using AWS services such as AWS Glue, Glue Catalog, AWS Step Functions, AWS EMR, AWS Lambda, RDS.Building and maintaining data lakes and data warehouses in AWS to support data analytics and business intelligence.Orchestrating and automating data workflows using AWS Data Pipeline and other orchestration services.Ensuring data integrity and quality throughout the data pipeline and storage process.Collaborating with cross-functional teams, including business analysts, data scientists, and other stakeholders to support data-driven decision-making.Requirements:Proficiency in AWS services related to data engineering, such as AWS Lambda, AWS Data Pipeline, AWS Glue, Amazon S3, Amazon RDS, and Amazon Redshift.Experience in building and optimizing data pipelines, architectures, and data sets.Strong analytical skills and the ability to work with large, complex data sets.Knowledge of data modeling, data access, and data storage techniques.Familiarity with big data technologies and ETL tools.Ability to work in a fast-paced and agile development environment.Working with Dev Team members and proving them required help. Requirements:Proficiency in AWS services related to data engineering, such as AWS Lambda, AWS Data Pipeline, AWS Glue, Amazon S3, Amazon RDS, and Amazon Redshift.Experience in building and optimizing data pipelines, architectures, and data sets.Strong analytical skills and the ability to work with large, complex data sets.Knowledge of data modeling, data access, and data storage techniques.Familiarity with big data technologies and ETL tools.Ability to work in a fast-paced and agile development environment.

What be you’ll doing? <ul><li>Build and deploy the infrastructure for ingesting high-volume support data from consumer interactions, devices, and apps.</li><li>Must have strong experience with AWS Glue, Spark, ETL</li><li>Design and implement the processes that turn data into insights. Model and mine the data to describe the system's behaviour and to predict future actions.</li><li>Enable data driven change -- Build effective visualizations and reports presenting data insights to all stakeholders, internal (corporate) and external (our SaaS customers)</li><li>Develop and maintain the data-related code in an automated CI/CD build/test/deploy environment</li><li>Generate specific reports needed across tenants to allow insight into agent performance and business effectiveness.</li><li>Research individually and in collaboration with other teams on how to solve problems</li></ul> What we seek in you:<ul><li>Bachelor's degree in computer science, Information Systems, or a related field. Minimum of 5+ years of relevant working experience in data engineering.</li><li>Experience working with cloud Data Warehouse solutions and AWS Cloud-based solutions. Exposure to salesforce or any CRM.</li><li>Experience with AWS Glue.</li><li>Advanced SQL skills and experience with relational databases and database design. Experience with working on large data sets and distributed computing (Spark/Hive/Hadoop)</li><li>Strong proficiency in data pipeline and workflow management tools (Airflow).</li><li>Excellent problem-solving, communication, and organizational skills. Proven ability to work independently and with a team.</li><li>Is a self-starter and action biased. Strong in communications that handles stake holder communications.</li><li>Follows agile methodology to work, collaborate and deliver in a global team set up. Ability to learn and adapt quickly.</li></ul> Life at Next:At our core, we're driven by the mission of tailoring growth for our customers by enabling them to transform their aspirations into tangible outcomes. We're dedicated to empowering them to shape their futures and achieve ambitious goals. To fulfil this commitment, we foster a culture defined by agility, innovation, and an unwavering commitment to progress. Our organizational framework is both streamlined and vibrant, characterized by a hands-on leadership style that prioritizes results and fosters growth. Perks of working with us:<ul><li>Clear objectives to ensure alignment with our mission, fostering your meaningful contribution.</li><li>Abundant opportunities for engagement with customers, product managers, and leadership.</li><li>You'll be guided by progressive paths while receiving insightful guidance from managers through ongoing feedforward sessions.</li><li>Cultivate and leverage robust connections within diverse communities of interest. Choose your mentor to navigate your current endeavors and steer your future trajectory.</li><li>Embrace continuous learning and upskilling opportunities through Nexversity.</li><li>Enjoy the flexibility to explore various functions, develop new skills, and adapt to emerging technologies. Embrace a hybrid work model promoting work-life balance. Access comprehensive family health insurance coverage, prioritizing the well-being of your loved ones.</li><li>Embark on accelerated career paths to actualize your professional aspirations.</li></ul> Who we are?We enable high growth enterprises build hyper personalized solutions to transform their vision into reality. With a keen eye for detail, we apply creativity, embrace new technology and harness the power of data and AI to co-create solutions tailored made to meet unique needs for our customers. Join our passionate team and tailor your growth with us!

Seeking a GCP Data Engineer to create, deliver, and support custom data products, as well as enhance/expand team capabilities. They will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and analytics. Google Cloud Data Engineers will be responsible for designing the transformation and modernization on Google Cloud Platform cloud. Experience with large scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on Google Cloud Platform is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of Google Cloud Platform and 3rd party technologies for deploying on Google Cloud Platform cloud. Skills Required:Cloud Platform (Google Cloud Platform) services: Big Query, DataFlow, PythonExperience: 3 to 5 Years onlyLocation: ChennaiNotice: Immediate to 15 Days Interested candidates please do share your updated CV with janani.srinivasan@htcinc.com along with below mentioned details"Rel. Exp. in GCP:Rel. Exp. in Big Query:Rel. Exp. in Python:Rel. Exp. in Data Flow:CTC:E.CTC:Current Location:

Company DescriptionObjectways is a boutique shop that specializes in solving complex problems in big data analytics, machine learning/artificial intelligence, and IoT analytics. Our approach involves working backwards from customer problems to provide tailored solutions using state-of-the-art tools and techniques. We prioritize simplicity, innovation, and well-architected systems to ensure operational excellence, security, reliability, performance efficiency, and cost optimization. Our engagement model includes dedicated engagement managers, infrastructure automation, and warranty support to provide a seamless experience for our customers. Role DescriptionThis is a full-time on-site role for a Data Engineer located in Chennai. As a Data Engineer, your day-to-day tasks will involve data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics. You will be responsible for designing, building, and maintaining data systems, as well as extracting insights from large datasets to support business objectives. Qualifications<ul><li>Conduct requirements gathering and project scoping sessions with subject matter experts, business users, and executive stakeholders to discover and define business data needs.</li><li>Design, build, and optimize the data architecture and Extract, Transform, and Load (ETL) pipelines to make them accessible for Business Data Analysts, Data Scientists, and business users to enable data-driven decision-making.</li><li>Work closely with analysts to productionize and scale value-creating capabilities, including data integrations and transformations, model features, and statistical and machine learning models.</li><li>Drive the highest standards in data reliability, data integrity, and data governance, enabling accurate, consistent, and trustworthy data sets, business intelligence products, and analyses.</li><li>Engage with the analyst community, communicate with analysts to understand critical user journeys and data sourcing inefficiencies, advocate best practices, and lead analyst trainings.</li><li>Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills</li><li>Data Warehousing and Data Analytics skills</li><li>Experience in working with large datasets and designing data systems</li><li>Proficiency in programming languages such as Python, SQL, and Java</li><li>Knowledge of data governance and data quality best practices</li><li>Understanding of cloud platforms and their data services</li><li>Strong analytical and problem-solving skills</li><li>Bachelor's degree in Computer Science, Engineering, or a related field</li><li>Experience with at least 1 cloud - AWS or Azure or GCP</li></ul>

Data Engineer Jobs in Chennai, Tamil Nadu

Data Engineer
July 17, 2024

Lead Data Engineer
July 16, 2024

Aws Data Engineer
July 15, 2024

Aws Data Engineer
July 6, 2024

Gcp Data Engineer
June 30, 2024

Data Engineer
June 28, 2024

Quick filters

Top companies

Data Engineer Jobs in Chennai, Tamil Nadu

Data EngineerJuly 17, 2024

Lead Data EngineerJuly 16, 2024

Aws Data EngineerJuly 15, 2024

Aws Data EngineerJuly 6, 2024

Gcp Data EngineerJune 30, 2024

Data EngineerJune 28, 2024