AWS and Azure cloud platforms, including cloud-native services and infrastructure, REST API experience using Flask/AWS API Gateway/REST API/Web API, MLOps, Gen AI Concepts, Dockers, AWS Cloud Formation Templates, DevOps, CI/CD

About the Company: ITC Infotech is a leading global IT services and solutions company that specializes in a range of industries including banking, financial services, insurance, healthcare, manufacturing, retail, and consumer goods. The company is a subsidiary of the Indian conglomerate company ITC Limited.ITC Infotech provides a wide range of services including consulting, technology solutions, business process management, application development, maintenance, and support. Their services are tailored to meet the specific needs of their clients and help them achieve their business objectives.ITC Infotech focuses on building long-term partnerships with its clients, understanding their challenges, and providing strategic solutions that help them stay competitive in the market. They follow a collaborative and customer-centric approach, working closely with clients to develop and implement solutions that meet their unique requirements.The company has a global presence with offices and delivery centres across the Americas, Europe, Middle East, and Asia Pacific regions. They leverage their global reach to provide round-the-clock support and delivery to their clients. Qualifications: Education details : B.Tech/ M.Tech/B.Sc./M.Sc. in Computer Science or related field and 4+ years of relevant industry experience Experience level: 5 to 10 years Mandatory Skills Required:Python, pyspark, Palantir foundry and SQL Primary Responsibilities <ul><li>Responsible for designing, developing, testing and supporting data pipelines and applications</li><li>Industrialize data pipelines</li><li>Establishes a continuous quality improvement process to systematically optimize data quality</li><li>Collaboration with various stakeholders incl. business and IT</li></ul> Required Skills: Data Engineer <ul><li> Strong experience in Big Data & Data Analytics </li><li> Experience in building robust ETL pipelines for batch as well as streaming ingestion </li><li> Big Data engineers with a firm grounding in Object Oriented Programming and an advanced level knowledge with commercial experience in Python, PySpark and SQL </li><li> Interacting with RESTful APIs incl. authentication via SAML and OAuth2 </li><li> Experience with test driven development and CI/CD workflows </li><li> Knowledge of Git for source control management </li><li> Agile experience in Scrum environments like Jira </li><li> Knowledge of container technologies such as Docker and Kubernetes is an advantage </li><li> Experience in visualization tools like Tableau or Qlik is a plus </li><li> Experience in Palantir Foundry, AWS or Snowflake is an added advantage </li><li> Basic knowledge of Statistics and Machine Learning is favorable </li><li> Problem solving abilities </li><li> Proficient in English with strong written and verbal communication</li></ul>

POSITION: Data EngineerLocation - Bangalore Experience:<ol><li>Candidate with 2-4 years of experience </li></ol> Roles and responsibilities: <ol><li>Build ETL pipelines using SQL scripts, Shell scripts, Spark jobs and Airflow DAGs.</li><li>Writing SQL queries, stored procedures, functions and triggers</li><li>Development of BI metadata and content</li><li>Query/ETL Performance Tuning</li><li>Enhancements in production ETL pipelines & BI content</li><li>Publishing Analytical Reports</li><li>Work with data architects and business analysts to handle data related issues </li></ol> Skills: <ol><li>Strong knowledge and working experience in any of the leading RDBMS</li><li>Excellent SQL skills with the ability to write complex queries, stored procedures, functions and triggers</li><li>Strong query optimization skills</li><li>Good knowledge in any ETL tool with the ability to develop/debug complex packages to move and transform data.</li><li>Experience in Big Data technologies (Hive, Presto, Spark, Kafka, etc)</li><li>Experience in two or more data warehousing projects</li><li>Experience in data quality management</li><li>Exposure to Cloud Services (AWS/Azure/GCP)</li><li>Knowledge in any BI tool, preferably Tableau</li></ol> Soft skills: Should have good communication and analytical skills. Should be a self-motivated innovative problem solver. Good to have: <ol><li>Experience in Redshift/Athena/Dynamo DB</li><li>Experience in Airflow</li><li>Knowledge in Python/Scala/Java</li><li>Experience in real-time data processing</li><li>Experience in handling large volume of data</li></ol>

Must have skills : Google BigQuery Minimum 5 year(s) of experience is requiredEducational Qualification : BE/BTech Summary:As an Infra Tech Support Practitioner, you will be responsible for providing ongoing technical support and maintenance of production and development systems and software products. Your typical day will involve troubleshooting and resolving issues related to Google BigQuery and API Management, both remotely and on-site. Roles & Responsibilities: - Provide technical support and maintenance for production and development systems and software products, both remotely and on-site.- Troubleshoot and resolve issues related to Google BigQuery and API Management.- Implement technology at the operating system-level across all server and network areas.- Provide hardware/software support and work with particular software solutions/vendors/brands. Professional & Technical Skills: - Must To Have Skills: Experience with Google BigQuery.- Good To Have Skills: Experience with API Management.- Strong understanding of operating systems and network areas.- Experience with hardware/software support.- Experience with troubleshooting and resolving issues related to Google BigQuery and API Management. Additional Information: - The candidate should have a minimum of 5 years of experience with Google BigQuery.- The ideal candidate will possess a strong educational background in information technology operations or a related field.- This position is based at our Bengaluru office.

We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, BigQuery, Pub/Sub, and related services. Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (IaC) with Terraform. This role will be critical in building and managing data pipelines, ensuring data quality, and optimizing data storage and retrieval processes. Responsibilities:• Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.• Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently.• Use Pub/Sub for real-time data ingestion and streaming analytics.• Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed.• Optimize data storage and retrieval processes to enhance performance and reduce costs.• Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services.• Ensure data quality and integrity through robust testing and validation processes.• Stay updated with the latest GCP features and best practices, integrating them into existing workflows.• Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing. Requirements:• Proven experience as a Data Engineer with a focus on GCP services.• Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub.• Hands-on experience with Terraform for provisioning and managing GCP infrastructure.• Proficiency in SQL and Python for data manipulation and analysis.• Solid understanding of data warehousing concepts and ETL processes.• Experience with real-time data processing and streaming analytics.• Strong problem-solving skills and attention to detail.• Excellent communication and collaboration skills. Preferred Qualifications:• Google Cloud Professional Data Engineer certification.• Experience with other GCP services like Cloud Storage, Cloud Functions, and Cloud Composer.• Familiarity with other IaC tools such as Ansible or Cloud Deployment Manager.• Experience with containerization technologies like Docker and Kubernetes.• Knowledge of data security and governance practices.

Data Engineer Jobs in Bangalore Urban, Karnataka

Aws Data Engineer
July 16, 2024

Data Engineer
July 7, 2024

Data Engineer
June 28, 2024

Gcp Data Engineer
June 28, 2024

Gcp Data Engineer Data Flow
June 28, 2024

Quick filters

Top companies

Data Engineer Jobs in Bangalore Urban, Karnataka

Aws Data EngineerJuly 16, 2024

Data EngineerJuly 7, 2024

Data EngineerJune 28, 2024

Gcp Data EngineerJune 28, 2024

Gcp Data Engineer Data FlowJune 28, 2024