At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses acrossmany industries. Focused on cloud technologies and technical expertise, we help organisationsnavigate the ever-changing landscape of the digital era. With dedicated Centres of Excellence across the globe, we are enabled to delivercomprehensive, senior resourcing solutions of both onshore and offshore resources, allowingour clients to achieve maximum ROI while staying on budget. Our focus is on delivering amazing end-to-end customer experiences. From cost engineeringbudgets to meeting time-sensitive deadlines, we strive to exceed expectations and addexcellence-grade value to our clients’ businesses. Job Description:·5+ years working experience as a data or software engineer in a fast-paced growing company.·Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.·Strong experience applying software engineering best practices to analytics (e.g. version control, testing, and CI/CD)·Power-user and expert in building scalable data warehouses and pipelines using some of Cloud tools such as Snowflake, AWS, Google Cloud, Cloud ETL tools such as Databricks (Spark/Azure)·Solid experience with ETL/ELT processes, scheduling tools (e.g., Talend, Airflow) and API management tools·Experienced with customer, marketing and/or web data (e.g., Salesforce, Google Analytics, AdWords, YouTube etc.)·Good with data visualization tools and packages (e.g., Looker, Tableau, matplotlib)·Strong attention to details to highlight and address data quality issues.·Self- starter , motivated, responsible, innovative, and technology-driven individual who performs well both independently and as a team member.·A proactive problem solver and have good communication as well as project management skills to relay your findings and solutions across technical and non-technical audiences.·Bachelor’s or master’s degree in engineering, Math, Statistics, Finance, Economics, or a related field·Passionate about gaming or gaming industry would be a great plus and conversation starter. Key Responsibilities: ·Work closely with data users to understand business requirements.·You will be actively involved with efforts in designing high-performance, reusable, and scalable data models for our data warehouse to ensure our end-users get consistent and reliable answers when running their own analyses.·Write complex yet optimized data transformations in SQL/Python using dbt or similar technology.·Continuously discover, transform, test, deploy and document data sources·Apply advanced aggregations and data wrangling techniques such as imputation for predictive analytics.·Work with wide range of tech stack at various levels such as Snowflake, dbt, Airflow, Fivetran, AWS, Spark, GCP Env:BigQuery, Cloud Composer, Cloud Dataflow etc.

ESSENTIAL RESPONSIBILITIES • Implement various data platform functionalities and structures using Microsoft Azure PaaS offerings e.g. Azure Data Factory, Databricks, Logic Apps, Functions, Event Hubs, and various storage offerings. • Lead cross-functional technical discussions that drive decisions and actionable implementation approaches • Design conceptual, logical and physical data architectures with various 3rd party solution delivery partners to meet our clients’ technical, security, and business requirements • Provide technical implementation plans to deploy Azure infrastructure leveraging modern CI/CD best practices • Evangelize and help advancement DevOps across the data platform teams • Play a key role in data transformation strategy and have a voice with Sr. IT leadership as well as Sr. business stakeholders • Work closely with Product Management to plan and deliver road-mapped features • Responsible for code reviews and mentoring other team members REQUIRED SKILLS/EXPERIENCE • Bachelor’s degree in Computer Science or related discipline; Masters in Software / Data Engineering preferred • 5+ years experience with SQL and/or NoSQL data technologies • 5+ years experience with cloud data storage technologies specifically Microsoft Azure PaaS offerings • 5+ years experience developing data models • 5+ years experience with ETL/ELT • 3+ years experience working with Microsoft Azure DevOps and CI/CD best practices • 3+ years experience working in an Agile Scrum environment • Experience with various data structure optimization techniques for performant reporting and execution of analytics • Experience with Power BI or other similar data visualization tools • IT healthcare and logistics experience preferred

Role & Responsibilities: As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be comfortable working with extremely abstract and ambiguous requirements. Must be capable of handling extremely changing business environments with the capability to wear multiple hats at once. Must be able to consult improvisations in various old school data engineering methods. Should be a very good team player. <ul><li>Design and Develop Data Pipelines: Create robust and efficient (infrastructure and cost efficient) data pipelines on GCP to facilitate the seamless flow of data. </li><li>Cross-functional Collaboration: Collaborate with cross-functional teams/stakeholders to understand data requirements and deliver high-quality data solutions in the least amount of time. </li><li>Collaborate with Data Architects: Work closely with client and team data architects to implement data models and pipelines and ensure their integration with GCP services. </li><li>Optimize Data Storage Solutions: Utilize BigQuery, Cloud Storage, and other appropriate GCP services to optimize data storage solutions.</li><li>Troubleshooting: Proactively troubleshoot data and pipeline-related issues to ensure smooth operation and reliability. </li></ul> Skills required: <ul><li>Migration of DAGs from AWS to GCP by handling version upgrade and architectural changes </li><li>Configuration changes for Hive jobs and spark jobs (Python, Scala) migration based on the cloud environment </li><li>Collaborate with development and operations teams to streamline the deployment process and ensure continuous integration and continuous deployment practices. </li><li>Define and enforce best practices for version control, branching, and code promotion in collaboration with development teams. </li><li>Work closely with cross-functional teams to troubleshoot and resolve deployment issues and optimize release processes. </li></ul> Good to have: <ul><li>Knowledge of LMS and education sector </li><li>Working knowledge of IICS</li></ul>

Greetings from Numeric Technologies!! Who are we?Numeric, incorporated in 1996, is a worldwide Business & Information Technology, Consulting and Services company. Headquartered in Chicago, IL with additional offices in Miami, Silicon Valley, Luxembourg, UK as well as delivery centers in India to serve our customers on and offshore needs.We at Numeric Technologies pride ourselves for providing our customers with the best services and solutions. We believe that the right people in the right time and the right position are the key to our company’s improvement; we continue to Endeavour and develop our company through our corporate culture and values. Job Description Job Title: Integration Developer/Data EngineerLocation – Bangalore, HybridExperience Level – 5-8 yearsShift Timings : GeneralNotice Period - Immediate - 15 days/Serving NP Primary SkillsPython, SQL, ETL Integration, AWS Roles & Responsibilities:· Working experience in Agile methodologies.· Strong knowledge and experience in AWS technologies.· Experience in Matillion and Redshift.· Strong programming skills in Python.· Experience with Hive and one relational DB.· Strong problem-solving skills.· Strong communication skills.· Ability to learn new technical skills.· Strong Experience in SQL/PLSQL Education and Exp:· BS or MS in computer science or a related field with 4+ years of experience.· 2+ years of AWS experience with cloud ETL/ELTs. If you’re interested, please get in touch at sangeetha.sundaram@numerictech.com We’d love to hear from you. Details: https://numerictech.com/

About Allica Bank We are rare amongst banks in that our senior leadership team includes backgrounds at world-leading FinTechs, which shows in their active engagement with our cross-functional Product Squads, and in our bank-wide adoption of modern tools & techniques such as DevOps, Terraform and the Azure Cloud. We are working on one of the last untapped fintech opportunities, which is banking to established small & medium-sized enterprises (SMEs). These established SMEs are the backbone of local communities - representing about a quarter of the economy - yet have been largely left behind both by traditional banks and modern fintech providers. Because we're breaking new ground, it often means that we're working on new technological challenges. We are building in-house banking products using modern technologies. Purpose of RoleData is a key asset to Allica and is deeply embedded in all our teams and products. With data, we assist and work with Finance, Operations, Credit Risk, Product and Management.We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it.You will be an integral part of the data engineering team, building and developing the tooling and pipelines that form our data ingestion and modelling machine for our partnerships agreements. Principal Accountabilities<ul><li>Understand our data landscape and architecture.</li><li>Strong skillset in data modelling.</li><li>Build and maintain data pipelines.</li><li>Work with the team to engineer tools based on data requirements, manage development from prototyping to productionising.</li><li>Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, improve existing tools for greater scalability, etc.</li><li>Develop and maintain data and coding standards, produce well-documented codes with robust testing and aligned with our data governance.</li><li>Helping us implement a data-driven mindset in the company.</li></ul> Experience<ul><li>Previous experience working as a data engineer in a start-up or fast-paced organisation.</li><li>STEM background or similar.</li><li>You have strong Python programming skills (built production-grade tools, have a test-driven approach, consistent and well documented code).</li><li>You have strong SQL skills.</li><li>Deployed applications on cloud services.</li><li>Experience in using orchestration tools (Airflow, Dagster or Prefect).</li><li>Experience with container technology (Docker, Kubernetes).</li><li>Experience with CI/CD pipelines (preferably Azure DevOps)</li><li>Experience with application deployment to Cloud services (GCP, AWS, Azure preferred)</li></ul> Bonus requirements<ul><li>Design and implement data frameworks.</li><li>Experience with using data testing tools (Great Expectations, Soda, deequ).</li><li>Experience with aspects of Data Governance.</li><li>Experience with automation projects with Python Web, API frameworks in Python (Flask, FastAPI).</li><li>You can share your GitHub repo (or equivalent)</li></ul> Working at Allica India Technology Services Private Limited At Allica we want to ensure our employees have the right tools andenvironment in which to succeed in their role and in support of our customers. Our employees are at the heart of everything we do, so our benefits are designed with you in mind: <ul><li>Full onboarding support and continued development opportunities </li><li>Options for flexible working </li><li>Regular social activities </li><li>Private Medical Insurance - fully comprehensive cover for the employee and dependants</li><li>22 days paid leave/ annual leave per year, excluding National & Festival holidays </li><li>Discretionary bonus scheme </li><li>Life assurance (30 Laks)</li><li>Family friendly policies including enhanced Maternity & Paternity leave</li></ul>

Role : Big Data EngineerYears of experience : 5-8 yearsLocation : Bangalore At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale. We aim to become the algorithmic bridge between consumers and brands/retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algonomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs We are seeking an experienced Big Data Engineer with a minimum of 5 years of relevant experience to join our team to contribute to the development and maintenance of a robust data lake infrastructure on AWS and Azure platforms. The ideal candidate will possess in-depth expertise in big data technologies, data lake architecture, and cloud services, particularly AWS and Azure. Key Responsibilities:Design, architect, and build data lake solutions on AWS and Azure environments, ensuring scalability, availability, and security of data.Collaborate with cross-functional teams to understand data requirements, and implement data ingestion, processing, and storage solutions within the data lake framework.Optimize and tune data lake performance, implement data governance, and ensure data quality and consistency.Develop Extract, Transform, Load (ETL) processes, implement data pipelines, and orchestrate data workflows to support analytics and reporting needs.Conduct performance monitoring, troubleshooting, and capacity planning for the data lake infrastructure.Stay up-to-date with emerging technologies and best practices in big data, data lake, and cloud computing, and provide recommendations for continuous improvement. Minimum Requirements:Bachelor’s degree in Computer Science, Engineering, or a related field.Minimum of 5 years of professional experience in big data engineering, data lake development, and cloud platforms (specifically AWS and Azure).Proficiency in big data technologies such as Hadoop, Spark, Hive, and related ecosystem tools.Hands-on experience with cloud services including Amazon S3, Amazon EMR, Amazon Redshift , AWS Athen , Azure Data Lake Storage, Azure HDInsight, Azure Synapse and related data services.Strong programming skills in languages such as SQL,Python, Scala, or Java for data processing and transformation.Knowledge of data warehousing concepts, data profile, data modeling, and database technologies.Experience with DevOps practices, containerization, and infrastructure as code tools (e.g., Docker, Kubernetes, Terraform) is a plus.Excellent problem-solving abilities, strong analytical skills, and the ability to work effectively in a team environment.We offer a collaborative and innovative work environment with opportunities for professional growth and development. If you are passionate about building scalable, high-performance data lake solutions and thrive in a dynamic, fast-paced environment, we encourage you to apply and join our team. ABOUT ALGONOMYAlgonomy (previously Manthan-Rich Relevance) empowers leading brands to become digital-first with the industry’s only real-time Algorithmic Customer Engagement (ACE) platform with built-in customer activation and analytics for the retail industry. With industry-leading retail AI expertise connecting demand to supply with a real-time customer data platform as the foundation, Algonomy enables 1:1 omnichannel personalization, customer journey orchestration & analytics, merchandising analytics and supplier collaboration. Algonomy is a trusted partner to more than 400 leading retailers, consumer brands, quick serve restaurant chains, convenience stores and more, and our global presence spans over 20 countries. More at https://algonomy.com

About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from their analytics investments. The aim is to bridge the gap between insight delivery and value realization by providing customers with a differentiated approach to data and analytics through tailor-made solutions. Tredence is 2200-plus employees strong with offices in San Jose, Foster City, Chicago, London, Toranto, and Bangalore, with the largest companies in retail, CPG, hi-tech, telecom, healthcare, travel, and industrials as clients. As we completed 10 years of Tredence, we are on the cusp of an ambitious and exciting phase of expansion and growth. • Tredence recently closed a USD 175 million Series B funding, which will help us build on growth momentum, strengthen vertical capabilities, and reach a broader customer base. • Apart from our geographic footprint in the US, Canada & UK, we plan to open offices in Kolkata and a few tier 2 cities in India. In 2024, we also plan to hire more than 1000 employees across markets. • Tredence is a Great Place to Work (GPTW) certified company that values its employees and creates a positive work culture by providing opportunities for professional development and promoting work-life balance. • At Tredence, nothing is impossible; we believe in pushing ourselves to limitless possibilities and staying true to our tagline, Beyond Possible. I appreciate your interest in Tredence Inc. and wish you the very best.Primary Roles and Responsibilities:● Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.● Triage issues to find gaps in existing pipelines and fix the issues● Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs● Help joiner team members to resolve issues and technical challenges.● Drive technical discussions with client architect and team members● Orchestrate the data pipelines in the scheduler via AirflowSkills and Qualifications:● Bachelor's and/or master’s degree in computer science or equivalent experience.● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.● Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.● Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.● Deep understanding of Star and Snowflake dimensional modeling.● Strong knowledge of Data Management principles● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture● Should have hands-on experience in SQL and Spark (PySpark)● Experience in building ETL / data warehouse transformation processes● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)● Experience working with structured and unstructured data including imaging & geospatial data.● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects● Should have experience working in Agile methodology● Strong verbal and written communication skills.● Strong analytical and problem-solving skills with a high attention to detail.Mandatory Skills: Snowflake/Azure Data Factory/ PySpark / Databricks

The Azure Data Engineer will focus specifically on developing solutions leveraging cloud-based data platforms and associated technologies based on Modern Data Platform (MDP) Architecture. You will be responsible for expanding and optimising data and pipeline architectures, and for optimising data collection and flow across functional teams. Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing and future projects.More specifically you will have the following responsibilities:<ul><li>Analyses current business practices, processes, and procedures as well as identifying future business opportunities for leveraging Microsoft Azure Data & Analytics Services</li><li>Provide technical and thought leadership in areas such as data access & ingestion, data processing, data integration, data modelling, database design & implementation</li><li>Engage and collaborate with IT Business Partners to understand business requirements/use cases and translate them into detailed technical specifications</li><li>Develop best practices including reusable code, libraries, patterns, and consumable frameworks for cloud-based data warehousing and ETL</li><li>Ensure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements</li><li>Maintain best practice standards for the development of cloud-based data solutions including naming standards</li><li>Deliver successful outcomes in projects, identify value propositions for internal customers, provide inputs for strategic development in specific area(s) of expertise, and to maintain knowledge and educate junior team members as required</li></ul> YEAR ONE CRITICAL SUCCESS FACTORS <ul><li>Successfully complete project implementations within time, cost and quality standards, in line with business and IT expectations</li><li>Successfully deploy data pipelines to build Azure data lake</li><li>Successfully develop data sourcing techniques that ensure data accuracy, integrity and accessibility</li></ul>PROFESSIONAL EXPERIENCE / SKILLS / QUALIFICATIONS <ul><li>Bachelor’s or Master’s degree in in Computer Science or Engineering OR equivalent years of work experience</li><li>7+ years of proven experience in designing and hands-on development in Azure cloud-based data and analytics solutions</li><li>Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required</li><li>Designing and building of data pipelines using API ingestion and Streaming ingestion methods</li><li>Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential</li><li>Experience in Modern Data Platforms related technologies such as Snowflake, Matillion, BryteFlow is a distinct advantage</li><li>A comprehensive understanding of the principles of and best practices behind data engineering, and the supporting technologies such as RDBMS, NoSQL, Cache & In-memory stores</li><li>Knowledge in Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics, Power BI is desirable</li><li>Experience of mapping key Enterprise data entities to business capabilities and applications</li><li>Working knowledge of Python is desirable</li><li>Familiarity with Agile / Scrum methodologies</li></ul>SOFT SKILLS <ul><li>Excellent verbal and written English communications skills</li><li>Strong interpersonal skills, with the demonstrated ability to engage well internally with colleagues who have both technical and non-technical backgrounds to develop shared solutions</li><li>Excellent creative problem-solving skills, including undertaking research to inform problem definitions</li><li>Be a team player liaising with business and technology teams across Biocon Biologics.</li></ul>

Data Engineer Jobs in Bangalore Urban, Karnataka

Data Engineer
April 30, 2024

Senior Data Engineer
April 30, 2024

Senior Data Engineer
April 20, 2024

Data Engineer
April 17, 2024

Data Engineer
April 15, 2024

Big Data Engineer
April 8, 2024

Data Engineer Snowflake Adf
April 7, 2024

Info Tech Azure Data Engineer Associate Manager
April 7, 2024

Quick filters

Top companies

Data Engineer Jobs in Bangalore Urban, Karnataka

Data EngineerApril 30, 2024

Senior Data EngineerApril 30, 2024

Senior Data EngineerApril 20, 2024

Data EngineerApril 17, 2024

Data EngineerApril 15, 2024

Big Data EngineerApril 8, 2024

Data Engineer Snowflake AdfApril 7, 2024

Info Tech Azure Data Engineer Associate ManagerApril 7, 2024