The Telus Data Engineer interview guide, interview questions, salary data, and interview experiences.

Telus Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Telus? The Telus Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Telus Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Telus.</li>
<li>Practice real Telus Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Telus Data Engineer interview.


Getting ready for an Data Engineer interview at Telus? The Telus Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Telus Data Engineer roles.
- Gain insights into the Data Engineer interview process at Telus.
- Practice real Telus Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Telus Data Engineer interview.
        

Overview

What Telus Looks for in a Data Engineer

Data Structures & Algorithms

Find the missing integer from a array of consequtive integers

Find the Missing Number

Get Top N Frequent Words

Given an integer N, write a function that returns all of the prime numbers up to N

Prime to N

Given an array and a target integer, write a function that returns the indices of two integers in the array that add up to the target integer.

Target Indices

Sort Strings

Select the 2nd highest salary in the engineering department

2nd Highest Salary

7 Day Streak

Find the average yearly purchases for each product

Average Quantity

Employee Project Budgets

Payments Received

Machine Learning

Random Forest Explanation

Xgboost vs Random Forest

When you should consider using Support Vector Machine rather then Deep learning models

Support Vector Machines vs Deep Learning Models

Addressing imbalanced data in machine learning through carefully prepared techniques.

Data Preparation for Imbalanced Data

Backpropagation Explanation

Data Pipelines

Design a data pipeline for hourly user analytics.

Data Pipelines and Aggregation

Design a solution to store and query raw data from Kafka on a daily basis.

Clickstream Data

Let's say that you're in charge of getting payment data into your internal data warehouse. 

Payment Data Pipeline

How would you design a data warehouse for a e-commerce company looking to expand internationally?

International e-Commerce Warehouse

Describing a real-world data cleaning and organization project

Data Cleaning Experiences

Analytics

How would you analyze the dataset to understand exactly where the revenue loss is occurring?

Evaluating Revenue Decline

Describing a data project and its challenges

Hurdles In Data Projects

Making data-driven insights actionable for those without technical expertise

Simple Explanations

Challenge

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Telus Data Engineer Interview Process

Interview Tips

When an interviewer asks a question along the lines of:

<ul>
<li>What would your current manager say about you? What constructive criticisms might he give?</li>
<li>What are your three biggest strengths and weaknesses you have identified in yourself?</li>
</ul>

How would you respond?

When asked about your strengths in an interview, what is an effective way to respond?

When asked about your strengths in an interview, what is an effective way to respond?

Your Strengths and Weaknesses I

Which of the following is an acceptable strategy when discussing weaknesses in an interview?

Which of the following is an acceptable strategy when discussing weaknesses in an interview?

Your Strengths and Weaknesses II

What do you tell an interviewer when they ask you what your strengths and weaknesses are?

Your Strengths and Weaknesses

Brainteasers

When an interviewer asks you a question along the lines of:

<ul>
<li>Why did you apply to our company?</li>
<li>What are you looking for in your next job?</li>
<li>What makes you a good fit for our company?</li>
</ul>

How should you respond?

When asked 'What are you looking for in your next job?' in an interview, how can you tie the company's employee benefits into your response?

When asked 'What are you looking for in your next job?' in an interview, how can you tie the company's employee benefits into your response?

Why Do You Want to Work With Us I

How can company values be used effectively in an interview when asked 'What makes you a good fit for our company?'

How can company values be used effectively in an interview when asked 'What makes you a good fit for our company?'

Why Do You Want to Work With Us II

When responding to the question 'Why did you apply to our company?' during an interview, what aspect should you highlight?

When responding to the question 'Why did you apply to our company?' during an interview, what aspect should you highlight?

Why Do You Want to Work With Us III

How would you answer when an Interviewer asks why you applied to their company?

Why Do You Want to Work With Us

Describe a data project you worked on. What were some of the challenges you faced?

How would you handle the data preparation for building a machine learning model using imbalanced data?

Given a string, write a function to determine if it is palindrome or not.

Note: A palindrome is a word/string that is read the same way forward as it is backward, e.g. <code>&#39;reviver&#39;</code>, <code>&#39;madam&#39;</code>, <code>&#39;deified&#39;</code> and <code>&#39;civic&#39;</code> are all palindromes, while <code>&#39;tree&#39;</code>, <code>&#39;music&#39;</code> and <code>&#39;person&#39;</code> are not palindromes.

Example:

Input:

<pre tabindex="0" class="chroma"><code>word1 = &#34;tree&#34;
word2 = &#34;radar&#34;
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def is_palindrome(word1) -&gt; False
def is_palindrome(word2) -&gt; True
</code></pre>

Given a string, write a function to determine if it is palindrome or not.

String Palindromes

Write a SQL query to select the 2nd highest salary in the engineering department.

Note: If more than one person shares the highest salary, the query should select the next highest salary.

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>first_name</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>last_name</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department_id</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
<code>departments</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>name</code></td>
<td>VARCHAR</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Explain the difference between the XGBoost and random forest algorithms and give an example where you would use one over the other.

Why might a data scientist choose to use XGBoost instead of Random Forest for a particular machine learning task?

Why might a data scientist choose to use XGBoost instead of Random Forest for a particular machine learning task?

XGBoost vs Random Forest: Choice

How does random forest generate the forest? Additionally, why would we use it over other algorithms such as logistic regression?

What happens when you average the output on multiple decision trees?

What happens when you average the output on multiple decision trees?

Average Trees

What is the difference between Logistic and Linear Regression?

When would use one instead of the other in practice?

What is the difference between Logistic and Linear Regression?

Linear vs Logistic Regression

Statistics

Tell me about a project in which you had to clean and organize a large dataset.

Given an array and a target integer, write a function <code>sum_pair_indices</code> that returns the indices of two integers in the array that add up to the target integer. If not found, just return an empty list.

Note: Can you do it on $O(n)$ time?

Note: Even though there could be many solutions, only one needs to be returned.

Example 1:

Input:

<pre tabindex="0" class="chroma"><code>array = [1 2 3 4] 
target = 5 
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def sum_pair_indices(array, target) -&gt; [0 3] or [1 2]
</code></pre>

Example 2:

Input:

<pre tabindex="0" class="chroma"><code>array = [3]
target = 6 
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>Do NOT return [0 0] as you can&#39;t use an index twice.
</code></pre>

Let’s say you work at Allstate. Allstate is running <code>N</code> online ads right now. The table <code>ads</code> contains all those ads, ranked by popularity via the <code>id</code> column (e.g., the entry with <code>id = 1</code> is the most popular, etc.).

Create a subquery or common table expression named <code>top_ads</code> containing the top 3 ads (by popularity) and return the number of rows that would result from the following operations

<ol>
<li><code>ads INNER JOIN top_ads</code></li>
<li><code>ads LEFT JOIN top_ads</code></li>
<li><code>ads RIGHT JOIN top_ads</code></li>
<li><code>ads CROSS JOIN top_ads</code></li>
</ol>

Note: Please make the <code>join_type</code> column in your output have the values <code>inner_join</code>, <code>left_join</code>, etc. for each of their respective join types

Note: Please return only one query with each number in a different row

Example:

Input:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>name</code></td>
<td>VARCHAR</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>join_type</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>number_of_rows</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Size of Joins

Given an integer <code>N</code>, write a function that returns a list of all of the prime numbers up to <code>N</code>.

Note: Return an empty list there are no prime numbers less than or equal to <code>N</code>.

Example:

Input:

<pre tabindex="0" class="chroma"><code>N = 3
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def prime_numbers(N) -&gt; [2,3]
</code></pre>

<h1>Binary Tree Validation</h1>

You are given the root of a binary tree. You need to determine if it is a valid binary search tree (BST).

A valid BST is defined as follows:

<ul>
<li>The left subtree of a node contains only nodes with values less than or equal to the node’s value.</li>
<li>The right subtree of a node contains only nodes with values greater than or equal to the node’s value.</li>
<li>Both the left and right subtrees must also be binary search trees.</li>
</ul>

Given the function <code>def is_valid_bst(root: Node) -&gt; bool:</code>, return True if the binary tree is a valid BST. Otherwise, return False.

<h3>Example:</h3>

Input:

<img src="/s3/questions/9664817c-3e12-4a40-9236-8382b13f55a0.png" alt="image"/>Converted Binary Tree.png

Output:

<pre tabindex="0" class="chroma"><code>def is_valid_bst(Node(3)) -&gt; True
</code></pre>

Given the root node, verify if a binary search tree is valid or not.

Binary Tree Validation

How would you convey insights and the methods you use to a non-technical audience?

You’re given a string that may contain the characters <code>{</code>, <code>}</code>, <code>[</code>, <code>]</code>, <code>(</code>, and <code>)</code>.

Task: Verify that the string is balanced. A balanced string is one where every opening character, <code>{</code>, <code>[</code>, or <code>(</code>, has a corresponding closing character, <code>}</code>, <code>]</code>, or <code>)</code>.

Write a function called <code>is_balanced(string: str) -&gt; bool</code> which verifies the balance of a string.

Example:

<pre tabindex="0" class="chroma"><code>is_balanced(&#39;(())[]{}&#39;) -&gt; True
</code></pre>

<pre tabindex="0" class="chroma"><code>is_balanced(&#39;{([(){}])()}&#39;) -&gt; True
</code></pre>

<pre tabindex="0" class="chroma"><code>is_balanced(&#39;{}[]())&#39;) -&gt; False
</code></pre>

<hr/>

Write a function that tests whether a string of brackets is balanced.

The Brackets Problem

In the context of hypothesis testing, what are type I errors (type one errors) and type II errors (type two errors)? What is the difference between the two?

Bonus: Describe the probability of making each type of error mathematically.

What is the difference between type I and type II errors?

Type I and II Errors

What does the backpropagation algorithm do in the context of neural networks? What is the informal intuition behind the algorithm? What are some drawbacks of the algorithm compared to other optimization methods?

Bonus: Formally derive the backpropagation algorithm and prove that it does what it claims to do.

You have an array of integers, <code>nums</code> of length <code>n</code> spanning <code>0</code> to <code>n</code> with one missing. Write a function <code>missing_number</code> that returns the missing number in the array.

Note: Complexity of $O(n)$ required.

Example:

Input:

<pre tabindex="0" class="chroma"><code>nums = [0,1,2,4,5] 
missing_number(nums) -&gt; 3
</code></pre>

You are given a dictionary with two keys <code>a</code> and <code>b</code> that hold integers as their values.

Without declaring any other variable, swap the value of <code>a</code> with the value of <code>b</code> and vice versa.

Note: Return the dictionary after editing it.

Example:

Input:

<pre tabindex="0" class="chroma"><code>numbers = {
 &#39;a&#39;:3,
 &#39;b&#39;:4
}
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def swap_values(numbers) -&gt; {&#39;a&#39;:4,&#39;b&#39;:3}
</code></pre>

Swap Variables

Write a function <code>fib</code> which takes an integer <code>n</code> and returns the nth fibonacci number. For this question, <code>fib</code> MUST be recursively defined.

Note: <code>for</code> and <code>while</code> keywords are disabled for this question, as well as <code>functools</code>. Any workarounds around this restriction is prohibited.

Example:

Input:

<pre tabindex="0" class="chroma"><code>n = 4
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def fib(n) -&gt; 3
# the sequence is [1, 1, 2, 3, 5, 8...]
</code></pre>

Implement a dynamic recursive fibonacci function.

Impossibly Iterative Fibonacci

An ecommerce company is experiencing a reduction in revenue for the past 12 months. You have the following transaction data:

<ul>
<li>Date of sale</li>

<li>Total $ Amount paid by customer</li>

<li>Profit Margin per unit</li>

<li>Quantity of item</li>

<li>Item category</li>

<li>Item subcategory</li>

<li>Marketing attribution source</li>

<li>% discount applied</li>
</ul>

How would you analyze the dataset to understand exactly where the revenue loss is occurring?

Given a list of strings, write a function, <code>sorting</code> from scratch to sort the list in ascending alphabetical order.

Notes:
- Do NOT use the built-in <code>sorted</code> function
- Return the new sorted list, rather than modifying the list in-place

Bonus: Have your solution be $O(n log(n))$.

Example:

Input:

<pre tabindex="0" class="chroma"><code>array = [&#34;apple&#34;, &#34;cat&#34;, &#34;banana&#34;, &#34;zoo&#34;, &#34;football&#34;]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def sorting(array) -&gt; [&#34;apple&#34;, &#34;banana&#34;, &#34;cat&#34;, &#34;football&#34;, &#34;zoo&#34;]
</code></pre>

Let’s say you have analytics data stored in a data lake. An analyst tells you they need hourly, daily, and weekly active user data for a dashboard that refreshes every hour.

How would you build this data pipeline?

Let’s say you work for an e-commerce company. Vendors can send products to the company’s warehouse to be listed on the website. Users are able to order any in-stock products and submit returns for refunds if they’re not satisfied.

The front end of the website includes a vendor portal that provides sales data in daily, weekly, monthly, quarterly, and yearly intervals.

The company wants to expand worldwide. They put you in charge of designing its end-to-end architecture, so you need to know what significant factors you’ll need to consider. What clarifying questions would you ask?

What kind of end-to-end architecture would you design for this company (both for ETL and reporting)?

Let’s say that you’re in charge of getting payment data into your internal data warehouse.

How would you build an ETL pipeline to get Stripe payment data into the database so analysts can build revenue dashboards and run analytics?

<ol>
<li>Given an example paragraph string and an integer <code>N</code>, write a function <code>n_frequent_words</code> that returns the top <code>N</code> frequent words in the posting and the frequencies for each word.</li>

<li>What’s the function run-time?</li>
</ol>

Example:

Input:

<pre tabindex="0" class="chroma"><code>posting = &#34;&#34;&#34;
Herbal sauna uses the healing properties of herbs in combination with distilled water. 
The water evaporates and distributes the effect of the herbs throughout the room. 
A visit to the herbal sauna can cause real miracles, especially for colds. 
&#34;&#34;&#34; 
n = 3
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>n_frequent_words(posting,N) = [
 (&#39;the&#39;, 6), 
 (&#39;herbal&#39;, 2), 
 (&#39;sauna&#39;, 2),
]
</code></pre>

One of the basic steps in parsing string inputs is to check whether the opening and closing characters or tags match, i.e., to check if each opened parenthesis is closed eventually.

Given a list of strings, write a <code>string</code> <code>parser</code> that verifies the integrity of the parenthesis used in the string. The parser should return a list of booleans stating whether that string’s integrity was verified.

Example:

Input:

<pre tabindex="0" class="chroma"><code>list_of_strings = [
 &#39;f(x) + g(x)&#39;, 
 &#39;sin(exp(x)}&#39;, 
 &#39;((())just some string)&#39;, 
 &#39;(4,{(3,4):x**2)&#39;]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def string_parser(list_of_strings) -&gt; [True, False, True, True]
</code></pre>

Given a list of strings, verify whether the parentheses in each string are properly opened and closed.

Check Matching Parentheses

Let’s say that you work for a company like Netflix. Netflix has two pricing plans: $15/month or $100/year.

Let’s say an executive at the company wants you to analyze the churn behavior of users that subscribe to either plan.

What kinds of metrics / graphs / models would you build to help give the executive an over-arching view of how the subscriptions are performing?

How would you present the performance of each subscription to an executive?

Analyzing Churn Behavior

Product Sense & Metrics

Singly-linked lists are a type of linked list where nodes have only one pointer: A pointer to the next element. Create a class <code>SinglyLinkedList</code> along with its methods:

<ul>
<li><code>add_head(element)</code> - adds an element to the head of the list. This becomes the new head of the linked list.</li>
<li><code>add_tail(element)</code> - adds an element to the tail of the list. This becomes the new tail of the linked list.</li>
<li><code>remove_head() -&gt; element</code> - removes the head and returns the value of the removed element.</li>
<li><code>remove_tail() -&gt; element</code> - removes the tail and returns the value of the removed element.</li>
<li><code>__contains__(item) -&gt; bool</code> - checks if the item is inside the list. Returns <code>True</code> if it is inside the list and returns <code>False</code> if not. This method is implemented to allow the use of Python’s <code>in</code> operator.</li>
<li><code>__getitem__(index)</code> - returns the element at the specified index. Raises an <code>IndexError</code> if the index is out of bounds. This method is implemented to allow the use of Python’s <code>[]</code> operator.</li>
<li><code>__len__()</code> - returns the length of the <code>SinglyLinkedList</code>.</li>
</ul>

Write a class 'SinglyLinkedList' that implements the interface required for a Singly Linked List.

Singly Linked List

Telus Data Engineer Interview Questions

Company Description Soojh AI is a leading AI services and consulting company that specializes in empowering businesses with Artificial Intelligence and Generative AI solutions to drive efficiency and growth. The organization offers end-to-end expertise for AI integration, AI-driven product development, and establishing in-house AI capabilities. With successful collaborations with Fortune 500 companies and startups that have scaled to unicorn status, Soojh AI has delivered impactful solutions across diverse industries including FinTech, LegalTech, Healthcare, Media, Hospitality, and Airlines. Committed to fostering AI innovation, Soojh AI helps businesses stay competitive and future-ready. Role SummaryWe are looking for a Data Engineer to develop and support real-time data pipelines that power enterprise analytics platforms. The role involves integrating operational systems such as Oracle Fusion and building streaming pipelines that process high-volume event data.You will work with technologies including Apache Kafka, Apache Flink, and Snowflake to build scalable pipelines that deliver reliable datasets for analytics and reporting. Responsibilities<ul><li>Develop and maintain streaming data pipelines using Kafka.</li><li>Build and deploy real-time processing jobs using Flink or similar frameworks.</li><li>Implement ingestion pipelines integrating Oracle ERP / Oracle Fusion systems.</li><li>Build CDC pipelines to capture changes from operational databases.</li><li>Develop data transformations and models within Snowflake.</li><li>Monitor pipeline performance and troubleshoot data processing issues.</li><li>Collaborate with architects and platform teams to implement data platform standards.</li></ul> Required Skills<ul><li>Experience integrating data from Oracle ERP / Oracle Fusion systems.</li><li>Hands-on experience with Apache Kafka or other streaming platforms.</li><li>Experience working with Flink, Spark Streaming, or similar processing frameworks.</li><li>Strong SQL and Python skills.</li><li>Experience working with Snowflake or other cloud data warehouses.</li></ul> Nice to Have<ul><li>Experience with CDC tools such as Debezium</li><li>Familiarity with Docker or Kubernetes</li><li>Experience working on AWS or Azure</li></ul> Experience<ul><li>3–6 years of experience in data engineering or real-time data pipelines</li></ul>

Job Title: Lead Data Engineer Location: Bangalore Experience: 12+ years Qualification: Bachelor’s degree in Computer Science, IT, or a related discipline Work Schedule: 5-day work week We’re hiring a Lead Data Engineer for our client to lead the design, development, and optimization of enterprise-scale data platforms on Microsoft Azure. As a Lead Data Engineer, your responsibilities would be: <ul><li>Leading the design and maintenance of high-performance data pipelines and ETL processes using Azure Data Factory, Databricks, and Airflow.</li></ul> <ul><li>To bring technical leadership in implementing data ingestion frameworks leveraging Autoloader and Delta Live Tables (DLT).</li></ul> <ul><li>To build and optimize scalable data models within Azure Synapse and Data Lakes to support advanced analytics and reporting.</li></ul> <ul><li>Play a key role in enforcing data quality, metadata validation, and schema enforcement aligned with Medallion architecture principles.</li></ul> Requirements <ul><li>12+ years of experience in data engineering, with a proven track record of leading technical teams and complex projects.</li></ul> <ul><li>Expertise in Azure Cloud platforms, specifically Synapse, ADF, and Data Lake, alongside big data tools like Databricks and Airflow.</li></ul> <ul><li>Advanced proficiency in Python and PySpark for transformation, automation, and performance tuning of big data workloads.</li></ul> <ul><li>Strong understanding of data governance, Medallion architecture, and master data management (MDM).</li></ul> <ul><li>Solid experience in managing CI/CD pipelines for data workflows using Git and Microsoft 365 DevOps tools.</li></ul> <ul><li>Excellent communication skills with the ability to collaborate across teams to ensure security and compliance standards.</li></ul> Benefits <ul><li>Lead the architecture and strategy of enterprise-level data solutions on a global scale.</li></ul> <ul><li>Work with a cutting-edge tech stack involving the latest Azure features, Databricks, and DLT.</li></ul> <ul><li>Drive innovation in data engineering by implementing industry-leading Medallion architecture and automation.</li></ul> <ul><li>Collaborate with cross-functional stakeholders to shape the data landscape of the organization.</li></ul> <ul><li>Opportunity for professional growth in a high-impact role that balances hands-on engineering with leadership.</li></ul>

Dear Professionals,Greetings from Tata Consultancy Services (TCS)!!!Job Title : Azure Data engineerExperience : 6- 10 YearsLocation: only HyderabadMode of Interview : VirtualMode of work : Work from Office Core Roles and Responsibilities:<ul><li><a>Data Pipeline Development (ETL/ELT)</a>: Designing and implementing robust data integration pipelines using Azure Data Factory to move data from various sources to analytical systems.</li><li><a>Data Storage & Modeling</a></li><li>:</li><li> Configuring and optimizing data storage solutions such as Azure Data Lake Storage (ADLS), Azure SQL Database, and Azure Cosmos DB to store structured and unstructured data efficiently.</li><li><a>Big Data Processing</a>: Utilizing Azure Databricks, Apache Spark, or Azure Synapse Analytics to process and analyze large datasets.</li><li><a>Data Security & Compliance</a>: Implementing security measures, including role-based access control (RBAC), Azure Key Vault, and encryption to protect sensitive data.</li><li><a>Monitoring & Optimization</a>: Monitoring data pipelines and storage performance using Azure Monitor, and troubleshooting failures to ensure data availability.</li><li><a>Collaboration</a>: Working with data scientists and analysts to ensure data is cleaned, modeled, and ready for analytics and reporting tools like Power BI.</li></ul> Key Azure Technologies Used:<ul><li>Data Integration: Azure Data Factory, SSIS.</li><li>Storage: Azure Data Lake Storage, Azure Blob Storage, Azure Cosmos DB.</li><li>Processing: Azure Databricks, Azure Synapse Analytics, HDInsight.</li><li>Security & Monitoring: Azure Active Directory, Key Vault, Azure Monitor. </li></ul> If you are Interested in the above opportunity kindly share your updated resume to pullagura.gokulsaiakhil@tcs.com immediately with the details below (Mandatory) Name:Contact No.Email id:Skillset:Total exp:Relevant Exp:Fulltime highest qualification (Year of completion with percentage scored):Current organization details (Payroll company):Current CTC:Expected CTC:Notice period:Current location:Preffered LocationAny gaps between your education or career (If yes pls specify the duration):Will you be able to join within 30/45 days? (Yes/NO)

Dear Professionals,Greetings from Tata Consultancy Services (TCS)!!!Job Title : Azure Data EngineerExperience : 6-10 YearsLocation: Only Pune, HyderabadMode of Interview : Virtual Mode of work : Work from Office Core Roles and Responsibilities:<ul><li><a>Data Pipeline Development (ETL/ELT)</a>: Designing and implementing robust data integration pipelines using Azure Data Factory to move data from various sources to analytical systems.</li><li><a>Data Storage & Modeling</a></li><li>:</li><li> Configuring and optimizing data storage solutions such as Azure Data Lake Storage (ADLS), Azure SQL Database, and Azure Cosmos DB to store structured and unstructured data efficiently.</li><li><a>Big Data Processing</a>: Utilizing Azure Databricks, Apache Spark, or Azure Synapse Analytics to process and analyze large datasets.</li><li><a>Data Security & Compliance</a>: Implementing security measures, including role-based access control (RBAC), Azure Key Vault, and encryption to protect sensitive data.</li><li><a>Monitoring & Optimization</a>: Monitoring data pipelines and storage performance using Azure Monitor, and troubleshooting failures to ensure data availability.</li><li><a>Collaboration</a>: Working with data scientists and analysts to ensure data is cleaned, modeled, and ready for analytics and reporting tools like Power BI.</li></ul> Key Azure Technologies Used:<ul><li>Data Integration: Azure Data Factory, SSIS.</li><li>Storage: Azure Data Lake Storage, Azure Blob Storage, Azure Cosmos DB.</li><li>Processing: Azure Databricks, Azure Synapse Analytics, HDInsight.</li><li>Security & Monitoring: Azure Active Directory, Key Vault, Azure Monitor.</li></ul> If you are Interested in the above opportunity kindly share your updated resume to pullagura.gokulsaiakhil@tcs.com immediately with the details below (Mandatory) Name:Contact No.Email id:Skillset:Total exp:Relevant Exp:Fulltime highest qualification (Year of completion with percentage scored):Current organization details (Payroll company):Current CTC:Expected CTC:Notice period:Current location:Preffered LocationAny gaps between your education or career (If yes pls specify the duration):Will you be able to join within 30/45 days? (Yes/NO)

A minimum of 5 years of experience as a Data Engineer or similar role. Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL). Experience with cloud-based data platforms (e.g., AWS, Azure, GCP). Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery). Experience with data ingestion tools (e.g., Fivetran, Stitch, Kafka). Programming experience in Python, Java, or similar languages. Experience with scripting languages (e.g., Bash, Shell). Experience with data workflow management tools (e.g., Airflow, Luigi).

Role Overview:We are looking for a skilled GCP Data Engineer with 4–7 years of experience in designing and building scalable data pipelines and data processing systems on Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Python, SQL, and GCP data services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer to support large-scale data analytics and data integration initiatives.The candidate will work closely with data analysts, data scientists, and platform teams to build reliable, efficient, and scalable data solutions. Key Responsibilities• Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP).• Build ETL/ELT workflows using Python and SQL for ingesting, transforming, and processing large datasets.• Implement real-time and batch data processing pipelines using Dataflow and Pub/Sub.• Develop and optimize data warehouse solutions using BigQuery.• Orchestrate data workflows using Cloud Composer (Apache Airflow).• Integrate multiple data sources including APIs, databases, and streaming systems.• Ensure data quality, integrity, and reliability across pipelines.• Optimize query performance and cost efficiency in BigQuery.• Collaborate with data scientists, analysts, and engineering teams to support analytics and machine learning use cases.• Implement monitoring, logging, and troubleshooting for data pipelines.• Follow best practices for data governance, security, and compliance. Required Skills & Qualifications• 4–7 years of experience in Data Engineering or Big Data development.• Strong programming experience in Python for data processing and automation.• Advanced SQL skills for data transformation and analysis.• Hands-on experience with Google Cloud Platform (GCP) data services including:<ul><li>BigQuery</li><li>Dataflow</li><li>Pub/Sub</li><li>Cloud Storage</li><li>Cloud Composer</li></ul>• Experience building batch and real-time data pipelines.• Strong understanding of data warehousing concepts and ETL frameworks.• Experience working with large-scale distributed data systems.• Familiarity with Apache Beam / Airflow concepts.• Experience with CI/CD pipelines and Git-based version control. Good to Have• Experience with Spark, Hadoop, or other big data frameworks.• Knowledge of data modeling techniques (star schema, dimensional modeling).• Exposure to machine learning data pipelines.• Experience with Terraform or Infrastructure as Code.• GCP certifications such as Professional Data Engineer. EducationBachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related field. Key Competencies• Strong problem-solving and analytical skills • Ability to work with large and complex datasets • Good communication and collaboration skills • Experience working in Agile environments

Job Family : Data Science Consulting

Travel Required : Up to 10%

Clearance Required : Ability to Obtain Public Trust

What You Will Do :
Guidehouse seeks a Data Engineer to support in building, optimizing, and maintaining data pipelines, cloud-based solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, cloud services, CI/CD, and version control, and will collaborate with cross-functional teams to deliver high-quality, scalable data solutions.

* Design, develop, and maintain robust data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources.

* Build and optimize data architectures and models to support analytics, reporting, and operational needs.

* Implement and manage CI/CD pipelines for data engineering workflows using tools such as Jenkins, Maven, and Git.

* Develop and deploy cloud-based solutions leveraging AWS (S3, Lambda, ECS, SQS), Azure (CosmosDB, Functions), and containerization (Docker, Kubernetes).

* Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.

* Ensure data quality, integrity, and security through rigorous validation, monitoring, and logging (e.g., Splunk, CloudWatch, Kibana).

* Support data migration, integration, and modernization initiatives, including legacy system upgrades and cloud adoption.

* Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.

* Document data flows, processes, and technical solutions for knowledge sharing and compliance.

* Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.

What You Will Need :

* US Citizenship is required

* Bachelor's degree is required

* Minimum FIVE (5) years of experience in data engineering, software development, or related roles.

* Proficient experience with: Programming languages (Java, Python, SQL, Pyspark); Data pipeline and ETL development; Database technologies (Oracle, MySQL, Postgres, SQL Server, MongoDB); Data modeling, stored procedures, and API development (RESTful, SOAP)

* Demonstrated experience with: Cloud platforms: AWS (S3, Lambda, ECS, SQS), Azure (CosmosDB, Functions); Containerization and orchestration (Docker, Kubernetes); CI/CD tools (Jenkins, Maven, Git, Bitbucket, GitHub); Monitoring and logging tools (Splunk, CloudWatch, Kibana, Elasticsearch)

* Effectively operate using Agile methodologies.

* Ability to work in fast-paced environment independently

* Strong analytical, troubleshooting, and communication skills, including communicate complex technical concepts in salient terms to diverse audience types

What Would Be Nice To Have :

* Experience supporting federal programs and/or large-scale data modernization projects.

* Certifications in AWS, Azure, or other cloud/data engineering domains.

* Experience with data visualization tools (e.g., Kibana, Tableau).

* Familiarity with security best practices and compliance in federal environments.

* Experience with microservices, Spring Boot, and integration of AI/ML components.

* Previous consulting experience

#LI-DNI

The annual salary range for this position is $113,000.00-$188,000.00. Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.

What We Offer :
Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

Benefits include:

* Medical, Rx, Dental & Vision Insurance
* Personal and Family Sick Time & Company Paid Holidays
* Position may be eligible for a discretionary variable incentive bonus
* Parental Leave and Adoption Assistance
* 401(k) Retirement Plan
* Basic Life & Supplemental Life
* Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
* Short-Term & Long-Term Disability
* Student Loan PayDown
* Tuition Reimbursement, Personal Development & Learning Opportunities
* Skills Development & Certifications
* Employee Referral Program
* Corporate Sponsored Events & Community Outreach
* Emergency Back-Up Childcare Program
* Mobility Stipend

About Guidehouse
Guidehouse is an Equal Opportunity Employer-Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com (mailto:RecruitingAccommodation@guidehouse.com) . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com (mailto:guidehouse@myworkday.com) . Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.

If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse's Ethics Hotline. If you want to check the validity of correspondence you have received, please contact recruiting@guidehouse.com (mailto:recruiting@guidehouse.com) . Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant's dealings with unauthorized third parties.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.

Locations Open - Pan India Key Requirements: <ul><li>Strong experience in Azure or AWS Cloud</li><li>Hands-on experience with Microsoft Purview (Mandatory)</li><li>Experience in data governance, data catalog, and metadata management</li><li>Ability to lead architecture, development, and mentor engineering teams</li></ul>

<h3>Job Description</h3><div>Job Description<div>Sr. Data Engineer for a stable company!Full Time Direct Hire JobHybrid with work location-Irvine, CA. The Senior Data Engineer will help design and build a modern data platform that supports enterprise analytics, integrations, and AI/ML initiatives. This role focuses on developing scalable data pipelines, modernizing the enterprise data warehouse, and enabling self-service analytics across the organization. Key Responsibilities• Build and maintain scalable data pipelines using Snowflake, dbt, and Fivetran.• Design and optimize enterprise data models for performance and scalability.• Support data cataloging, lineage, quality, and compliance efforts.• Translate business and analytics requirements into reliable data solutions.• Use AWS (primarily S3) for storage, integration, and platform reliability.• Perform other data engineering tasks as needed. Required Qualifications• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field.• 5+ years of data engineering experience.• Hands-on expertise with Snowflake, dbt, and Fivetran.• Strong background in data warehousing, dimensional modeling, and SQL.• Experience with AWS (S3) and data governance tools such as Alation or Atlan.• Proficiency in Python for scripting and automation.• Experience with streaming technologies (Kafka, Kinesis, Flink) a plus.• Knowledge of data security and compliance best practices.• Exposure to AI/ML workflows and modern BI tools like Power BI, Tableau, or Looker.• Ability to mentor junior engineers. Skills• Snowflake• dbt• Fivetran• Data modeling and warehousing• AWS• Data governance• SQL• Python• Strong communication and cross-functional collaboration• Interest in emerging data and AI technologies No Sponsorship Available. Need candidates local to the area. </div></div>

Senior Data Engineer Data Platform and Semantic Architecture and Engineering. Hybrid (In office 3 days/week) within Oregon, Washington, Idaho, or Utah. Build a career with purpose. Join our Cause to create a person-focused and economically sustainable health care system. Who We Are Looking For: Every day, Cambias Data & Analytics Engineering team is living our mission to make health care easier and lives better. The Data & Analytics Engineering team is seeking a senior technical leader with deep expertise in dimensional modeling, semantic layer engineering, and analytics enablement, combined with a strong ability to influence architecture, mentor senior engineers, and partner with product, architecture, and business leaders. This leader thrives in ambiguous problem spaces, sets direction where none exists, and makes long-term platform decisions that balance scalability, governance, and usability. Experience designing and implementing semantic layers is critical. If you have hands-on...Data Engineer, Engineer, Architect, Data, Leadership, Platform, Healthcare

Calculate Moving Average	SQL	Easy
Predict Customer Churn	Machine Learning	Medium
A/B Test Significance	Statistics	Medium
Optimize Query Performance	SQL	Hard
Feature Importance Analysis	Machine Learning	Medium
Clean Missing Data	Python	Easy
Neural Network Architecture	Deep Learning	Hard
Calculate Cohort Retention	SQL	Medium
Bayesian Probability	Statistics	Easy
Recommend Similar Products	Machine Learning	Hard