Prepare for and practice interview questions from Oak Ridge National Laboratory across topics like Presentation, Product Metrics, Statistics and more.

Oak Ridge National Laboratory Interview Questions

Oak Ridge National Laboratory Interview Guides

A/B Testing

How would you assess the validity of the result?

Experiment Validity

Button AB Test

How would you make a control group and test group to account for network effects

Network Experiment Design

How would you analyze the effectiveness of this new feature?

Green Dot

How would you design a two-week A/B test to determine whether a pricing increase is a good business decision

Testing Price Increase

Data Structures & Algorithms

Given two sorted lists, write a function to merge them into one sorted list.

Merge Sorted Lists

Find the missing integer from a array of consequtive integers

Find the Missing Number

Write a function one_element_removed that returns the integer removed from list Y in O(1) space and O(n) time without using set

One Element Removed

Given an array and a target integer, write a function that returns the indices of two integers in the array that add up to the target integer.

Target Indices

This problem involves identifying duplicate numbers in a list of integers. The function should return a list of the duplicate numbers.

Find Duplicate Numbers in a List

Machine Learning

How would you encode a categorical variable with thousands of distinct values

Encoding Categorical Features

Interpret coefficients of logistic regression for categorical and boolean variables

Coefficients of Logistic Regression

What are the logistic and softmax functions? What is the difference between the two?

Softmax vs Logistic

Explain the key differences between classification models and regression models

Classification and Regression

How would you build a machine learning system to generate Spotify's discover weekly playlist

Generating Discover Weekly

Behavioral

Describing a data project and its challenges

Hurdles In Data Projects

Strategically resolving misaligned expectations with stakeholders for a successful project outcome

Stakeholder Communication

How would you answer when an Interviewer asks why you applied to their company?

Why Do You Want to Work With Us

Making data-driven insights actionable for those without technical expertise

Simple Explanations

What do you tell an interviewer when they ask you what your strengths and weaknesses are?

Your Strengths and Weaknesses

Statistics

Explain what a p-value is to someone who is not technical

P-value to a Layman

What are the assumptions of linear regression?

Assumptions of Linear Regression

How would you tackle multicollinearity in multiple linear regression

Multicollinearity in Regression

Determine whether using an 83% cutoff overestimates or underestimates the actual population’s credit score

Credit Score Estimation

Given two sorted lists, write a function to merge them into one sorted list.

Bonus: What’s the time complexity?

Example:

Input:

<pre tabindex="0" class="chroma"><code>list1 = [1,2,5]
list2 = [2,4,6]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def merge_list(list1,list2) -&gt; [1,2,2,4,5,6]
</code></pre>

You have two sorted lists, one with m elements and one with n elements. What would be the time complexity of merging the two lists via merge sort?

You have two sorted lists, one with m elements and one with n elements. What would be the time complexity of merging the two lists via merge sort? 

Merging Lists Complexity

Let’s say that your company is running a standard control and variant AB test on a feature to increase conversion rates on the landing page. The PM checks the results and finds a .04 p-value.

How would you assess the validity of the result?

Tell me about a data project that didn’t go the way you expected. What did you set out to do, what surprised you, and how did you handle it?

Let’s say you want to test the close friends feature on Instagram Stories.

How would you make a control group and test group to account for network effects?

What could be a potential risk when Facebook segments the metrics of the user interface change by market or demographic groups?

What could be a potential risk when Facebook segments the metrics of the user interface change by market or demographic groups?

Network Experiment Design I

What is the primary metric that Facebook should monitor if it decides to make the user interface of its posting feature more like Instagram's?

What is the primary metric that Facebook should monitor if it decides to make the user interface of its posting feature more like Instagram's?

Network Experiment Design II

If Facebook changes its user interface to mimic Instagram's, which adverse effect should they anticipate and monitor?

If Facebook changes its user interface to mimic Instagram's, which adverse effect should they anticipate and monitor?

Network Experiment Design III

A team wants to A/B test multiple different changes through a sign-up funnel.

For example, on a page, a button is currently red and at the top of the page. They want to see if changing a button from red to blue and/or from the top of the page to the bottom of the page will increase click-through.

How would you set up this test?

Your team wants to run an AB test on the color (red or blue) and position (top/bottom of the page) of a button that links to a promotion.

How many different variants of the test should you run to see the effect that a red button has on the bottom of the page, if currently the button is blue and on the top of the page.

Your team wants to run an AB test on the color (red or blue) and position (top/bottom of the page) of a button that links to a promotion.

How many different variants of the test should you run to see the effect that a red button has on the bottom of the page, if currently the button is blue and on the top of the page.

A/B Test Variants

You have an array of integers, <code>nums</code> of length <code>n</code> spanning <code>0</code> to <code>n</code> with one missing. Write a function <code>missing_number</code> that returns the missing number in the array.

Note: Complexity of \(O(n)\) required.

Example:

Input:

<pre tabindex="0" class="chroma"><code>nums = [0,1,2,4,5] 
missing_number(nums) -&gt; 3
</code></pre>

Over budget on a project is defined when the salaries, prorated to the day, exceed the budget of the project.

For example, if Alice and Bob both combined income make 200K and work on a project of a budget of 50K that takes half a year, then the project is over budget given 0.5 * 200K = 100K &gt; 50K.

Write a query to forecast the budget for all projects and return a label of <code>&#34;overbudget&#34;</code> if it is over budget and <code>&#34;within budget&#34;</code> otherwise.

Note: Assume that employees only work on one project at a time.

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>first_name</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>last_name</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department_id</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
<code>projects</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>title</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>state_date</code></td>
<td>DATETIME</td>
</tr>

<tr>
<td><code>end_date</code></td>
<td>DATETIME</td>
</tr>

<tr>
<td><code>budget</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
departments table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>name</code></td>
<td>VARCHAR</td>
</tr>
</tbody>
</table>
<code>employee_projects</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>project_id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>employee_id</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>title</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>project_forecast</code></td>
<td>VARCHAR</td>
</tr>
</tbody>
</table>

Write a query to forecast each project's budget and label it overbudget or within budget

Over-Budget Projects

Let’s say you have a categorical variable with thousands of distinct values, how would you encode it?

Which method can be used to extract communities from large networks, that does not require a pre-determined number of clusters like K-means?

Which method can be used to extract communities from large networks, that does not require a pre-determined number of clusters like K-means?

There are two lists, <code>list X</code> and <code>list Y</code>. Both lists contain integers from <code>-1000</code> to <code>1000</code> and are identical to each other except that one integer is removed in <code>list Y</code> that exists in <code>list X</code>.

Write a function <code>one_element_removed</code> that takes in both lists and returns the integer that was removed in \(O(1)\) space and \(O(n)\) time without using the python set function.

Example:

Input:

<pre tabindex="0" class="chroma"><code>list_x = [1,2,3,4,5]
list_y = [1,2,4,5]

one_element_removed(list_x, list_y) -&gt; 3
</code></pre>

Which of the following methods would be the most efficient way of identifying what element is not included in two lists of integers that differ by a single element being removed?

For example, if the lists are <code>[1,2,3,4,5]</code> and <code>[1,2,4,5]</code>, the function should return <code>3</code>

Which of the following methods would be the most efficient way of identifying what element is not included in two lists of integers that differ by a single element being removed? 

For example, if the lists are `[1,2,3,4,5]` and `[1,2,4,5]`, the function should return `3`

Efficiently Identifying Missing Integer

How would you explain what a p-value is to someone who is not technical?

What does a p-value in a statistical test represent?

What does a p-value in a statistical test represent?

P-value to a Layman I

In a statistical test, how does a low p-value (less than 0.05) influence our decision about the null hypothesis?

In a statistical test, how does a low p-value (less than 0.05) influence our decision about the null hypothesis?

P-value to a Layman II

Given a list of integers, identify all the duplicate values in the list. Assume that the list can contain both positive and negative numbers, and the order of the list does not matter. A number is considered a duplicate if it appears more than once in the list. Return a list of the duplicate numbers.

Example 1:

Input:

<pre tabindex="0" class="chroma"><code>nums = [1, 2, 3, 1, 2, 3]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_duplicates(nums) -&gt; [1, 2, 3]
</code></pre>

The numbers 1, 2, and 3 all appear more than once in the list, so they are considered duplicates.

Example 2:

Input:

<pre tabindex="0" class="chroma"><code>nums = [1, -1, 2, 3, 3, -1]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_duplicates(nums) -&gt; [-1, 3]
</code></pre>

The numbers -1 and 3 both appear more than once in the list, so they are considered duplicates. Note that the order of the output does not matter.

Example 3:

Input:

<pre tabindex="0" class="chroma"><code>nums = [1, 2, 3, 4, 5]
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>find_duplicates(nums) -&gt; []
</code></pre>

None of the numbers in the list appear more than once, so there are no duplicates.

Given an array and a target integer, write a function <code>sum_pair_indices</code> that returns the indices of two integers in the array that add up to the target integer. If not found, just return an empty list.

Note: Can you do it on \(O(n)\) time?

Note: Even though there could be many solutions, only one needs to be returned.

Example 1:

Input:

<pre tabindex="0" class="chroma"><code>array = [1 2 3 4] 
target = 5 
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>def sum_pair_indices(array, target) -&gt; [0 3] or [1 2]
</code></pre>

Example 2:

Input:

<pre tabindex="0" class="chroma"><code>array = [3]
target = 6 
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>Do NOT return [0 0] as you can&#39;t use an index twice.
</code></pre>

You’re a data scientist at YouTube. Leadership wants to revisit how the platform measures success, not for a specific new feature, but for the product as a whole given its current state.

How would you define and measure success for YouTube? Identify your primary and secondary metrics, explain your rationale for each, and discuss how you would choose the right thresholds for any engagement-based metrics you propose.

The role of A/B testing in measuring the success rate of an analytics experiment

Success Measurement

Product Sense & Metrics

Let’s say you’re a data scientist at LinkedIn where you’re working on a product that sends qualified job candidates to companies. The team has launched a new feature that allows candidates to message hiring managers at companies directly during the interview process to get updates on their status.

Due to engineering constraints, the company can’t AB test the feature before launching it.

How would you analyze how the feature is performing?

How would you analyze the performance of a new LinkedIn feature that lets candidates message hiring managers during the interview process

Recruiting Leads

Analytics

What are the assumptions of linear regression?

Which assumption of the residuals of the standard linear regression model can not be overcome by increasing the sample size?

Regression assumptions

How would you handle the data preparation for building a machine learning model using imbalanced data?

Addressing imbalanced data in machine learning through carefully prepared techniques.

Data Preparation for Imbalanced Data

Let’s say that you work at a B2B SAAS company that’s interested in testing the pricing of different levels of subscriptions.

Your project manager comes to you and asks you to run a two-week-long A/B test to test an increase in pricing.

How would you approach designing this test? How would you determine whether the increase in pricing is a good business decision?

You are required to extract a specific word <code>target_word</code> from an encrypted document. Fortunately, you have the basic information needed to decrypt that document.

The equation used to encrypt the document is as follows:

\[E_n(x) = (I(\mathsf{s}) + n) \mod 26 \]

Where:

<ul>
<li>\(\mathsf{s}\) is a letter</li>
<li>\(I(x) \) is the number representing the position of the letter in the alphabet (1 for <code>A</code>, 2 for <code>B</code>, etc.)</li>
<li>\(n \) is an arbitrary integer.</li>
<li>\(E_n(x) \) is the encrypted letter.</li>
</ul>

Return the number of occurrences of <code>target_word</code> in the document after decryption.

Note: The document only has upper case letters and spaces.

Example:

Input:

<pre tabindex="0" class="chroma"><code>encrypted_document = &#39;WKH TXLFN EURZQ IRA MXPSV RYHU WKH ODCB GRJ&#39;
n = 3
target_word = &#39;BROWN&#39;
</code></pre>

Output:

<pre tabindex="0" class="chroma"><code>extract_word(encrypted_document,n,target_word) -&gt; 1
</code></pre>

Explanation:

After decrypting the document, you will have :

<pre tabindex="0" class="chroma"><code>THE QUICK BROWN FOX JUMPS OVER THE LAZY DOG
</code></pre>

In which the <code>target_word</code> (BROWN) appears only once.

Return the number of occurrences of `target_word` in the decrypted document

Words in Encrypted String

How would you interpret coefficients of logistic regression for categorical and boolean variables?

Why is one-hot encoding recommended for categorical variables in logistic regression models?

Why is one-hot encoding recommended for categorical variables in logistic regression models?

Design a database to represent a Tinder style dating app. 

What does the schema look like and what are some optimizations that you think we might need?

Let’s say you are making a swiping app, similar to Tinder.

What would be the most efficient way (in terms of retrieval time) to store which users have swiped on each other on a database backend?

Let's say you are making a swiping app, similar to Tinder.

What would be the most efficient way (in terms of retrieval time) to store which users have swiped on each other on a database backend?

Swipes Database Design

Design a database schema for a Tinder-style dating app and discuss needed optimizations

Swiping App Design

Data Modeling

What are the key differences between classification models and regression models?

What is the MOST important difference between regression and classification models?

What is the MOST important difference between regression and classification models?

Classification vs Regression

You’ve been tasked with building a classification machine-learning model to predict whether a transaction is either fraud or not fraud for a credit card company. You have ten years of historical data on transactions, including a flag for whether a transaction was manually identified as fraud.

Describe how you might go about building a fraud detection model for credit card transactions. Be sure to mention the possible model types, discuss the bias-variance tradeoff in model development, and address any complexities that arise from the class imbalance.

Input features in the data include:

<ul>
<li>Transaction amount</li>
<li>Merchant category for the transaction</li>
<li>Zip code for the merchant</li>
<li>Zip code for the billing address</li>
<li>Average transaction amount for the account over the past six months</li>
</ul>

Output feature:

<ul>
<li>0/1 flag for fraud (0 = not fraud, 1 = fraud)</li>
</ul>

Note: Fraudulent transactions are (thankfully) a very small percentage of all historical transactions. Assume fraudulent transactions are 0.01% of historical data.While building the model to perform the classification, you need to consider the bias/variance tradeoff, and take into account the fact that there is a class imbalance (very few of the observations are “fraud”).

Bias variance tradeoff and class imbalance in finance

Bias - Variance Tradeoff and Class Imbalance in Finance

What are the logistic and softmax functions? What is the difference between the two?

What makes them useful for use in logistic regression?

In logistic regression, how is the predicted class determined based on the logistic function?

In logistic regression, how is the predicted class determined based on the logistic function?

Softmax vs Logistic II

What is the key characteristic of the logistic function that makes it useful for mapping continuous values to a probability?

What is the key characteristic of the logistic function that makes it useful for mapping continuous values to a probability?

Softmax vs Logistic I

You work on an artificial intelligence team at ABC Neural Inc. Your client, the New York City Transit Authority, provides an hourly feed of subway ridership data (entries and exits) for the NYC Subway system. Your task is to predict the number of riders each hour for each subway station.

Design and outline a solution (both functional and non-functional requirements) that takes the hourly ridership data as input and delivers predictions of hourly ridership back to the client. Predictions must be consistently updated as new data arrives, and the end product will be integrated into the client’s internal systems.

Design a machine learning solution to predict hourly subway ridership for each NYC subway station using hourly entry and exit data

Subway Machine Learning Model

You work as a backend engineer at Glassdoor. The company relies on multiple legacy systems to aggregate and process job postings, salary data, and company reviews. To ensure reliable data ingestion and processing, you are tasked with building a monitoring service that tracks the health of these legacy systems via regular heartbeat signals.

The service must expose one endpoint to receive heartbeat signals from each legacy system, and another endpoint to return a list of systems that have not sent a heartbeat in the last five seconds. How would you architect this monitoring system? Write a technical design document describing your approach.

Design a monitoring service for legacy system health via heartbeat endpoints at Glassdoor.

Legacy System Heartbeat Monitor

DevOps

You’re building a machine learning model to predict hospital readmission risk using patient records from the past five years. The data includes patient demographics, diagnoses, treatment history, and outcomes, but hospitals periodically change treatment protocols and data collection standards over time.

How would you structure your training, validation, and test splits to ensure your model generalizes to future patients? What risks would arise if these datasets were not clearly separated, and how would you validate that your final evaluation reflects real-world performance?

How would you structure your training, validation, and test splits to ensure your model generalizes to future patients? 

Training vs Validation vs Test Data

How would you tackle multicollinearity in multiple linear regression?

Let’s say we’ve deployed a recommendation model for an e-commerce site, and after two months, we notice that the model’s click-through rate has dropped from 12% to 7%.

How would you investigate the cause of this performance decline, and what steps might you take to address it?

How would you investigate and address a decline in a model's production performance?

Model Product Performance Degradation

ML Ops

Talk about a time when you had trouble communicating with stakeholders. How were you able to overcome it?

When an interviewer asks you a question along the lines of:

<ul>
<li>Why did you apply to our company?</li>
<li>What are you looking for in your next job?</li>
<li>What makes you a good fit for our company?</li>
</ul>

How should you respond?

When asked 'What are you looking for in your next job?' in an interview, how can you tie the company's employee benefits into your response?

When asked 'What are you looking for in your next job?' in an interview, how can you tie the company's employee benefits into your response?

Why Do You Want to Work With Us I

How can company values be used effectively in an interview when asked 'What makes you a good fit for our company?'

How can company values be used effectively in an interview when asked 'What makes you a good fit for our company?'

Why Do You Want to Work With Us II

When responding to the question 'Why did you apply to our company?' during an interview, what aspect should you highlight?

When responding to the question 'Why did you apply to our company?' during an interview, what aspect should you highlight?

Calculate Moving Average	SQL	Easy
Predict Customer Churn	Machine Learning	Medium
A/B Test Significance	Statistics	Medium
Optimize Query Performance	SQL	Hard
Feature Importance Analysis	Machine Learning	Medium
Clean Missing Data	Python	Easy
Neural Network Architecture	Deep Learning	Hard
Calculate Cohort Retention	SQL	Medium
Bayesian Probability	Statistics	Easy
Recommend Similar Products	Machine Learning	Hard

Oak Ridge National Laboratory Interview Questions

Oak Ridge National Laboratory Interview Guides

Oak Ridge National Laboratory Interview Questions

Challenge

Discussion & Interview Experiences

Discussion & Interview Experiences