Interviews for computer vision engineer and CV researcher roles are similar in a lot of ways to ML engineer interviews. You’ll face lots of ML system design and Python programming questions.
However, the biggest difference is that all the questions will relate to computer vision, and during the technical screens and the on-site, you’ll be facing questions and sessions that are focused on CV techniques.
The most common concepts to come up in computer vision interviews include:
To help, we’ve compiled some top computer vision interview questions.
Early on in the interview process, be prepared for basic computer vision interview questions. These questions are designed to quickly assess your expertise and working knowledge of common CV tools.
One tip: Always check out the computer vision projects that a company is working on before getting started. You can find CV blogs for most large tech companies – here are the blogs from Facebook, Amazon, and Google.
Interviewers ask questions like this to quickly understand your expertise and working knowledge of CV tools. A computer vision library is used to store equations and functions that can then be used to create neural networks for image identification and processing. Popular CV libraries include:
As you prepare, practice defining use cases that align with specific CV techniques and potential benefits. For this question, you might discuss Intersection over Union (IoU). IoU is a metric used to evaluate the accuracy of the model and measures the amount of overlap between the predicted and ground truth bounding box.
This refers to the optical illusion that is created when images have edges with similar shades of grey. The eye naturally adjusts by interpreting higher contrast between the two. In computer vision, the mach band causes inaccurate results. One way to reduce the mach band effect is to adjust the smoothness to reduce the banding effect.
Explain why the inputs in computer vision programs can get so large. What are some methods for overcoming this?
Why would you greyscale images in computer vision? Explain what a digital image is?
How does convolution work? How does it change if the inputs are greyscale vs. RGB?
Machine learning algorithm questions in computer vision interviews assess your understanding of CV algorithms, e.g. how they work, use cases, and how you might go about implementing a new model. You should have a strong grasp of SIFT, Global Block Matching, and convolutional neural networks, as well as traditional machine learning algorithms.
An inception network is a deep neural network with an architecture that consists of inception modules, which are repeating components. Using inception architecture introduces inception blocks, which contain multiple convolutional and pooling layers stacked together. This gives more accurate results and can help to reduce computation costs.
The approach to this encoding categorical features question depends on whether the problem is a regression or a classification model. If it’s a regression model, one possible solution would be to cluster them based on the response by working backwards. You could sort them by the response variable and then split the categorical variables into buckets based on the grouping of the response variable.
Bias variance tradeoff is the tradeoff between predictive accuracy and generalization of patterns outside training data. Increasing the accuracy of the model will lead to less generalization, while increasing the bias will decrease the variance.
Remember the equation for precision:
Because we can’t have high TrueNegatives, recall should be high when assessing the model.
Python machine learning questions test your ability to write code that’s used in computer vision. This would include writing functions for image rotation, image processing, detection and visualization.
Is there a simpler matrix transformation that can be performed on the example matrix array that gives the same output as a 90 degree clockwise rotation? What is special about the example matrix that makes this possible?
You’ll likely be asked to perform the task without using a library.
Writing algorithms from scratch are increasingly common in coding interviews. With a KNN algorithm question like this, you’ll be given conditions, and then will be instructed to write the code from the ground up.