Automating Quality Testing of ML Models

Artificial Intelligence (AI) systems are evolving at a very rapid pace to make our lives easier with every passing month. Advances in the academic coupled with miniaturization of hardware requirements in deploying models has made most of the models available off-the-shelf for developers which do not require further expertise to modify the models to make them suitable for the end applications they are targeting. These AI systems are built using Machine Learning (ML), which uses vast computational networks that grow in complexity as the tasks they handle evolve to achieve the needed performance targets. With models being available off-the-shelf and their complex computational nature, makes it harder to interpret or control the model’s output. Especially in Robotics, noise in the environment and the sensors leads to misclassifications, because the training dataset is not a complete representation of the production inputs. Hence, most of the ML models that we are using and are exposed to in our daily life are not robust and thus have a grave quality concern that needs to be addressed.

Share This Article