Biases in An Automated Decision Making System and Its Effect on Individual Rights

Abstract

With big data driving today's prediction based technology, onehas to bear in mind that all predictive knowledge and patterns collectedfrom individuals through profiling is nothing but technologiesprogrammed to omit certain data either by choice or due to lack of toolsfor translation of data. This, over a period of time marks the genesis of abias, whether conscious or unconscious, being ingrained into the systemswhich then tends to create an asymmetry of knowledge and concentrationof power in select few, thus paving way to a programmed ' DigitalTyranny'. This may potentially result in compromise of interest of theultimate beneficiaries and jeopardise the core reason behind adoption ofthese technologies, especially if such technology-assisted automated-decision-making systems (ADMs) are used by State administrativebodies. Further, with lack of legislative sanction the adoption of theseADMs by the State becomes ultra-vires.