The first concern is the vanishing/exploding gradient issue within neural network based models and the inherent bias. But greater is the propensity for abuse,

The first concern is the vanishing/exploding gradient issue within neural network based models and the inherent bias. But greater is the propensity for abuse, the algorithm that determines the risk model isn't publicly accessible. Once we get to a point where an AI controls sentencing, it could be manipulated. The idea that an AI get's to determine which humans go to jail is the last thing we should ever utilize AI for. A more important issue would be to focus on prison reform, let's reduce the causation of crime. Unfortunately private prisons are expanding right now and there's no reason to assume the prison lobby wouldn't love to influence an algorithm designed to send more people to jail.