It'd be trivial to sort the calls by listening to a few seconds of each to identify potential high value phone numbers (banks, florists, catalogue ordering line

It'd be trivial to sort the calls by listening to a few seconds of each to identify potential high value phone numbers (banks, florists, catalogue ordering lines, etc), then listen to every call to the high-value numbers.