When the best available human is an AI?

Co-authored by: Amolo Ng'weno and David del Ser
February 5, 2024 - 4 mins read

Developing country economies are characterized by shortages of skills that seem to be good for AI to fill: from tasks like writing and coding to, potentially, business advice and decision-making. But when do we decide that generative AI (GenAI) is actually better than the Best Available Human? The Best Available Human standard asks the question: would the best available AI in a particular moment, in a particular place, do a better job solving a problem than the best available human that is actually able to help in a particular situation?

Promise and opportunity

The Best Available Human in many emerging market contexts isn’t really up to the job; there’s a yawning mismatch between employees’ skills and what’s really needed. As this ILO report from 2019 indicated, “skills mismatch can negatively affect labor market outcomes, workers’ productivity, competitiveness and economic growth.”  Management practices are worse, leading to worse performance for firms. We end up with a situation where employees need more supervision and coaching, yet managers are weaker and less competent.

GenAI to the rescue! More so than in mature markets, where skilled managerial and technical talent is relatively more available, GenAI seems to offer the promise to step in and take care of not just rote and routine tasks but tasks requiring technical skills, writing ability, understanding of complex subjects, and business acumen. 

The line where GenAI becomes more useful than the Best Available Human is drawn earlier in emerging markets because the Best Available Human doesn’t have as much training and experience. To take accountants as an example, since maintaining accounts is key to the growth of any business, there were 25,589 registered accountants in Kenya in 2021, according to the National Treasury. Meanwhile there are 144,000 registered business entities and 1.5 MILLION formally registered micro and small businesses and over 5 million informal businesses. Not everyone needs a CPA but you can see that finding a qualified bookkeeper is probably not easy. Even Bill Gates thinks GenAI can help cobble over shortages of skilled workers like doctors and teachers.

Recent research seems to indicate that GenAI can be most helpful to mediocre and low-skill employees; if this is borne out in the real world, then GenAI could be a force that helps developing countries catch up in the productivity marathon. Whereas before it was prohibitive to find the capital, time and expertise to put in place automation, now GenAI’s near infinite capacity to learn, adapt and mimic should be able to augment low-skilled workers with much less drain on management oversight. 

For instance, a startup could employ a GenAI to speed up coding a new product or a government could use GenAI to improve how they deal with customer service complaints. A small company could use AI services out of the box to automate document processing tasks as part of their accounting and consult an AIBot when it has business questions. 

These are just examples that are already underway. And no doubt managers, leaders and entrepreneurs will find other uses that we don’t yet know about.  

So that’s all great, and GenAI is going to solve all our human resources shortages, right? Not so fast: we’ve seen adoption so far is limited (except in the exam cheating field, but that goes unmourned) and there are good reasons for that. 

Recommendations for designing AI systems when the Best Available Human isn’t that available

People are going to adopt GenAI if they feel it has the potential to be helpful, so here are a few things that GenAI developers, promoters, and systems engineers should take into account:

In conclusion, GenAI is set to augment the humans we have, who often are not the humans we really need. At it’s best, we hope that GenAI will cobble over that gap and equalize human capabilities, allowing rapid catch-up for companies in emerging markets. It’s early days yet – probably in the short term, we’ll see that GenAI makes human capabilities better, but not as much as we need. And it will introduce new problems that we may not yet be set up to handle. It’s a journey of exploration and we expect that there will be quite a few twists and turns on the road.  


Related Publications
Leave a Reply