AI Is Writing Performance Reviews. What Could Go Wrong?

JPMorgan Chase & Co.’s decision to let managers use artificial intelligence to help write performance reviews stands to bring relief to one of bosses’ most dreaded annual tasks. It also raises questions as to whether bot-written reviews will make the process better or worse, especially for employees seeking meaningful feedback.

Bringing AI into annual assessments can save managers time, and even result in more useful feedback than employees get from human bosses alone, executives and management experts say. Yet they caution that outsourcing too much could turn reviews into AI workslop. (At any rate, bot-written reviews are already out there whether employers bless them or not, with many managers making up their own rules.)

“The boundaries are going to be redrawn with this technology shift,” said Benjamin Levick, who leads internal AI and operations at corporate card company Ramp. “I don’t know if they’ll be full-blown uncomfortable or feel dehumanizing. There’s of course a risk of that if you’re very clunky with how you utilize AI, but I do think that there's a way to thread the needle of infusing AI in more managerial practices.”

JPMorgan’s guidelines permit supervisors to use an internal chatbot to help compose their write-ups, but warns them that technology is “not a substitute for human judgment.” It also forbids them from using AI tools to assign performance scores or make pay or promotion decisions.

Time-strapped managers may be doing their direct reports a disservice if they don’t use available tools to more thoroughly evaluate employees’ work, Levick said.

“I’d feel pretty bad if an AI just wholesale read everything that I wrote, looked at everything I did, and just assigned me a grade, and then my manager read the script at the end,” Levick said. “That’s the wrong way to do it, but I would probably also feel bad, honestly, if my manager only has a couple few hours to do this process and they spent all the time painstakingly manually reading the 2% of things they could get through and then wrote a review based on that very small subset.”

Bosses, like all humans, are prone to bias and faulty memory and may put too much weight on the recent past when reviewing a longer period, said Peter Cappelli, a management professor at the University of Pennsylvania’s Wharton School and director of its Center for Human Resources. Cappelli said AI often can provide a more objective assessment than one you get from a human manager.