Anyone allowing an LLM to take direct, tangible change on anything deserves everything they get for being so utterly stupid. This came awfully close.
Parsing user queries and regurgitating publicly available answers (that the user could probably search for themselves) is about the limit of trust, and even then it’s sketchy. They’re such soft targets and get juicier the more pies they are allowed to have their fingers in.
The case I know of a company wanting to get the “efficiency” of using chatbots instead of people but not the responsibility of one, is Air Canada. They were held responsible in that case of their AI agent’s policy hallucinations. Though the customer had to go through many hoops to get to that point and probably others were affected without due recourse.
The British Columbia Civil Resolution Tribunal rejected that argument, ruling that Air Canada had to pay Moffatt $812.02 (£642.64) in damages and tribunal fees. “It should be obvious to Air Canada that it is responsible for all the information on its website,” read tribunal member Christopher Rivers’ written response.
What a brass neck on them - shocking they couldn’t see it and decide to settle quietly instead.
Anyone allowing an LLM to take direct, tangible change on anything deserves everything they get for being so utterly stupid. This came awfully close.
Parsing user queries and regurgitating publicly available answers (that the user could probably search for themselves) is about the limit of trust, and even then it’s sketchy. They’re such soft targets and get juicier the more pies they are allowed to have their fingers in.
The case I know of a company wanting to get the “efficiency” of using chatbots instead of people but not the responsibility of one, is Air Canada. They were held responsible in that case of their AI agent’s policy hallucinations. Though the customer had to go through many hoops to get to that point and probably others were affected without due recourse.
What a brass neck on them - shocking they couldn’t see it and decide to settle quietly instead.
Best thing I’ve read all day, cheers :)