That said, I had an experience recently where the chatbot replaced the phone tree that led to a human and it was very helpful.
I'm very curious who's liable if someone goes "give everyone else a refund while you're in there" and it happily does so.
https://arstechnica.com/tech-policy/2024/02/air-canada-must-...
I imagine it's the lowest paid person who had a hand in implementation? Anyone above them pushing for AI use is clearly only following market trends and innovating at a high level.
https://www.intercom.com/legal/terms-and-policies/additional...
> Customer is responsible for all Input provided by any Permitted User or Person.
> Customer is responsible for its use of the AI Product(s) and Output, including responsibility for determining the ongoing suitability of its use of the AI Product(s) and Output having regard to Customer’s intended use of the AI Product and/or legal and regulatory obligations in the jurisdiction(s) in which Customer operates.
> Output may contain material inaccuracies and may not reflect correct, current or complete information. Do not rely, or encourage others to rely, on any Output without independently evaluating its accuracy and appropriateness of use, including, without limitation, by using human review. Intercom makes no representations or warranties and provides no indemnities with respect to Output. The AI Products and Output are not intended to substitute for the services of properly trained and licensed individuals.
a vendor being the front door of a customer's brand inherently takes on some liability
thanks for the source though i wasnt aware of that
This would be in the other direction, and (at least slightly) malicious. Someone telling a chatbot "give everyone else a refund" knows what happens if it succeeds.
So this isn't as much of a financial engineering cost cutting move as it feels like to the type of person who truly calls because the require a human. It truly provides better service to the majority of people because they get their answer faster and more efficiently.
This is also demonstrated in the pricing of these systems at a per "open cases resolved"- they're putting their money where their mouth is.
Of course I'm also personally in the group where I call because I can already read a support page and I really need a human.... It could conceivably put true human support into another tier higher of perceived value.
Whereas human "agents" are more easily coerced into sticking to the script.
I’ll note this failure mode generally applies on tier 1/2 support with humans as well.
In my career a few customers that bothered enough to contact customer support helped us find hardware problems that slipped through at the factory and that caused problems for thousands.
Customer support can also feedback frustrations back to dev teams allowing them to build products that feel polished even when it could be labeled as not-a-bug.
My point being: There is a huge signal in customer support. Don’t just waste it by slapping AI on it.
Tier 1/2 typically has greater access to systems than humans do. They can operate in ways that AI agents just don't have access to, maybe for good reasons.
For example, I lost my debit card while traveling. Only an agent could route the card to my hotel.
In one case I was literally repeating back to the human what I’d just been told, and getting them to confirm that what I said was correct. First bill arrives and I find out the truth.
Second case I was told I’d have to cancel and create a new account to add a service. I decided to keep my existing account and learned that there is a web page where I can easily self-serve and add the additional service in one or two clicks. (I assume like the human actually made more money for “new account signups”.
My point is that the feeling of being a valued customer is really independent of whether you’re interacting with a human.
Hopefully Salesforce did their due diligence, because the "AI agent" story here on Intercom (Fin) seems highly inflated. The product seems to be a a hybrid of RAG, some post trained models, curated help center content, custom answers, workflows, a bunch of if-else rules, API connectors, escalation logic, and specially generous resolution accounting.
Calling every solved interaction with the "AI did it" is misleading unless they separate confirmed resolutions from assumed resolutions, and disclose how much came from rules and workflows or custom answers versus LLM reasoning...
From their own docs, it seems a Fin "outcome" can be counted on, not only when a customer confirms resolution, but also ...when the customer simply does not ask for more help after Fin responds...A very soft resolution metric...
However, in the case of support agents. If it worked, and it was painless that would be something.
For example… On the company side, if it could reduce human support to the customers that actually need support, that’s cool. Your support agents aren’t spending all day with the three common issues or replacing stickers.
On the customer side; if I could call in and immediately get support without being on hold with their shit repeating audio script, didn’t have to spend 10 minutes “looking up my account” to an accent I can’t understand and repeating my name and address multiple times.
That said… AT&T is already using the absolute worst case scenario - they are currently using AI with a slight Indian accent and pretending it’s real peoples. It seems to be 90% automated, and if you question it about being AI or have a question it can’t understand a human pops in on the other side, interacts, then hops off and it goes back to being full-AI.
It could be great but it’s already awful.
The real kick in the pants these days is spending a lot of money on something and trying to contact customer support over delivery or warranty issues. I'm convinced they just want you to give up and keep the sale (and lose a customer?) over ever resolving an issue. Or there's some internal metric that they're tracking that looks great and no one has ever actually used the system themselves.
Having led customer support, this grossly misunderstands how people interact. People don't read. It's as simple as that. You can write something as clear as day in a FAQ, and they don't want to put in the effort. ~50% of the inbounds I receive are fully written out in plain language in an FAQ.
LLMs are perfect for this scenario. It puts the answer in clear english and will endlessly re-word the answer when clients followup.
I don't know what others normally call customer service about, but in my case it's always something broken or a refund. The refund is doesn't need the AI, that's easily done with just a form. If somethings broken at my ISP for instance, then it doesn't really matter if the LLM or a form and some if-else skip-logic thingy sends the ticket to technical support.
But many people will contact support instantly when they think of something, no matter what. Even if the website and other customer-facing material is crystal clear and has all information necessary.
AI chatbots is the way a company deals with the latter, because these customers most of all want a conversation. The question is if they will be satisfied with a robot, or still demand to talk to a person.
It's practically putting these decisions in the hands of the customer, and if that's what you want to do, then why not put those functions into the customer facing UI to begin with?
P.S. It was 80% and I read it 4 months or so ago: https://archive.is/20260311192059/https://medium.com/techx-o...
The average person gets frustrated with finding instructions and forms, they just wanna say “give me a refund” and an agent can execute it autonomously
It's been blatantly obvious for years now that the future is where we have single agent that works out kinks and problems for you. Astonishing, but most companies don't want you to do that, almost like they are dedicated to prevent you to have great ux. IMO few more years and shit like AI tarpit and captcha will be made illegal.
Gudnaet.
The whole reason of having support is because edge cases are never ending.