The Bottom Line: CX leaders underestimate that they face liability under the EU AI Act when AI systems in customer service make high-risk decisions.
In AI-powered customer service solutions, the boundaries between automation and decision responsibility become blurred. Under the EU AI Act, CX teams legally bear final responsibility for algorithmic outcomes.
Artificial intelligence increasingly makes autonomous decisions in modern customer service environments regarding customer inquiries, escalations, and service resolutions. Shana Simmons, Chief Legal Officer at Zendesk, warns that organizations underestimate the legal implications of this development: who bears liability when an AI system makes a faulty or discriminatory decision?
Under the EU AI Act, operators of high-risk AI systems must meet strict compliance requirements. Customer service AI falls into this category when it makes decisions that deny access to critical services or disadvantage customers. This means concretely: documentation of all training data, traceable decision criteria (transparency requirements), and regular audits are not optional.
The CX team ultimately bears operational responsibility. It must ensure that AI systems do not operate in a discriminatory manner, that customers understand that a machine made the decision, and that escalation paths to human agents exist. Transparency does not mean that algorithms must be “explainable,” but rather that the organization can document and demonstrate the basis on which the AI operates.
Organizations deploying AI in customer service must therefore coordinate early with Legal, Compliance, and Data Governance. The illusion that AI implementations are primarily a technical or marketing problem has become dangerous.
Source: itwelt.at · Published 17 June 2026
Lumi AI News — AI-assisted curation pursuant to Art. 50 EU AI Act. Paraphrase and classification by Lumi News Pipeline v1.7.1.