Fujitsu Launches New Technologies To Protect Conversational AI From Hallucinations And Adversarial Attacks
By Ron Chen, Bureau Chief, Asia
Fujitsu has announced the launch of two new AI trust technologies to improve the reliability of the responses from conversational AI models. The newly developed technologies include a technique to detect hallucinations in conversational AI models – a phenomenon in which generative AI creates incorrect or unrelated output – and a technique jointly developed at its small research lab at Ben Gurion University to detect phishing site URLs implanted in the responses of the AI through poisoning attacks that inject false information.
With the new technologies, Fujitsu aims to provide corporate and individual users a tool to evaluate the reliability of replies from conversational AI, ultimately contributing to a more secure use of AI across a range of use cases, including for businesses aiming to implement the technology in actual operations.
Ben Gurion University, Professor Yuval Elovici,comments: “Generative AI stands as a critical domain, and within it, the hallucination detection technology Fujitsu has developed emerges as pivotal for establishing trustworthy conversational AI systems. Researchers from Ben-Gurion University (BGU) and Fujitsu have pioneered an innovative technique to enhance the security of AI-based URL filtering against adversarial threats. Our breakthrough focuses on tabular data, resulting in a more resilient defense mechanism against adversarial attacks in the realm of AI-driven URL filtering. Moving ahead, Fujitsu and Ben-Gurion University are set to collaborate on forging novel security-centric advancements within the realm of Generative AI.”
Fujitsu will include these new technologies in its conversational AI core engine provided through the “Fujitsu Kozuchi (code name) – Fujitsu AI Platform,” which offers users access to a wide range of powerful AI and ML technologies.
The technology to detect hallucinations in conversational AI will be available to users in Japan starting September 28, 2023, and the technology to detect phishing site URLs in responses of conversational AI starting October 2023. The new technologies will be both available to corporate users as a demo environment via Kozuchi and to individual users via a dedicated portal site. Fujitsu plans a roll-out of both technologies to the global market in the future.