All case studies

Customer story

The Open Telekom Cloud relies on amber as a customer-centric AI chatbot

Updated
Reading time
7 min

Too many places for information about the Open Telekom Cloud? With the amber AI chatbot at T-Systems, customers find everything they need in one central location.

Magenta cloud with knowledge cards and a chat message representing the Open Telekom Cloud AI chatbot

Information is not only located in different places within the company. Customers of T-Systems’ Open Telekom Cloud (OTC) can find information not only on the official website, but also in technical help pages, community notes and other sources. Users therefore first had to know where to look for an answer.

The first freely available and externally directed AI chatbot from amber has been available on the OTC website since July 2024. As an expert in cross-system chat and search for internal use cases, amber has long been a partner of Deutsche Telekom via Techboost and also hosts its software on the OTC as standard. The existing infrastructure has now been used to make the public OTC knowledge centrally accessible, in compliance with the GDPR, of course.

Chapter 01

Development of the AI chatbot

For the realisation, the strengths of artificial intelligence were combined with Retrieval Augmented Generation (RAG). The chatbot, including connection to the various systems, was realised in just 7 weeks.

to build the chatbot, including connection to the systems
7 weeks
less search effort on average with enterprise search
40 %

“As Open Telekom Cloud, we have various points of contact with artificial intelligence,” says Norbert Brüll, Senior Service Manager, “as an AI provider, we are pursuing various AI initiatives with our partners.” These include the provision of development and training environments (e.g. via ModelArts), data pipelines, the GDPR-compliant operation of AI services and the offer of an LLM Hub.

“With the current project, we have changed our perspective and put ourselves in the shoes of an AI user. We wanted to explore the possibilities of AI for ourselves and our customers,” says Brüll. The use case was quickly found: a typical enterprise problem also prevails in the Open Telekom Cloud, a lot of data is “scattered” in many different places. Users (both internal and external) often have to search until they find the right information. The solution in AI times lies in an intelligent search assistant that taps into all sources and summarises the information in a handy answer.

“An enterprise search or intelligent knowledge management reduces search efforts in such cases by an average of 40 percent,” explains Bastian Maiworm, co-founder of amber, “the productivity gains are obvious.”

In May 2024, amber and the Open Telekom Cloud launched the project to get the new AI-based chatbot up and running. The basis for this were services that the start-up had already developed and which are now available quickly and easily as a standard product. These include the semantic search “amber” and the question-answer system “amberAI”, which are based on a self-developed and trained Large Language Model (LLM). In the basic version, the amber services act as a kind of ChatGPT to find and chat with the company’s internal knowledge.

“However, the internal use case was not the intention of our Open Telekom Cloud Chatbot,” says Brüll, “it was intended to help our users to quickly find relevant information and apply it for easy use of the cloud according to the motto ‘Find it fast’.”

Chapter 02

Technical implementation of the AI chatbot

To do this, the amber system needed access to the relevant sources. These include, for example:

  • the Open Telekom Cloud website
  • the document library (Doc Library)
  • community content
  • a collection of PDFs such as the service description

“To give the chatbot access to this information, we used a technology known as Retrieval Augmented Generation,” explains Maiworm.

To our knowledge, we are the first public cloud provider to offer its customers a free LLM-based chatbot. The bot creates clear benefits for customer experience and user experience.

Norbert Brüll, Senior Service Manager, Open Telekom Cloud

When RAG is used, the AI model is not retrained or fine-tuned, which also eliminates the corresponding effort and costs. Instead, the chatbot co-operates with an enterprise search:

  1. 01

    Question

    A user asks the chatbot a question.

  2. 02

    Search

    A search is first triggered in the connected sources.

  3. 03

    Context

    The information is made available to the AI model depending on the situation.

  4. 04

    Answer

    The AI model summarises it into an answer.

The information thus remains within the company or in the repositories in which it is already stored.

amber offers various methods to make the data accessible to the bot. Specifically, an API is used for the multimedia content of the community, while the other sources are indexed several times a day using a crawler. The information is collected and standardised in a vector database. This database then acts as a consolidated basis for the concentrated Open Telekom Cloud knowledge from which the bot draws. The automated updates of the vector database ensure that the bot always has at least the latest knowledge.

The chatbot was created in just seven weeks. It has been running since mid-July 2024. It gives users of the Open Telekom Cloud easy access to the latest knowledge they need; tedious searches are a thing of the past. The bot also documents the sources from which it has obtained the relevant information. This reduces the likelihood of hallucinations.

With the AI chatbot for the Open Telekom Cloud, we have demonstrated how easy it is to build a value-added AI service for knowledge management. Practically every company can benefit from such a blueprint.

Bastian Maiworm, Managing Director of amber
Chapter 03

Accessibility of the chatbot

“Our chatbot is easily accessible via the support tab on the right-hand side of the screen (AI). Registration is not necessary,” says Brüll. “By operating the vector DB and the model within the Open Telekom Cloud, the team has full control over the AI. This also includes GDPR compliance,” adds Maiworm, “so that a second stage can also be realised if necessary, in which personal data is used via a login.”

Open Telekom Cloud website with the AI chatbot window opened on the right, powered by amber
Screenshot of the chatbot on the Open Telekom Cloud website

Incidentally, the bot is not just an information assistant, but can also help you in a very practical way. Norbert Brüll: “If you want to deploy a service, you don’t have to trawl through API documentation or community input, you can simply ask the bot for a deployment setup on a container basis, including code.”

About the author

Bastian Maiworm

Co-founder & CRO at amber

LinkedIn

Bastian co-founded amber and talks to mid-sized companies every day about how they make their knowledge findable with AI.

FAQ

Frequently asked questions about the Open Telekom Cloud AI chatbot

What is the Open Telekom Cloud AI chatbot?

A freely available, externally directed AI chatbot from amber on the Open Telekom Cloud website. It brings together information from the website, the Doc Library, the community and PDFs and summarises it into an answer.

How long did the implementation take?

The project started in May 2024. The chatbot, including connection to the various systems, was realised in just seven weeks and has been running since mid-July 2024.

Which technology is behind it?

Retrieval Augmented Generation (RAG): the AI model is not retrained but co-operates with an enterprise search. For each question, the connected sources are searched first, then the model summarises the information into an answer.

How does the chatbot stay up to date?

Community content is connected via an API, the other sources are indexed several times a day using a crawler. Automated updates of the vector database ensure that the bot always has at least the latest knowledge.

How does the chatbot reduce hallucinations?

The bot documents the sources from which it has obtained the relevant information. This reduces the likelihood of hallucinations.

How can I access the chatbot and is it GDPR-compliant?

It is accessible via the support tab on the right-hand side of the screen (AI), without registration. The vector database and the model run within the Open Telekom Cloud, so the team has full control over the AI, including GDPR compliance.

Ready to work more efficiently?

Sign up with your company email address and try amber for yourself today. Upload documents, connect the tools you use every day and let amber take work off your hands.

Try amber free for 30 days. No credit card required.