As the demand for AI-enabled software continues to surge, there is a rising need for platforms that can quickly provide APIs and other capabilities that are easy to consume by applications. The Open Platform for Enterprise AI (OPEA) project is designed to do just that, specifically for deployment of generative AI (GenAI) applications. In this blog post, we use the OPEA framework to demonstrate the ease of deploying ChatQnA on a laptop running Ubuntu 24.04 LTS and Canonical Kubernetes. This includes:
- A ChatQnA web application that uses the retrieval augmented generation (RAG) architecture, complete with swappable large language model (LLM) components
- A command-line tool for interacting with the ChatQnA service
Read more at Ubuntu.