Documentation Center

Introduction

Zeppeli.ai seamlessly connects LLM with enterprise data and service capabilities, efficiently building AI Bot services. It can easily integrate AI Bot capabilities deeply into actual business operations, driving business growth and efficiency improvement through AI.

Zeppeli.ai Product Features

Zeppeli.ai product has the following advantages and features:

LLMs

• Supports out-of-the-box mainstream commercial large models, open-source large models, professional domain models, and customized models with fine-tuning.
• Eliminates the need to invest significant effort in LLM deployment and fine-tuning, allowing developers to focus more on core enterprise business.
• Regardless of commercial or open-source models, it can quickly generate the data needed for model fine-tuning based on knowledge base data and user dialogue data.

Knowledge Base

• Supports out-of-the-box mainstream commercial large models, open-source large models, professional domain models, and customized models with fine-tuning.
• Supports various types of knowledge data such as doc/docx, pdf, txt, markdown, csv, xls/xlsx, web crawling, Q&A, etc.
• Utilizes different data parsing and segmentation schemes for different types of data to improve data quality and completeness.
• Supports a mixed search scheme of sparse vectors and dense vectors to improve knowledge retrieval accuracy.
• Supports the management, editing, and updating of knowledge documents in sliced dimensions.

Plugins

• For specific domain requirements, developers can obtain excellent solutions through Plugins (e.g., investment analysis, output files, product recommendations, service reservations, etc.).
• Developers can seamlessly connect with enterprise data and service capabilities through plugins while ensuring the security of enterprise data.
• Zeppeli.ai not only provides official plugins but also supports third-party developers to publicly release plugins based on their own service capabilities.

Flow Bot

• When facing complex requirements and issues, developers can use Flow to visualize the orchestration of multiple LLMs.
• Defines single-function, clearly defined "vertical LLMs" to improve quality and stability.
• Multiple "vertical LLMs" and "functional components" work serially or in parallel through Flow to solve complex problems.

Bot Training

• Chat records support quality scoring, keywords, and topic summarization, making it easier for developers to understand user interests.
• Supports summarizing, summarizing, and categorizing user questions to help developers understand high-frequency user questions and optimize and supplement relevant knowledge in a targeted manner.
• Bot training mode supports real-time correction of "dialogue content" to continuously train the Bot for better responsiveness.

How does Zeppeli.ai product solve the challenges of LLM landing in enterprises?

Zeppeli.ai’s product has the following advantages and features:

LLM Illusion Problem

• Accurate knowledge supplementation of context.
• Bot training and LLM fine-tuning to correct the model.
• Designing reflection mechanisms and verification tools for LLM.
• Optimizing Prompt to limit the range of responses.

General LLM lacks domain knowledge

• Supports various types of knowledge data such as doc/docx, pdf, txt, markdown, csv, xls/xlsx, web crawling, Q&A, etc.
• Utilizes different data parsing and segmentation schemes for different types of data to improve data quality and completeness.
• Supports a mixed search scheme of sparse vectors and dense vectors to improve knowledge retrieval accuracy.
• Supports the management, editing, and updating of knowledge documents in sliced dimensions.

Single LLM cannot solve complex tasks in enterprise business scenarios

• Break down complex problems into multiple branches.
• Flow supports the collaboration of multiple versions of LLM.
• LLM has capabilities such as long short-term memory, plugins, and knowledge base.
• Incorporate external feedback and information into the LLM response process.

LLM cannot solve complex tasks in enterprise business scenarios

• Provides a simple and efficient LLMOps platform.
• Solves the challenges of knowledge data loading and retrieval.
• Provides out-of-the-box AI Bot building capabilities.
• Rich and comprehensive API and SDK.

Enterprises lack talent reserves in the AI field

• Nearly zero-threshold use of Zeppeli.ai.
• Bot training and fine-tuning LLM capabilities for product operation personnel.
• No need for extensive AI domain knowledge; enterprise business personnel can also train and optimize the Bot.
• Developers can complete integration through API interfaces.