Amity Solutions
  • Announcements
  • Amity Bots Platform
    • Dashboard
      • User Journey
    • Users
      • Setup Microsoft Entra ID Integration
      • Password Policy
      • Typing animation
    • Channels
      • Connect to Facebook Page
      • Connect to LINE Official Account
      • Using Webchat SDK
      • Connet to Custom Channel
    • Audience
    • Chatbot
      • Intent
      • Entity
      • Mapper
      • Chatlogic
    • Message Template
      • Creating Message Template
      • Message Types Examples
    • Rich Menu
      • Linking Rich Menu to Channel
    • Campaign
      • Broadcast
      • ChatAds
  • Amity Bots Live Chat
    • Channels
    • Ticket
      • Ticket Management
      • Ticket Detail
      • Ticket Wrap up
      • Auto assign
    • Team Management
    • Livechat
    • Message Type
    • Livechat Dashboard
    • Audience's Profile
    • Customer Satisfaction Survey
      • Customer Satisfaction Score
    • Agent Copilot✨
  • Amity Bots Gen AI Platform
    • Dashboard
    • Assistants
      • Chat Sandbox
      • Assistant API Integration
      • Message Report
    • Fulfillments
    • Knowledge Base
      • Documents and Files (Legacy)
      • CSV File
      • Documents and Files
      • External Knowledge Base
    • AI Lab
    • Memorized Response
  • Insight
    • Journey Insight
  • Guides
    • Creating a simple chatbot
    • Setting up a LINE Rich Menu
    • How to use ChatAds
  • API Reference
  • Versioning & Upgrade Policy
Powered by GitBook
On this page

Was this helpful?

  1. Amity Bots Gen AI Platform

AI Lab

AI Lab (Test Framework) feature enables users to upload test cases and view test results directly on the platform.

PreviousExternal Knowledge BaseNextMemorized Response

Last updated 7 months ago

Was this helpful?

AI Lab page

Limitations for the Knowledge Management (KM) System:

  1. CSV File Validation: Imported .CSV files must undergo validation to ensure they meet the specified header requirements and data integrity before being accepted into the system.

  2. Single Knowledge Base: The system does not support the use of assistants with more than one Knowledge Base at a time, limiting users to managing knowledge within a single base for streamlined operations.

In order to upload a test case file, you need to have these columns as follow:

Input Column (* Mandatory)

  • no.*: Test case number (Format: case-[case]-[step])

  • question*: The test case prepared to assess Generative AI.

  • expected chunk id: The knowledge chunk expected to be used for answering the question.

  • expected answer: The answer anticipated from Generative AI.

The action of testing AI Lab consists of 3 options, as follows:

  1. Search KM Answer: Tests the selected chunk to generate an answer and automatically verifies document match between the expected and actual chunk.

  2. Generate Answer with Actual KM: Tests the entire process of answer generation by the Generative AI.

  3. Generate Answer with Expected KM: Tests only generating answer with using expected chunk from input file.

After finish executing, the test history will appear. User can click download as a zip file, consists of:

  1. Summary: Show the overall summary of test case.

  2. Test-cases: Show the result of each test case.

Warning:

The result will be displayed only once. Leaving the page will reset the test history and the test result.

AI Lab CSV Format
AI Lab Option
AI Lab Result
Sample of downloaded Summary file,
Sample of downloaded Test-cases file