AnythingLLM

Retrieval Augmented Generation (RAG) with LLM and Vector DB that can be local for full data privacy or cloud-based for greater functionality. Prompts and responses can be scanned for security issues using Prisma Airs. APIs are documented at: <Anything LLM URL> /api/docs Product documentation: https://docs.useanything.com/

Utilities · Anything LLM

Details

IDAnythingLLM
ProviderMintplex Labs Inc
CategoryUtilities
From Version6.10.0
Docker Imagedemisto/python3:3.12.13.8319994
Supported ModulesAgentix XSIAM

README

Retrieval Augmented Generation (RAG) with LLM and Vector DB that can be local for full data privacy or cloud-based for greater functionality

Configure AnythingLLM in Cortex

Parameter Description Required
AnythingLLM URL (e.g., http://<url to local AnythingLLM>:3001) or https://<Anything LLM cloud url>   True
AnythingLLM API Key   True
Cloudflare Access Client Id   False
Cloudflare Access Client Secret   False
AIRS API URL Leave blank if AIRS is not being used False
AIRS API Key Leave blank if AIRS is not being used False
Sync Scan LLM Prompts with AIRS Have AIRS scan all LLM prompts and throw exeception if BLOCK is returned False
Sync Scan LLM Response with AIRS Have AIRS scan all LLM responses and throw exeception if BLOCK is returned False
AIRS Profile Name for Scan Requests The profile must be created in the AIRS console False
AIRS Application Name for Scan Requests Provide an application name to identify XSOAR scan requests in AIRS False
AIR User for Scan Requests Provide a user name to include in XSOAR scan requests in AIRS False
Anything LLM Model in use Provide the LLM model being used for scan requests in AIRS False

Commands

You can execute these commands from the CLI, as part of an automation, or in a playbook.
After you successfully execute a command, a DBot message appears in the War Room with the command details.

anyllm-document-upload-file


Uploads an XSOAR file entry to the custom-documents folder.

Base Command

anyllm-document-upload-file

Input

Argument Name Description Required
fileentry XSOAR file entry to upload - example: 181@24789. Required

Context Output

There is no context output for this command.

anyllm-document-upload-link


Uploads a web link to the custom-documents folder

Base Command

anyllm-document-upload-link

Input

Argument Name Description Required
link Web link to upload - example: https://unit42.paloaltonetworks.com/darkgate-malware-uses-excel-files”. Required
title No description provided. Required
description No description provided. Required
author No description provided. Required
source No description provided. Required

Context Output

There is no context output for this command.

anyllm-document-upload-text


Upload text content as a document to the custom-documents folder

Base Command

anyllm-document-upload-text

Input

Argument Name Description Required
text Raw text content that is the document. Required
title Document title to use when uploading. Required
description Description of the document. Optional
author Author of the document. Optional
source Source of the document. Optional

Context Output

There is no context output for this command.

anyllm-workspace-new


Creates a new workspace in AnythingLLM

Base Command

anyllm-workspace-new

Input

Argument Name Description Required
workspace Name of the workspace to create. Required

Context Output

There is no context output for this command.

anyllm-workspace-delete


Deletes an AnythingLLM workspace

Base Command

anyllm-workspace-delete

Input

Argument Name Description Required
workspace Name of the workspace to delete. Required

Context Output

There is no context output for this command.

anyllm-workspace-list


List all the workspaces in AnythingLLM

Base Command

anyllm-workspace-list

Input

| Argument Name | Description | Required |
| — | — | — |

Context Output

There is no context output for this command.

anyllm-workspace-get


Get a specific workspace details

Base Command

anyllm-workspace-get

Input

Argument Name Description Required
workspace Name of the workspace. Required

Context Output

There is no context output for this command.

anyllm-workspace-settings


Update workspace settings

Base Command

anyllm-workspace-settings

Input

Argument Name Description Required
workspace Name of the workspace. Required
settings JSON object for the settings. Required

Context Output

There is no context output for this command.

anyllm-workspace-add-embedding


Add a document to a workspace and create its vector embedding in the workspace

Base Command

anyllm-workspace-add-embedding

Input

Argument Name Description Required
workspace Name of the workspace. Required
folder Folder name containing the document. Required
document Document name to add as an embedding. Required

Context Output

There is no context output for this command.

anyllm-workspace-delete-embedding


Delete a document embedding from the workspace

Base Command

anyllm-workspace-delete-embedding

Input

Argument Name Description Required
workspace Name of the workspace. Required
folder Folder the document originated from. Required
document Name of the document to have its embedding deleted. Required

Context Output

There is no context output for this command.

anyllm-document-createfolder


Create a new document folder

Base Command

anyllm-document-createfolder

Input

Argument Name Description Required
folder Name of the folder to create. Required

Context Output

There is no context output for this command.

anyllm-document-move


Move a document from a source folder to a destination folder

Base Command

anyllm-document-move

Input

Argument Name Description Required
srcfolder Name of the source folder. Required
dstfolder Name of the destination folder. Optional
document Document name to move. Optional

Context Output

There is no context output for this command.

anyllm-document-delete


Delete a document

Base Command

anyllm-document-delete

Input

Argument Name Description Required
folder Name of the folder. Required
document Name of the document to delete. Required

Context Output

There is no context output for this command.

anyllm-workspace-chat


Send a chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

Base Command

anyllm-workspace-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
message Message to send. Required
mode Mode to chat, query or chat. Possible values are: query, chat. Required
format No description provided. Possible values are: markdown, dictionary. Default is dictionary. Optional

Context Output

There is no context output for this command.

anyllm-workspace-stream-chat


Send a stream chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general

Base Command

anyllm-workspace-stream-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
message Message to send. Required
mode Chat mode, query or chat. Possible values are: query, chat. Optional

Context Output

There is no context output for this command.

anyllm-document-list


List all document details

Base Command

anyllm-document-list

Input

| Argument Name | Description | Required |
| — | — | — |

Context Output

There is no context output for this command.

anyllm-document-get


Get a specific document details

Base Command

anyllm-document-get

Input

Argument Name Description Required
folder Folder containing the document. Required
document Document name. Required

Context Output

There is no context output for this command.

anyllm-workspace-pin


Set the pinned status of a document embedding

Base Command

anyllm-workspace-pin

Input

Argument Name Description Required
workspace Workspace name. Required
folder Folder the document originated from. Required
document Document name. Required
status Set pin status to true or false. Possible values are: true, false. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-chats


Get the conversation for a workspace thread

Base Command

anyllm-workspace-thread-chats

Input

Argument Name Description Required
workspace No description provided. Required
thread No description provided. Optional

Context Output

There is no context output for this command.

anyllm-workspace-thread-chat


Send a chat a message to a conversation thread

Base Command

anyllm-workspace-thread-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
thread Name of the conversation thread. Required
message Message to send. Required
mode Mode to chat, query or chat. Possible values are: query, chat. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-new


Create a new conversation thread

Base Command

anyllm-workspace-thread-new

Input

Argument Name Description Required
workspace Name of the workspace. Required
thread Name of the new conversation thread. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-delete


Delete a thread in a workspace

Base Command

anyllm-workspace-thread-delete

Input

Argument Name Description Required
workspace Name of the workspace. Optional
thread Name of the thread. Optional

Context Output

There is no context output for this command.

anyllm-scan-request


Perform an AI security scan of a request with AIRS

Base Command

anyllm-scan-request

Input

Argument Name Description Required
profile_name AIRS profile name to use in scanning. Required
app_name AIRS application name - metadata. Optional
app_user AIRS application user name - metadata. Optional
ai_model LLM model in use - metadata. Optional
user_ip User IP - metadata. Optional
prompt LLM prompt to scan. Optional
response LLM response to scan. Optional
code_prompt LLM prompt with code to scan. Optional
code_response LLM response with code to scan. Optional
context LLM context for grounding. Optional

Context Output

The context data returned from a scan request is:

Key Value
action block or allow
category malicious etc
profile_id ID of the AIRS profile used
profile_name Name of the AIRS profile used
prompt_detected Details of a prompt detection - dictionary
response_detected Details of a response detection - dictionary
scan_id Scan ID
tr_id TR ID

Configuration parameters

  • url — AnythingLLM URL (e.g., http://<url to local AnythingLLM>:3001) or https://<Anything LLM cloud url> (required)
  • apikey — AnythingLLM API Key (required)
  • cf_auth — Cloudflare Access Client Id
  • airs_url — AIRS API URL
  • airs_apikey
  • airs_scan_prompt — Sync Scan LLM Prompts with AIRS
  • airs_scan_response — Sync Scan LLM Response with AIRS
  • airs_profile — AIRS Profile Name for Scan Requests
  • airs_app — AIRS Application Name for Scan Requests
  • airs_user — AIR User for Scan Requests
  • airs_model — Anything LLM Model in use

Commands (23)

  • anyllm-document-createfolder

    Create a new document folder.

  • anyllm-document-delete

    Delete a document.

  • anyllm-document-get

    Get a specific document details.

  • anyllm-document-list

    List all document details.

  • anyllm-document-move

    Move a document from a source folder to a destination folder.

  • anyllm-document-upload-file

    Uploads an XSOAR file entry to the custom-documents folder.

  • anyllm-document-upload-link

    Uploads a web link to the custom-documents folder.

  • anyllm-document-upload-text

    Upload text content as a document to the custom-documents folder.

  • anyllm-scan-request

    Perform an AI security scan of a request with AIRS.

  • anyllm-workspace-add-embedding

    Add a document to a workspace and create its vector embedding in the workspace.

  • anyllm-workspace-chat

    Send a chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

  • anyllm-workspace-delete

    Deletes an AnythingLLM workspace.

  • anyllm-workspace-delete-embedding

    Delete a document embedding from the workspace.

  • anyllm-workspace-get

    Get a specific workspace details.

  • anyllm-workspace-list

    List all the workspaces in AnythingLLM.

  • anyllm-workspace-new

    Creates a new workspace in AnythingLLM.

  • anyllm-workspace-pin

    Set the pinned status of a document embedding.

  • anyllm-workspace-settings

    Update workspace settings. Anything LLM APIs are documented at: <URL>/api/docs.

  • anyllm-workspace-stream-chat

    Send a stream chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

  • anyllm-workspace-thread-chat

    Send a chat a message to a conversation thread.

  • anyllm-workspace-thread-chats

    Get the conversation for a workspace thread.

  • anyllm-workspace-thread-delete

    Delete a thread in a workspace.

  • anyllm-workspace-thread-new

    Create a new conversation thread.

commonfields:
  id: AnythingLLM
  version: -1
sectionorder:
- Connect
- Collect
name: AnythingLLM
display: AnythingLLM
category: Utilities
provider: Mintplex Labs Inc
description: "Retrieval Augmented Generation (RAG) with LLM and Vector DB that can be local for full data privacy or cloud-based for greater functionality. Prompts and responses can be scanned for security issues using Prisma Airs.\n\nAPIs are documented at:  <Anything LLM URL> /api/docs \n\nProduct documentation:   https://docs.useanything.com/"
configuration:
- section: Connect
  display: AnythingLLM URL (e.g., http://<url to local AnythingLLM>:3001) or https://<Anything LLM cloud url>
  name: url
  defaultvalue: http://localhost:3001
  type: 0
  required: true
- section: Connect
  display: AnythingLLM API Key
  displaypassword: AnythingLLM API Key
  name: apikey
  type: 9
  required: true
  hiddenusername: true
- section: Connect
  display: Cloudflare Access Client Id
  displaypassword: Cloudflare Access Client Secret
  name: cf_auth
  required: false
  type: 9
- additionalinfo: Leave blank if AIRS is not being used
  defaultvalue: https://service.api.aisecurity.paloaltonetworks.com
  display: AIRS API URL
  name: airs_url
  required: false
  section: Connect
  type: 0
- additionalinfo: Leave blank if AIRS is not being used
  section: Connect
  displaypassword: AIRS API Key
  hiddenusername: true
  name: airs_apikey
  required: false
  type: 9
  display: ''
- additionalinfo: Have AIRS scan all LLM prompts and throw exeception if BLOCK is returned
  defaultvalue: 'false'
  display: Sync Scan LLM Prompts with AIRS
  name: airs_scan_prompt
  required: false
  section: Collect
  type: 8
- additionalinfo: Have AIRS scan all LLM responses and throw exeception if BLOCK is returned
  defaultvalue: 'false'
  display: Sync Scan LLM Response with AIRS
  name: airs_scan_response
  required: false
  section: Collect
  type: 8
- additionalinfo: The profile must be created in the AIRS console
  defaultvalue: anythingllm
  display: AIRS Profile Name for Scan Requests
  name: airs_profile
  required: false
  section: Collect
  type: 0
- additionalinfo: Provide an application name to identify XSOAR scan requests in AIRS
  defaultvalue: anythingllm
  display: AIRS Application Name for Scan Requests
  name: airs_app
  required: false
  section: Collect
  type: 0
- additionalinfo: Provide a user name to include in XSOAR scan requests in AIRS
  defaultvalue: XSOAR
  display: AIR User for Scan Requests
  name: airs_user
  required: false
  section: Collect
  type: 0
- additionalinfo: Provide the LLM model being used for scan requests in AIRS
  defaultvalue: llama3_2
  display: Anything LLM Model in use
  name: airs_model
  required: false
  section: Collect
  type: 0
script:
  script: ''
  type: python
  commands:
  - name: anyllm-document-upload-file
    arguments:
    - name: fileentry
      required: true
      description: 'XSOAR file entry to upload - example: 181@24789.'
    description: Uploads an XSOAR file entry to the custom-documents folder.
  - name: anyllm-document-upload-link
    arguments:
    - name: link
      required: true
      description: 'Web link to upload - example:  https://unit42.paloaltonetworks.com/darkgate-malware-uses-excel-files".'
    - name: title
      required: true
      description: Document title to use.
    - name: description
      required: true
      description: Description of the content in the document.
    - name: author
      required: true
      description: Who is the author of the document.
    - name: source
      required: true
      description: What is the source of the document.
    description: Uploads a web link to the custom-documents folder.
  - name: anyllm-document-upload-text
    arguments:
    - name: text
      required: true
      description: Raw text content that is the document.
    - name: title
      required: true
      description: Document title to use when uploading.
    - name: description
      description: Description of the  content in the document.
    - name: author
      description: Author of the document.
    - name: source
      description: Source of the document.
    description: Upload text content as a document to the custom-documents folder.
  - name: anyllm-workspace-new
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace to create.
    description: Creates a new workspace in AnythingLLM.
  - name: anyllm-workspace-delete
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace to delete.
    description: Deletes an AnythingLLM workspace.
  - name: anyllm-workspace-list
    arguments: []
    description: List all the workspaces in AnythingLLM.
  - name: anyllm-workspace-get
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    description: Get a specific workspace details.
  - name: anyllm-workspace-settings
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    - name: settings
      required: true
      description: JSON object for the settings.
    description: 'Update workspace settings.  Anything LLM APIs are documented at:   <URL>/api/docs.'
  - name: anyllm-workspace-add-embedding
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    - name: folder
      required: true
      description: Folder name containing the document.
    - name: document
      required: true
      description: Document name to add as an embedding.
    description: Add a document to a workspace and create its vector embedding in the workspace.
  - name: anyllm-workspace-delete-embedding
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    - name: folder
      required: true
      description: Folder the document originated from.
    - name: document
      required: true
      description: Name of the document to have its embedding deleted.
    description: Delete a document embedding from the workspace.
  - name: anyllm-document-createfolder
    arguments:
    - name: folder
      required: true
      description: Name of the folder to create.
    description: Create a new document folder.
  - name: anyllm-document-move
    arguments:
    - name: srcfolder
      required: true
      description: Name of the source folder.
    - name: dstfolder
      description: Name of the destination folder.
    - name: document
      description: Document name to move.
    description: Move a document from a source folder to a destination folder.
  - name: anyllm-document-delete
    arguments:
    - name: folder
      required: true
      description: Name of the folder.
    - name: document
      required: true
      description: Name of the document to delete.
    description: Delete a document.
  - name: anyllm-workspace-chat
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    - name: message
      required: true
      description: Message to send.
    - name: mode
      required: true
      auto: PREDEFINED
      predefined:
      - query
      - chat
      description: Mode to chat, query or chat.
    - auto: PREDEFINED
      default: true
      defaultValue: dictionary
      name: format
      predefined:
      - markdown
      - dictionary
      description: Markdown or dictionary format output.
    description: Send a chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.
  - name: anyllm-workspace-stream-chat
    arguments:
    - name: workspace
      required: true
      description: Name of the workspace.
    - name: message
      required: true
      description: Message to send.
    - name: mode
      required: true
      auto: PREDEFINED
      predefined:
      - query
      - chat
      description: Chat mode, query or chat.
    description: Send a stream chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.
  - name: anyllm-document-list
    arguments: []
    description: List all document details.
  - name: anyllm-document-get
    arguments:
    - name: folder
      required: true
      description: Folder containing the document.
    - name: document
      required: true
      description: Document name.
    description: Get a specific document details.
  - name: anyllm-workspace-pin
    arguments:
    - name: workspace
      required: true
      description: Workspace name.
    - name: folder
      required: true
      description: Folder the document originated from.
    - name: document
      required: true
      description: Document name.
    - name: status
      required: true
      auto: PREDEFINED
      predefined:
      - 'true'
      - 'false'
      description: Set pin status to true or false.
    description: Set the pinned status of a document embedding.
  - arguments:
    - description: Name of the workspace.
      name: workspace
      required: true
    - description: Name of the new conversation thread.
      name: thread
      required: true
    description: Create a new conversation thread.
    name: anyllm-workspace-thread-new
  - arguments:
    - description: Name of the workspace.
      name: workspace
      required: true
    - description: Name of the conversation thread.
      name: thread
      required: true
    - description: Message to send.
      name: message
      required: true
    - auto: PREDEFINED
      description: Mode to chat, query or chat.
      name: mode
      predefined:
      - query
      - chat
      required: true
    description: Send a chat a message to a conversation thread.
    name: anyllm-workspace-thread-chat
  - arguments:
    - description: Name of the workspace.
      name: workspace
    - description: Name of the thread.
      name: thread
    description: Delete a thread in a workspace.
    name: anyllm-workspace-thread-delete
  - arguments:
    - description: Name of the workspace.
      name: workspace
      required: true
    - description: Thread to delete.
      name: thread
    description: Get the conversation for a workspace thread.
    name: anyllm-workspace-thread-chats
  - arguments:
    - description: AIRS profile name to use in scanning.
      name: profile_name
      required: true
    - description: AIRS application name - metadata.
      name: app_name
    - description: AIRS application user name - metadata.
      name: app_user
    - description: LLM model in use - metadata.
      name: ai_model
    - description: User IP - metadata.
      name: user_ip
    - description: LLM prompt to scan.
      name: prompt
    - description: LLM response to scan.
      name: response
    - description: LLM prompt with code to scan.
      name: code_prompt
    - description: LLM response with code to scan.
      name: code_response
    - description: LLM context for grounding.
      name: context
    description: Perform an AI security scan of a request with AIRS.
    name: anyllm-scan-request
  dockerimage: demisto/python3:3.12.13.8319994
  runonce: false
  subtype: python3
fromversion: 6.10.0
tests:
- No tests (auto formatted)