AnythingLLM

Retrieval Augmented Generation (RAG) with LLM and Vector DB that can be local for full data privacy or cloud-based for greater functionality. Prompts and responses can be scanned for security issues using Prisma Airs. APIs are documented at: <Anything LLM URL> /api/docs Product documentation: https://docs.useanything.com/

Utilities · Anything LLM

Details

IDAnythingLLM
ProviderMintplex Labs Inc
CategoryUtilities
From Version6.10.0
Docker Imagedemisto/python3:3.12.13.8319994
Supported ModulesAgentix XSIAM

README

Retrieval Augmented Generation (RAG) with LLM and Vector DB that can be local for full data privacy or cloud-based for greater functionality

Configure AnythingLLM in Cortex

Parameter Description Required
AnythingLLM URL (e.g., http://<url to local AnythingLLM>:3001) or https://<Anything LLM cloud url>   True
AnythingLLM API Key   True
Cloudflare Access Client Id   False
Cloudflare Access Client Secret   False
AIRS API URL Leave blank if AIRS is not being used False
AIRS API Key Leave blank if AIRS is not being used False
Sync Scan LLM Prompts with AIRS Have AIRS scan all LLM prompts and throw exeception if BLOCK is returned False
Sync Scan LLM Response with AIRS Have AIRS scan all LLM responses and throw exeception if BLOCK is returned False
AIRS Profile Name for Scan Requests The profile must be created in the AIRS console False
AIRS Application Name for Scan Requests Provide an application name to identify XSOAR scan requests in AIRS False
AIR User for Scan Requests Provide a user name to include in XSOAR scan requests in AIRS False
Anything LLM Model in use Provide the LLM model being used for scan requests in AIRS False

Commands

You can execute these commands from the CLI, as part of an automation, or in a playbook.
After you successfully execute a command, a DBot message appears in the War Room with the command details.

anyllm-document-upload-file

Uploads an XSOAR file entry to the custom-documents folder.

Base Command

anyllm-document-upload-file

Input

Argument Name Description Required
fileentry XSOAR file entry to upload - example: 181@24789. Required

Context Output

There is no context output for this command.

anyllm-document-upload-link

Uploads a web link to the custom-documents folder

Base Command

anyllm-document-upload-link

Input

Argument Name Description Required
link Web link to upload - example: https://unit42.paloaltonetworks.com/darkgate-malware-uses-excel-files”. Required
title No description provided. Required
description No description provided. Required
author No description provided. Required
source No description provided. Required

Context Output

There is no context output for this command.

anyllm-document-upload-text

Upload text content as a document to the custom-documents folder

Base Command

anyllm-document-upload-text

Input

Argument Name Description Required
text Raw text content that is the document. Required
title Document title to use when uploading. Required
description Description of the document. Optional
author Author of the document. Optional
source Source of the document. Optional

Context Output

There is no context output for this command.

anyllm-workspace-new

Creates a new workspace in AnythingLLM

Base Command

anyllm-workspace-new

Input

Argument Name Description Required
workspace Name of the workspace to create. Required

Context Output

There is no context output for this command.

anyllm-workspace-delete

Deletes an AnythingLLM workspace

Base Command

anyllm-workspace-delete

Input

Argument Name Description Required
workspace Name of the workspace to delete. Required

Context Output

There is no context output for this command.

anyllm-workspace-list

List all the workspaces in AnythingLLM

Base Command

anyllm-workspace-list

Input

| Argument Name | Description | Required |
| — | — | — |

Context Output

There is no context output for this command.

anyllm-workspace-get

Get a specific workspace details

Base Command

anyllm-workspace-get

Input

Argument Name Description Required
workspace Name of the workspace. Required

Context Output

There is no context output for this command.

anyllm-workspace-settings

Update workspace settings

Base Command

anyllm-workspace-settings

Input

Argument Name Description Required
workspace Name of the workspace. Required
settings JSON object for the settings. Required

Context Output

There is no context output for this command.

anyllm-workspace-add-embedding

Add a document to a workspace and create its vector embedding in the workspace

Base Command

anyllm-workspace-add-embedding

Input

Argument Name Description Required
workspace Name of the workspace. Required
folder Folder name containing the document. Required
document Document name to add as an embedding. Required

Context Output

There is no context output for this command.

anyllm-workspace-delete-embedding

Delete a document embedding from the workspace

Base Command

anyllm-workspace-delete-embedding

Input

Argument Name Description Required
workspace Name of the workspace. Required
folder Folder the document originated from. Required
document Name of the document to have its embedding deleted. Required

Context Output

There is no context output for this command.

anyllm-document-createfolder

Create a new document folder

Base Command

anyllm-document-createfolder

Input

Argument Name Description Required
folder Name of the folder to create. Required

Context Output

There is no context output for this command.

anyllm-document-move

Move a document from a source folder to a destination folder

Base Command

anyllm-document-move

Input

Argument Name Description Required
srcfolder Name of the source folder. Required
dstfolder Name of the destination folder. Optional
document Document name to move. Optional

Context Output

There is no context output for this command.

anyllm-document-delete

Delete a document

Base Command

anyllm-document-delete

Input

Argument Name Description Required
folder Name of the folder. Required
document Name of the document to delete. Required

Context Output

There is no context output for this command.

anyllm-workspace-chat

Send a chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

Base Command

anyllm-workspace-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
message Message to send. Required
mode Mode to chat, query or chat. Possible values are: query, chat. Required
format No description provided. Possible values are: markdown, dictionary. Default is dictionary. Optional

Context Output

There is no context output for this command.

anyllm-workspace-stream-chat

Send a stream chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general

Base Command

anyllm-workspace-stream-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
message Message to send. Required
mode Chat mode, query or chat. Possible values are: query, chat. Optional

Context Output

There is no context output for this command.

anyllm-document-list

List all document details

Base Command

anyllm-document-list

Input

| Argument Name | Description | Required |
| — | — | — |

Context Output

There is no context output for this command.

anyllm-document-get

Get a specific document details

Base Command

anyllm-document-get

Input

Argument Name Description Required
folder Folder containing the document. Required
document Document name. Required

Context Output

There is no context output for this command.

anyllm-workspace-pin

Set the pinned status of a document embedding

Base Command

anyllm-workspace-pin

Input

Argument Name Description Required
workspace Workspace name. Required
folder Folder the document originated from. Required
document Document name. Required
status Set pin status to true or false. Possible values are: true, false. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-chats

Get the conversation for a workspace thread

Base Command

anyllm-workspace-thread-chats

Input

Argument Name Description Required
workspace No description provided. Required
thread No description provided. Optional

Context Output

There is no context output for this command.

anyllm-workspace-thread-chat

Send a chat a message to a conversation thread

Base Command

anyllm-workspace-thread-chat

Input

Argument Name Description Required
workspace Name of the workspace. Required
thread Name of the conversation thread. Required
message Message to send. Required
mode Mode to chat, query or chat. Possible values are: query, chat. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-new

Create a new conversation thread

Base Command

anyllm-workspace-thread-new

Input

Argument Name Description Required
workspace Name of the workspace. Required
thread Name of the new conversation thread. Required

Context Output

There is no context output for this command.

anyllm-workspace-thread-delete

Delete a thread in a workspace

Base Command

anyllm-workspace-thread-delete

Input

Argument Name Description Required
workspace Name of the workspace. Optional
thread Name of the thread. Optional

Context Output

There is no context output for this command.

anyllm-scan-request

Perform an AI security scan of a request with AIRS

Base Command

anyllm-scan-request

Input

Argument Name Description Required
profile_name AIRS profile name to use in scanning. Required
app_name AIRS application name - metadata. Optional
app_user AIRS application user name - metadata. Optional
ai_model LLM model in use - metadata. Optional
user_ip User IP - metadata. Optional
prompt LLM prompt to scan. Optional
response LLM response to scan. Optional
code_prompt LLM prompt with code to scan. Optional
code_response LLM response with code to scan. Optional
context LLM context for grounding. Optional

Context Output

The context data returned from a scan request is:

Key Value
action block or allow
category malicious etc
profile_id ID of the AIRS profile used
profile_name Name of the AIRS profile used
prompt_detected Details of a prompt detection - dictionary
response_detected Details of a response detection - dictionary
scan_id Scan ID
tr_id TR ID

Configuration parameters

  • url — AnythingLLM URL (e.g., http://<url to local AnythingLLM>:3001) or https://<Anything LLM cloud url> (required)
  • apikey — AnythingLLM API Key (required)
  • cf_auth — Cloudflare Access Client Id
  • airs_url — AIRS API URL
  • airs_apikey —
  • airs_scan_prompt — Sync Scan LLM Prompts with AIRS
  • airs_scan_response — Sync Scan LLM Response with AIRS
  • airs_profile — AIRS Profile Name for Scan Requests
  • airs_app — AIRS Application Name for Scan Requests
  • airs_user — AIR User for Scan Requests
  • airs_model — Anything LLM Model in use

Commands (23)

  • anyllm-document-createfolder

    Create a new document folder.

  • anyllm-document-delete

    Delete a document.

  • anyllm-document-get

    Get a specific document details.

  • anyllm-document-list

    List all document details.

  • anyllm-document-move

    Move a document from a source folder to a destination folder.

  • anyllm-document-upload-file

    Uploads an XSOAR file entry to the custom-documents folder.

  • anyllm-document-upload-link

    Uploads a web link to the custom-documents folder.

  • anyllm-document-upload-text

    Upload text content as a document to the custom-documents folder.

  • anyllm-scan-request

    Perform an AI security scan of a request with AIRS.

  • anyllm-workspace-add-embedding

    Add a document to a workspace and create its vector embedding in the workspace.

  • anyllm-workspace-chat

    Send a chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

  • anyllm-workspace-delete

    Deletes an AnythingLLM workspace.

  • anyllm-workspace-delete-embedding

    Delete a document embedding from the workspace.

  • anyllm-workspace-get

    Get a specific workspace details.

  • anyllm-workspace-list

    List all the workspaces in AnythingLLM.

  • anyllm-workspace-new

    Creates a new workspace in AnythingLLM.

  • anyllm-workspace-pin

    Set the pinned status of a document embedding.

  • anyllm-workspace-settings

    Update workspace settings. Anything LLM APIs are documented at: <URL>/api/docs.

  • anyllm-workspace-stream-chat

    Send a stream chat message to a workspace (default thread). Query mode is based on embedded documents in chat, whereas chat mode is more general.

  • anyllm-workspace-thread-chat

    Send a chat a message to a conversation thread.

  • anyllm-workspace-thread-chats

    Get the conversation for a workspace thread.

  • anyllm-workspace-thread-delete

    Delete a thread in a workspace.

  • anyllm-workspace-thread-new

    Create a new conversation thread.

Source

AnythingLLM.py AnythingLLM_test.py AnythingLLM.yml AnythingLLM_description.md
Download History Raw 
## AnythingLLM
- Install AnythingLLM on a Windows/Linux/Mac host
- In AnythingLLM, generate an API key in AnythingLLM
- In the integration instance, configure the **url** parameter to the AnythingLLM host
- In the integration instance, configure the **apikey** parameter