Overview of External mode for ElementsGPT
We have developed a new mode for ElementsGPT AI features where you can connect to your own API endpoint that uses the Salesforce Trust Layer. This allows you to feel secure in the use of your data with AI, is it uses a connection that you own where you can choose the model providers and settings.
This setting supports the following AI features in Elements:
User story generation from a diagram
Diagram generation from text
Agentforce test generation from a diagram
The following features are currently inactive when using the Trust Layer connection:
Elements diagram generation using images (text generation is still supported)
Prerequisites
Corporate Management set up for your domain
External mode for GPT turned on for your Corporate Management
Endpoint specified with Client ID and secret (see below)
External Mode for GPT in Corporate Management
When External mode is active on Corporate Management it is active by default on all spaces within that Corporate domain. If you turn external mode off, it then is turned off for all contained spaces too. There is currently no option to select specific spaces within the domain to have External mode activated.
How does it work?
When External mode is active, Elements will connect to your specified API endpoint, and does not use our own AI / LLM connections.
You must specify an endpoint that allows us to connect to an LLM such as OpenAI's GPT 4o or similar. If you want this to go via the Trust Layer for security reasons, this can be done using the Models API from Salesforce.
Configuring External Mode
To see and change the External mode settings you must be a Corporate Admin in the space.
Setting up endpoints and authentication
To use External mode you must specify 2 key endpoints: one for the OAuth token to be retrieved, and one for the data to be sent to (i.e the application).
We use OAuth authentication to validate the API request.
The token response should look something like this:
{ access_token: String,
expires_in: Number // time to live (TTL), in seconds }
Navigate to Corporate Settings, open the "Config" tab (6th icon down on the left) and navigate to "External Settings"(third tab along the top).
You will need to provide the following information to set up the connection to your LLM endpoint:
1: External GPT OAuth URL
This is the URL for OAuth authentication so Elements can request a bearer token to access the application.
2: External GPT URL
The URL endpoint of the API.
3. External GPT Client Id
The Client Id for your endpoint.
4. External GPT Secret
The Client Secret for your endpoint.
Once provided, press "Submit" to save the details. You can change or delete the details at any time. If you delete the details and do not provide new ones, the AI features will not work until new valid information is submitted.
Configuring Permissions
When ExternalGPT is active, the default is for all new spaces within your domain to use your external LLM application.
However, there are 2 ways that you can disable specific spaces from using it so that the full ElementsGPT capability is available. This can allow you or other users to still benefit from and explore all the other AI capabilities in Elements.
Disable for a single space
To disable ExternalGPT on a specific space you must have Corporate Admin permissions. Then complete the following steps:
Open Corporate Settings
Open the "Spaces" tab from the list on the left hand side
Navigate to the Space you want to turn ExternalGPT off for
Select the Space, and in the right hand panel, open the 3rd tab down with the fingerprint icon ("Access" tab).
Toggle on "Disable External GPT for space"
This space now has access to all the standard ElementsGPT functionality, and does not use your external application for LLM calls.
This action can be reversed.
Disable for all spaces
If you decide that you want to disable or enable the feature for all spaces under your Corporate domain, you can go to "Policies". Turn the toggle on for "Disable External GPT for all spaces". Once this is done all spaces will no longer use External GPT. If you turn it back on, all spaces will use External GPT. Note that it will not remember the previous settings if you had some spaces with the feature overridden/disabled.
For further assistance you can contact us using the blue chat box in the bottom right hand corner of the screen, or email us at success@elements.cloud.