Set Up Testing Criteria

Learning Objectives

After completing this unit, you’ll be able to:

• Explain how to get the testing template.
  
• Describe the different parts of test criteria.
  

What to Test

Testing is all about making sure you achieve an acceptable level of risk for your agent. After testing and troubleshooting your agent manually in Agentforce Builder, you’ve updated the instructions, topics, actions, filters, and guardrails based on those test results. Now, you can use the Agentforce Testing Center to store those tests and run them over and over again.

Your customers put your agents to the test because they want answers to their every question. Hackers, and sometimes even employees, might try to get around restrictions and attempt to perform tasks or manipulate the model’s output in ways that the model wasn’t designed‌ for. These scenarios get added to the tests in the Agentforce Testing Center.

The trick is to try and predict the types of questions they’re going to ask. You should try to cover every angle, every possibility. That’s what you’re designing your tests to cover.

You can expect to find errors or at least issues as you start testing. Test for positive, expected results. Then test for negative, unexpected, or even invalid results. You want to be sure the agent responds correctly to even the most wrong requests. This is called positive and negative testing. It makes for a more robust test suite.

Here's an example: While testing an agent email input, test for the correct email response. This is testing the positive, valid, and expected behavior. But don’t stop there. Test for an incorrect email input to the agent, and be sure the correct response for that scenario is returned. This is testing the negative, invalid, and unexpected behavior.

While this can sound like a daunting task, doing your due diligence pays off in the end. Ready to get started?

Sign Up for a Developer Edition Org with Agentforce Testing Center

To complete this module, you need a special Developer Edition org that contains Agentforce Testing Center and our sample data. Get the free Developer Edition and connect it to Trailhead now so you can complete the challenges in this module. Note that this Developer Edition is designed to work with the challenges in this badge, and might not work for other badges. Always check that you’re using the Trailhead Playground or special Developer Edition org that we recommend.

When you’re finished completing the step-by-step instructions, click Check Challenge to Earn 500 Points at the bottom of the page.

1. Sign up for a free Developer Edition org with Agentforce Testing Center.
   
2. Fill out the form:
   
   • For Email, enter an active email address.
     
   • For Username, enter a username that looks like an email address and is unique, but it doesn't need to be a valid email account (for example, yourname@example.com).
     
3. After you fill out the form, click Sign me up. A confirmation message appears.
   
4. When you receive the activation email (this might take a few minutes), open it and click Verify Account.
   
5. Complete your registration by setting your password and challenge question. Tip: Save your username, password, and login URL in a secure place—such as a password manager—for easy access later.
   
6. You are logged in to your Developer Edition.
   

Now connect your new Developer Edition org to Trailhead.

1. Make sure you're logged in to your Trailhead account.
   
2. In the Challenge section at the bottom of this page, click the org name and then click Connect Org.
   
3. On the login screen, enter the username and password for the Developer Edition you just set up.
   
4. On the Allow Access? screen, click Allow.
   
5. On the Want to connect this org for hands-on challenges? screen, click Yes! Save it. You are redirected back to the challenge page and ready to use your new Developer Edition to earn this badge.
   

Turn on Agentforce

1. Click the Setup icon , then click Setup.
   
2. In the Quick Find box, search for and select Einstein Setup.
   
3. Toggle the Turn on Einstein switch to On.
   
   
   

4. Refresh your browser.
   
5. In the Quick Find box, search for and select Agentforce Agents under Agentforce Studio. If you can’t find the Agentforce Agents page, refresh the browser and try again.
   
6. At the top of the Agentforce Agents page, click the Agentforce toggle, and ensure it is set to On.
   
   
   

7. Click the Enable the Agentforce (Default) Agent toggle, and ensure it is set to On.
   
   
   

8. Refresh the browser.
   

9. Verify that both Agentforce Agents and Enable the Agentforce (Default) Agent are on.
   

Agentforce is now enabled and the Agentforce Testing Center is available. But before we begin testing agents, let’s talk about permissions.

Got Permissions?

The Developer Edition that you’re using for this badge already has the correct permissions set up, but what if they weren’t set up?

Part of creating trust is making sure only the right access is given. Working with Agentforce requires certain permissions. Not only for the Agentforce tools but also for the automations that agents might use. Like access to data, apps, and Apex. Let's start with getting access to Agentforce.

Control access to the Agentforce (Default) agent with type-specific permissions. To use Agentforce (Default), users must have the Access Agentforce Default Agent permission set group or be an admin with the Customize Application permission. Users who previously accessed Agentforce (Default) with only the Modify Metadata permission no longer have access.

To work with the Agentforce Testing Center, these permissions are needed:

• Manage AI Agents and the required permissions for your agent type
  

Or

• Customize Application
  

Create Test Cases

To start crafting the test cases, you need a place to store them so you can upload them into the Agentforce Testing Center. The Agentforce Testing Center has a template you can use to help get you on your way, so let’s start with that. Here’s how you get the testing template.

1. From Setup, in the Quick Find box, search for and select Testing Center.
   
2. Click New Test.
   
3. For Test Name, enter template.
   
4. Select Einstein Copilot - v1 or Agentforce (Default) - v1 for the agent to test.
   
5. Click Next.
   
6. Click Next.
   
7. Click the Template link.
   
   
   
   This downloads a testing_template.csv file to your device.
   

8. Close the New Test without saving. We were just looking for the testing template.
   
9. Open the file in a text editor to see the comma-separated values.
   

CSV files are one of the most common ways to store tabular data. Each value is separated with a comma, and each line is a data record, or a test case. The top row is the header designating what each column is used for by the Agentforce Testing Center. Each question or utterance and its expected outcomes are on a separate line.

Here’s a closer look at the first example from the testing_template.csv file.

The utterance is “Summarize account Acme” and is looking for the expected topic to be OOTBSingleRecordSummary. Notice that the topic is the API name and not the Label for the topic. Utterances are the questions or inquiries that the agent can get. Since an agent can have multiple topics, the Expected Topic is the topic that the utterance should trigger to run.

Then it looks for the expected actions from that topic to be more than just a single action. There can be one or more actions used in generating a response. In this case the expected actions are set in a list denoted with brackets [] and each action is separated with single quotes ‘’ and a comma. The actions for this test case are 'IdentifyRecordByName' and 'SummarizeRecord'. Notice again that the actions in the list are the API names and not the Labels for the actions.

The last column is for the expected response to the actions and is set as a description of what the response should cover.

Now let’s look at another example from the testing template file. The last line is similar to the first, but covers more data since it is looking for all open cases and activities of the Acme account in a certain data range.

When creating your own test criteria, be sure to add utterances for positive and negative results and appropriate topics, actions, and responses. Also, the only required columns are Utterance and at least one other column. Empty values are treated as failures.

Run Your Tests

Once you have created your own test cases in a CSV file, you’re ready to initiate the test. Let’s see how to do that.

Important!

• Running tests consumes requests and credits. See Considerations for Testing Center.
  
• Testing agents can modify CRM data. To avoid issues, be sure to use the Agentforce Testing Center only in your sandbox environment.
  

1. From Setup, in the Quick Find box, search for and select Testing Center.
   
2. Select New Test.
   
3. For Test Name, enter Test Agentforce v1. Note: When you create your own tests, use versions and be specific with the test name so they are easy to discern from other tests and versions.
   
4. Select Einstein Copilot - v1 or Agentforce (Default) - v1.
   You can have more than one agent to select from. Each test only runs against one agent.
   
5. For Description, enter Test cases for Agentforce to verify account summaries and details.
   Descriptions should be natural language describing the types of test cases being run.
   
6. Click Next.
   
7. Test Conditions allows you to specify Context Variables that are used in your tests by the agents when they need input values. For this test, we won’t need to use them. Click Next.
   
8. Click Upload Files and select the testing_template.csv test file.
   
   
   

9. Click Done.
   
10. Click Next.
    
11. Click Save & Run.
    
    
    

Way to go! You created your first test in the Agentforce Testing Center. You also gained an insight into the working of the test file and test parameters. In the next unit, you take a look at using AI to generate your tests.

Make sure to click Check Challenge to Earn 500 Points before moving on to the next unit.

Resources

• Salesforce News & Insights: Salesforce Introduces Agentforce Testing Center
• Trailhead: The Einstein Trust Layer
• Salesforce Help: Agentforce Testing Center Create a Test