Skip to main content
Join us at TDX in San Francisco or on Salesforce+ on March 5-6 for the Developer Conference for the AI Agent Era. Register now.

Learn How Salesforce Uses Large Language Models

Learning Objectives

After completing this unit, you’ll be able to:

  • Explain how Salesforce brings trust to LLMs
  • Choose the correct LLM option for your business.
  • Describe the limitations of the available LLM options.

Leading with Trust

Trust is the number one value at Salesforce. So it makes sense that Salesforce requires using Large Language Models (LLMs) in a secure and trusted way. And the key to maintaining this trust is through the Einstein Trust Layer. The Einstein Trust Layer ensures generative AI is secure by using data and privacy controls that are seamlessly integrated in the Salesforce end-user experience. These controls let Einstein deliver AI that securely uses retrieval augmented generation (RAG) to ground your customer and company data, without introducing potential security risks. In its simplest form, the Einstein Trust Layer is a sequence of gateways and retrieval mechanisms that together enable trusted and open generative AI.

Trusted Salesforce Agents

Agentforce agents use leading LLMs through the Einstein Trust Layer by using RAG to build secure prompts with Salesforce and Data Cloud data. This creates a rich and secure environment to use AI agents capable of supporting employees and customers. These agents don't just offer suggestions—they can complete tasks independently. For example, they can handle customer inquiries, troubleshoot issues, and even make sales recommendations without human intervention. All while using the Trust Layer to secure the data and provide confident responses.

Choose the Best Large Language Model

Choosing the right model for the right task will help you get started with generative AI faster. Salesforce provides deployment capabilities for any relevant LLM while also helping companies maintain their data privacy, security, residency, and compliance goals.

Many LLMs may need to be used depending on different use cases. Customers will want to deploy LLMs in different ways because they may have certain data residency concerns.

The Right LLM for the Right Task. Shared Trust: Data retained in Salesforce with joint moderation. Salesforce Hosted: Globally on Hyperforce, AWS, Anthropic, Salesforce, Cohere. Bring Your Own Model: Your model, your infrastructure, Amazon SageMaker, Vertex AI.

Use Salesforce Shared LLMs

Salesforce shared LLMs are a way to access LLMs across the internet. Salesforce pioneered this with our partner OpenAI. Salesforce uses a secure gateway to travel across the internet to ask its amazing LLMs for a response.

Einstein lets customers use Salesforce LLMs developed by Salesforce AI Research to power advanced capabilities, such as code generation and business process automation assistance, fundamentally transforming how businesses interact with their CRM software. Salesforce LLMs, including CodeGen, CodeT5+, and CodeTF, help companies increase productivity, bridge the talent gap, reduce the cost of implementations, and better detect incidents.

Use Salesforce Hosted Third-Party LLMs

You can also host models inside Salesforce.

As part of Salesforce’s commitment to an open ecosystem, Einstein is designed to host LLMs from Amazon, Anthropic, Cohere, and others—entirely within the Salesforce infrastructure. Einstein will help maintain customer prompts and responses in the Salesforce infrastructure. In addition, Salesforce and OpenAI have established a shared trust partnership to deliver content through the Einstein Trust Layer.

Bring Your Own Model

If you are already investing in your own model, the bring your own model (BYOM) option can help.

You can benefit from Einstein even if you’ve trained your own domain-specific models outside of Salesforce while storing data on your own infrastructure. These models, whether running through Amazon SageMaker or Google Vertex AI, will connect directly to Einstein through the Einstein Trust Layer. In this scenario, customer data can remain within the customers’ trust boundaries.

The BYOM options are changing and fast! Keep an eye on the resources for new updates.

Resources

Share your Trailhead feedback over on Salesforce Help.

We'd love to hear about your experience with Trailhead - you can now access the new feedback form anytime from the Salesforce Help site.

Learn More Continue to Share Feedback