Learn How Salesforce Uses Large Language Models
Learning Objectives
After completing this unit, you’ll be able to:
- Explain how Salesforce brings trust to LLMs
- Choose the correct LLM option for your business.
- Describe the limitations of the available LLM options.
Leading with Trust
Trust is the number one value at Salesforce. So it makes sense that Salesforce requires using Large Language Models (LLMs) in a secure and trusted way. And the key to maintaining this trust is through the Einstein Trust Layer. The Einstein Trust Layer ensures generative AI is secure by using data and privacy controls that are seamlessly integrated in the Salesforce end-user experience. These controls let Einstein deliver AI that securely uses retrieval augmented generation (RAG) to ground your customer and company data, without introducing potential security risks. In its simplest form, the Einstein Trust Layer is a sequence of gateways and retrieval mechanisms that together enable trusted and open generative AI.
Trusted Salesforce Agents
Agentforce agents use leading LLMs through the Einstein Trust Layer by using RAG to build secure prompts with Salesforce and Data Cloud data. This creates a rich and secure environment to use AI agents capable of supporting employees and customers. These agents don't just offer suggestions—they can complete tasks independently. For example, they can handle customer inquiries, troubleshoot issues, and even make sales recommendations without human intervention. All while using the Trust Layer to secure the data and provide confident responses.
Choose the Best Large Language Model
Choosing the right model for the right task will help you get started with generative AI faster. Salesforce provides deployment capabilities for any relevant LLM while also helping companies maintain their data privacy, security, residency, and compliance goals.
Many LLMs may need to be used depending on different use cases. Customers will want to deploy LLMs in different ways because they may have certain data residency concerns.
Use Salesforce Shared LLMs
Salesforce shared LLMs are a way to access LLMs across the internet. Salesforce pioneered this with our partner OpenAI. Salesforce uses a secure gateway to travel across the internet to ask its amazing LLMs for a response.
Einstein lets customers use Salesforce LLMs developed by Salesforce AI Research to power advanced capabilities, such as code generation and business process automation assistance, fundamentally transforming how businesses interact with their CRM software. Salesforce LLMs, including CodeGen, CodeT5+, and CodeTF, help companies increase productivity, bridge the talent gap, reduce the cost of implementations, and better detect incidents.
Use Salesforce Hosted Third-Party LLMs
You can also host models inside Salesforce.
As part of Salesforce’s commitment to an open ecosystem, Einstein is designed to host LLMs from Amazon, Anthropic, Cohere, and others—entirely within the Salesforce infrastructure. Einstein will help maintain customer prompts and responses in the Salesforce infrastructure. In addition, Salesforce and OpenAI have established a shared trust partnership to deliver content through the Einstein Trust Layer.
Bring Your Own Model
If you are already investing in your own model, the bring your own model (BYOM) option can help.
You can benefit from Einstein even if you’ve trained your own domain-specific models outside of Salesforce while storing data on your own infrastructure. These models, whether running through Amazon SageMaker or Google Vertex AI, will connect directly to Einstein through the Einstein Trust Layer. In this scenario, customer data can remain within the customers’ trust boundaries.
The BYOM options are changing and fast! Keep an eye on the resources for new updates.
Resources
- Trailhead: The Einstein Trust Layer
- Trailhead: Large Language Model Data Masking in the Einstein Trust Layer
- Trailhead: Retrieval Augmented Generation: Quick Look
- Salesforce Help: Einstein Trust Layer: Designed for Trust
- Salesforce Help: Bring Your Own Model
- Trailhead: Prepare Your Data for AI
- Salesforce News & Insights: Salesforce Announces AI Cloud–Bringing Trusted Generative AI to the Enterprise
- Trailhead: Get Started with Artificial Intelligence
- Salesforce The 360 Blog: 4 Ways Large Language Models Help You Do More With Customer Data
- Help About Salesforce Data Cloud: Bring Your Own Model
- News and Insights: Salesforce Launches BYOM to Make It Easy for Businesses to Use Proprietary Data to Build and Deploy AI Models
- Developers’ Blog: Bring Your Own AI Models to Data Cloud