Unable to Access PDF Content in Data Cloud Data Explorer Using Azure Blob Storage and UDLO

Subject: Unable to Access PDF Content in Data Cloud Data Explorer Using Azure Blob Storage and UDLO

Product:

Salesforce Data Cloud 

Description

We are implementing an integration to ingest PDF files from Dropbox into Salesforce Data Cloud through Azure Blob Storage.

We have configured the Azure Blob Storage connection, created the Unstructured Data Lake Object (UDLO) and Unstructured Data Model Object (UDMO), and configured the search index.

We have also implemented Azure Event Grid notifications and an Azure Function to notify Data Cloud when files are created or deleted in Azure Blob Storage. The ingestion API returns accepted: true, indicating that Data Cloud has accepted the notification.

However, we are unable to verify that the actual PDF content has been processed and made available for retrieval through Agentforce.

The UDLO displays the PDF file metadata, and the search index status is Ready. However, we need clarification on how to access and validate the extracted PDF content and generated chunks in Data Cloud.

We found a similar issue discussed in the Salesforce Trailblazer Community: Not able to ingest the Unstructured (PDF) data from Azure.

Current Configuration

1. Azure Blob Storage is configured as the source for PDF files.
2. The Azure connection and SAS authentication are configured.
3. A UDLO is created with the directory path and PDF file pattern (*.pdf).
4. The UDLO is mapped to a UDMO.
5. A search index is configured on the UDMO.
6. Azure Event Grid is configured to notify Data Cloud about file creation and deletion events.
7. An Azure Function sends notifications to the Data Cloud unstructured ingestion API.
8. The API returns accepted: true.
9. PDF file metadata is visible in the UDLO, and the search index status is Ready.

Issue

Although the PDF files are listed in the UDLO and the search index shows a Ready status, we need to confirm whether the actual PDF text has been extracted, processed into searchable chunks, and made available through the configured retriever.

We also need guidance on how to validate the generated chunks and retrieve the PDF content through Agentforce.

Assistance Required

Could you please help us clarify the following?

1. What is the expected processing workflow for extracting PDF content from Azure Blob Storage when using a UDLO and UDMO?
2. How can we verify that the PDF text has been extracted and that the corresponding chunk objects have been generated successfully?
3. Is it expected that unstructured PDF content will not appear in Data Explorer in the same way as structured CSV data?
4. If the search index status is Ready but the PDF content is not retrievable, what additional configurations or troubleshooting steps should we perform?
5. How should we configure and validate the search index and retriever so that Agentforce can retrieve relevant PDF content and generate answers based on the documents?
6. Are there any additional permissions, file notification requirements, ingestion steps, or processing delays that could prevent PDF content from becoming searchable?

Expected Outcome

We would like to confirm that PDF content is being processed correctly in Data Cloud and obtain the recommended configuration and troubleshooting steps required to retrieve relevant PDF passages through Agentforce.

Please provide guidance on the expected behavior of UDLO, UDMO, search index processing, generated chunks, and retriever configuration for unstructured PDF data stored in Azure Blob Storage.