Hello, community! 😊
I am starting in the world of Data Cloud and would like to better understand how credit consumption works.
I have already read part of the documentation, but I have these questions:
- I mainly require these six processes (usage types): Data Pipeline (Batch), Data Transforms (Batch), Profile Unification, Calculated Insights, Data Queries, Segmentation, and Activation. I have 5 million records (across different objects) that would be loaded initially, with an additional 50,000 records per day (new records). Is it possible to schedule these processes separately to run at different intervals? For example: running Data Pipeline, Data Transforms, and Profile Unification monthly, and Calculated Insights and Activation daily? This is to minimize credit usage.
- Another question: Does the Data Pipeline and Data Transform only process the incremental data, meaning new or modified records?
Thank you.
,
Since you mentioned you are using Health Cloud, may I assume you are using the standard CRM Data Connector to bring data into Salesforce? If so, the ingest schedule is automatic and from what I know, you cannot control it at this time.
With Identity Resolution, you have a greater degree of control. What you may be to Individual object for matching or reconcilliation can make a big difference in how often IR rules trigger. You have data architect design decisions that can make on whether something is pre-calculated before the DMO or is a calculated insight. Rule of thumb, map things to Individual or Account if they are used in matching or if they
mustbe reconciled.
In general, monitor your consumption in a controlled setting for a couple of weeks using a deliberate sample set. That's how you will
know vs guessing what the cost to build the unified view would be. While consumption tracking to the "right" of DMO and Calculated Insights is harder, that's valuevs. cost, so hopefully easier to manage.
Are you coming to TDX? If so, we'll likely dive deeper into these topics.
