We're having an issue with either missing from the output when running prep flows.
To provide some context - we have an area that uses the combination of 5 prep flows as it's data source. So for example; prep flow #1 runs, the output is of that flow is a published data source on server. Then prep flow #2's data source is the output from prep flow #1, so on and so forth. Prep flow #1 is using csvs as its data source, where 2-4 are using the published data sources from the step before.
The problem that we're running into is that the output of the prep flows is producing a much smaller row count than it should be, especially when we run the flows on server. For example, prep flow #1 should produce at LEAST 12 million rows, but on server it shows that it's only producing 8 million. This occurs on multiple prep flows (another example is that prep flows #1-4 will produce the expected numbers fine, but then prep flow #5 should have at least 30 rows, and it only has 10.)
The flow also doesnt produce any errors. According to server, it ran as expected without any issues.
When we try running locally and publishing to a csv rather than publishing to server, sometimes it works as expected and produces the full row count, sometimes it runs and does not produce the full row count - but again doesnt show any errors, and sometimes it errors out with a generic error that says "System error: TableauException: No details available. DataServiceFailure"
We've tried deleting our prep logs locally, as well as removing and re-adding the connection details on server. We're using 2022.3
@Savanah F
Hi, Two questions:
a. What happens if you create an initial flow (let's call it flow 0), to convert your csvs to published data sources, and then in the flow 1, use the published data sources, so flow 1 does not use CSVs?
b. In your flow 1, you are using CSVs, and I guess you are using some date conversions and maybe filters. If this is the case, are you using the correct locale in the input modules, or in subsequent clean steps, are you using DATEPARSE instead of the automatic date conversion?
c. Are you using Tableau Server or Cloud? When you obtain the DataServiceFailure, are you obtaining it in Server/Cloud or in Tableau Prep Builder?
If this post resolves the question, would you be so kind to "Select as Best"?. This will help other users find the same answer/resolution and help community keep track of answered questions. Thank you.
Regards,
Diego Martinez
Tableau Visionary and Forums Ambassador
