Informational and error messages display in a different location based on the type of information:
Pipeline configuration issues
The Data Collector console provides guidance and error details in the console as follows:- Issues found by implicit validation are displayed in the Issues list.
- An error icon displays at the stage where the problem occurs or on the canvas for pipeline configuration issues.
- Issues discovered by explicit validation are displayed in a warning message on the canvas.
Runtime error information
You can view error information when you monitor a running pipeline. On the pipeline, the console displays error record counts for each stage generating error records.
On the Errors tab, you can view error record statistics and the latest set of error records with error messages. If the error was produced by an exception, you can click View Stack Trace to view the full stack trace.
Error record information
You can use the Error Records pipeline properties to write error records and related details to a file or Kafka. The information in the following fields can help you determine the problem that occurred:- errorStage - The stage in the pipeline that generated the error.
- errorCode - The error code associated with the error message.
- errorMessage - The text of the error message.
Data Collector errors
You can view information and errors related to the general Data Collector functionality in the Data Collector log. You can view or download the logs from the Data Collector console. For details, see Viewing Data Collector Logs.
