Solved

Is there any way to sort records?

  • 8 February 2022
  • 1 reply
  • 62 views

Userlevel 5
Badge

Is there any way to sort records?

icon

Best answer by Drew Kreiger 8 February 2022, 22:00

View original

1 reply

Userlevel 5
Badge

If you are using the Transformer engine, there is a sort processor. Transformer processes entire datasets at a time. In Data Collector, the data is processed in micro batches based on the batch size you provide, so sorting would only happen on that batch. Typically, you would sort the data when you are reporting on the data after it is loaded. If you are using files as an origin, you could use the linux sort command to sort the file before processing.


 

Reply