Skip to main content

Pipeline unable to delete records from MongoDB destination.


AkshayJadhav
StreamSets Employee
Forum|alt.badge.img

Question: 

One might see their pipeline unable to delete records for MongoDB records even though the sdc.operation.type is configured for delete operation. 

 

Answer:

The DELETE operation takes input as conditions and compares the values in the database. If the conditions are not met, the operation does not trigger. By providing fewer inputs, the DELETE would search and delete the record with the matching condition. 

 

If there are more than one matching records are found, Data Collector uses the default collation that is explained here, https://docs.mongodb.com/manual/reference/method/db.collection.remove/

 

If no collation is specified for the collection or for the operations, MongoDB uses the simple binary comparison used in prior versions for string comparisons.

Did this topic help you find an answer to your question?
This topic has been closed for comments