Über Open CoDE Software Wiki Diskussionen GitLab

Skip to content

Allow disabling merging of duplicates

Adam Reichold requested to merge disable-duplicate-merge into main

During development it can be useful to disable merging of duplicates, for example to avoid log spam when a lot duplicates are merged or when it is relevant to see the original datasets, for example to debug the deduplication process itself.

Using this change, once can for example add

merge_duplicates = false

[auto_classify]
disabled = true

to data/harvester.toml to trigger this.

Merge request reports