[codex] docs: clarify deduplication input discovery#2130

lbliii wants to merge 4 commits into

NVIDIA-NeMo:mainNVIDIA-NeMo/Curator:mainfrom

lbliii:codex/docs-dedup-input-defaultslbliii/NeMo-Curator:codex/docs-dedup-input-defaultsCopy head branch name to clipboard