Skip to content

Commit 259ad1b

Browse files
Added UnicodeReformatter import in docs/curate-text/process-data/content-processing/index.md
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by: Kunal Sachdev <kunalmgsachdev@gmail.com>
1 parent bc596ad commit 259ad1b

File tree

1 file changed

+1
-0
lines changed
  • docs/curate-text/process-data/content-processing

1 file changed

+1
-0
lines changed

docs/curate-text/process-data/content-processing/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,7 @@ from nemo_curator.pipeline import Pipeline
6666
from nemo_curator.stages.text.io.reader import JsonlReader
6767
from nemo_curator.stages.text.io.writer import JsonlWriter
6868
from nemo_curator.stages.text.modifiers.heuristic import UrlRemover, NewlineNormalizer
69+
from nemo_curator.stages.text.modifiers.unicode import UnicodeReformatter
6970
from nemo_curator.stages.text.modifiers import Modify
7071

7172
# Initialize Ray client

0 commit comments

Comments
 (0)