From b4ae7aa21d81f170a388129dd1b38fb105087cca Mon Sep 17 00:00:00 2001 From: pliny <133052465+elder-plinius@users.noreply.github.com> Date: Sun, 15 Sep 2024 23:23:05 -0400 Subject: [PATCH] Update CLOSEDAI.mkd --- CLOSEDAI.mkd | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/CLOSEDAI.mkd b/CLOSEDAI.mkd index e8b6201..f875c13 100644 --- a/CLOSEDAI.mkd +++ b/CLOSEDAI.mkd @@ -1,8 +1,8 @@ Special Tokens - **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. - **\ (End of Sequence)**: Tells the model when to stop generating text or processing. - **\ (Padding Token)**: Pads sequences to the same length for batch processing. - **\ (Unknown Token)**: Represents words not in the model's vocabulary. - **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. - **\ (Separator Token)**: Separates different segments in input, like questions from context. +- **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. +- **\ (End of Sequence)**: Tells the model when to stop generating text or processing. +- **\ (Padding Token)**: Pads sequences to the same length for batch processing. +- **\ (Unknown Token)**: Represents words not in the model's vocabulary. +- **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. +- **\ (Separator Token)**: Separates different segments in input, like questions from context.