diff --git a/CLOSEDAI.mkd b/CLOSEDAI.mkd index e8b6201..f875c13 100644 --- a/CLOSEDAI.mkd +++ b/CLOSEDAI.mkd @@ -1,8 +1,8 @@ Special Tokens - **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. - **\ (End of Sequence)**: Tells the model when to stop generating text or processing. - **\ (Padding Token)**: Pads sequences to the same length for batch processing. - **\ (Unknown Token)**: Represents words not in the model's vocabulary. - **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. - **\ (Separator Token)**: Separates different segments in input, like questions from context. +- **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. +- **\ (End of Sequence)**: Tells the model when to stop generating text or processing. +- **\ (Padding Token)**: Pads sequences to the same length for batch processing. +- **\ (Unknown Token)**: Represents words not in the model's vocabulary. +- **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. +- **\ (Separator Token)**: Separates different segments in input, like questions from context.