diff --git a/CLOSEDAI.mkd b/CLOSEDAI.mkd index 2db6d63..e8b6201 100644 --- a/CLOSEDAI.mkd +++ b/CLOSEDAI.mkd @@ -1,8 +1,8 @@ Special Tokens -1. **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. -2. **\ (End of Sequence)**: Tells the model when to stop generating text or processing. -3. **\ (Padding Token)**: Pads sequences to the same length for batch processing. -4. **\ (Unknown Token)**: Represents words not in the model's vocabulary. -5. **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. -6. **\ (Separator Token)**: Separates different segments in input, like questions from context. + **\ (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing. + **\ (End of Sequence)**: Tells the model when to stop generating text or processing. + **\ (Padding Token)**: Pads sequences to the same length for batch processing. + **\ (Unknown Token)**: Represents words not in the model's vocabulary. + **\ (Mask Token)**: Used in tasks like predicting missing words in masked language models. + **\ (Separator Token)**: Separates different segments in input, like questions from context.