Record Class MiniMaxTokenizer.AddedToken

java.lang.Object
java.lang.Record
smile.llm.model.minimax.MiniMaxTokenizer.AddedToken
Record Components:
content - the token string.
special - true if the token is a special control token.
Enclosing class:
MiniMaxTokenizer
public static record MiniMaxTokenizer.AddedToken(String content, boolean special) extends Record
One entry of added_tokens in tokenizer.json.

  • Constructor Summary

    Constructors
    Constructor
    Description
    AddedToken(String content, boolean special)
    Creates an instance of a AddedToken record class.

  • Method Summary

    Modifier and Type
    Method
    Description
    String
    content()
    Returns the value of the content record component.
    final boolean
    equals(Object o)
    Indicates whether some other object is "equal to" this one.
    final int
    hashCode()
    Returns a hash code value for this object.
    boolean
    special()
    Returns the value of the special record component.
    final String
    toString()
    Returns a string representation of this record class.

    Methods inherited from class Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

  • Constructor Details

    • AddedToken

      public AddedToken(String content, boolean special)
      Creates an instance of a AddedToken record class.
      Parameters:
      content - the value for the content record component
      special - the value for the special record component

  • Method Details

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object

    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object

    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with the compare method from their corresponding wrapper classes.
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.

    • content

      public String content()
      Returns the value of the content record component.
      Returns:
      the value of the content record component

    • special

      public boolean special()
      Returns the value of the special record component.
      Returns:
      the value of the special record component