Record Class SpeculativeDecoding.AcceptResult

java.lang.Object
java.lang.Record
smile.llm.engine.SpeculativeDecoding.AcceptResult
Record Components:
numDraftAccepted - number of draft tokens accepted (0..N).
acceptedTokens - accepted drafts plus the bonus token (length r+1).
Enclosing class:
SpeculativeDecoding
public static record SpeculativeDecoding.AcceptResult(int numDraftAccepted, int[] acceptedTokens) extends Record
Result of one speculative verify round.

  • Constructor Details

    • AcceptResult

      public AcceptResult(int numDraftAccepted, int[] acceptedTokens)
      Creates an instance of a AcceptResult record class.
      Parameters:
      numDraftAccepted - the value for the numDraftAccepted record component
      acceptedTokens - the value for the acceptedTokens record component

  • Method Details

    • numTokens

      public int numTokens()
      Returns total tokens to emit this round.
      Returns:
      total tokens to emit this round (numDraftAccepted + 1).

    • bonusToken

      public int bonusToken()
      Returns the bonus (target) token always kept at the end.
      Returns:
      the bonus (target) token always kept at the end.

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object

    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object

    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with the compare method from their corresponding wrapper classes.
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.

    • numDraftAccepted

      public int numDraftAccepted()
      Returns the value of the numDraftAccepted record component.
      Returns:
      the value of the numDraftAccepted record component

    • acceptedTokens

      public int[] acceptedTokens()
      Returns the value of the acceptedTokens record component.
      Returns:
      the value of the acceptedTokens record component