Record Class FlashInferKvMetadata

java.lang.Object

java.lang.Record

smile.llm.cache.FlashInferKvMetadata

Record Components:

pagedKvIndptr - CSR indptr over pages.

pagedKvIndices - page ids.

pagedKvLastPageLen - last-page lengths.

pageSize - tokens per page.

All Implemented Interfaces:

AutoCloseable

public record FlashInferKvMetadata(Tensor pagedKvIndptr, Tensor pagedKvIndices, Tensor pagedKvLastPageLen, int pageSize)
extends Record
implements AutoCloseable

FlashInfer CSR page-table metadata for a bound KV request window.

All tensors are int32. Layout matches FlashInfer / vLLM:

• pagedKvIndptr — [batch + 1] cumulative page counts
• pagedKvIndices — flattened physical page ids
• pagedKvLastPageLen — [batch] tokens in the last page (1..pageSize)

Constructor Summary

Constructors

Constructor	Description
FlashInferKvMetadata(Tensor pagedKvIndptr, Tensor pagedKvIndices, Tensor pagedKvLastPageLen, int pageSize)	Creates an instance of a FlashInferKvMetadata record class.

Method Summary

Modifier and Type	Method	Description
void	close()
final boolean	equals(Object o)	Indicates whether some other object is "equal to" this one.
final int	hashCode()	Returns a hash code value for this object.
Tensor	pagedKvIndices()	Returns the value of the pagedKvIndices record component.
Tensor	pagedKvIndptr()	Returns the value of the pagedKvIndptr record component.
Tensor	pagedKvLastPageLen()	Returns the value of the pagedKvLastPageLen record component.
int	pageSize()	Returns the value of the pageSize record component.
final String	toString()	Returns a string representation of this record class.

Methods inherited from class Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

FlashInferKvMetadata

public FlashInferKvMetadata(Tensor pagedKvIndptr,
 Tensor pagedKvIndices,
 Tensor pagedKvLastPageLen,
 int pageSize)

Creates an instance of a FlashInferKvMetadata record class.

Parameters:

pagedKvIndptr - the value for the pagedKvIndptr record component

pagedKvIndices - the value for the pagedKvIndices record component

pagedKvLastPageLen - the value for the pagedKvLastPageLen record component

pageSize - the value for the pageSize record component

Method Details

close

public void close()

Specified by:

close in interface AutoCloseable

toString

public final String toString()

Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.

Specified by:

toString in class Record

Returns:

a string representation of this object

hashCode

public final int hashCode()

Returns a hash code value for this object. The value is derived from the hash code of each of the record components.

Specified by:

hashCode in class Record

Returns:

a hash code value for this object

equals

public final boolean equals(Object o)

Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with the compare method from their corresponding wrapper classes.

Specified by:

equals in class Record

Parameters:

o - the object with which to compare

Returns:

true if this object is the same as the o argument; false otherwise.

pagedKvIndptr

public Tensor pagedKvIndptr()

Returns the value of the pagedKvIndptr record component.

Returns:

the value of the pagedKvIndptr record component

pagedKvIndices

public Tensor pagedKvIndices()

Returns the value of the pagedKvIndices record component.

Returns:

the value of the pagedKvIndices record component

pagedKvLastPageLen

public Tensor pagedKvLastPageLen()

Returns the value of the pagedKvLastPageLen record component.

Returns:

the value of the pagedKvLastPageLen record component

pageSize

public int pageSize()

Returns the value of the pageSize record component.

Returns:

the value of the pageSize record component