Record Class MarlinWeightPacker.Packed

java.lang.Object

java.lang.Record

smile.llm.quant.MarlinWeightPacker.Packed

Record Components:

qweight - packed INT32 storage (Marlin layout).

scales - FP16 scales [numGroups, outFeatures].

inFeatures - K.

outFeatures - N.

groupSize - group size.

All Implemented Interfaces:

AutoCloseable

Enclosing class:

MarlinWeightPacker

public static record MarlinWeightPacker.Packed(Tensor qweight, Tensor scales, int inFeatures, int outFeatures, int groupSize)
extends Record
implements AutoCloseable

Result of packing: Marlin qweight, scales, logical features.

Constructor Summary

Constructors

Constructor	Description
Packed(Tensor qweight, Tensor scales, int inFeatures, int outFeatures, int groupSize)	Creates an instance of a Packed record class.

Method Summary

Modifier and Type	Method	Description
void	close()
final boolean	equals(Object o)	Indicates whether some other object is "equal to" this one.
int	groupSize()	Returns the value of the groupSize record component.
final int	hashCode()	Returns a hash code value for this object.
int	inFeatures()	Returns the value of the inFeatures record component.
int	outFeatures()	Returns the value of the outFeatures record component.
Tensor	qweight()	Returns the value of the qweight record component.
Tensor	scales()	Returns the value of the scales record component.
final String	toString()	Returns a string representation of this record class.

Methods inherited from class Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

Packed

public Packed(Tensor qweight,
 Tensor scales,
 int inFeatures,
 int outFeatures,
 int groupSize)

Creates an instance of a Packed record class.

Parameters:

qweight - the value for the qweight record component

scales - the value for the scales record component

inFeatures - the value for the inFeatures record component

outFeatures - the value for the outFeatures record component

groupSize - the value for the groupSize record component

Method Details

close

public void close()

Specified by:

close in interface AutoCloseable

toString

public final String toString()

Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.

Specified by:

toString in class Record

Returns:

a string representation of this object

hashCode

public final int hashCode()

Returns a hash code value for this object. The value is derived from the hash code of each of the record components.

Specified by:

hashCode in class Record

Returns:

a hash code value for this object

equals

public final boolean equals(Object o)

Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with the compare method from their corresponding wrapper classes.

Specified by:

equals in class Record

Parameters:

o - the object with which to compare

Returns:

true if this object is the same as the o argument; false otherwise.

qweight

public Tensor qweight()

Returns the value of the qweight record component.

Returns:

the value of the qweight record component

scales

public Tensor scales()

Returns the value of the scales record component.

Returns:

the value of the scales record component

inFeatures

public int inFeatures()

Returns the value of the inFeatures record component.

Returns:

the value of the inFeatures record component

outFeatures

public int outFeatures()

Returns the value of the outFeatures record component.

Returns:

the value of the outFeatures record component

groupSize

public int groupSize()

Returns the value of the groupSize record component.

Returns:

the value of the groupSize record component