Class QwenRMSNorm

java.lang.Object

smile.llm.model.qwen.QwenRMSNorm

All Implemented Interfaces:

Function<Tensor,Tensor>, Layer

public class QwenRMSNorm
extends Object
implements Layer

Qwen3.5 RMSNorm: rms_norm(x) * (1 + weight) with weight initialized to zeros.

Constructor Summary

Constructors

Constructor	Description
QwenRMSNorm(int dim, double eps)	Constructor.

Method Summary

Modifier and Type	Method	Description
Tensor	forward(Tensor input)	Forward propagation (or forward pass) through the layer.
MemorySegment	module()	Returns the native ST_Module handle for this layer.

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface Function

andThen, compose

Methods inherited from interface Layer

apply, name, to, to

Constructor Details

QwenRMSNorm

public QwenRMSNorm(int dim,
 double eps)

Constructor.

Parameters:

dim - feature dimension.

eps - numerical stability epsilon.

Method Details

forward

public Tensor forward(Tensor input)

Description copied from interface: Layer

Forward propagation (or forward pass) through the layer.

Specified by:

forward in interface Layer

Parameters:

input - the input tensor.

Returns:

the output tensor.

module

public MemorySegment module()

Description copied from interface: Layer

Returns the native ST_Module handle for this layer.

Specified by:

module in interface Layer

Returns:

the native ST_Module handle.