Class MiniMaxFollower
java.lang.Object
smile.llm.model.minimax.MiniMaxFollower
A non-leader node of a multi-node MiniMax-M3: loads its share of the experts on its GPUs, joins the leader's NCCL
communicator and executes every call the leader mirrors (
MiniMax.serveCluster(ClusterFollower)). It serves no HTTP, loads no
vision encoder and discards the logits: only the leader samples.
Usage: MiniMaxFollower --leader host:port --node 1 --devices 0,1,2,3 --checkpoint /path/to/model
[--timeout-s 3600]. The checkpoint path is local to this node; everything else (batch size, memory fraction...) is
taken from the leader so that all processes agree.
-
Method Summary
-
Method Details
-
main
-