xlnstorch.optim.lr_scheduler.LNSChainedScheduler

class xlnstorch.optim.lr_scheduler.LNSChainedScheduler(schedulers, optimizer)

A scheduler that chains multiple schedulers together.

Note that this scheduler is a subclass of torch’s ChainedScheduler, and is implemented for completeness. You can use the torch version directly with LNS optimizers.

See also: torch.optim.lr_scheduler.ChainedScheduler

Parameters:

• schedulers (List[torch.optim.lr_scheduler.LRScheduler]) – List of schedulers to chain.

• optimizer (LNSOptimizer)

__init__(schedulers, optimizer)

Parameters:

• schedulers (List[LRScheduler])

• optimizer (LNSOptimizer)

Methods

__init__(schedulers, optimizer)
get_last_lr()	Return last computed learning rate by current scheduler.
get_lr()	Compute learning rate using chainable form of the scheduler.
load_state_dict(state_dict)	Load the scheduler's state.
state_dict()	Return the state of the scheduler as a dict.
step()	Perform a step.