xlnstorch.nn.LNSConv1d#
- class xlnstorch.nn.LNSConv1d(in_channels, out_channels, kernel_size, stride=1, padding=0, dilation=1, groups=1, bias=True, padding_mode='zeros', device=None, weight_f=None, weight_b=None, bias_f=None, bias_b=None)#
An LNS 1D convolutional layer that applies a 1D convolution over the input tensor.
See also:
torch.nn.Conv1d- Parameters:
in_channels (int) – Number of channels in the input tensor.
out_channels (int) – Number of channels produced by the convolution.
stride (int or tuple, optional) – Stride of the convolution. Default is 1.
padding (int or tuple, optional) – Zero-padding added to both sides of the input. Default is 0.
dilation (int or tuple, optional) – Spacing between kernel elements. Default is 1.
groups (int, optional) – Number of blocked connections from input channels to output channels. Default is 1.
bias (bool, optional) – If True, adds a learnable bias to the output. Default is True.
padding_mode (str, optional) – Type of padding to use. Can be ‘zeros’, ‘reflect’, ‘replicate’, or ‘circular’. Default is ‘zeros’.
device (torch.device, optional) – The device on which to create the layer’s parameters. If None, uses the default device.
weight_f (int, optional) – The number of fractional exponent bits for the weight. mutually exclusive with
weight_b.weight_b (Optional[Union[float, int, torch.Tensor]], optional) – The explicit logarithm base for the weight; mutually exclusive with
weight_f.bias_f (int, optional) – The number of fractional exponent bits for the bias. mutually exclusive with
bias_b.bias_b (Optional[Union[float, int, torch.Tensor]], optional) – The explicit logarithm base for the bias; mutually exclusive with
bias_f.
- weight#
The weight tensor of shape \((\text{out_channels}, \frac{\text{in_channels}}{\text{groups}}, \text{kernel_size})\), initialized with random values uniformly distributed between \(-\sqrt{k}\) and \(\sqrt{k}\), where \(k = \frac{\text{groups}}{\text{in_channels} \times \text{kernel_size}}\).
- Type:
- bias#
The bias vector of shape \((\text{out_channels},)\), initialized with random values uniformly distributed between \(-\sqrt{k}\) and \(\sqrt{k}\), where \(k = \frac{\text{groups}}{\text{in_channels} \times \text{kernel_size}}\). This is only created if bias is set to True.
- Type:
LNSTensor or None
- __init__(in_channels, out_channels, kernel_size, stride=1, padding=0, dilation=1, groups=1, bias=True, padding_mode='zeros', device=None, weight_f=None, weight_b=None, bias_f=None, bias_b=None)#
Initialize internal Module state, shared by both nn.Module and ScriptModule.
Methods
__init__(in_channels, out_channels, kernel_size)Initialize internal Module state, shared by both nn.Module and ScriptModule.
add_module(name, module)Add a child module to the current module.
apply(fn)Apply
fnrecursively to every submodule (as returned by.children()) as well as self.bfloat16()Casts all floating point parameters and buffers to
bfloat16datatype.buffers([recurse])Return an iterator over module buffers.
children()Return an iterator over immediate children modules.
compile(*args, **kwargs)Compile this Module's forward using
torch.compile().cpu()Move all model parameters and buffers to the CPU.
cuda([device])Move all model parameters and buffers to the GPU.
double()Casts all floating point parameters and buffers to
doubledatatype.eval()Set the module in evaluation mode.
extra_repr()Return the extra representation of the module.
float()Casts all floating point parameters and buffers to
floatdatatype.forward(x)Define the computation performed at every call.
get_buffer(target)Return the buffer given by
targetif it exists, otherwise throw an error.get_extra_state()Return any extra state to include in the module's state_dict.
get_parameter(target)Return the parameter given by
targetif it exists, otherwise throw an error.get_submodule(target)Return the submodule given by
targetif it exists, otherwise throw an error.half()Casts all floating point parameters and buffers to
halfdatatype.ipu([device])Move all model parameters and buffers to the IPU.
lns_parameters()Returns a list of parameter groups for the module.
load_state_dict(state_dict[, strict, assign])Copy parameters and buffers from
state_dictinto this module and its descendants.modules()Return an iterator over all modules in the network.
mtia([device])Move all model parameters and buffers to the MTIA.
named_buffers([prefix, recurse, ...])Return an iterator over module buffers, yielding both the name of the buffer as well as the buffer itself.
named_children()Return an iterator over immediate children modules, yielding both the name of the module as well as the module itself.
named_modules([memo, prefix, remove_duplicate])Return an iterator over all modules in the network, yielding both the name of the module as well as the module itself.
named_parameters([prefix, recurse, ...])Return an iterator over module parameters, yielding both the name of the parameter as well as the parameter itself.
parameters([recurse])Return an iterator over module parameters.
register_backward_hook(hook)Register a backward hook on the module.
register_buffer(name, tensor[, persistent])Add a buffer to the module.
register_forward_hook(hook, *[, prepend, ...])Register a forward hook on the module.
register_forward_pre_hook(hook, *[, ...])Register a forward pre-hook on the module.
register_full_backward_hook(hook[, prepend])Register a backward hook on the module.
register_full_backward_pre_hook(hook[, prepend])Register a backward pre-hook on the module.
register_load_state_dict_post_hook(hook)Register a post-hook to be run after module's
load_state_dict()is called.register_load_state_dict_pre_hook(hook)Register a pre-hook to be run before module's
load_state_dict()is called.register_module(name, module)Alias for
add_module().register_parameter(name, param[, requires_grad])Registers a parameter in the module.
register_state_dict_post_hook(hook)Register a post-hook for the
state_dict()method.register_state_dict_pre_hook(hook)Register a pre-hook for the
state_dict()method.requires_grad_([requires_grad])Change if autograd should record operations on parameters in this module.
set_extra_state(state)Set extra state contained in the loaded state_dict.
set_submodule(target, module[, strict])Set the submodule given by
targetif it exists, otherwise throw an error.share_memory()state_dict(*args[, destination, prefix, ...])Return a dictionary containing references to the whole state of the module.
to(*args, **kwargs)Move and/or cast the parameters and buffers.
to_empty(*, device[, recurse])Move the parameters and buffers to the specified device without copying storage.
train([mode])Set the module in training mode.
type(dst_type)Casts all parameters and buffers to
dst_type.xpu([device])Move all model parameters and buffers to the XPU.
zero_grad([set_to_none])Clears the gradients of all parameters in the module.
Attributes
T_destinationcall_super_initdump_patchestraining