Lint
Summary: Pull Request resolved:
@@ -22,8 +22,10 @@ class LightweightConv1d(nn.Module):
input_size: # of channels of the input and output
kernel_size: convolution channels
padding: padding
- num_heads: number of heads used. The weight is of shape (num_heads, 1, kernel_size)
+ num_heads: number of heads used. The weight is of shape
+ `(num_heads, 1, kernel_size)`
weight_softmax: normalize the weight with softmax before the convolution
+
Shape:
Input: BxCxT, i.e. (batch_size, input_size, timesteps)
Output: BxCxT, i.e. (batch_size, input_size, timesteps)
