Linear Layer and Softmax

The linear layer is a fully connected neural network layer that transforms the output embedding into a higher-dimensional space.Figure 6G shows the process by which the features are propagated through a linear layer, followed by the activation of the accurate output probability using the softmax activation function.