Remove invocation of out_balancer

This commit is contained in:
Daniel Povey 2022-11-23 18:40:27 +08:00
parent b88f12fe83
commit f2dbf87461

View File

@ -1481,7 +1481,6 @@ attn_weights: a Tensor of shape (num_heads, batch_size, seq_len, seq_len)
x = self.activation(x) # diagnostics only, it's the identity.
x = self.out_proj(x)
x = self.out_balancer(x)
return x