Mixture Density Networks

Predicts one or more gaussian distributions from a dataset, rather than relying on softmax to predict a single output token.

The more certain the dataset is the more of a "spike" response is returned. The more uncertain, the more you get a flat response.