Commit 08af6717 authored by Dan Povey's avatar Dan Povey
Browse files

Further edits to paper.

git-svn-id: https://svn.code.sf.net/p/kaldi/code/sandbox/discrim@535 5e6a8d80-dfce-4ca6-a32a-6e07a63d50c8
parent 0081c587
...@@ -327,10 +327,11 @@ which leads to an exponentially decreasing impact of the initial parameter set. ...@@ -327,10 +327,11 @@ which leads to an exponentially decreasing impact of the initial parameter set.
We implemented this for all the parameters but found it only helped when We implemented this for all the parameters but found it only helped when
applied to just the weights, applied to just the weights,
which is consistent with our interpretation that stopping the weights from overfitting which is consistent with our interpretation that stopping the weights from overfitting
too fast allows the Gaussians to ``move farther'' than they otherwise would from too fast allows the Gaussian parameters to move farther away from the initialization
the initial estimate. We note that other practitioners have also used mechanisms that than they otherwise would.
prevent the weights from changing too fast~\footnote{James Droppo, personal communication} and We note that other practitioners have also used mechanisms that
have found that this improved results. prevent the weights from changing too fast and
have found that this improved results\footnote{Jasha Droppo, personal communication.}.
%----%<------------------------------------------------------------------------ %----%<------------------------------------------------------------------------
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment