Search the web
Sign In
New User? Sign Up
icsi-speech-tools
? Already a member? Sign in to Yahoo!

Yahoo! Groups Tips

Did you know...
Message search is now enhanced, find messages faster. Take it for a spin.

Best of Y! Groups

   Check them out and nominate your group.
Having problems with message search? Fill out this form to ensure your group is one of the first to be migrated to the new message search system.

Messages

  Messages Help
Advanced
Why are there positive posteriori probabilities when I use MLP featu   Message List  
Reply | Forward Message #158 of 162 |
Re: Why are there positive posteriori probabilities when I use MLP feature in LV

From your message, I assume you're using the MLP outputs as features
to a GMM (so-called "tandem") rather than using the posteriors
directly (so-called "hybrid"). In this case, we either use a linear
output layer, or use log probabilities. In both cases, we usually
append acoustic features, and follow it up with PCA or LDA to reduce
the dimensionality.

I can check with folks here, but I don't recall any normalization
steps prior to this, so I can see how dynamic range might be a
problem. You might try just doing mean/variance normalization.

Good luck,

Adam


--- In icsi-speech-tools@yahoogroups.com, "qingqing.zhang"
<qingqing.zhang@...> wrote:
>
> Dear Adam,
> I am so sorry that I did not explain the problem clearly.
>
> Actually, we found that MLP has the much larger dynamic range than PLP
> has (In the log domain). Our decoder cannot deal with such large
> dynamic range when decoding. I don't know if you use any method to
> reduce MLP's probability range in order to adapt to PLP's probability
> range.
> Thank you very much!





Mon Nov 3, 2008 7:21 pm

ajanin
Offline Offline
Send Email Send Email

Forward
Message #158 of 162 |
Expand Messages Author Sort by Date

When I use MLP as my HMM features, the POSITIVE posteriori probabilities always occurred. The POSITIVE posteriori probabilities will break the decoding rule...
qingqing.zhang
Offline Send Email
Oct 30, 2008
7:26 am

... I'm not sure I understand. If you're using softmax as the output layer of the MLP, then all the values should be between 0.0 and 1.0. If you're not using...
Adam Janin
ajanin
Offline Send Email
Oct 30, 2008
4:58 pm

Dear Adam, I am so sorry that I did not explain the problem clearly. Actually, we found that MLP has the much larger dynamic range than PLP has (In the log...
qingqing.zhang
Offline Send Email
Nov 3, 2008
3:26 am

There is another problem: When we use MLP feature on Mandarin CTS, the Frame Error Rate of training data was up to 60% after NN training. Does this a little ...
qingqing.zhang
Offline Send Email
Nov 3, 2008
7:37 am

... I haven't run Mandarin CTS myself, so maybe somebody else on the list can answer in more detail, but for English, high 60s for frame ACCURACY (not error)...
Adam Janin
ajanin
Offline Send Email
Nov 3, 2008
7:23 pm

From your message, I assume you're using the MLP outputs as features to a GMM (so-called "tandem") rather than using the posteriors directly (so-called...
Adam Janin
ajanin
Offline Send Email
Nov 3, 2008
7:21 pm
Advanced

Copyright © 2009 Yahoo! Inc. All rights reserved.
Privacy Policy - Terms of Service - Guidelines - Help