I must be missing something here - in step 3, PMI for x, y is calculated as: log( P(x|y) / ( P(x)P(y) ) ) Because the skipgram probabilities are sparse, P(x|y) is often going to be zero, so taking the log yields…
I must be missing something here - in step 3, PMI for x, y is calculated as: log( P(x|y) / ( P(x)P(y) ) ) Because the skipgram probabilities are sparse, P(x|y) is often going to be zero, so taking the log yields…