r/MachineLearning
· Communities
Loss functions in Instance Representation Learning [R]
In Wu et. al, the MLE objective is computationally infeasible due to the high number of images in the dataset. Non-parametric Softmax Negative Log-Likelihood With large n, the denominator in (2) is hard to compute. Therefore, they use NCE (Noise-Contrastive Estimation). The NCE Objective Essentially, they approximate t