An airline has numbered their planes and you observe the following 3 planes, which are randomly sampled from the planes:
What is the maximum likelihood estimate for In other words, what value of would, according to conditional probability, make your observation most likely?
This section requires Javascript.
You are seeing this because something didn't load right. We suggest you, (a) try
refreshing the page, (b) enabling javascript if it is disabled on your browser and,
finally, (c)
loading the
non-javascript version of this page
. We're sorry about the hassle.
Relevant wiki: Maximum Likelihood Estimation (MLE)
If N < 1 7 , the probability is, of course, 0. If N ≥ 1 7 , the probability of seeing these three planes is 3 ! × N 1 × N − 1 1 × N − 2 1 . Note that as N grows, this probability decreases, so the maximum likelihood estimate for N is 17.
This should strike you as slightly weird -- intuitively, 17 seems like a bad guess for N since, well, "what are the odds I happened to see the largest plane?" This illustrates an issue with maximum likelihood estimators (finding the parameter which makes the observed outcome most likely). A better estimate might be the minimum-variance unbiased estimator*, which is m ⋅ ( 1 + k 1 ) − 1 = 1 7 ⋅ ( 1 + 3 1 ) − 1 ≈ 2 1 . 6 7 .
*: Unbiased estimator means that the expected value of the estimate for the parameter is equal to the true value of the parameter. The minimum-variance one is often considered the "best", which should be fairly intuitive since lower variance means your estimate is more likely to be close to the true value. In general, the bias-variance tradeoff is a fundamental issues in fields like statistics and machine learning .