TOPICS
Search

Score Function


The score function u(theta) is the partial derivativeof the log-likelihood function F(theta)=lnL(theta), where L(theta) is the standard likelihood function.

Defining the likelihood function

 L(theta)=product_(i=1)^nf_i(y_i|theta)
(1)

shows that

 F(theta)=sum_(i=1)^nlnf_i(y_i|theta)
(2)

and thus that

u(theta)=partial/(partialtheta)F(theta)
(3)
=sum_(i=1)^(n)(partiallnf_i(y_i|theta))/(partialtheta)
(4)
=sum_(i=1)^(n)1/(f_i(y_i|theta))(partialf_i(y_i|theta))/(partialtheta).
(5)

Using the above formulation of u, one can easily compute various statistical measurements associated with u. For example, the mean E(u(theta)) can be shown to equal zero while the variance is precisely the Fisher information matrix. The score function has extensive uses in many areas of mathematics, both pure and applied, and is a key component of the field of likelihood theory.


See also

Derivative, Expectation Value, Fisher Information Matrix, Likelihood, Likelihood Function, Logarithm, Log-Likelihood Function, Partial Derivative, Probability, Variance

This entry contributed by Christopher Stover

Explore with Wolfram|Alpha

References

Rodriguez, G. "Lecture Notes on Generalized Linear Models." 2007. http://data.princeton.edu/wws509/notes/.Sun, D. and Xiao, F. "Likelihood Theory with Score Function." 2013. http://www.stats.uwo.ca/faculty/bellhouse/Likelihood_Theory_with_Score_Function.pdf

Cite this as:

Stover, Christopher. "Score Function." From MathWorld--A Wolfram Web Resource, created by Eric W. Weisstein. https://mathworld.wolfram.com/ScoreFunction.html

Subject classifications