You are here

Home » Content

Data Fusion Using Weighted Likelihood

Journal Name:

  • European Journal of Pure and Applied Mathematics

Publication Year:

  • 2012

Key Words:

Author NameUniversity of Author

AMS Codes:

Abstract (2. Language): 
This article proposes to perform data fusion by using an adaptive weighted likelihood function when data sets are available from related populations. The main objective of data fusion is to integrate information from different sources to improve the quality of inference when the sample size from the target population is small or moderate. The weighted likelihood function is employed simply as an instrument to facilitate the data fusion process. The weighted likelihood method has informationtheoretic justification and embraces the widely used classical likelihood method which utilizes only on the data set from the target population. The degree of information integration in the proposed data fusion process is determined by the likelihood weights which should be chosen in a reasonable and adaptive way. The major challenge in the proposed data fusion process is then to choose likelihood weights adaptively and effectively when the deterministic relationships among all related parameters are unknown. We propose adaptive likelihood weights based on the estimated likelihood ratio. We show that the data fusion involving all relevant data sets could significantly improve the mean squared error (MSE) of the classical maximum likelihood estimator which only uses data set from the target population. It also increases the power for hypothesis testing. The proposed estimator is shown to be consistent and asymptotically normally distributed in the framework of generalized linear models. The advantage of the proposed weighted likelihood estimator for linear models is illustrated numerically by a simulation study. A real data example is also provided.
Bookmark/Search this post with
FULL TEXT (PDF): 
PDF icon arastirmax-data-fusion-using-weighted-likelihood.pdf
  • 3
333-356
  • English

REFERENCES

References: 

[1] J Shao. Mathematical Statistics. Springer, New York, 2003.
[2] J Staniswalis. The kernel estimate of a regression function in a likelihood-based models.
J. Am. Statist. Assoc., 84:276–83, 1989.
[3] M Stone. Strong inconsistencies from uniform priors. J. Am. Statist. Assoc., 71:114–116,
1976.
[4] R Tibshirani and T Hastie. Local likelihood estimation. J. Am. Statist. Assoc., 82:559–67,
1987.
[5] X Wang. Approximating bayesian inference by weighted likelihood. Can. J. Statist.,
34:279–298, 2006.
[6] X Wang and J Zidek. Derivation of mixture distribution and weighted likelihood as
minimizers of kl-divergence subject to constraints. Ann. Inst. Statist. Math., 57:687–
701, 2005.
[7] X Wang and J Zidek. Selecting likelihood weights by cross-validation. Ann. Statist.,
33:463–500, 2005.
[8] D. Hosmer and S. Lemeshow. Applied Logistic Regression. Wiley, New York, 1989.
[9] F. Hu. The asymptotic properties of the maximum-relevance weighted likelihood estimators.
Can. J. Statist., 25:45–59, 1997.
[10] F. Hu and J. Zidek. The relevance weighted likelihood with applications. In Ahmed, S.E.
& Reid, N. , editor, Empirical Bayes and Likelihood Inference., pages 211–235, New York.,
2001. Springer Verlag.
[11] F Hu and J Zidek. The weighted likelihood. Can. J. Statist., 25:347–71, 2002.
[12] F. Hu and W. Rosenberger. Analysis of time trends in adaptive designs with applications
to a neurophysiology experiments. Statist. Med., 19:2067–75, 2000.
[13] H. Akaike. Information theory and an extension of the maximum likelihood principle.
In Petrov, B.N. & Csaki, F. , editor, Proc. 2nd International Symposium on Information
Theory., pages 267–281, Budapest., 1973. Akademiai Kiado.
[14] I. Csiszár. I-divergence geometry of probability distributions and minimization problems.
. Ann. Statist., 3:146–158, 1975.
[15] J. Bernardo. A maximum likelihood methodology for clusterwise linear regression. Ann.
Statist., 7:686–690, 1979.
[16] H Royden. Real Analysis. Prentice Hall, New York, 3 edition, 1988.
[17] S. Eguchi and J. Copas. A class of local likelihood methods and near-parametric asymptotics.
J. R. Statist. Soc. B, 60:709–24, 1998.
[18] S Kullback. Information Theory and Statistics. Wiley, New York, 1959.
[19] T. Cover and J. Thomas. Elements of Information Theory. Wiley, New York, 1991.
[20] W James and C Stein. Estimation with quadratic loss. In Proc 4th Berkeley Symp. Math
Statist Prob., volume 1, pages 361–379. Berkely: University of California Press., 1961.
[21] X Wang, C van Emden and J Zidek. Asymptotic properties of maximum weighted likelihood
estimator. J. Statist. Plan. Infer., 119:37–54, 2004.

Thank you for copying data from http://www.arastirmax.com