Information-Theoretic Gene Selection In Expression Data

Meyer, Patrick; Bontempi, Gianluca

doi:10.1002/9781118617151.ch17

Download

Contribution to collective works (Parts of books)

Information-Theoretic Gene Selection In Expression Data

Meyer, Patrick; Bontempi, Gianluca

2013 • In Biological Knowledge Discovery Handbook: Preprocessing, Mining, and Postprocessing of Biological Data

Peer reviewed

Permalink
https://hdl.handle.net/2268/163892

DOI
10.1002/9781118617151.ch17

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

meyerbontempi.pdf

Author preprint (232.12 kB)

Download

All documents in ORBi are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Disciplines :

Life sciences: Multidisciplinary, general & others

Author, co-author :

Meyer, Patrick ; Université Libre de Bruxelles - ULB

Bontempi, Gianluca

Language :

English

Title :

Information-Theoretic Gene Selection In Expression Data

Publication date :

2013

Main work title :

Biological Knowledge Discovery Handbook: Preprocessing, Mining, and Postprocessing of Biological Data

Publisher :

John Wiley Sons, Inc.

Pages :

399-420

Peer reviewed :

Peer reviewed

Commentary :

Biological Knowledge Discovery Handbook: Preprocessing, Mining, and Postprocessing of Biological Data

Available on ORBi :

since 05 March 2014

Statistics

Number of views

65 (10 by ULiège)

Number of downloads

5 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

H. Almuallim and T. G. Dietterich. Learning with many irrelevant features. In Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI91). AAAI Press, Washington, DC, 1991, pp 547-552.
D. Anastassiou. Computational analysis of the synergy among multiple interacting genes. Mol. Sys, Biol., 3(83), 2007.
R. Battiti. Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Networks, 5:537-550, 1994.
J. Beirlant, E. J. Dudewica, L. Gyofi, and E. van der Meulen. Nonparametric entropy estimation: An overview. J. Statist., 6:17-39, 1997.
D. A. Bell and H. Wang. A formalism for relevance and its application in feature subset selection. Machine Learning, 41(2):175-195, 2000.
A. Blum and P. Langley. Selection of relevant features and examples in machine learning. Artif. Intell., 97:245-271, 1997.
B. V. Bonnlander and A. S. Weigend. Selecting input variables using mutual information and nonparametric density estimation. In Proceedings of the 1994 International Symposium on Artificial Neural Networks (ISANN94), 1994.
G. Bontempi and P. E. Meyer. Causal filter selection in microarray data. In International Conference on Machine Learning (ICML), 2010.
R. Caruana and D. Freitag. Greedy attribute selection. In International Conference on Machine Learning, 1994, pp 28-36.
T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, New York, 1990.
R. T. Cox. Algebra of Probable Inference. John Hopkins Press, Baltimore, 1961.
G. Darbellay and I. Vajda. Estimation of the information by an adaptive partitioning of the observation space. IEEE Trans. Inform. Theory, 45:1315-1321, 1999
C. O. Daub, R. Steuer, J. Selbig, and S. Kloska. Estimating mutual information using b-spline functions—An improved similarity measure for analysing gene expression data. BMC Bioinformatics, 5, 2004.
L. Devroye, L. Gyorfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition. Springer- Verlag, 1996.
J. Dougherty, R. Kohavi, and M. Sahami. Supervised and unsupervised discretization of continuous features. In International Conference on Machine Learning. 1995, pp 194-202.
J. Dreo, A. Petrowski, P. Siarry, and E. Taillard. Metaheuristiques pour l’Optimisation Difficile. Eyrolles, 2003.
W. Duch, T. Winiarski, J. Biesiada, and A. Kachel. Feature selection and ranking filters. In International Conference on Artificial Neural Networks (ICANN) and International Conference on Neural Information Processing (ICONIP). June 2003, pp 251-254.
F. Fleuret. Fast binary feature selection with conditional mutual information. J. Machine Learning Res., 5:1531-1555, 2004.
D. Francois, F. Rossi, V. Wertz, and M. Verleysen. Resampling methods for parameter-free and robust feature selection with mutual information. Neurocomputing, 70(7-9):1276-1288, 2007.
I. Guyon and A. Elisseeff. An introduction to variable and feature selection. J. Machine Learning Res., 3:1157-1182, 2003.
I. Guyon, S. Gunn, M. Nikravesh, and L. A. Zadeh. Feature Extraction: Foundations and Applications. Springer-Verlag, New York, 2006.
S. Haykin. Neural Networks: A Comprehensive Foundation. Prentice-Hall International, 1999.
A. Jakulin and I. Bratko. Quantifying and visualizing attribute interactions, report: Arxiv 0308002, 2003.
A. Jakulin and I. Bratko. Testing the significance of attribute interactions. In Proceedings of 21st International Conference on Machine Learning (ICML). 2004, pp 409-416.
E. T. Jaynes. Probability Theory: The Logic of Science. Cambridge University Press, 2003.
M. G. Kendall, A. Stuart, and J. K. Ord. Kendall’s Advanced Theory of Statistics. Oxford University Press, 1987.
M. B. Kennel, J. B. Shlens, H. D. I. Abarbanel, and E. J. Chichilnisky. Estimating entropy rates with Bayesian confidence intervals. Neural Comput., 17(7):1531-1576, 2005.
R. Kohavi and G. H. John. Wrappers for feature subset selection. Artif. Intell., 97(1-2):273-324, 1997.
I. Kojadinovic. Relevance measures for subset variable selection in regression problems based on k-additive mutual information. Computat. Statist. Data Anal., 49:1205-1227, 2005.
D. Koller and M. Sahami. Toward optimal feature selection. In International Conference on Machine Learning. 1996, pp 284-292.
I. Kononenko. Estimating attributes: Analysis and extensions of RELIEF. In European Conference on Machine Learning. 1994, pp 171-182.
H. Liu, F. Hussain, C. Lim Tan, and M. Dash. Discretization: An enabling technique. J. Data Mining Knowledge Discov., 6(4):393-423, 2002.
A. A. Margolin, I. Nemenman, K. Basso, C. Wiggins, G. Stolovitzky, R. Dalla Favera, and A. Califano. ARACNE: An algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC Bioinformatics, 7, 2006.
W. J. McGill. Multivariate information transmission. Psychometrika, 19(2):97-116, 1954.
P. E. Meyer and G. Bontempi. On the use of variable complementarity for feature selection in cancer classification. In F. Rothlauf et al. (Eds.), Applications of Evolutionary Computing: EvoWorkshops, Vol. 3907 of Lecture Notes in Computer Science, Springer, Budapest, 2006, pp 91-102.
P. E. Meyer, K. Kontos, F. Lafitte, and G. Bontempi. Information-theoretic inference of large transcriptional regulatory networks. EURASIP J. Bioinformatics Syst. Biol., Special Issue on Information-Theoretic Methods for Bioinformatics, 2007.
P. E. Meyer, D. Marbach, S. Roy, and M. Kellis. Information-theoretic inference of gene networks using backward elimination. In International Conference on Bioinformatics and Computational Biology (BioComp), Las Vegas, 2010.
P. E. Meyer, C. Schretter, and G. Bontempi. Information-theoretic feature selection using variable complementarity. IEEE J. Spec. Topics Signal Process., 2(3):261-274, 2008.
A. J. Miller. Subset Selection in Regression, 2nd ed. Chapman and Hall, 2002.
I. Nemenman, W. Bialek, and R. de Ruyter van Steveninck. Entropy and information in neural spike trains: Progress on the sampling problem. Phys. Rev. Lett., 69(5):056111, 2004.
C. Olsen, P. E. Meyer, and G. Bontempi. On the impact of entropy estimation on transcriptional regulatory network inference based on mutual information. EURASIP J. Bioinformatics Syst. Biol., 2009(1):308959, 2009.
L. Paninski. Estimation of entropy and mutual information. Neural Computat., 15(6):1191-1253, 2003.
H. Peng and F. Long. An efficient max-dependency algorithm for gene selection. In 36th Symposium on the Interface: Computational Biology and Bioinformatics, 57:65, May 2004.
H. Peng, F. Long, and C. Ding. Feature selection based on mutual information: Criteria of maxdependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Machine Intell., 27(8):1226-1238, 2005.
L. Portinale and L. Saitta. Feature selection. Appl. Intell., 9(3):217-230, 1998.
G. Provan and M. Singh. Learning Bayesian networks using feature selection. In Fifth International Workshop on Artificial Intelligence and Statistics. 1995, pp 450-456
F. Rossi, A. Lendasse, D. Francois, V. Wertz, and M. Verleysen. Mutual information for the selection of relevant variables in spectrometric nonlinear modelling. Chemometr. Intell. Lab. Syst., 2:215-226, 2006.
C. E. Shannon. A mathematical theory of communication. Bell Syst. Tech. J., 28(4):656-715, 1949.
M. Studeny and J. Vejnarova. The multiinformation function as a tool for measuring stochastic dependence. In Proceedings of the NATO Advanced Study Institute on Learning in Graphical Models. 1998, pp 261-297.
N. Tishby, F. Pereira, and W. Bialek. The information bottleneck method. In Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing. 1999.
G. D. Tourassi, E. D. Frederick, M. K. Markey, and C. E. Floyd Jr. Application of the mutual information criterion for feature selection in computer-aided diagnosis. Med. Phys., 28(12):2394-2402, 2001.
M. J. van de Vijver, Y. D. He, L. J. van’t Veer, H. Dai, A. A. Hart, D.W. Voskuil, G. J. Schreiber, J. L. Peterse, C. Roberts, M. J. Marton, M. Parrish, D. Atsma, A. Witteveen, A. Glas, L. Delahaye, T. van der Velde, T H Bartelink, H. S Rodenhuis, E. T. Rutgers, S. H. Friend, and R. Bernards. A gene-expression signature as a predictor of survival in breast cancer. New Engl. J. Med., 347(25):1999-2009, 2002.
L. J. van ‘t Veer, H. Dai, M. J. van de Vijver, Y. D. He, A. A. Hart, M. Mao, H. L. Peterse, K. van der Kooy, M. J. Marton, A. T. Witteveen, G. J. Schreiber, R. M. Kerkhoven, C. Roberts, P. S. Linsley, R. Bernards, and S. H. Friend. Gene expression profiling predicts clinical outcome of breast cancer. Nature, 415(6871):530-536, 2002.
W. Wienholt and B. Sendhoff. How to determine the redundancy of noisy chaotic time series. Int. J. Bifurcation Chaos, 6(1):101-117, 1996.
J. Yang and V. Honavar. Feature subset selection using A genetic algorithm. In Genetic Programming 1997: Proceedings of the Second Annual Conference. Morgan Kaufmann, 1997, p 380.
Y. Yang and G. I. Webb. Discretization for naive-Bayes learning: Managing discretization bias and variance. Machine Learning, 74(1):39-74, 2009.
Y. Yang and G. I. Webb. On why discretization works for naive-bayes classifiers. AI 2003: Advances in Artificial Intelligence. Springer, Berlin, 2003, pp 440-452.
L. Yu and H. Liu. Efficient feature selection via analysis of relevance and redundancy. J. Machine Learning Res., 5:1205-1224, 2004.
Z. Zhao and H. Liu. Searching for interacting features. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI-07). 2007.