CNEL Alumnus: Deniz Erdogmus


Former student webpage:
About Me

I have been with CNEL for 5 years from August 1999 to July 2004, first as a PhD student, then as a post-doctoral research associate.
Currently, I am an assistant professor at the CSE & BME Departments of OGI/OHSU.
 
My Research Interests

My research interests include statistical, nonlinear, and adaptive signal processing, especially focusing on information theoretic aspects.
 
Research Goals

My research goal is to develop a mathematical theory of information theoretic learning for adaptive systems.
In the mean time I am also working on the brain-machine interface project, trying to come up with a feasible model to interpret the neural code of the cortical activity of a primate in order to estimate its hand position.
Picture
Links

 
CNEL Papers
Dissertation
1Deniz Erdogmus,"Information Theoretic Learning: Renyi’s Entropy and its Applications to Adaptive System Training", May 2002, University of Florida.(author PDF)
 
Journal Papers
1D. Erdogmus, Y. Rao, J. Principe, "An Interpretation of the Parzen Window resubstitution estimate for Renyi's entropy based on the Eigendecomposition of Kernels in the Function Space," Trans. on Information Theory. (Submitted)
2D. Erdogmus, Y. Rao, J. Principe, "Extending Price's Theorem for Nonlinear Finite-Memory Information Processing Systems with Non-Gaussian Inputs," Trans. on Information Theory. (Submitted)
3D. Erdogmus, K. Hild, J. Principe, "Kernel Size Selection in Parzen Density Estimation," Journal of VLSI Signal Processing-Systems. (Submitted)
4A. Hegde, D. Erdogmus, D. Shiau, J. Prinicpe, C. Sackellares, "Clustering Approach to Quantify Long-Term Spatio-temporal Interactions in Epileptic Intracranial EEG", , Vol. 2007, No. , pp. -, Jan. 2007,DOI:10.1155/2007/83416 (author PDF)
5R. Jenssen, D. Erdogmus, J. Prinicpe, T. Eltoft, "The Laplacien Classifier", Trans. on Signal Processing, Vol. 55, No. 7, pp. 3262-3271, 2007,DOI:10.1109/TSP.2007.894391 (author PDF)
6D. Erdogmus, J. Principe, "From Linear Adaptive Fiiltering to Nonlinear Information Processing", Signal Processing Magazine, Vol. 23, No. 6, pp. 14-23, Nov. 2006,DOI:10.1109/SP-M.2006.248709 (author PDF)
7D. Erdogmus, O. Fontenla-Romero, J. Principe, A. Alonso-Betanzos, E. Castillo, "Linear Least-Squares Initialization of Multilayer Perceptrons Through Backpropagation of the Desired Response", Trans. on Neural Networks, Vol. 16, No. 2, pp. 325-337, Mar. 2005 (author PDF)
8S.P. Kim, Y.N. Rao, D. Erdogmus, J.C. Sanchez, M.A. Nicolelis, J.C. Principe, "Determining Patterns in Neural Activity for Reaching Movements Using Non-Negative Matrix Factorization", EURASIP Journal on Applied Signal Processing, Vol. 2005, No. 4, pp. 3113-3121, Jan. 2005 (author PDF)
9D. Erdogmus, J. Principe, "Lower and Upper Bounds for Misclassification Probability based on Renyi's Information", Journal of VLSI Signal Processing-Systems, Vol. 37, No. 2-3, pp. 305-317, June 2004 (author PDF)
10Deniz Erdogmus, Kenneth E. Hild II, Marcelino Lazaro, Ignacio Santamaria, Jose C. Principe, "Adaptive Blind Deconvolution of Linear Channels Using Renyi's Entropy with Parzen Estimation", Trans. on Signal Processing, Vol. 52, No. 6, pp. 1489-1498, June 2004 (author PDF)
11Deniz Erdogmus, Kenneth E. Hild II, Yadunandana N. Rao, Jose C. Principe, "Minimax Mutual Information Approach for Independent Components Analysis", Neural Computation, Vol. 16, No. 6, pp. 1235-1252, June 2004 (author PDF)
12D. Erdogmus, J. Principe, "Information Theoretical lower and upper bounds for error probability of classifiers", Journal of VLSI Signal Processing-Systems, Vol. 37, No. 2-3, pp. 305-317, June 2004 (author PDF)
13D. Erdogmus, Y. Rao, H. Peddaneni, A. Hegde, J. Principe, "Recursive principal components analysis usingeigenvector matrix perterbation", EURASIP Journal on Applied Signal Processing, Vol. 2004, No. 13, pp. 2034-2041, Mar. 2004 (author PDF)
14Kenneth E. Hild II, Deniz Erdogmus, Jose C. Principe, "Corrections to 'Blind Source Separation Using Renyi's Mutual Information'", Signal Processing Letters, Vol. 10, No. 8, pp. 250-250, Aug. 2003 (author PDF)
15Deniz Erdogmus, Jose C. Principe, Kenneth E. Hild II, "On-Line Entropy Manipulation: Stochastic Information Gradient", Signal Processing Letters, Vol. 10, No. 8, pp. 242-245, Aug. 2003 (author PDF)
16Deniz Erdogmus, Jose C. Principe, "Convergence Properties and Data Efficiency of the Minimum Error Entropy Criterion in ADALINE Training", Trans. on Signal Processing, Vol. 51, No. 7, pp. 1966-1978, July 2003 (author PDF)
17S.P. Kim, J.C. Sanchez, D. Erdogmus, Y.N. Rao, J.C. Principe, M. Nicolelis, "Divide-and-Conquer Approach for Brain Machine Interfaces: Nonlinear Mixture of Competitive Local Linear Models", Neural Networks, Vol. 16, No. 5-6, pp. 865-871, June 2003 (author PDF)
18Vikas Sindhwani, Subrata Rakshit, Dipti Deodhar, Deniz Erdogmus, Jose C. Principe, Partha Niyogi, "Feature Selection in MLPs and SVMs based on Maximum Output Information", Trans. on Neural Networks, Vol. 15, No. 4, pp. 937-948, Apr. 2003 (author PDF)
19Erik G. Larsson, Deniz Erdogmus, Rui Yan, Jose C. Principe, Jeffrey R. Fitzsimmons, "SNR-optimality of Sum-of-Squares Reconstruction for Phased-Array Magnetic Resonance Imaging", Journal of Magnetic Resonance, Vol. 163, No. 1, pp. 121-123, Jan. 2003 (author PDF)
20Deniz Erdogmus, Kenneth E. Hild II, Jose C. Principe, "Blind Source Separation Using Renyi's a-Marginal Entropies", NeuroComputing, Vol. 49, No. 1, pp. 25-38, Dec. 2002 (author PDF)
21Deniz Erdogmus, Yadunandana N. Rao, Kenneth E. Hild II, Jose C. Principe, "Simultaneous Principal Component Extraction with Application to Adaptive Blind Multiuser Detection", EURASIP Journal on Applied Signal Processing, Vol. 2002, No. 12, pp. 1473-1484, Dec. 2002 (author PDF)
22Deniz Erdogmus, Jose C. Principe, "Generalized Information Potential Criterion for Adaptive System Training", Trans. on Neural Networks, Vol. 13, No. 5, pp. 1035-1044, Sept. 2002 (author PDF)
23Deniz Erdogmus, Jose C. Principe, "An Error-Entropy Minimization Algorithm for Supervised Training of Nonlinear Adaptive Systems", Trans. on Signal Processing, Vol. 50, No. 7, pp. 1780-1786, July 2002 (author PDF)
24I. Santamaria, D. Erdogmus, J.C. Principe, "Entropy Minimization for Supervised Digital Communications Channel Equalization", Trans. on Signal Processing, Vol. 50, No. 5, pp. 1184-1192, May 2002 (author PDF)
25Deniz Erdogmus, Jose C. Principe, Kenneth E. Hild II, "Beyond Second-Order Statistics for Learning: A Pairwise Interaction Model for Entropy Estimation", Natural Computing, Vol. 1, No. 1, pp. 85-108, May 2002 (author PDF)
26Deniz Erdogmus, A. Umut Genc, Jose C. Principe, "A Neural Network Perspective to Extended Luenberger Observers", Institute of Measurement and Control, Vol. 35, No. 2, pp. 10-16, Feb. 2002 (author PDF)
27Kenneth E. Hild II, Deniz Erdogmus, Jose Principe, "Blind Source Separation Using Renyi's Mutual Information", IEEE Signal Processing Letters, Vol. 8, No. 6, pp. 174-176, June 2001 (author PDF)
 
Conference Papers
1Justin C. Sanchez, Deniz Erdogmus, Yadunandana Rao, Sung-Phil Kim, Miguel Nicolelis, Johan Wessberg, Jose C. Principe, "Interpreting Neural Activity Through Linear and Nonlinear Models for Brain Machine Interfaces," Intl. Conf. of Engineering in Medicine and Biology Society.(Submitted)
2Justin C. Sanchez, Deniz Erdogmus, Yadunandana Rao, Jose C. Principe, Johan Wessberg, Miguel Nicolelis, "Analysis of the Neural to Motor Representation Space Constructed by a Recurrent Neural Network Trained for a Brain-Machine Interface," Intl. Work. on Neural Networks for Signal Processing.(Submitted)
3Bryan Davis, Deniz Erdogmus, Yadunandana Rao, Jose Principe, "Supervised Synaptic Weight Adaptation for a Spiking Neuron," Neural Information Processing Systems.(Submitted)
4Nicolas Obolensky, Deniz Erdogmus, Jose C. Principe, "A TIME-VARYING KALMAN FILTER APPLIED TO MOVING TARGET TRACKING," Portuguese Conf. on Automatic Control.(Accepted) (author PDF)
5Bryan Davis, Deniz Erdogmus, Yadunandana N. Rao, Jose C. Principe, "Supervised Synaptic Weight Adaptation for a Spiking Neuron," Intl. Joint Conf. on Neural Networks.(Accepted) (author PDF)
6Mustafa C. Ozturk, Jose C. Principe, Bryan Davis, Deniz Erdogmus, "Simulation of the Freeman Model of the Olfactory Cortex:A Quantitative Performance Analysis for the DSP Approach," Intl. Joint Conf. on Neural Networks.(Accepted) (author PDF)
7Dorothee E. Marossero, Deniz Erdogmus, Neil Euliano, Jose C. Principe, Kenneth E. Hild II, "Independent Components Analysis for fetal electrocardiogram extraction: A case for the data efficient Mermaid algorithm," Intl. Work. on Neural Networks for Signal Processing.(Accepted) (author PDF)
8D. Erdogmus, J. Principe, L. Vielva, "Blind deconvolution with minimal Renyi's entropy", European Signal Processing Conf., pp. 71-74, Jan. 2007 (author PDF)
9D. Erdogmus, J. Principe, S.-P Kim, J. Sanchez, "A recursive Renyi's entropy estimator", American Control Conf., pp. 209-217, Jan. 2007 (author PDF)
10D. Erdogmus, Y. Rao, J. Principe, "Supervised Training of Adaptive Systems with Partially Labeled Data", Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. v321-v324, Apr. 2005 (author PDF)
11D. Erdogmus, R. Jenssen, Y. Rao, J. Principe, "Multivariate density estimation with optimal marginal parzen density estimation and gaussianization", Intl. Conf. on ICA and Signal Separation, pp. 73-82, Sept. 2004 (author PDF)
12D. Erdogmus, Y.N. Rao, J.C. Principe, "Gaussianizing Transformations for ICA", Intl. Conf. on ICA and Signal Separation, pp. 26-32, Mar. 2004 (author PDF)
13J.C. Sanchez, D. Erdogmus, Y.N. Rao, S.P. Kim, M. A. Nicolelis, J. Wessberg, J.C. Principe, "Interpreting Neural Activity Through Linear and Nonlinear Models for Brain Machine Interfaces", Intl. Conf. of Engineering in Medicine and Biology Society, pp. 2160-2163, Sept. 2003 (author PDF)
14S.P. Kim, J.C. Sanchez, D. Erdogmus, Y.N. Rao, J.C. Principe, M. A. Nicolelis, "Modeling the Relation from Motor Cortical Neuronal Firing to Hand Movements Using Competitive Linear Filters and a MLP", Intl. Joint Conf. on Neural Networks, pp. 332-336, July 2003 (author PDF)
15D. Erdogmus, O. Fontenla-Romero, J. Principe, A. Alonso-Betanzos, E. Castillo, R. Jenssen, "Accurate initialization of neural network weights by backpropagationof the desired response", Intl. Joint Conf. on Neural Networks, pp. 2005-2010, July 2003 (author PDF)
16Sung-Phil Kim, Yadunandana N. Rao, Deniz Erdogmus, Jose C. Principe, "A Hybrid Subspace Projection Method for System Identification", Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. VI312-VI324, Apr. 2003 (author PDF)
17M. Lazaro, I. Santamaria, C. Pantaleon, D. Erdomus, K.E. Hild II, J.C. Principe, "Blind equalization by sampled pdf fitting", Intl. Conf. on ICA and Signal Separation, pp. 1041-1046, Apr. 2003 (author PDF)
18D. Erdogmus, Y. Rao, M. Ozturk, L. Vielva, J. Principe, "On the convergence of SIPEX", Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. 697-700, Apr. 2003 (author PDF)
19Justin C. Sanchez, Deniz Erdogmus, Yadunandana Rao, Jose C. Principe, Miguel Nicolelis, Johan Wessberg, "Learning the Contributions of the Motor, Premotor, and Posterior Parietal Cortices for Hand Trajectory Reconstruction in a Brain Machine Interface", IEEE EMBS Neural Engineering Conf., pp. 59-62, Mar. 2003 (author PDF)
20D. Erdogmus, Y. Rao, J. Principe, O. Fontenla-Romero, A. Alonso-Betanzos, "Recursive least squares for anentropy regularized MSE cost function", European Symposium on Artificial Neural Networks, pp. 1-6, 2003 (author PDF)
21Deniz Erdogmus, Justin C. Sanchez, Jose C. Principe, "Modified Kalman Filter Based Method for Training State-Recurrent Multilayer Perceptrons", Intl. Work. on Neural Networks for Signal Processing, pp. 219-228, Sept. 2002 (author PDF)
22Justin C. Sanchez, Sung-Phil Kim, Deniz Erdogmus, Yadunandana N. Rao, Jose C. Principe, Johan Wessberg, Miguel Nicolelis, "Input-Output Mapping Performance of Linear and Nonlinear Models for Estimating Hand Trajectories from Cortical Neuronal Firing Patterns", Intl. Work. on Neural Networks for Signal Processing, pp. 139-148, Sept. 2002 (author PDF)
23Geetha K. Thampi, Jose C. Principe, JeongHo Cho, Deniz Erdogmus, Mark A. Motter, "Adaptive Inverse Control Using SOM based Multiple Models", Portuguese Conf. on Automatic Control, pp. 278-282, Sept. 2002 (author PDF)
24Deniz Erdogmus, Jose C. Principe, Geetha K. Thampi, "Adaptive Linear Observer For Nonlinear Systems", Portuguese Conf. on Automatic Control, pp. 56-60, Sept. 2002 (author PDF)
25D. Erdogmus, Y. Rao, J. Principe, O. Fontenla-Romero, L. Vielva, "An efficient, robust, and fast converging principal components extraction algorithm: SIPEX-G", European Signal Processing Conf., pp. 75-78, Sept. 2002 (author PDF)
26D. Erdogmus, J. Principe, K. Hild, "Do Hebbian synapses estimate entropy?", Intl. Work. on Neural Networks for Signal Processing, pp. 199-208, Sept. 2002 (author PDF)
27Justin C. Sanchez, Deniz Erdogmus, Jose C. Principe, Johan Wessberg, Miguel Nicolelis, "A Comparison Between Nonlinear Mappings and Linear State Estimation to Model the Relation from Motor Cortical Neuronal Firing to Hand Movements", Simulation of Adaptive Behavior, pp. 59-65, Aug. 2002 (author PDF)
28Kenneth E. Hild II, Deniz Erdogmus, Jose C. Principe, "Blind source separation of time-varying, instantanteous mixtures using an on-line algorithm", Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. 993-996, May 2002 (author PDF)
29D. Erdogmus, Y. Rao, J. Principw, J. zhao, K. Hild, "Simultaneous Extraction of principal components using Givens rotations and output variances", Intl. Conf. on Acoustics, Speech, and Signal Processing, pp. 1069-1072, May 2002 (author PDF)
30Kenneth E. Hild II, Deniz Erdogmus, Jose Principe, "On-line Minimum Mutual Information Method for Time-Varying Blind Source Separation", Intl. Conf. on ICA and Signal Separation, pp. 126-131, Dec. 2001 (author PDF)
31D. Erdogmus, J.C. Principe, "An On-Line Adaptation Algorithm for Adaptive System Training with Minimum Error Entropy: Stochastic Information Gradient", Intl. Conf. on ICA and Signal Separation, pp. 7-12, Dec. 2001 (author PDF)
32L. Vielva, D. Erdogmus, J.C. Principe, "Underdetermined Blind Source Separation Using a Probabilistic Source Sparsity Model", Intl. Conf. on ICA and Signal Separation, pp. 675-679, Dec. 2001 (author PDF)
33D. Erdogmus, L. Vielva, J.C. Principe, "Nonparametric Estimation and Tracking of the Mixing Matrix for Underdetermined Blind", Intl. Conf. on ICA and Signal Separation, pp. 189-194, Dec. 2001 (author PDF)
34D. Erdogmus, J.C. Principe, "Convergence Analysis of the Information Potential Criterion in Adaline Training", Intl. Work. on Neural Networks for Signal Processing, pp. 123-132, Sept. 2001 (author PDF)
35D. Erdogmus, D. Rende , J.C. Principe, T.F. Wong, "Nonlinear Channel Equalization Using Multilayer Perceptrons with", Intl. Work. on Neural Networks for Signal Processing, pp. 443-451, Sept. 2001 (author PDF)
36D. Erdogmus, J. Principe, "Convergence analysis of hte information potential criterion in Adaliine Training", Intl. Work. on Neural Networks for Signal Processing, pp. 123-132, Sept. 2001 (author PDF)
37D. Erdogmus, J.C. Principe, "Information Transfer Through Classifiers and its Relation to Probability of Error", Intl. Joint Conf. on Neural Networks, pp. 50-54, July 2001 (author PDF)
38D. Erdogmus, J.C. Principe, "Entropy Minimization Algorithm for Neural Networks", Intl. Joint Conf. on Neural Networks, pp. 3003-3008, July 2001 (author PDF)
39D. Erdogmus, K.E. Hild II, J.C. Principe, "Independent Components Analysis Using Renyi's Mutual Information and Legendre Density", Intl. Joint Conf. on Neural Networks, pp. 2762-2767, July 2001 (author PDF)
40D. Erdogmus, J. Principe, "Entropy minimization algorithm for multilayer perceptrons", Intl. Joint Conf. on Neural Networks, pp. 3003-3008, July 2001 (author PDF)
41J.C. Principe, D. Erdogmus, "From Adaptive Linear to Information Filtering", Symposium on Adaptive Systems for Signal Processing, Communications and Control, pp. 99-104, Oct. 2000 (author PDF)
42D. Erdogmus, J.C. Principe, "Comparison of Entropy and Mean Square Error Criteria in Adaptive System Training Using Higher Order", Intl. Conf. on ICA and Signal Separation, pp. 75-80, June 2000 (author PDF)
 

Copyright Notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.

People

Research

Publications

Courses, Tutorials and Wikis

Communications

Search CNEL