Online and adaptive pseudoinverse solutions for ELM weights


Online and adaptive pseudoinverse solutions for ELM weights


AndrĂ© van Schaik and Jonathan Tapson


Neurocomputing, Volume 149, pp 233-238.




The ELM method has become widely used for classification and regressions problems as a result of its accuracy, simplicity and ease of use. The solution of the hidden layer weights by means of a matrix pseudoinverse operation is a significant contributor to the utility of the method; however, the conventional calculation of the pseudoinverse by means of a singular value decomposition (SVD) is not always practical for large data sets or for online updates to the solution. In this paper we discuss incremental methods for solving the pseudoinverse which are suitable for ELM. We show that careful choice of methods allows us to optimize for accuracy, ease of computation, or adaptability of the solution. 


Unfortunately, we discovered some errors in notation in the manuscript after the final proofs were approved. The manuscript below contains the corrections in red font so they are easily spotted.