We study the approximation of the classes of functions by the manifold R n formed by all possible linear combinations of n ridge functions of the form r(a · x)): It is proved that, for any 1 ≤ q ≤ p ≤ ∞, the deviation of the Sobolev class W r p from the set R n of ridge functions in the space L q (B d) satisfies the sharp order n -r/(d-1).
Similar content being viewed by others
References
A. R. Barron, “ Universal approximation bounds for superposition of a sigmoidal function,” IEEE Trans. Inform. Theory, 39, 930–945 (1993).
R. A. DeVore, K. Oskolkov, and P. Petrushev, “Approximation by feed-forward neural networks,” Ann. Numer. Math., 4, 261–287 (1997).
L. Devroye, L. Györfy, and G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer, New York (1996).
A. Erdelyi, ed., Higher Transcendental Functions. Vol. 2. Bateman Manuscript Project, McGraw Hill, New York (1953).
Y. Gordon, V. Maiorov, M. Meyer, and S. Reisner, “On best approximation by ridge functions in the uniform norm,” Constr. Approxim., 18, 61–85 (2002).
V. Ya. Lin and A. Pinkus, “Fundamentality of ridge functions,” J. Approxim. Theory, 75, 295–311 (1993).
V. Ya. Lin and A. Pinkus, “Approximation of multivariate functions,” Adv. Comput. Math., World Sci. (Singapore), 257–265 (1994).
B. Logan and L. Shepp, “ Optimal reconstruction of functions from their projections,” Duke Math. J., 42, 645–659 (1975).
V. Maiorov, “ On best approximation by ridge functions,” J. Approxim. Theory, 99, 68–94 (1999).
V. Maiorov, “On best approximation of classes by radial functions,” J. Approxim. Theory, 120, 36–70 (2003).
V. Maiorov, R. Meir, and J. Ratsaby, “On the approximation of functional classes equipped with a uniform measure using ridge functions,” J. Approxim. Theory, 99, 95–111 (1999).
V. Maiorov and R. Meir, “On the near optimality of the stochastic approximation of smooth functions by neural networks,” Adv. Comput. Math., 13, 79–103 (2000).
V. Maiorov, K. I. Oskolkov, and V. N. Temlyakov, “Gridge approximation and Radon compass,” Approxim. Theory (a Volume dedicated to Blagovest Sendov), Ed. B. Bojanov, DARBA, Sofia, 284–309 (2002).
Makovoz Y., “Random approximation and neural networks,” J. Approxim. Theory, 85, 98–109 (1996).
H. N. Mhaskar, “Neural networks for optimal approximation of smooth and analytic functions,” Neural Comput., 8, 164–177 (1996).
H. N. Mhaskar and C. A. Micchelli, “Dimension independent bounds on the degree of approximation by neural networks,” IBM J. Res. Develop., 38, 277–284 (1994).
K. I. Oskolkov, “Ridge approximation, Chebyshev–Fourier analysis and optimal quadrature formulas,” Proc. Steklov Inst. Math., 219, 265–280 (1997).
P. P. Petrushev, “Approximation by ridge functions and neural networks,” SIAM J. Math. Anal., 30, 291–300 (1998).
A. Pinkus, “Approximation by ridge functions, some density problems from neutral networks,” Surface Fitting and Multiresolution Method, 2, 279–292 (1997).
E. M. Stein and G. Weiss, Introduction to Fourier Analysis on Euclidean Spaces, New Jersey, Princeton (1971).
V. Temlyakov, On Approximation by Ridge Functions, Preprint.
A. F. Timan, Theory of Approximation of Functions of the Real Variable, Macmillan Co., New York (1963).
H. Tribel, Interpolation Theory, Function Spaces, Differential Operators, VEB Deutscher Verlag Wissenschaften, Berlin (1978).
V. Vapnik and A. Chervonkis, “Necessary and sufficient conditions for the uniform convergence of empirical means to their expectations,” Theory Probab. Appl., 3, 532–553 (1981).
N. Ya. Vilenkin, Special Functions and the Theory of Representations of Groups [in Russian], Fizmatgiz, Moscow (1965).
B. A. Vostretsov and M. A. Kreines, “Approximation of continuous functions by superpositions of plane waves,” Sov. Math. Dokl., 2, 1320–1329 (1961).
Author information
Authors and Affiliations
Additional information
Published in Ukrains’kyi Matematychnyi Zhurnal, Vol. 62, No. 3, pp. 396–408, March, 2010.
Rights and permissions
About this article
Cite this article
Maiorov, V.E. Best approximation by ridge functions in L p -spaces. Ukr Math J 62, 452–466 (2010). https://doi.org/10.1007/s11253-010-0364-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11253-010-0364-0