Next: Linear models for regression Up: NNA_Exercises_2012 Previous: Probability Theory III [2

# Linear models for regression I [3 P]

Use MATLAB to investigate the dependence of the performance of a linear model consisting of radial basis functions (RBF) on the number of basis functions and the parameter value of the variance. Generate values for the input in the interval and a target function . Add Gaussian noise with standard deviation to the target values and use this as your training data.

a)

Randomly select points from the -interval and the corresponding (noisy) target values. Train the linear model with exact interpolation and default width ( ) on these training points. Measure the mean squared error (MSE) between the original function (without noise) and the predictions of the linear model on the whole -interval. Repeat the experiment at least 20 times for every value of to obtain a more reliable estimate of the true MSE. Plot the MSE and the standard error of the MSE (with error bars) as a function of the number of basis functions .

b)

Set the number of basis functions to the lowest value with which you still obtain a reliably good prediction. Manually select good positions for the RBF centers (explain how you chose them!) and train the weights. Plot the prediction of the network and the target curve in one figure.

c)

Use the same RBF centers as in b). Now change the width of the RBF and investigate how the prediction changes. Plot the MSE as a function of the RBF width and plot the predictions of the network when the width is either too small or to wide. Explain what you find.

Useful Matlab commands: randn and errorbar.

Next: Linear models for regression Up: NNA_Exercises_2012 Previous: Probability Theory III [2
Haeusler Stefan 2013-01-16