섭동/상관관계 기반 최적화 기법

Abstract

This paper describes a new method of estimating the gradient of a function with perturbation and correlation. We impose a known periodic perturbation to the input variable and observe the output of the function in order to obtain much richer and more reliable information. By taking the correlation between the input perturbation and the resultant function outputs, we can determine the gradient of the function. The computation of the correlation does not require derivatives; therefore the gradient can be estimated reliably. Robust estimation of the gradient using perturbation/correlation, which is very effective when an analytical solution is not available, is described. To verify the effectiveness of perturbation/correlation based estimation, the results of gradient estimation are compared with the analytical solutions of an example function. The effects of amplitude of the perturbation and number of samplings in a period are investigated. A minimization of a function with the gradient estimation method is performed.