Markovian algorithms for estimating the global maximum or minimum of real valued functions defined on some domain $\Omega \,\, \subset \,\, \mathbb{R}^{d}$ are presented. Conditions on the search ...