Let F be the infinite-horizon minimal cost function, and FKS  the minimal cost function for horizon s and terminal cost function K. In Section 2 we define the ‘stable domain' (the set of K for which  ), determine some of its properties, and relate these to the questions of stability of the process (whether
), determine some of its properties, and relate these to the questions of stability of the process (whether  ) and whether a given solution of the dynamic programming equation can be identified with F These ideas are developed in Sections 3 and 5 for various strengthenings and weakenings of the hypothesis of non-negative costs. In Section 5 we derive a new sufficient condition for stability and for characterisation of F.
) and whether a given solution of the dynamic programming equation can be identified with F These ideas are developed in Sections 3 and 5 for various strengthenings and weakenings of the hypothesis of non-negative costs. In Section 5 we derive a new sufficient condition for stability and for characterisation of F.