We study the two-times differentiability of the value functions of the primal
and dual optimization problems that appear in the setting of expected utility
maximization in incomplete markets. We also study the differentiability of the
solutions to these problems with respect to their initial values. We show that
the key conditions for the results to hold true are that the relative risk
aversion coefficient of the utility function is uniformly bounded away from
zero and infinity, and that the prices of traded securities are sigma-bounded
under the num\'{e}raire given by the optimal wealth process.Comment: Published at http://dx.doi.org/10.1214/105051606000000259 in the
Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute
of Mathematical Statistics (http://www.imstat.org