Problem 3.1 Gamma function

Integrate by parts:

\begin{align} \Gamma (x+1) & = \int\_{0}^{\infty} u^{x} e^{-u} , du \\ & = \int\_{0}^{\infty} u^{x} (-e^{-u})' d u \\ & = \left\[ u^{x}(-e^{-u}) \right]_{0}^{\infty} - \int_{0}^{\infty} (-e^{-u}) (x u ^{x-1}) , du \\ & = - \lim\_{ u \to \infty } \frac{u^{x}}{e^{u}} + x \int\_{0}^{\infty} e^{-u}u^{x-1} , du \\ & = x\Gamma(x) \end{align} \Gamma(1) = \int\_{0}^{\infty} e^{-u} , du \stackrel{s(u)=-u}= - \int\_{0}^{-\infty} e^s , ds = - \left\[ e^{s} \right]\_{0}^{-\infty} = 1

Gamma Function

Problem 3.2 MAP for the exponential density

let has an exponential density

the prior

Problem 3.3 Invariance of MAP to linear transformations

Problem 3.4 Bayesian estimation for the Gaussian mean

Problem 3.6 Bayesian estimation for the precision of a Gaussian

Problem 3.7 Bayesian estimation for a multivariate Gaussian

Problem 3.8 Bayesian estimation for a multinomial distribution