This is the problem 2.11 from Lehman book "Theory of point estimation" 2-nd edition.
Construct a sequence $\{\delta_{n}\}$ of estimators of $g(\theta)$, satisfying
$$ \sqrt{n}[\delta_{n} - g(\theta)]\stackrel{d}{\to}\mathcal{N}[0,v(\theta)], \; v>0, $$
but for which the bias $b_{n}(\theta) = E[\delta_{n}] - g(\theta)$ does not tend to zero.
By another words, asymptotic normality does not guaranty that $\{\delta_{n}\}$ is unbiased or even that its bias tends to zero (p 439).
ok, may be for beginning someone has an example:
(a) $k_{n}[\delta_{n} - g(\theta)] \stackrel{d}{\to} H $, where $E[H] = 0$ -- this is asymptotic unbiasedness.
(b) $\delta_{n} \stackrel{p}{\to} g(\theta)$ -- consistency.
(a) plus (b) does not imply that $b_{n} {\to} 0$ as $n{\to} \infty$
– Lars May 02 '15 at 16:18$$ Y_{n} = X_{n}, ; for ; |X_{n}| \leq 1- \frac{1}{n} $$
and $$ Y_{n} = n, ; otherwise. $$
In this case $E[X_{n}]\not\to E[Y]$
– Lars May 02 '15 at 16:36In this case $Y_{n} \to Y=U(-1, 1)$, but $E[Y_{n}]\not\to E[Y]$.
(A. Gut p 183)
– Lars May 02 '15 at 16:43