Answered step by step
Verified Expert Solution
Link Copied!

Question

1 Approved Answer

Problem 2. Let X (X1,...,X) be iid samples from Pe, where 6 is a fixed, unknown, scalar-valued parameter. Let 6, be a n-1/2-consistent estimator

image text in transcribed

Problem 2. Let X" (X1,...,X) be iid samples from Pe, where 6 is a fixed, unknown, scalar-valued parameter. Let 6, be a n-1/2-consistent estimator of 0. The claim is that 0, can be improved by carrying out a single iteration of Newton's root-finding algorithm. More specifically, the claim is that, under regularity conditions, is asymptotically efficient, like the MLE 6, in the sense that it's asymptotically normal with variance equal to the Cramer-Rao lower bound. As in lecture, l, and , are the first and second derivatives of the log-likelihood function with respect to the parameter. Recall that the MLE satisfies the likelihood equation, i.e., (en) = 0; also, I(9) denotes the Fisher information in a sample of size 1 from Pe. === (a) Suppose that P, N(0, 1). Start with 6, as the sample median, find the corre- sponding, and argue that it's asymptotically efficient. (b) Suppose that P corresponding = Pois(0). Starting with e, as the sample variance, find the Use Monte Carlo to find and then compare the variances of the sample variance n, the improved version 0, and the MLE X. Use n = 100 and any value(s) of the true 6 that you like. (c) Prove the asymptotic normality and efficiency of + by following the steps below. I. Use the definition of to show that n1/2 (0-0)=n/2[0-8 - {in (n) /n (n)}]+n/2 (0-0). II. Get a linear Taylor approximation of (0) at 6, (ignoring the remainder term if you like), plug it into the expression in curly braces above, and simplify. III. Argue that n1/2(0-6) is "bounded in probability," i.e., it doesn't converge in probability to too as n o. IV. Prove that the first term in the above display is converging to 0 in probability. Hint: You may use the fact that, under the assumed regularity conditions, if T, is a n-1/2-consistent estimator of 6, then n(T) 1(0) in probability. V. Use the asymptotic normality/efficiency of the MLE to finish the proof.

Step by Step Solution

There are 3 Steps involved in it

Step: 1

blur-text-image

Get Instant Access to Expert-Tailored Solutions

See step-by-step solutions with expert insights and AI powered tools for academic success

Step: 2

blur-text-image

Step: 3

blur-text-image

Ace Your Homework with AI

Get the answers you need in no time with our AI-driven, step-by-step assistance

Get Started

Recommended Textbook for

Introduction to Real Analysis

Authors: Robert G. Bartle, Donald R. Sherbert

4th edition

471433314, 978-1118135853, 1118135857, 978-1118135860, 1118135865, 978-0471433316

More Books

Students also viewed these Mathematics questions