Cramér Rao Lower Bound - Revision history

Carlos.Lopez at 09:08, 25 November 2011

2011-11-25T09:08:53Z

← Older revision		Revision as of 09:08, 25 November 2011
Line 38:		Line 38:
	==References==		==References==
	<references/>		<references/>


			== Credits ==
			The information presented in this NAVIPEDIA’s article is an extract of the PhD work performed by Dr. Jose Ángel Ávila Rodríguez in the FAF University of Munich as part of his Doctoral Thesis “On Generalized Signal Waveforms for Satellite Navigation” presented in June 2008, Munich (Germany)

	[[Category:Fundamentals]]		[[Category:Fundamentals]]
	[[Category:GNSS Signals]]		[[Category:GNSS Signals]]

Timo.Kouwenhoven at 07:34, 6 November 2011

2011-11-06T07:34:39Z

← Older revision		Revision as of 07:34, 6 November 2011
Line 1:		Line 1:
	{{Article Infobox2		{{Article Infobox2
	\|Category=Fundamentals		\|Category=Fundamentals
	\|Authors=J.A Ávila Rodríguez, University FAF Munich, Germany.		\|Authors=J.A. Ávila Rodríguez, University FAF Munich, Germany.
	\|Level=Advanced		\|Level=Advanced
	\|YearOfPublication=2011		\|YearOfPublication=2011

Carlos.Lopez at 16:03, 4 November 2011

2011-11-04T16:03:51Z

← Older revision		Revision as of 16:03, 4 November 2011
Line 6:		Line 6:
	\|Title={{PAGENAME}}		\|Title={{PAGENAME}}
	}}		}}
	The mean-squared error for any estimate of a nonrandom parameter has a lower bound, known in the literature as the Cramér-Rao lower bound or CRLB in short [J.-A. Avila-Rodriguez et al., 2006]<ref>[J.-A. Avila-Rodriguez et al., ~~2006a~~] J.-A. Avila-Rodriguez, S. Wallner, G.W. Hein, How to Optimize GNSS Signals and Codes for Indoor Positioning, Proceedings of the International Technical Meeting of the Institute of Navigation, ION-GNSS 2006, 26-29 September, 2006, Fort Worth Convention Center, Fort Worth, Texas.</ref>. The Cramér-Rao lower bound defines the ultimate accuracy of any estimation and shows the minimum code pseudorange variance we would have with the best possible receiver implementation. Indeed, the Cramér-Rao lower bound is nothing else than a different way of expressing the Gabor bandwidth which sets the physical limit of a signal for a given bandwidth. This last one is also known in the literature as the root mean square bandwidth.		The mean-squared error for any estimate of a nonrandom parameter has a lower bound, known in the literature as the Cramér-Rao lower bound or CRLB in short [J.-A. Avila-Rodriguez et al., 2006]<ref>[J.-A. Avila-Rodriguez et al., 2006] J.-A. Avila-Rodriguez, S. Wallner, G.W. Hein, How to Optimize GNSS Signals and Codes for Indoor Positioning, Proceedings of the International Technical Meeting of the Institute of Navigation, ION-GNSS 2006, 26-29 September, 2006, Fort Worth Convention Center, Fort Worth, Texas.</ref>. The Cramér-Rao lower bound defines the ultimate accuracy of any estimation and shows the minimum code pseudorange variance we would have with the best possible receiver implementation. Indeed, the Cramér-Rao lower bound is nothing else than a different way of expressing the Gabor bandwidth which sets the physical limit of a signal for a given bandwidth. This last one is also known in the literature as the root mean square bandwidth.

	In our particular case, we are interested in finding the bound of the matrix:		In our particular case, we are interested in finding the bound of the matrix:

Carlos.Lopez at 16:03, 4 November 2011

2011-11-04T16:03:23Z

← Older revision		Revision as of 16:03, 4 November 2011
Line 1:		Line 1:
	{{Article Infobox2		{{Article Infobox2
	\|Category=Fundamentals		\|Category=Fundamentals
	~~\|Title={{PAGENAME}}~~		\|Authors=J.A Ávila Rodríguez, University FAF Munich, Germany.
	\|Authors= J.A Ávila Rodríguez, University FAF Munich, Germany.
	\|Level=Advanced		\|Level=Advanced
	\|YearOfPublication=2011		\|YearOfPublication=2011
			\|Title={{PAGENAME}}
	}}		}}

	The mean-squared error for any estimate of a nonrandom parameter has a lower bound, known in the literature as the Cramér-Rao lower bound or CRLB in short [J.-A. Avila-Rodriguez et al., 2006]<ref>[J.-A. Avila-Rodriguez et al., 2006a] J.-A. Avila-Rodriguez, S. Wallner, G.W. Hein, How to Optimize GNSS Signals and Codes for Indoor Positioning, Proceedings of the International Technical Meeting of the Institute of Navigation, ION-GNSS 2006, 26-29 September, 2006, Fort Worth Convention Center, Fort Worth, Texas.</ref>. The Cramér-Rao lower bound defines the ultimate accuracy of any estimation and shows the minimum code pseudorange variance we would have with the best possible receiver implementation. Indeed, the Cramér-Rao lower bound is nothing else than a different way of expressing the Gabor bandwidth which sets the physical limit of a signal for a given bandwidth. This last one is also known in the literature as the root mean square bandwidth.		The mean-squared error for any estimate of a nonrandom parameter has a lower bound, known in the literature as the Cramér-Rao lower bound or CRLB in short [J.-A. Avila-Rodriguez et al., 2006]<ref>[J.-A. Avila-Rodriguez et al., 2006a] J.-A. Avila-Rodriguez, S. Wallner, G.W. Hein, How to Optimize GNSS Signals and Codes for Indoor Positioning, Proceedings of the International Technical Meeting of the Institute of Navigation, ION-GNSS 2006, 26-29 September, 2006, Fort Worth Convention Center, Fort Worth, Texas.</ref>. The Cramér-Rao lower bound defines the ultimate accuracy of any estimation and shows the minimum code pseudorange variance we would have with the best possible receiver implementation. Indeed, the Cramér-Rao lower bound is nothing else than a different way of expressing the Gabor bandwidth which sets the physical limit of a signal for a given bandwidth. This last one is also known in the literature as the root mean square bandwidth.

Line 27:		Line 26:
	Looking now at the bound of every parameter in particular, the Cramér-Rao lower bound can be expressed as follows:		Looking now at the bound of every parameter in particular, the Cramér-Rao lower bound can be expressed as follows:

	::[[File:CR_Eq_4.png\|none\|~~460px~~]]		::[[File:CR_Eq_4.png\|none\|500px]]

	and for the case the estimator is unbiased, the bound simplifies then to		and for the case the estimator is unbiased, the bound simplifies then to

	::[[File:CR_Eq_5.png\|none\|~~300px~~]]		::[[File:CR_Eq_5.png\|none\|260px]]

	The most important conclusion that can be drawn from observing the equation above is that for the unbiased case, the estimator is not necessary for the computation of the bound. In fact, we only need the Fisher matrix to compute the CRLB, which only depends on the logarithm of the likelihood function. In other words, only in the case of unbiased estimators the Cramér-Rao lower bound is independent of the used estimator. Accordingly, using the unbiased Cramér-Rao lower bound when the estimator is biased can lead to wrong conclusions.		The most important conclusion that can be drawn from observing the equation above is that for the unbiased case, the estimator is not necessary for the computation of the bound. In fact, we only need the Fisher matrix to compute the CRLB, which only depends on the logarithm of the likelihood function. In other words, only in the case of unbiased estimators the Cramér-Rao lower bound is independent of the used estimator. Accordingly, using the unbiased Cramér-Rao lower bound when the estimator is biased can lead to wrong conclusions.

Carlos.Lopez: Created page with "{{Article Infobox2 |Category=Fundamentals |Title={{PAGENAME}} |Authors= J.A Ávila Rodríguez, University FAF Munich, Germany. |Level=Advanced |YearOfPublication=2011 }} The mea..."

2011-11-04T16:02:01Z

Created page with "{{Article Infobox2 |Category=Fundamentals |Title={{PAGENAME}} |Authors= J.A Ávila Rodríguez, University FAF Munich, Germany. |Level=Advanced |YearOfPublication=2011 }} The mea..."

New page

{{Article Infobox2
|Category=Fundamentals
|Title={{PAGENAME}}
|Authors= J.A Ávila Rodríguez, University FAF Munich, Germany.
|Level=Advanced
|YearOfPublication=2011
}}

The mean-squared error for any estimate of a nonrandom parameter has a lower bound, known in the literature as the Cramér-Rao lower bound or CRLB in short [J.-A. Avila-Rodriguez et al., 2006]<ref>[J.-A. Avila-Rodriguez et al., 2006a] J.-A. Avila-Rodriguez, S. Wallner, G.W. Hein, How to Optimize GNSS Signals and Codes for Indoor Positioning, Proceedings of the International Technical Meeting of the Institute of Navigation, ION-GNSS 2006, 26-29 September, 2006, Fort Worth Convention Center, Fort Worth, Texas.</ref>. The Cramér-Rao lower bound defines the ultimate accuracy of any estimation and shows the minimum code pseudorange variance we would have with the best possible receiver implementation. Indeed, the Cramér-Rao lower bound is nothing else than a different way of expressing the Gabor bandwidth which sets the physical limit of a signal for a given bandwidth. This last one is also known in the literature as the root mean square bandwidth.

In our particular case, we are interested in finding the bound of the matrix:

::[[File:CR_Eq_1.png|none|320px]]

being <math>\epsilon</math> the code delay error, <math>\theta</math> the real code delay value and <math>\hat{\theta}</math> its estimation. As it can be shown, the Cramér-Rao lower bound is deeply related to the Fisher information matrix F in the following form:

::[[File:CR_Eq_2.png|none|520px]]

where <math>b\left(\theta\right)</math> is the bias of the estimate <math>\theta</math> and F is the already mentioned Fisher matrix defined by means of the Hessian matrix as follows

::[[File:CR_Eq_3.png|none|420px]]

It must be noted that according to this general definition, the Cramér-Rao lower bound also applies for the case of biased estimates in contrast to the way it is widely used in the general literature where the Cramér-Rao lower bound is understood as the minimum unbiased variance estimate bound.

Looking now at the bound of every parameter in particular, the Cramér-Rao lower bound can be expressed as follows:

::[[File:CR_Eq_4.png|none|460px]]

and for the case the estimator is unbiased, the bound simplifies then to

::[[File:CR_Eq_5.png|none|300px]]

The most important conclusion that can be drawn from observing the equation above is that for the unbiased case, the estimator is not necessary for the computation of the bound. In fact, we only need the Fisher matrix to compute the CRLB, which only depends on the logarithm of the likelihood function. In other words, only in the case of unbiased estimators the Cramér-Rao lower bound is independent of the used estimator. Accordingly, using the unbiased Cramér-Rao lower bound when the estimator is biased can lead to wrong conclusions.

Indeed, due to its simplicity, the unbiased Cramér-Rao lower bound is frequently used to assess performance limits. Nevertheless, we must keep in mind that when multipath is present the exact form of the estimator´s bias explicitly enters the computation of the bound. As a consequence, the use of the unbiased Cramér-Rao has to be actually understood as a desperate try to give a lower bound to a problem which is in reality so complicated and nonlinear that computing the bias is nearly impossible

==References==
<references/>

[[Category:Fundamentals]]
[[Category:GNSS Signals]]