If you wish to contribute or participate in the discussions about articles you are invited to contact the Editor

GNSS Performances: Difference between revisions

From Navipedia
Jump to navigation Jump to search
No edit summary
mNo edit summary
 
(12 intermediate revisions by 4 users not shown)
Line 1: Line 1:
{{Article Infobox2
{{Article Infobox2
|Category=Fundamentals
|Category=Fundamentals
|Title={{PAGENAME}}
|Editors=GMV
|Authors=Rui Barradas Pereira
|Level=Basic
|Level=Basic
|YearOfPublication=2011
|YearOfPublication=2011
|Logo=GMV
|Logo=GMV
|Title={{PAGENAME}}
}}
}}
Performance of a navigation system is most usually measured in terms of the solution error ([[Accuracy|accuracy]]) and of the portion of the time it can be used for the intended application ([[Availability|availability]]). However, other performance parameters can become important for some [[GNSS Applications|applications]]. For instance, when a navigation system is used for air or maritime navigation, an unwarned large solution error can seriously increase the risk of an accident, possibly causing damage of goods, injuries to people or even death. Such errors can occur without violating the [[Accuracy|accuracy]] specification, and this is why the civil aviation community has defined the concept of [[Integrity|integrity]] as a measure of the probability that such hazardous situations can take place. Also, since some flight phases (such as approach and landing) are of special criticality, it is important that the navigation system remains available without interruptions during such periods although actually all flight phases have certain needs at this respect. That is why the civil aviation community has defined a fourth performance parameter called [[Continuity|continuity]].




Accuracy is the degree of conformance between the estimated or measured position, velocity and/or time of a platform at a given time and its true position, velocity and/or time{{#tag:ref| This accuracy definition was adapted from the [http://www.navcen.uscg.gov/pdf/2008_Federal_Radionavigation_Plan.pdf 2008 US Federal Radionavigation Plan]<ref> [http://www.navcen.uscg.gov/pdf/2008_Federal_Radionavigation_Plan.pdf Federal Radionavigation Plan], DOT-VNTSC-RITA-08-02/DoD-4650.5, 2008</ref>|group="footnotes"}}.
==Performance Parameters==
 


==Measuring Accuracy==
The civil aviation community has put the greatest effort in the rationalization and standardization of positioning (navigation) performance parameters and requirements, thus specifying the so-called [[Wikipedia:Required navigation performance|Required Navigation Performance (RNP)]] that an airborne navigation system must accomplish<ref>Report of the Special Communications/Operations Divisional Meeting, [[Wikipedia:International Civil Aviation Organization|ICAO]] Doc. 9650, November 1995</ref>:


Although being very easily understood from a conceptual point of view, the way that accuracy is measured and what is measured is not always obvious. The accuracy concept is generally used to measure the accuracy of positioning but can be also be used to measure the accuracy of velocity and even the accuracy of timing. For positioning there are 3 variants depending on the number of dimensions being considered: one-dimensional accuracy (used for vertical accuracy), bidimensional accuracy (used for horizontal accuracy) and tridimensional accuracy (combining horizontal and vertical accuracy)
:'''[[Wikipedia:Required navigation performance|RNP]]:''' A statement of the navigation performance [[Accuracy|accuracy]], [[Integrity|integrity]], [[Continuity|continuity]] and [[Availability|availability]] necessary for operations within a defined airspace.


In literature and in system/product specifications it can be found measurements of accuracy such as CEP, rms, Percentile 67%, Percentile 95%, 1 sigma, 2 sigma. Some of these accuracy measures are averages while others are counts of distribution<ref>[http://www.gpsworld.com/gnss-system/receiver-design/gnss-accuracy-lies-damn-lies-and-statistics-4142 GNSS Accuracy: Lies, Damn Lies, and Statistics], GPS World, Frank van Diggelen, January 2007</ref>:
* '''x% Percentile (x%):''' Means that x% of the positions calculated have an error lower or equal to the accuracy value obtained. Typical used values are 50%, 67%, 75% and 95%. Having an accuracy of 5m (95%) means that in 95% of the time the positioning error will be equal or below 5m.


* '''Circular Error Probable (CEP):''' Percentile 50%. Means that 50% of the positions returned calculated have an error lower or equal to the accuracy value obtained.


* '''Root Mean Square Error (rms):''' The square root of the average of the squared error. This measurement is an average but assuming that the error follows a normal distribution (which is close but not exactly true) it will correspond to the percentile 68% in one-dimensional distributions (e.g. vertical error or timing error) and percentile 63% for bidimensional distributions (e.g. horizontal error). For the horizontal error this measurement is also referred as drms and can have variants such as 2rms or 2drms (2 times rms)
The four parameters used to characterize GNSS performance are based on the [[Wikipedia:Required navigation performance|RNP]] specification are summarized hereafter{{#tag:ref| These definitions were adapted from the [http://www.navcen.uscg.gov/pdf/2008_Federal_Radionavigation_Plan.pdf 2008 US Federal Radionavigation Plan]<ref> [http://www.navcen.uscg.gov/pdf/2008_Federal_Radionavigation_Plan.pdf US Federal Radionavigation Plan], DOT-VNTSC-RITA-08-02/DoD-4650.5, 2008</ref>|group="nb"}}:


* '''x sigma:''' 1 sigma corresponds to one standard deviation and x sigma corresponds to x times 1 sigma. Assuming normal distributions 1 sigma corresponds to Percentile 68% in one-dimensional distributions and Percentile 39% for bidimensional distributions.
:'''[[Accuracy]]:''' The accuracy of an estimated or measured position of a craft (vehicle, aircraft, or vessel) at a given time is the degree of conformance of that position with the true position, velocity and/or time of the craft. Since accuracy is a statistical measure of performance, a statement of navigation system accuracy is meaningless unless it includes a statement of the uncertainty in position that applies.  


:'''[[Availability]]:''' The availability of a navigation system is the percentage of time that the services of the system are usable by the navigator. Availability is an indication of the ability of the system to provide usable service within the specified coverage area. Signal availability is the percentage of time that navigation signals transmitted from external sources are available for use. It is a function of both the physical characteristics of the environment and the technical capabilities of the transmitter facilities.


Less used that the previous measurements are the:
:'''[[Continuity]]:''' The continuity of a system is the ability of the total system (comprising all elements necessary to maintain craft position within the defined area) to perform its function without interruption during the intended operation. More specifically, continuity is the probability that the specified system performance will be maintained for the duration of a phase of operation, presuming that the system was available at the beginning of that phase of operation.
* '''Mean Error:''' Average error. Corresponds Percentile 68% in one-dimensional distributions and Percentile 54% for bidimensional distributions.


* '''Standard Deviation:''' Standard deviation of the error. Same as one sigma. Corresponds Percentile 58% in one-dimensional distributions and Percentile 39% for bidimensional distributions.
:'''[[Integrity]]:''' Integrity is the measure of the trust that can be placed in the correctness of the information supplied by a navigation system. Integrity includes the ability of the system to provide timely warnings to users when the system should not be used for navigation.


Although the mean error and standard deviation are as less used as accuracy measurements, assuming normal distributions its use is as legitimate as the other measurements usually used.


==Relationship between Accuracy Measurements==
Furthermore, an additional performance indicator, the Time To First Fix ([[TTFF]]), is also used by some receiver manufacturers. The TTFF is a measure of performance of a GNSS receiver that accounts for the time elapsed from the GNSS receiver switch-on until the output of a navigation solution within a certain performance (e.g. in terms of [[Accuracy|accuracy]]).


Assuming normal distributions these accuracy measurements can be converted between themselves. There is a correspondence between sigmas and percentiles. This correspondence can be used to convert between accuracy measurements since an accuracy of 1m (1 sigma) corresponds to 2m (2 sigma) , 3m (3 sigma) and xm (x sigma).
==Uses of GNSS Performance Parameters==


The performance parameters described above measure the performance of the GNSS system. These performance parameters can be used in different ways, with different purposes and in different conditions.


For one-dimensional distributions:
One of the uses of the GNSS Performance Parameters is to define requirements that a GNSS System should have in specific conditions. All GNSS systems had such requirements during the specification phase of the development of the system. These requirements are one of the drivers of the system design and development. During the operational phase these requirements are kept and sometimes updated as operational requirements against which actual performance will be verified. Such [[GALILEO Performances|performance]] requirements for [[Galileo General Introduction|Galileo]] can be found in the Galileo Mission High Level Definition coming from the Galileo System Requirement Document<ref> Galileo Mission High Level Definition, v3, September 2002.</ref><ref> Galileo System Requirement Document, ESA-APPNS-REQ-00011, issue 3.0, June 20 2003</ref>. The GPS Performance requirements can be found in the [http://www.gps.gov/technical/ps/ GPS Performance Requirements Documents]<ref> [http://www.gps.gov/technical/ps/2008-SPS-performance-standard.pdf GPS Standard Positioning Service (SPS) Performance Standard], 4<sup>th</sup> Edition, September 2008.</ref><ref> [http://www.gps.gov/technical/ps/2007-PPS-performance-standard.pdf GPS Precision Positioning Service (PPS) Performance Standard], 1<sup>st</sup> Edition, February 2007.</ref>.
{| class="wikitable"
|-
! Sigma
! Percentile
|-
| 0,67
| 0,5 (CEP)
|-
| 0,80
| 0,58 (mean error)
|-
| 1
| 0,6827 (rms and std deviation)
|-
| 1,15
| 0,75
|-
| 1,96
| 0,95
|-
| 2
| 0,9545
|-
| 2,33
| 0,98
|-
| 2,57
| 0,99
|-
| 3
| 0,9973
|-
| 4
| 0,999936
|-
| 5
| 0,99999942
|-
| 6
| 0,999999998
|}


These performance requirements can be used also to define the performance that an [[GNSS Applications|application]] will need from a GNSS system in order to be able to perform its functionality adequately.


For bidimensional distributions (Rayleigh distribution) :
In the same way that these parameters are used for the definition of requirements of a GNSS system, they are use to evaluate its actual performance under typical and well defined conditions. The actual [[GPS Performances|performance of GPS]] is monitored by several entities such as the [[Wikipedia:Federal Aviation Administration|US Federal Aviation Administration]] in its GPS Performance Analysis Reports<ref> [http://www.nstb.tc.faa.gov/reports/PAN72_0111.pdf FAA Global Positioning System (GPS) Standard Positioning Service (SPS) Performance Analysis Report], Report 72, January 2011.</ref>.
{| class="wikitable"
|-
! Sigma
! Percentile
|-
| 1
| 0,394 (std deviation)
|-
| 1,18
| 0,5 (CEP)
|-
| 1,25
| 0,544 (mean error)
|-
| 1,414
| 0,632 (rms)
|-
| 1,67
| 0,75
|-
| 2
| 0,865
|-
| 2,45
| 0,95
|-
| 2,818
| 0,982 (2rms)
|-
| 3
| 0,989
|-
| 3,03
| 0,99
|-
| 4
| 0,9997
|-
| 5
| 0,999997
|-
| 6
| 0,999999985
|}


The increase in performance given by space-based augmentations systems ([[EGNOS Performances|EGNOS]], [[WAAS Performances|WAAS]], [[MSAS Performances|MSAS]]) and of other [[GNSS Augmentation|GNSS Augmentations]] is measured also using these parameters.


Besides being used to evaluate the performance of the GNSS systems and its augmentation systems and technologies these performance parameters are used to measure the performance of the receivers that use these systems. This performance evaluation can be made for generic conditions (such as open sky locations) or for the evaluation of the receiver on specific conditions since the receiver performance can be influenced by local factors such as:


* '''Location of the user''' - Different locations yield different performances since different satellites will be visible at different positions in the sky.
* '''Time of day''' - Despite the fact that different views of constellation will be visible at different times of day, some errors (such as the errors caused by [[Ionospheric Delay]]) have different impacts during different times of the day.
* '''Surrounding environment''' - Surrounding buildings and vegetation can lead to masking of the sky leading to less visible satellites, signal attenuation effects coming from tree foliage and multi-path effects coming from the reflection of the GNSS signal on buildings or other landmarks.


==Notes==
==Notes==
<references group="footnotes"/>
<references group="nb"/>
==References==
==References==
<references/>
<references/>


[[Category:Fundamentals]]
[[Category:Fundamentals]]

Latest revision as of 08:49, 26 July 2018


FundamentalsFundamentals
Title GNSS Performances
Edited by GMV
Level Basic
Year of Publication 2011
Logo GMV.png

Performance of a navigation system is most usually measured in terms of the solution error (accuracy) and of the portion of the time it can be used for the intended application (availability). However, other performance parameters can become important for some applications. For instance, when a navigation system is used for air or maritime navigation, an unwarned large solution error can seriously increase the risk of an accident, possibly causing damage of goods, injuries to people or even death. Such errors can occur without violating the accuracy specification, and this is why the civil aviation community has defined the concept of integrity as a measure of the probability that such hazardous situations can take place. Also, since some flight phases (such as approach and landing) are of special criticality, it is important that the navigation system remains available without interruptions during such periods although actually all flight phases have certain needs at this respect. That is why the civil aviation community has defined a fourth performance parameter called continuity.


Performance Parameters

The civil aviation community has put the greatest effort in the rationalization and standardization of positioning (navigation) performance parameters and requirements, thus specifying the so-called Required Navigation Performance (RNP) that an airborne navigation system must accomplish[1]:

RNP: A statement of the navigation performance accuracy, integrity, continuity and availability necessary for operations within a defined airspace.


The four parameters used to characterize GNSS performance are based on the RNP specification are summarized hereafter[nb 1]:

Accuracy: The accuracy of an estimated or measured position of a craft (vehicle, aircraft, or vessel) at a given time is the degree of conformance of that position with the true position, velocity and/or time of the craft. Since accuracy is a statistical measure of performance, a statement of navigation system accuracy is meaningless unless it includes a statement of the uncertainty in position that applies.
Availability: The availability of a navigation system is the percentage of time that the services of the system are usable by the navigator. Availability is an indication of the ability of the system to provide usable service within the specified coverage area. Signal availability is the percentage of time that navigation signals transmitted from external sources are available for use. It is a function of both the physical characteristics of the environment and the technical capabilities of the transmitter facilities.
Continuity: The continuity of a system is the ability of the total system (comprising all elements necessary to maintain craft position within the defined area) to perform its function without interruption during the intended operation. More specifically, continuity is the probability that the specified system performance will be maintained for the duration of a phase of operation, presuming that the system was available at the beginning of that phase of operation.
Integrity: Integrity is the measure of the trust that can be placed in the correctness of the information supplied by a navigation system. Integrity includes the ability of the system to provide timely warnings to users when the system should not be used for navigation.


Furthermore, an additional performance indicator, the Time To First Fix (TTFF), is also used by some receiver manufacturers. The TTFF is a measure of performance of a GNSS receiver that accounts for the time elapsed from the GNSS receiver switch-on until the output of a navigation solution within a certain performance (e.g. in terms of accuracy).

Uses of GNSS Performance Parameters

The performance parameters described above measure the performance of the GNSS system. These performance parameters can be used in different ways, with different purposes and in different conditions.

One of the uses of the GNSS Performance Parameters is to define requirements that a GNSS System should have in specific conditions. All GNSS systems had such requirements during the specification phase of the development of the system. These requirements are one of the drivers of the system design and development. During the operational phase these requirements are kept and sometimes updated as operational requirements against which actual performance will be verified. Such performance requirements for Galileo can be found in the Galileo Mission High Level Definition coming from the Galileo System Requirement Document[3][4]. The GPS Performance requirements can be found in the GPS Performance Requirements Documents[5][6].

These performance requirements can be used also to define the performance that an application will need from a GNSS system in order to be able to perform its functionality adequately.

In the same way that these parameters are used for the definition of requirements of a GNSS system, they are use to evaluate its actual performance under typical and well defined conditions. The actual performance of GPS is monitored by several entities such as the US Federal Aviation Administration in its GPS Performance Analysis Reports[7].

The increase in performance given by space-based augmentations systems (EGNOS, WAAS, MSAS) and of other GNSS Augmentations is measured also using these parameters.

Besides being used to evaluate the performance of the GNSS systems and its augmentation systems and technologies these performance parameters are used to measure the performance of the receivers that use these systems. This performance evaluation can be made for generic conditions (such as open sky locations) or for the evaluation of the receiver on specific conditions since the receiver performance can be influenced by local factors such as:

  • Location of the user - Different locations yield different performances since different satellites will be visible at different positions in the sky.
  • Time of day - Despite the fact that different views of constellation will be visible at different times of day, some errors (such as the errors caused by Ionospheric Delay) have different impacts during different times of the day.
  • Surrounding environment - Surrounding buildings and vegetation can lead to masking of the sky leading to less visible satellites, signal attenuation effects coming from tree foliage and multi-path effects coming from the reflection of the GNSS signal on buildings or other landmarks.

Notes

  1. ^ These definitions were adapted from the 2008 US Federal Radionavigation Plan[2]

References

  1. ^ Report of the Special Communications/Operations Divisional Meeting, ICAO Doc. 9650, November 1995
  2. ^ US Federal Radionavigation Plan, DOT-VNTSC-RITA-08-02/DoD-4650.5, 2008
  3. ^ Galileo Mission High Level Definition, v3, September 2002.
  4. ^ Galileo System Requirement Document, ESA-APPNS-REQ-00011, issue 3.0, June 20 2003
  5. ^ GPS Standard Positioning Service (SPS) Performance Standard, 4th Edition, September 2008.
  6. ^ GPS Precision Positioning Service (PPS) Performance Standard, 1st Edition, February 2007.
  7. ^ FAA Global Positioning System (GPS) Standard Positioning Service (SPS) Performance Analysis Report, Report 72, January 2011.