MAXIMUS – CDG Alliance Glen Zimmer- MAXIMUS Richard Clifton - CDG.
CDG Test Plan for Location Determination Tech
-
Upload
lindsey-martin -
Category
Documents
-
view
222 -
download
0
Transcript of CDG Test Plan for Location Determination Tech
-
8/10/2019 CDG Test Plan for Location Determination Tech
1/40
-
8/10/2019 CDG Test Plan for Location Determination Tech
2/40
CDG Test Plans Document for Location Page2
Determination Technologies Evaluation
CONTENTS
1 GENERAL 4 1.1 Purpose, Objectives and Intended Air Interface Standards 4
1.2 Definitions 4
2 DEFINITION OF LOCATION DETERMINATION TECHNOLOGIES (LDTS) 7
2.1 Mobile Station Based Methods 8 2.1.1 MS Based Methods Using Wireless System Signals 8
2.1.2 MS Based Methods Using Satellite Signals 8
2.1.3 MS Based Methods Using Wireless System and Satellite Signals 8
2.2 Network Based Methods 8
2.2.1 Time Difference of Arrival 8
2.2.2 Angle of Arrival 9
2.2.3 Location Fingerprinting 9
2.3 Hybrid Methods 9
2.3.1 Hybrid MS Based Methods Using Wireless System and Satellite Signals Plus Network
Based Methods 9
2.3.2 Hybrid MS Based Methods Using Wireless System plus Network Based Methods 10
3 TEST ASSUMPTIONS AND REQUIREMENTS 10
3.1 Assumptions 10 3.2 Requirements 10
3.2.1 Network Availability 10
3.2.2 Raw Timing and Measurement Data 10
3.2.3 Ground Truth Methodology for Determining Reference Location 10
3.2.4 Use of Additional Antennae for LDT Testing 11
3.2.4.1 Use of Additional Antennae for Mobile Station Based Testing 11
3.2.4.1 Use of Additional Antennae for Network-Based Testing 11
3.2.5 Test Location Methodology 11
3.2.6 Restr ictions on Use of Assistance Information and Previous Location Fixes 12
4 LDT EVALUATION CRITERIA 12
4.1 Evaluation Through Testing 12
4.1.1 Accuracy 12
4.1.1.1 Representation of the results 12
4.1.1.2 Purpose 13
4.1.2 Latency 13
4.1.2.1 Representation of the results 13
4.1.2.2 Purpose 13
4.1.3 Capacity 14
4.1.3.1 Representation of the results 14
4.1.3.2 Purpose 14
4.1.4 Reliability 14
4.1.4.1 Representation of the results 14
4.1.4.2 Purpose 14
4.2 Evaluation by Other Means 15
4.2.1 Impact on the Wireless Network 15 4.2.1.1 Representation of the results 15
4.2.1.2 Purpose 15
4.2.2 Location Reporting 15
4.2.2.1 Representation of the results 16
4.2.2.2 Purpose 16
5 TEST SCENARIOS 16
5.1 Scenario Class Rural 17
5.2 Scenario Class Suburban 19
5.3 Scenario Class Urban 20
-
8/10/2019 CDG Test Plan for Location Determination Tech
3/40
CDG Test Plans Document for Location Page3
Determination Technologies Evaluation
5.4 Scenario Class Highway 22
5.5 Scenario class Water 23
6 ADDITIONAL TESTS FOR SPECIFIC LDTS 24
6.1 GPS-Enabled Mobile Station Based and Hybrid Based LDTs 24
6.1.1 GPS Sensitivity Laboratory Tests 24
6.1.1.1 Background 24
6.1.1.2 Requirements 24 6.1.1.3 Single Satellite Sensitivity (C/N0) Calibration 25
6.1.1.4 Test Scenarios 26
6.1.1.4.1 Receiver Dynamic Range 26
6.1.1.4.2 Receiver Performance Indoors 27
6.1.1.4.3 Receiver Performance Limited Satellite Visibility 27
A LATENCY MEASUREMENTS FOR HANDSET AND HYBRID BASED LDTS 28
B LATENCY MEASUREMENTS FOR NETWORK BASED LDTS 34
C REPORTING FORMATS 36
C.1 Representation of Accuracy and Latency Results 36
C.2 Representation of Capacity Results 39
C.3 Representation of Reliability Results 39
C.4 Representation of Location Reporting Results 40
-
8/10/2019 CDG Test Plan for Location Determination Tech
4/40
CDG Test Plans Document for Location Page4
Determination Technologies Evaluation
1 General
1.1 Purpose, Objectives and Intended Air Interface Standards
The purpose of a Location Determination Technology test is to evaluate the accuracy,latency, reliability, sensitivity, complexity, location reporting capability and capacity ofthe technology under consideration. The CDG Test Plan document contained herein
provides definitions and guidelines for test criteria and test scenarios for all possibleLDTs that provide solutions in meeting the FCC E-911 Phase II requirements for
locating mobile stations based on the TIA/EIA-95 and IS-2000 family of dual mode(analog and digital) standards in both the cellular and the PCS bands.
This document uses the following verbal forms: Shall and shall not identifyrequirements to be followed strictly to conform to the document and from which no
deviation is permitted. Should and should not indicate that one of severalpossibilities is recommended as particularly suitable, without mentioning or excluding
others; that a certain course of action is preferred but not necessarily required; or that
(in the negative form) a certain possibility or course of action is discouraged but notprohibited. May and need not indicate a course of action permissible within thelimits of the document. Can and cannot are used for statements of possibility andcapability, whether material, physical, or causal. The use of must and must not is
equivalent to the use of shall and shall not.
1.2 Definitions
Active Set. The set of CDMA pilots associated with the CDMA Channels containingForward Traffic Channels assigned to a particular mobile station. (See also Candidate
Set)
Advanced Forward Link Trilateration (AFLT). A geolocation technique that utilizesthe mobile stations measured time of arrival of radio signals from the base stations
(and, possibly, other terrestrial measurements).
AOA.Angle of Arrival.
Almanac.See GPS Almanac.
Altitude.The altitude is defined as the Height Above Ellipsoid.
Assistance Data. The GPS assistance data provided by the base station to the mobilestation for various purposes (e.g., acquisition, location calculation or sensitivity
improvement).
Autonomous Mobile Station. A mobile station that is capable of detecting a GPSnavigation signal without any help from the base station. The mobile station may be
capable of autonomously calculating its own position.
Base Station (BS). The base station includes the transceiver equipment, MobileSwitching Center (MSC), Mobile Positioning Center (MPC), Position DeterminationEntity (PDE) and any Inter-Working Function (IWF) required for network connection.
-
8/10/2019 CDG Test Plan for Location Determination Tech
5/40
CDG Test Plans Document for Location Page5
Determination Technologies Evaluation
Candidate Set. The set of CDMA pilots that have been received with sufficient
strength by the mobile station to be successfully demodulated, but have not beenplaced in the Active Set by the base station. (See also Active Set)
C/N0. The ratio of received GPS carrier signal power (C) to the power spectral density
of background noise (N0).
Circular Error Probability (CERP). The CERP is a measurement that expresses the
probability of location fix error being within a stated distance from the ground truth.For example, a 67% within 50 meters CERP means that 67% of location attempts
are located within a circle of 50 meter radius centered at the ground truth. The CERPcan be expressed over the entire set, or any subset, of location estimates determined
by use of a CDF or PDF graph.
Code Division Multiple Access (CDMA). A technique for spread-spectrum multiple-
access digital communications that creates channels through the use of unique codesequences.
Cold Start Acquisition for an Assisted GPS Receiver. The GPS receiver attached to a
mobile station may be assisted via the cellular network to increase coverage andaccuracy of the conventional GPS algorithm and speed up the cold start acquisitiontime. One of the goals of assistance is to remedy the long cold start acquisition delay
associated with the conventional GPS receivers. See section 3.2.6 for restrictions onuse of assistance information available prior to initiation of a location fix attempt.
Cold Start Acquisition for a Standalone GPS Receiver. Refers to conditions where
the GPS unit has been turned off for a period of time and has no location informationto reference and check itself with, so it needs to start over by acquiring satellite signalsand calculating a new position based on the current time, ephemeris, error
corrections, and other satellite information. See section 3.2.6 for restrictions on theuse of assistance information available prior to initiation of a location fix attempt.
Cumulative Distribution Function (CDF). The cumulative distribution function is a
method of showing the probability of location error. The Y-axis is scaled from 0 to100% in 1% increments while the X axis varies from 0 to the maximum location errorin 5 meter increments so that the graph ramps up to the right.
DOP. Dilution of Precision. Measure of location accuracy degradation due to the
effects geometry related to the source of geolocation signals.
Ephemeris. The ephemeris data embedded in the GPS signal. The precise (highaccuracy) orbital parameters of one GPS satellite, as transmitted by that satellite in the
GPS Navigation Message.
Fix. The process of performing a single position computation.
FOCC.AMPS Forward Control Channel.
Geolocation. The process of determining a geographic location.
GPS. Global Positioning System.
-
8/10/2019 CDG Test Plan for Location Determination Tech
6/40
CDG Test Plans Document for Location Page6
Determination Technologies Evaluation
GPS Almanac. The almanac data embedded in the GPS signal. The almanac data are
a reduced-precision subset of the clock and ephemeris parameters for all satellites, astransmitted by every satellite in the GPS Navigation Message.
GPS Navigation Message. A GPS navigation message containing ephemeris
information, message and almanac information.
Ground Truth. The reference coordinates of the mobile station, expressed in latitude
and longitude, which are compared to an LDTs location fix estimate to determine theassociated location fix error in meters.
Handoff. The act of transferring communication with a mobile station from one base
station to another.
Hard Handoff. A handoff characterized by a temporary disconnection of the Traffic
Channel. Hard handoffs occur when the mobile station is transferred between disjointActive Sets, the CDMA frequency assignment changes, the frame offset changes, or the
mobile station is directed from a CDMA Traffic Channel to an analog voice channel.See alsoSoft Handoff.
HDOP. Horizontal Dilution of Precision.
Heading.Measured in degrees from True North.
Height Above Ellipsoid (HAE). The height above the WGS-84 reference ellipsoid, inunits of 1 meter.
Latitude. Refers to the definition given by MIL-STD-2401, "World Geodetic System1984". WGS-84 shall be the sole geodetic reference for all reported test data.
LDT. Location Determination Technology.
LF. Location Fingerprinting.
Location. The terms location and position are used interchangeably throughoutthis document. In this respect, the definition of the term differs from the historic use of
location in wireless systems to identify the mobile stations current serving system.See Position.
Location Report Record. The location information delivered to the network. This
information consists of the exact time of location, the estimates of latitude andlongitude, the estimate of uncertainty, and any other optional data such as the
heading, speed, and/or altitude.
Longitude. Refers to the definition given by MIL-STD-2401, "World Geodetic System1984". WGS-84 shall be the sole geodetic reference for all reported test data.
Mobile Station (MS). A station that communicates with the base station.
Position. The geographic position of the mobile station expressed in latitude,longitude and optionally altitude.
Position Determination Entity (PDE). A network entity which manages the positionor geographic location determination of the mobile station.
-
8/10/2019 CDG Test Plan for Location Determination Tech
7/40
-
8/10/2019 CDG Test Plan for Location Determination Tech
8/40
CDG Test Plans Document for Location Page8
Determination Technologies Evaluation
2.1 Mobile Station Based Methods
Broadly defined, a mobile station based LDT is one that detects signal(s) transmitted
from multiple base stations and/or satellites. Specifically, such methods may bedivided into three sub-categories:
2.1.1 MS Based Methods Using Wireless System Signals
The location determination technologies that use signals transmitted by base stations
serving the system to perform algorithms such as Advanced Forward Link Trilateration(AFLT) fall into this category.
2.1.2 MS Based Methods Using Satellite Signals
The Global Positioning System Navigation type MS based system receives signals from
multiple satellites. Note that technologies that fall into this category make use of only
the satellite signals for location determination. Each mobile station is furnished with astandalone GPS receiver in this category.
2.1.3 MS Based Methods Using Wireless System and Satellite Signals
The location determination technologies that fall into this category use signalstransmitted by a number of GPS satellites as well as a number of wireless system base
stations to estimate the mobile station location. The signals from the base stationsmay be used in aiding the mobile stations GPS signal acquisition. The captured GPSsignals may then be used for location estimation. In addition, the base station signals
may be used in combination with the GPS signals for location estimation.
2.2 Network Based Methods
Broadly defined, a Network based LDT detects the signal transmitted from a mobilestation and uses that signal to determine the mobile station location. Within the
category of Network based methods, there are three techniques that are primarilyemployed: Time Difference of Arrival, Angle of Arrival and Location Fingerprinting.
These techniques may be employed either individually or in combination. Thefollowing is a brief description of each technique:
2.2.1 Time Difference of Arrival
The TDOA technique works by measuring the time of arrival of a radio signal at three
or more separate receivers. Because radio waves can be assumed to travel at a fixedand known rate (the speed of light), by calculating the difference in arrival time at
pairs of receivers, it is possible to calculate hyperbolas on which the transmittingdevice is located. If the TDOA system can receive the mobile station signal at morethan three receivers, additional hyperbolas can be calculated to provide a greater
confidence in the location. The TDOA technique receivers are typically co-located with
-
8/10/2019 CDG Test Plan for Location Determination Tech
9/40
CDG Test Plans Document for Location Page9
Determination Technologies Evaluation
the wireless networks cell site base station, in which case the technique may use the
existing receive antenna already present at a cell site.
2.2.2 Angle of Arrival
The AOA technique determines the direction of arrival of the mobile station's emitted
signal at the LDT receiver antenna. The phase difference of the signal on elements of acalibrated antenna array mounted at the cell site provides a line of bearing to the
mobile station. The intersection of the lines of bearing from two or more receiversprovides the location although single site location determinations using AOA and
TDOA techniques are possible. The AOA technique receivers are also typically co-
located with the wireless networks cell site base station.
2.2.3 Location Fingerprinting
The LF technique utilizes the distinct RF patterns (multipath phase and amplitude
characteristics) of the radio signals arriving at a receiver antenna from a single caller.The unique characteristics of the signal, including its multipath pattern are analyzedand a "fingerprint" is determined for a defined area. The fingerprint is then compared
to a database of previously "fingerprinted" locations, and a match is made. Bymatching the fingerprint of the callers signal with the database of known fingerprints,
the callers geographic location is identified to one of the surveyed areas.
2.3 Hybrid Methods
The Hybrid methods make use of radiolocation measurements performed by both themobile station and the base stations in conjunction, to produce a more robust
estimate of location in a single process. Two techniques are primarily employed:
2.3.1 Hybrid MS Based Methods Using Wireless System and Satellite Signals PlusNetwork Based Methods
These techniques combine GPS satellite and wireless system assisted MS basedmethods with Network based methods. The mobile station collects geolocation
measurements from the GPS satellite constellation as well as signals from the wirelessnetworks base stations. The mobile station then sends the information back to thePDE which combines these geolocation measurements together with geolocation
measurements made by the base station to produce an estimate of the mobile stationslocation. Hybrid based methods use knowledge of the mobile stations reference time
and pilot phase measurements, as well as round trip delay measurements made by the
base station to compute the location. This allows base stations to be used to improvethe availability of the location service under the conditions of limited satellite visibility.Hybrid based methods utilize the integration of CDMA and GPS technologies in the
mobile station, as well as aiding information from the PDE as defined in EIA/TIA-801.The hybrid method may also utilize the integration of AMPS and GPS technologies inthe mobile station, as well as aiding information from the PDE as defined in PN-4662
(to be published as IS-817).
-
8/10/2019 CDG Test Plan for Location Determination Tech
10/40
CDG Test Plans Document for Location Page10
Determination Technologies Evaluation
2.3.2 Hybrid MS Based Methods Using Wireless System plus Network Based Methods
These techniques combine wireless system assisted MS based methods with Network
based methods. The mobile station collects measurements from a number of basestations. These measurements are then sent back to the PDE which combines them
together with measurements made by the network to produce an estimate of the
mobile stations location.
3 Test Assumptions and Requirements
3.1 Assumptions
The scope of the tests shall be limited to FCC E-911 Phase II mandate compliance.
Initially, the testing shall focus on locating mobile stations with the first reported
location fix that is triggered by call initiation.
Testing for location update (a subsequent location determination) may be done
simultaneously or at a later date.
3.2 Requirements
3.2.1 Network Availability
The mobile station shall be able to successfully place emergency calls on the wirelessnetwork during the tests. The LDT shall make the location estimate using geolocation
measurements made on the forward and/or reverse link channels with or withoutaiding messages using the control or traffic channels assigned to the mobile station.
The LDT shall generate a single Location Data as a response to the emergency call
placed by the mobile station. The tests may also optionally include collection oflocation estimates for idle mode phones.
3.2.2 Raw Timing and Measurement Data
The raw, unedited data generated by or delivered by the LDT to the network shall beavailable for independent analysis and audit.
3.2.3 Ground Truth Methodology for Determining Reference Location
There are 4 methods that can be used to collect ground truth for each test site.
1. The first method is to contract a surveying company.
2. The second method is useful in areas where there is a clear view of the sky and
minimal GPS signal blockage is present. This method uses a Differential GPSservice. The GPS receiver receives the local broadcast of differential corrections.
These corrections are supplied to a GPS receiver in RTCM-SC104 format. The datavalues for static locations are copied from the display. A combination of a few
reported values may be used to improve the accuracy of the ground truth estimate.For driving locations, we expect to be able to record the NMEA formatted messages
-
8/10/2019 CDG Test Plan for Location Determination Tech
11/40
CDG Test Plans Document for Location Page11
Determination Technologies Evaluation
from the GPS receiver into a computer for later plotting on the map in a separate
map layer. Note that the differentially corrected maps can be very sparse in rurallocations.
3. The third method is used in downtown locations where there is significant GPS
Signal blockage and/or contamination. A rolling measurement wheel can be used
to measure the distance from street intersections to the test site. A rooftopmeasurement using method 2 may also be used as the starting point. Typical
accuracy is approximately 1 meter.
4. The fourth method is used only if differential corrections are not available in thearea. Differentially corrected digital maps can be used, however, the accuracy is
dependent on the map vendors.
The LDT tests shall clearly specify which technique is being used for ground truth
determination in each case.
3.2.4 Use of Additional Antennas for LDT Testing
3.2.4.1 Use of Additional Antennas for Mobile Station Based Testing
The use of additional antennas for mobile station testing is permitted for all tests. Any
use of an external antenna requires that it be specifically noted that the test wascompleted with an external antenna. Tests undertaken with the antennas must be
specifically labeled with the antenna type and brand used, and the antennascharacteristics (the manufacturers data sheets) be included with the test results. The
antenna used shall be the same antenna intended for commercial deployment of theLDT under test.
3.2.4.2 Use of Additional Antennas for Network-Based Testing
The use of additional antennas to be added to the existing tower antennas is permittedfor all tests. Any use of additional antenna requires that it be specifically noted that
the network-based test was completed with additional antennas. Tests undertakenwith the antennas must be specifically labeled with the antenna type and brand used,and antennas characteristics (the manufacturers data sheets) must be included with
the test results. The antenna used shall be the same antenna intended for commercialdeployment of the LDT under test.
3.2.5 Test Location Methodology
To most accurately represent real world conditions in a repeatable fashion, the mobilestation should be placed next to a standard phantom head (if available) or humanhead1. The mobile station should be clamped in a standard position next to the head
at ear level by following these guidelines (variations shall be noted in the test results):1. center the ear piece on the center of the ear,
2. rotate the mobile station about the ear until the center line of the mobilestation is in line with the line connecting the center of the ear to the center of
the mouth, and
1Placement next to a phantom head or human head attempts to simulate the effects ofhead blockage.
-
8/10/2019 CDG Test Plan for Location Determination Tech
12/40
CDG Test Plans Document for Location Page12
Determination Technologies Evaluation
3. while maintaining the centerline alignment, push the mobile station up to the
face until there are at least three points of contact between the mobile stationand the user's head.
If an external GPS-enabled mobile station antenna is used, the antenna should be
clamped to the phantom head and the orientation noted in the test results.
3.2.6 Restrictions on Use of Assistance Information and Previous Location Fixes
For the scope of tests performed in this document, the LDT under test shall not makeuse of any location assistance information, or knowledge of any other information
related to a previous location fix, that may be available prior to initiation of a newlocation fix attempt. A new location fix attempt starts at the time of call initiation. TheLDT under test shall document in the test report the steps taken to ensure that a
location fix is both independent of previous location fixes and does not make use ofany location assistance information potentially available prior to call initiation.
For the case of GPS-enabled LDTs, this restriction includes, but is not limited to, a
priori knowledge of any previous location fixes, satellite almanac data, satelliteephemeris data, satellite error corrections, satellite position data, satellite velocitydata, satellite time-of-day information, satellite Doppler measurements, satellite code
phase measurements and GPS correlator presetting computations.
4 LDT Evaluation Criteria
4.1 Evaluation Through Testing
The LDT shall be evaluated in field tests (test scenarios are detailed in section 5) usingvendor hardware and software. The version of the hardware and software used, as well
as the stage of development (production, prototype) shall be noted.
The use of simulators for any testing is at the discretion of the Service Provider and isoutside the scope of this document.
4.1.1 Accuracy
The accuracy of the geolocation technology is a measure that defines how close thelocation measurements are to the actual location (see 3.2.3) of the mobile station being
located. The accuracy can only be determined when the LDT provides a location reportwith contents other than sector and cell information. In other words, the accuracyfigures shall be composed of test points and times where the LDT is reliable as defined
in Section 4.1.4. Multiple measurement trials shall be taken for a particular class orsub-class of test scenarios described in Section 5 to assess the accuracy of the LDT. In
this case, accuracy shall be defined as a distribution of the relative distance betweenthe location estimates and the actual location as described by a ground truth
algorithm.
4.1.1.1 Representation of the results
-
8/10/2019 CDG Test Plan for Location Determination Tech
13/40
CDG Test Plans Document for Location Page13
Determination Technologies Evaluation
Since different methods of scoring accuracy yield different results, a technologically
neutral route shall be followed in all cases. The LDT accuracy shall be represented in atabular form by specifying the ground truth and the corresponding location estimates
in terms of the latitude, longitude and optionally altitude, speed and heading valuesfor every performed location estimate. The LDT accuracy shall also be recorded
graphically as a probability density function and a cumulative distribution function for
individual test scenarios (each requiring a total of 120 location estimates collected over3 distinctive locations as described in Section 5). The cumulative result achieved by
weighting the test scenarios based on the Service Providers population density and E-911 calling patterns shall also be recorded. The 95% and the 67% CERP, as well as
CERP values corresponding to 50 meter, 100 meter, 150 meter and 300 meter errorsshall be plotted on the resultant graphs.
GPS-enabled LDTs shall also report the C/N0measurements per satellite, number ofGPS satellites, GPS satellite IDs, and HDOP. Interpolation of the C/N0calibration data
collected during the laboratory testing specified in 6.1.1.3 should be used to relatethese reported C/N0measurements back to GPS signal strengths to permit comparison
of received GPS signal levels among the GPS-enabled mobile station under test.
Table and graph templates for recording test data and representation of test resultscan be found in Appendix C.
4.1.1.2 Purpose
The presentation of data in CDF and PDF forms will allow for independent comparisonof the accuracy of different location determination systems in different tests.
4.1.2 Latency
Latency is defined as the time needed from the instant of mobile station call
origination to the instant the location report record is sent from the PDE (this is equalto TFL). Latency can be broken down into a number of components by defining the
call set-up delay, network delay and the LDT associated processing delay as describedin detail in Appendix A for GPS-enabled LDTs (both Mobile Station based and Hybridmethods) and Appendix B for Network based LDTs.
4.1.2.1 Representation of the results
Latency shall be expressed as the difference between the location report time stampand the mobile station call origination time stamp in a tabular form for each of thelocation estimates performed as referenced in Table C-1 of Appendix C. The associated
constituent delay components, the call setup delay, network delay and LDT delay,shall be explicitly represented as referenced in Tables A-2 and B-2 for GPS based and
Network based LDTs, respectively.
4.1.2.2 Purpose
The latency of location determination is important in determining the LDTs time to
locate and the speed of delivery of location data to network. Both consumer servicesand emergency services require fast time-to-first-locate.
-
8/10/2019 CDG Test Plan for Location Determination Tech
14/40
CDG Test Plans Document for Location Page14
Determination Technologies Evaluation
4.1.3 Capacity
The capacity of an LDT is defined as the maximum number of independent,
simultaneous location determinations the technology can sustain for a given wirelesssystems load. Capacity measurements should be made for unloaded, lightly loaded,
medium load and heavily loaded systems. (Note that the capacity may affect location
accuracy.) The definitions of unloaded, lightly, medium and heavily loaded systemsare left to the Service Providers conducting the tests to define. These definitions shall
be included in the representation of the test results.
4.1.3.1 Representation of the results
The capacity of an LDT shall be expressed as
The maximum number of independent, simultaneous location estimates an LDTcan handle, expressed as the number of simultaneous locations, for an unloadedsystem,
The maximum number of independent, simultaneous location estimates an LDT
can handle, expressed as the number of simultaneous locations, for a lightly
loaded system, The maximum number of independent, simultaneous location estimates an LDT
can handle, expressed as the number of simultaneous locations, for an averageload system,
The maximum number of independent, simultaneous location estimates an LDTcan handle, expressed as the number of simultaneous locations, for a heavily
loaded system.These values shall be given for each test scenario. Also an average capacity value shall be
presented for a weighted inclusive set of test scenarios.
The template for representation of capacity test results can be found in Table C-2 ofAppendix C.
4.1.3.2 Purpose
The capacity measurements show the usefulness of a particular LDT system forlocation based consumer and/or emergency services.
4.1.4 Reliability
Reliability is defined as the total number of E-911 calls that result in a location report
divided by the total number of E-911 calls, for each test scenario and for the weightedinclusive set of test scenarios.
4.1.4.1 Representation of the results
The reliability of an LDT shall be expressed as one number per test scenario, and one
number for the set of all tests with the associated percentage of location requestswhere the LDT is able to return a location estimate other than the cell and sector
information as referenced in Table C-3 of Appendix C. The associated latencymeasurements shall be reported in conjunction with all reliability measurements.
-
8/10/2019 CDG Test Plan for Location Determination Tech
15/40
CDG Test Plans Document for Location Page15
Determination Technologies Evaluation
4.1.4.2 Purpose
The reliability of an LDT gives an indication of the percentage of location estimaterequests that result in location reports other than sector and cell information.
4.2 Evaluation by Other Means
4.2.1 Impact on the Wireless Network
No specific test or measurement is needed for this evaluation. However, the followingissues need to be understood/observed and shall be documented:
1. Configuration changes in the cellular network.2. Software changes in the cellular network.
3. Physical footprint size of the LDT equipment, power requirements andenvironmental conditions required, e.g., air conditioning, etc.
4. If the LDT product is evaluated with one wireless technology, e.g., AMPS and N-AMPS, then how much of the hardware can be re-used (leveraged) for supporting
another wireless technology, e.g., CDMA, or for supporting two wireless carriersusing the same or different wireless technologies or for supporting multi-band, i.e.,800 and 1900 MHz, wireless technologies.
4.2.1.1 Representation of the results
For evaluating the impact on the wireless network, record the following:
1. Hardware additions
2. Software additions3. Modifications to the communications link
4. Physical area needed to house various components of the LDT equipment5. Power requirements of the LDT equipment
6. Air conditioning requirements of the LDT equipment7. Amount of hardware sharing of LDT equipment working with two or more air
interfaces or wireless services, e.g., cellular and PCS.
4.2.1.2 Purpose
The purpose of these tests is to evaluate the impact of operating the LDT on the
wireless network in terms of the complexity of the required changes to the wirelessnetwork, the physical requirements of the LDT equipment, etc.
4.2.2 Location Reporting
Any scenario defined in Section 5 may be selected for conducting these tests since
these are functional tests. A location reporting test to demonstrate the ability to reportlocation of a specific call as triggered by a call initiation, in the presence of multiple E-911 calls, shall be conducted.
The following desirable location reporting tests may be conducted:
-
8/10/2019 CDG Test Plan for Location Determination Tech
16/40
-
8/10/2019 CDG Test Plan for Location Determination Tech
17/40
CDG Test Plans Document for Location Page17
Determination Technologies Evaluation
coverage, the locations selected shall be sufficiently far apart so that the mobile
stations at these locations will have entirely different base stations in both their ActiveSet and Candidate Set. For GPS-enabled LDTs, the locations shall provide entirely
different satellite constellations. Tests in one of the three locations shall be conductedat busy hour while tests for the second location shall be conducted at an off-peak
hour. Tests for the third location shall be conducted at night. The definitions of busy
hour, off-peak hour and night time are left up to the service provider conducting thetest.
The Service Provider conducting the test may choose the scenarios to be tested fromthe list of scenarios given in Sections 5.1 to 5.5 based on its network coverage area.
The set of LDT evaluation criteria given in Section 4 that shall be the outcome of everyconducted test will not only present results for the individual tested scenarios but alsoa cumulative result that is achieved by weighting the tested scenarios based on the
population density and the wireless E-911 calling patterns.
To obtain the proper weights for a given service area, the provider should identify thecomplete set of scenarios that are representative of his service area and establish the
expected fraction of total calls in each scenario. Additionally, the provider shouldestablish the fraction of total calls in each scenario during the peak, off-peak and night
hours. The actual sites selected for the tests should be representative of the expectedtraffic conditions, as well as, the propagation conditions associated with each scenario.
Thus, test results of each scenario shall have a weight reflecting its expected spatialand temporal distribution of calls in the service area. Ideally, the sum of the weights
should be equal to one, however, good results in the high traffic scenarios may reducethe need for tests in the very low traffic scenarios during compliance tests.
5.1 Scenario Class - Rural
Sparsely populated geographic areas with isolated dwellings characterize the rural
class of scenarios. This class specifically excludes corridors along highways and
freeways. The rural test scenarios listed in Table 5.1 should be repeated for each of thefollowing rural cases applicable to the Service Providers network coverage area:
AMPS Coverage Area: Isolated Single AMPS Rural Coverage Case
A single, large AMPS omni-directional (or sectorized) base station coverage areadefines this case with no hand-off candidates. The mobile station can only detect a
single AMPS FOCC. Only the serving AMPS base station can detect the mobilestation.
AMPS Coverage Area: Nominal AMPS Rural Coverage Case
A single, large AMPS omni-directional (or sectorized) base station coverage area
defines this case with limited hand-off candidates. The mobile station detects andmonitors the strongest AMPS FOCC, though additional weaker control channels
may be detectable. Multiple base stations may detect the mobile station, but theserving AMPS base station remains the same.
CDMA Coverage Area: Isolated Single CDMA Base Station Rural Coverage Case
This case is defined by a single, large CDMA omni-directional (or sectorized) base
station coverage area with no additional base stations, either above or below the
-
8/10/2019 CDG Test Plan for Location Determination Tech
18/40
CDG Test Plans Document for Location Page18
Determination Technologies Evaluation
CDMA T_ADD system parameter. The mobile station can only detect a single base
station pilot. Only the serving CDMA base station can detect the mobile station.
CDMA Coverage Area: Nominal CDMA Rural Coverage Case
This case is defined by a single, large CDMA omni-directional (or sectorized) base
station coverage area with no other base stations exceeding the CDMA T_ADDsystem parameter. There is only one base station in the mobile stations Active Set.
Table 5.1. Rural Test Scenarios
Ref.
No.
Environment Condition Number of
Locations
No. of
LocationEstimatesper
Location
Notes
R-1 Flat land, clear viewof sky Outdoor, stationary 3 40
R-2 Flat land, clear view
of sky
Inside car,
stationary
3 40
R-3 Flat land, clear view
of sky
Inside car,
30 mph
3 40
R-4 Flat land Inside metal roofed
building, stationary
3 40 2
R-5 Flat land Inside woodbuilding, stationary
3 40 1
R-6 Flat land, densefoliage
Outdoor, stationary 3 40
R-7 Flat land, dense
foliage
Inside car,
stationary
3 40
R-8 Flat land, dense
foliage
Inside car,
30 mph
3 40
R-9 Flat land, dense
foliage
Inside metal roofed
building, stationary
3 40 2
R-10 Flat land, dense
foliage
Inside wood
building, stationary
3 40 1
R-11 Hilly terrain, clearview of sky
Outdoor, stationary 3 40
R-12 Hilly terrain, clearview of sky
Inside car,stationary
3 40
R-13 Hilly terrain, clear
view of sky
Inside car,
30 mph
3 40
R-14 Hilly terrain Inside metal roofed
building, stationary
3 40 2
R-15 Hilly terrain Inside wood
building, stationary
3 40 1
R-16 Hilly terrain, dense
foliage
Outdoor, stationary 3 40
R-17 Hilly terrain, densefoliage
Inside car,stationary
3 40
-
8/10/2019 CDG Test Plan for Location Determination Tech
19/40
CDG Test Plans Document for Location Page19
Determination Technologies Evaluation
R-18 Hilly terrain, densefoliage
Inside car,30 mph
3 40
R-19 Hilly terrain, dense
foliage
Inside metal roofed
building, stationary
3 40 2
R-20 Hilly terrain, dense
foliage
Inside wood
building, stationary
3 40 1
R-21 Repeater in anyterrain
Outdoor, stationary 3 40
Note(s):
1. House is made of wood-frame construction.2. The building must be metal roofed and may be also metal sided. The test shall
be conducted on the ground floor of the building.
5.2 Scenario Class Suburban
Medium levels of population density, where 1-2 story residential neighborhoods, 2-3
story office buildings, and public spaces such as large shopping malls and multi-levelparking garages characterize the suburban class of scenarios. The suburban test
scenarios listed in Table 5.2 should be repeated for each of the following suburbancases that are applicable to the Service Providers network coverage area:
AMPS-only Coverage Area: Nominal AMPS Suburban Coverage Case
A single AMPS omni-directional (or sectorized) base station coverage area defines this
case with hand-off candidates. The mobile station may detect several AMPS FOCCsand occasionally change the control channel it monitors. Multiple base stations may
detect the mobile station, with the serving AMPS base station changing occasionally.
CDMA Coverage Area: Nominal CDMA Suburban Coverage Case
This case is defined for soft/softer handoff coverage areas where there are 1-3 CDMAomni-directional/sectorized base station(s) in the Active Set. 1-3 base station(s) detect
the mobile station.
Table 5.2. Suburban Test Scenarios
Ref.
No.
Environment Condition No of
Locations
No of
LocationEstimates
per
Location
Notes
S-1 Residential sidewalk Outdoor, stationary 3 40
S-2 Residential sidewalk Outdoor, walking 3 40
S-3 Residential 2 lanestreet
Inside car, stationary 3 40
S-4 Residential 2 lanestreet
Inside car,15-40 mph
3 40
S-5 Residential house,wood
Upper floor,stationary
3 40 1
-
8/10/2019 CDG Test Plan for Location Determination Tech
20/40
CDG Test Plans Document for Location Page20
Determination Technologies Evaluation
S-6 Residential house,wood
Basement, stationary 3 40 1
S-7 Residential house,
brick
Upper floor,
stationary
3 40 2
S-8 Residential house,
brick
Basement, stationary 3 40 2
S-9 Shopping mall No atrium or opensky, stationary
3 40 3
S-10 2-3 story officebuilding
Bottom floor,stationary
3 40
S-11 Warehouse Site Inside, metal roofed 3 40 4
S-12 Parking garage,middle floor
Inside car, stationary 3 40
S-13 Parking garage,middle floor
Outside car,stationary
3 40
S-14 Shopping Plazas Outdoor, stationary 3 40 5
S-15 Shopping Plazas Indoor, stationary 3 40 6
Note(s):1. Residential house is made of wood-frame construction.2. Residential house is made of brick or concrete construction.
3. There should be no direct view of the sky from within the shopping mall.4. The building roof is metal sheeting, the building walls may be metallic also. The
test shall be conducted on the ground floor of the building.5. Shopping plazas (also commonly referred to as strip malls) are distinguished from
the shopping malls in that they consist of stores adjacent to one another andwhich are independently accessed from the outside. They generally tend to haveopen air parking lots.
6. Inside one of the shops in a shopping plaza, e.g., inside a supermarket.
5.3 Scenario Class Urban
High levels of population density characterize the urban class of scenarios, multi-story/high rise apartment/office buildings as well as medium height and narrow
streets are typical. The urban test scenarios listed in Table 5.3 should be repeated foreach of the following urban cases that are applicable to the Service Providers network
coverage area:
AMPS-only Coverage Area: Nominal AMPS Urban Coverage Case
This case is defined for the unlikely case of AMPS-only urban coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control
channel with only minor movement of the mobile station. Multiple base stations
typically detect the mobile station.
CDMA Coverage Area: Nominal CDMA Urban Coverage Case
This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMA
omni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.
-
8/10/2019 CDG Test Plan for Location Determination Tech
21/40
CDG Test Plans Document for Location Page21
Determination Technologies Evaluation
Table 5.3 Urban Test Scenarios
Ref.No.
Environment Condition No of Locations
No ofLocation
EstimatesperLocation
Notes
U-1 Urban canyon-high,
intersection
Outdoor, stationary 3 40 1, 8
U-2 Urban canyon-high,mid-block
Outdoor, walking 3 40 1, 8
U-3 Urban canyon-med.,intersection
Outdoor, stationary 3 40 2, 8
U-4 Urban canyon-med.,mid-block
Outdoor, walking 3 40 2, 8
U-5 Off-street Outdoor, stationary 3 40 3
U-6 Off-street Outdoor,walking/jogging
3 40 3
U-7 Urban canyon-high,
mid-block
Inside car,
stationary
3 40 1
U-8 Urban canyon-high,
Multi-Lane Street
Inside car,
10-25mph
3 40 1
U-9 Narrow alley, 1 lane
street
Inside car,
stationary
3 40 4
U-10 Urban canyon-high,exterior room
Indoor, stationary,top floor
3 40 1, 5
U-11 Urban canyon-high,exterior room
Indoor, stationary,middle floor
3 40 1, 5
U-12 Urban canyon-high,exterior room
Indoor, stationary,ground floor
3 40 1, 5
U-13 Urban canyon-high,
interior room
Indoor, stationary,
top floor
3 40 1, 6
U-14 Urban canyon-high,
interior room
Indoor, stationary,
middle floor
3 40 1, 6
U-15 Urban canyon-high,
interior room
Indoor, stationary,
ground floor
3 40 1, 6
U-16 Urban canyon-high,core
Indoor, stationary,top floor
3 40 1, 7
U-17 Urban canyon-high,core
Indoor, stationary,middle floor
3 40 1, 7
U-18 Urban canyon-high,
core
Indoor, stationary,
ground floor
3 40 1, 7
U-19 Urban canyon-med.,
exterior room
Indoor, stationary,
top floor
3 40 2, 5
U-20 Urban canyon-med.,
exterior room
Indoor, stationary,
middle floor
3 40 2, 5
U-21 Urban canyon-med.,
exterior room
Indoor, stationary,
ground floor
3 40 2, 5
U-22 Parking garage,middle floor
Inside car,stationary
3 40 9
-
8/10/2019 CDG Test Plan for Location Determination Tech
22/40
CDG Test Plans Document for Location Page22
Determination Technologies Evaluation
U-23 Parking garage,middle floor
Outside car,stationary
3 40 9
U-24 Urban low rise Outdoor, stationary 3 40 10
U-25 Urban low rise Outdoor, walking 3 40 10
U-26 Urban low rise Inside car,10-25mph
3 40 10
U-27 Urban low rise Indoor,Ground floor
3 40 10
U-28 Urban residential,brick
Ground floor,Stationary
3 40 11
U-29 Urban residential,
sidewalk
Outdoor, walking 3 40 11
Note(s):
1. Urban canyon-high includes buildings with between 25-50 stories.2. Urban canyon-medium includes buildings with between 5-10 stories.
3. Off street area, e.g., a park with preferably plenty of foliage and near the
downtown dense urban area.4. 4-8 story buildings surround alley on either side.
5. 4 meters from the window, no interior wall blocking the window access.6. 10 meters from the window, 1 interior wall between the windows and the mobile
station.7. Near the core of the high-rise building by the elevator.
8. Location estimates should be collected from the safety of the sidewalk, at either thestreet intersection or mid-block as specified under Environment.
9. Multi-storied parking garage, in, or on the fringes of the urban core or downtown.
10.Urban low rise includes streets lined with two or three-storied, side-by-side, brickbuildings covering entire blocks. This portion of the urban area generally lies
beyond the urban core.11.Area consists mostly of single family brick houses, which are closely spaced.
5.4 Scenario Class Highway
Freeways, primary and secondary roads between major population centerscharacterize the highway class of scenarios. Excluded from these areas are heavily
urbanized areas where buildings are over 2 stories. There is significant overlap inadjacent omni-directional/sectorized base station coverage for mobile station service
along the driving corridor. Foliage will range from non-existent to a dense canopy. Thehighway test scenarios listed in Table 5.4 should be repeated for each of the followinghighway cases that are applicable to the Service Providers network coverage area:
AMPS-only Coverage Area: Nominal AMPS Highway Coverage Case
This case is defined for the unlikely case of AMPS-only highway coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control
channel with only minor movement of the mobile station. Multiple base stationstypically detect the mobile station.
CDMA Coverage Area: Nominal CDMA Highway Coverage Case
-
8/10/2019 CDG Test Plan for Location Determination Tech
23/40
CDG Test Plans Document for Location Page23
Determination Technologies Evaluation
This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMA
omni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.
Table 5.4 Highway Test Scenarios
Ref.No.
Environment Condition No of Locations
No ofLocationEstimates
perLocation
Notes
H-1 Highway Inside car, heavy traffic 3 40
H-2 Highway Inside car, 30-40 mph 3 40
H-3 Highway Inside car, max speed limit 3 40 1
H-4 Highway Area serviced by repeaters,inside car
3 40
Note(s):
1. These tests should be conducted at the maximum posted speed limit, taking intoaccount safety and responsible driving practices.
5.5 Scenario Class Water
Proximity to water bodies such as a lake, bay or ocean categorize the water class ofscenarios. There may be a significant RF delay profile due to over-water propagation
effects. The water test scenarios listed in Table 5.5 should be repeated for each of thefollowing water cases that are applicable to the Service Providers network coverage
area:
AMPS-only Coverage Area: Nominal AMPS Water Coverage Case
This case is defined for the unlikely case of AMPS-only water coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control
channel with only minor movement of the mobile station. Multiple base stationstypically detect the mobile station.
CDMA Coverage Area: Nominal CDMA Water Coverage Case
This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMAomni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.
Table 5.5 Water Test Scenarios
Ref.
No.
Environment Condition No of
Locations
No of
LocationEstimates
perLocation
Notes
W-1 Boat, within 2miles from shore
Stationary 3 40
-
8/10/2019 CDG Test Plan for Location Determination Tech
24/40
CDG Test Plans Document for Location Page24
Determination Technologies Evaluation
W-2 Boat, within 2miles from shore
5-20 knots 3 40
W-3 Waterfront
building, exteriorroom
Indoor, stationary 3 40
W-4 Waterfront
building, interiorroom
Indoor, stationary 3 40
W-5 Waterfront Outdoor,
stationary
3 40
W-6 Waterfront Inside car,stationary
3 40
W-7 Waterfront Inside car,20-40 mph
3 40
6 Additional Tests for Specific LDTs
6.1 GPS-Enabled Mobile Station Based and Hybrid Based LDTs
6.1.1 GPS Sensitivity Laboratory Tests
In addition to the tests described in Section 5, these laboratory tests shall be
performed by any Mobile Station based and Hybrid based LDTs which utilize GPSconstellation measurements at the mobile station for the purpose of geolocation.
6.1.1.1 Background
The GPS signal sensitivity of the mobile station in field test environments is assessed
qualitatively in the test scenarios of Section 5. There is a direct correlation betweenachieved location accuracy and measured signal strength. In highly blockedenvironments, the GPS signal is weaker and more multi-path is present, resulting in
less accurate location fixes. Therefore the capability of the mobile station to receiveweak GPS signals is reported indirectly by the accuracy, TFL and reliability results.
The C/N0field measurement data should be used to compare the received GPS signal
strength levels encountered by each GPS-enabled mobile station under test. The C/N0measurement shall be recorded per location fix. As the C/N0definitions differ between
GPS manufacturers, it is important to have a calibration phase in a controlledenvironment, using a GPS RF simulator. This permits the reported C/N0measurements from different GPS-enabled mobile stations to be related back to
common received GPS signal strength values. This will assist interpretation of the
C/N0values reported during field testing from multiple GPS-enabled mobile stations.
The laboratory based simulator tests described in this section also provide quantitative
measurements of the GPS-enabled mobile station receiver sensitivity performance inrelation to the geolocation processing time.
6.1.1.2 Requirements
-
8/10/2019 CDG Test Plan for Location Determination Tech
25/40
CDG Test Plans Document for Location Page25
Determination Technologies Evaluation
A Multi-Channel L1 C/A-Code GPS Satellite Simulator2with at least 45 dB attenuation
range should be used. The attenuation shall be controllable on an individual channel(satellite) basis. Two phase coherent RF outputs with separate physical locations
(scenarios) shall provide input to a reference receiver and the mobile station undertest. The reference output shall be at nominal open-sky signal levels and the test
output signal strength shall be set according to the parameters specified in the
following test scenarios.
For these tests, the mobile station under test shall operate in a Cellular/PCS systemwith 3 cell coverage in the location of GPS simulator testing. The restrictions described
in 3.2.6 for the use of assistance information available prior to initiation of a locationfix shall be applicable to these laboratory tests. Upon call initiation, the mobile station
and PDE may exchange position location assisting information. The locationhypothesis may be retrieved from either the mobile station or PDE, and then comparedagainst the mobile stations ground truth location to determine the location error.
6.1.1.3 Single Satellite Sensitivity (C/N0) Calibration
The GPS simulator should be set in a single satellite configuration to calibrate the
reported C/N0 output values of different GPS-enabled mobile station receivers to acommon GPS input signal strength definition. For these calibration procedures, themobile station under test should be configured as it will be field-tested.
The test setup should employ an anechoic chamber to facilitate far-field radiated
testing of the GPS-enabled mobile station under test. The anechoic chamber setupincludes the GPS simulator source connected to a standard reference radiating
antenna. The GPS-enabled mobile station under test should be at a fixed distancefrom the radiating source. To account for polarization mismatch between radiating andreceiving sources, the calibration procedure should be conducted for both vertical and
horizontal polarizations and the measured C/N0values linearly summed to provide theaggregate of the two orientations. Any variations in the suggested laboratory
procedures shall be noted in the test results.
Suggested laboratory procedures include the following:
1. Configure the radiating antenna to use vertical polarization. Account for calibration
of known cable loss between GPS simulator source and radiating antenna, as wellas anechoic chamber path loss between radiating antenna and receiving GPS-
enabled mobile station under test. Adjust the GPS simulator level such that theGPS input signal strength received at the mobile station under test is at 125 dBm.
2. Record the reported mobile station C/N0 value.
3. The GPS-enabled mobile station under test should be rotated 5 degrees in azimuth
relative to the GPS simulator radiating antenna. Repeat step 2. Continue until theentire azimuthal plane is measured at 5 degree resolution.
4. Adjust the mobile station under test elevation angle relative to the GPS simulatorradiating antenna by 5 degrees. Repeat steps 2 and 3.
2 One commercial GPS simulator option has 4 channels. It has a 47 dB attenuationrange programmable in 0.5 dB increments.
-
8/10/2019 CDG Test Plan for Location Determination Tech
26/40
CDG Test Plans Document for Location Page26
Determination Technologies Evaluation
5. Repeat step 4 over the elevation range of +/- 90 degrees relative to the GPS
simulator radiating antenna until the entire sphere of orientation is mapped.3
6. Repeat steps 2-5 with the radiating antenna configured to use horizontalpolarization.
7. Compute the linear-mean of the recorded C/N0 measurements from steps 2-6 byfirst summing the vertical and horizontal polarization C/N0 values (in linear terms)
for each corresponding azimuth/elevation measurement point, and thencalculating the C/N0 linear-mean value for the entire sphere of orientation.
8. Reduce the GPS simulators output level by 5 dB. Repeat steps 1-7 until Table
6.1.1.3-1 is completed.
Table 6.1.1.3-1 GPS Simulator Input Level vs. Mobile Station Under Test Mean
Output C/N0Value
GPS Simulator InputLevel at Mobile StationUnder Test
[dBm]
GPS-Enabled MobileStation MeanReported C/N0
[dB-Hz]
-125
-130
-135
-140
-145
-150
-155-160
6.1.1.4 Test Scenarios
These lab scenarios test the effects of a 25 dB difference in GPS satellite signalstrength being combined in the same location estimate. The purpose is to test with a
larger dynamic range than the 20.9 dB cross correlation protection afforded by the1023 chip CDMA code length when there is 0 Hz Doppler difference between two GPSsignals. The signal levels shall be -125 dBm for the strong signal strength and -150
dBm for the weak signal(s).
6.1.1.4.1 Receiver Dynamic Range
3Care should be taken to ensure any test cables connected to the mobile station under
test do not affect the antennas receiving characteristics.
-
8/10/2019 CDG Test Plan for Location Determination Tech
27/40
CDG Test Plans Document for Location Page27
Determination Technologies Evaluation
This lab scenario tests receiver dynamic range. This static test shall utilize a 3-
satellite constellation with two strong signals and one weak signal. The purpose ofthis test is to determine the receivers cross-correlation detection capabilities. Altitude
aiding may be applied during this test for 3-D solution. This scenario demonstrateswhether the receiver acquires, detects and uses the cross-correlated measurement in
the geolocation.
Geolocations shall be performed over 20 minutes with cold start acquisitions every 20
seconds to explore the full range of code phase relations for a typical GPS signal.
6.1.1.4.2 Receiver Performance Indoors
This lab scenario tests receiver performance indoors. The test shall use a 3-satelliteconstellation, with all satellites transmitting weak signals. Altitude aiding may be
applied during this test for 3-D solution. This scenario tests the receivers ability toacquire weak GPS signals, when no direct signals are present, and provide a position
solution. Optionally, this lab scenario may test receiver performance under varioussatellite constellation configurations. The satellite geometry tested shall be
represented by corresponding Horizontal Dilution of Precision (HDOP).
Geolocations shall be performed over 20 minutes with cold start acquisitions every 20
seconds to explore the full range of code phase relations for a typical GPS signal.
6.1.1.4.3 Receiver Performance Limited Satellite Visibility
This lab scenario tests system performance in environments where only three, two andone satellite(s) are visible. The GPS constellation simulator shall be setup to generateonly three, two or one satellite signals. This scenario shall determine if the proposed
system supports three, two and one satellite fix scenarios, respectively.
Geolocations shall be performed over 20 minutes with cold start acquisitions every 20seconds to explore the full range of code phase relations for a typical GPS signal.
-
8/10/2019 CDG Test Plan for Location Determination Tech
28/40
CDG Test Plans Document for Location Page28
Determination Technologies Evaluation
Appendix A Latency Measurements for Mobile Station and Hybrid Based LDTs
This is a method for measuring the time during the test trials from when the location
estimation is started until the location fix is available. The intent is to make themeasurements in such a way that the time related to network use is insulated fromthe time specifically related to GPS functionality. As the purpose of the test trial is to
evaluate the GPS technology, not the network performance, the measurements aredefined in such a way that the time related to network delay can be measured
independently from the time specifically related to GPS processing.
The network-related delays are: Connection establishment, including Dialing Time and Call Progress through
the network,
Assistance information transmission time (this depends on baud rate of datatransmission and amount of transmitted data),
Measurement data transmission, Position information transmission.
The GPS related delays are: Assistance data preprocessing (correlators presetting computation) if any, Satellite initial acquisition, Measurement data collection, Position computation.
All those functions can be distributed throughout the mobile station and the network.
The three considered modes are: Autonomous MS (no assistance from network, position computation local to
MS) Network assisted (assistance information from network, but position
computation still in MS) Network centered (assistance and position computation in the network).
Hypotheses have been made for the actual sequencing of all phases in those three
different cases.
The goal is to split the total TFL time into 4 categories, and to be able to measure them
independently1. Call setup delay
Call setup delay is defined as the time elapsed between Start (Send) Keydepressed at the MS and first character of first assistance message received at
the MS2. Network delay
Network Delay is defined as the time needed to transmit all messages
(assistance, measurement and position reporting), excluding call setup delay
3. GPS processing timeIt is the time used by the total GPS processing time (acquisition + datacollection + position computation). Those functions do not necessary happen
in the same functional entity.4. LDT delay
LDT is the time elapsed between cellular connection established and position
information available at the PDE (Position Determination equipment).
-
8/10/2019 CDG Test Plan for Location Determination Tech
29/40
CDG Test Plans Document for Location Page29
Determination Technologies Evaluation
The Network delay and GPS processing time delays are provided for insight into the
various delay components. The chosen delay category definitions allow for repetitivegeolocation attempts, without necessarily breaking and reestablishing the connection
between attempts.
All events considered are defined in Table A-1:
Table A.1. Event Time Definitions
Event time Event Description
T0 Power-Up
T1 Start (Send) Key Depressed
T2 Cellular connection establishment
T3 Request origination from MPC observed
T4 First Character of First Assistance Message Received at MS
T5 End of Last Assistance Message (received at MS)
T6 End of Measurement Data Collection
T7 Start of Measurement Data Message
(transmitted from MS)T8 End of Measurement Data Message
(received at LDT)
T9 End Of Location Determination
T10 End Of Location Determination
(received at LDT)
Notes:All these events are neither necessarily in sequence, nor all present in all cases.
Category delay times for different assistance cases are defined in Table A-2:
Table A.2. Category Delay Times
E-911 Case Call Setup
Delay
Network Delay GPS Time LDT Delay TFL
Autonomous (T2-T1) (T10-T9) (T9-T1) (T10-T2) (T10-T1)
Network Assisted (T2-T1) (T5-T2)+
(T10-T9)
(T9-T5) (T10-T2) (T10-T1)
Network Centered (T2-T1) (T5-T4)+
(T8-T7)
(T7-T5)+
(T9-T8)
(T9-T2) (T9-T1)
Notes: All message events are defined as the time of transmission at the transmitting end
of the first character or the time of reception at the receiving end of the last
character of a given message. Only the Cellular Connection Established event hasa different definition; for CDMA, it is the time of reception of the first character of
the Service Connect Message on the Forward Traffic Channel as described inTIA/EIA-95-B.
The time determination depends on events, which should be convenientlyidentifiable in all implementations.
-
8/10/2019 CDG Test Plan for Location Determination Tech
30/40
CDG Test Plans Document for Location Page30
Determination Technologies Evaluation
The events have to be measured on either side of the transmission; therefore, it is
necessary to have some kind of time synchronization between both sides of theconnection. A time synchronization with an accuracy and precision of 100
milliseconds should be sufficient.
As an event can happen at either the MS side or PDE side, event logging has to be
made at both sites; the logged analysis may be done on 2 different files.
Following is a timeline for all considered cases, illustrating the activity on Network andGPS section and justifying the proposed time definitions.
The time reference used for recording the timing events does not need to be GPS time.
It is a relative time, which shall be identical within 100ms on both parts of theconnection. It is only for monitoring, and should not be used for GPS assistance.
-
8/10/2019 CDG Test Plan for Location Determination Tech
31/40
CDG Test Plans Document for Location Page31
Determination Technologies Evaluation
T4
Timeline
Start of Assistance Message
T9
T10
End of Position Computation
End of Position message
Dial &Call Progress
Position Message
Transmission
Call Setup Delay=(T2-T1)
Network Delay Time =(T10-T9)
GPS Processing Time=(T9-T1)
LDT Delay Time =(T10-T2)
TFL=(T10-T1)
Assistance computatio
Acquisition,
Measurement Data colle
Position Computation
E-911 Autonomous Case
Network activity GPS activity
Initialization
T0
T1Start Key Depressed
Power Up
T2Cellular connection establishment
-
8/10/2019 CDG Test Plan for Location Determination Tech
32/40
CDG Test Plans Document for Location Page32
Determination Technologies Evaluation
Timeline
T10End of Position Message
Network activity GPS activity
Initialization
Dial &Call Progress
Position Computation
Position Message
Transmission
Call Setup Delay=(T2-T1)
Network Delay Time =(T5-T2)+(T10-T9)
GPS Processing Time=(T9-T5)
LDT Delay Time=(T10-T2)
TFL=(T10-T1)
Assistance computatio
Acquisition,
Measurement Data colle
E-911 Network Assisted Case
T0
T1Start Key Depressed
Power Up
T2Cellular connection establishment
T4 Start of Assistance Message
End of Assistance Message T5
Transmission Assistance
Messages
End of Position ComputationT9
Preparation AssistanceMessages
-
8/10/2019 CDG Test Plan for Location Determination Tech
33/40
CDG Test Plans Document for Location Page33
Determination Technologies Evaluation
Timeline
Call Setup Delay=(T2-T1)
Network Delay Time =(T5-T4)+(T8-T7)GPS Processing Time=(T7-T5)+(T9-T8)
LDT Delay Time=(T9-T2)
TFL=(T9-T1)
E-911 Network Centered Case
T0
T1Start Key Depressed
T4 Start of Assistance Message
T7
End of Assistance Message
T8End of Measurement Data Message
End of Position Computation
Network, PDE activity GPS activity
T5
Initialization
Dial &Call Progress
Position Computation(PDE)
Assistance computation,
Satellite Acquisition,
Measurement Data collectionStart of Measurement Data Message
T9
Measurement Data
Transmission
Power Up
T2Cellular connection establishment
Transmission AssistanceMessages
Preparation AssistanceMessages
-
8/10/2019 CDG Test Plan for Location Determination Tech
34/40
CDG Test Plans Document for Location Page34
Determination Technologies Evaluation
Appendix B - Latency Measurements for Network Based LDTs
This is a method for measuring the time during the test trials from when the location
fix is started until the location result is available. The intent is to make themeasurements in such a way that the time related to cellular network use is insulated
from the time specifically related to PDE functionality. As the purpose of the test trial
is to evaluate the PDE technology, not the network performance, the measurementsare defined in such a way that the time related to network use can be measured
independently from the time specifically related to PDE processing. Timers defined arein no particular order and can be used for both network based location system using
either or both the control channel and/or traffic channel.
The network-related delays are: Connection establishment, including Dialing Time and Call Progress through
the network.
The PDE related delays are: Time needed to deliver mobile station and channel information to the PDE. Position computation. Time needed to deliver the location data to the network.
The two considered modes are: Control Channel In the control channel case, no information is provided to
the PDE for emergency call identification.
Traffic Channel In the traffic channel case, mobile station identity and radiochannel information is delivered to the PDE before location can be performed.
Hypotheses have been made for the actual sequencing of all phases in those twodifferent cases.
The goal is to split the total time into 4 categories, and to be able to measure themindependently:
Call setup delayCall setup delay is defined as the time elapsed between Send Key depressed at the
MS and when ringing is delivered.
Network delayNetwork Delay is defined as the times needed to transmit any messages, excluding
call setup delay.
LDT delay, Control ChannelThe time elapsed between the moment that the Send key is depressed and a
position report is available at the PDE. See Note 1.
LDT delay, Traffic ChannelThe time elapsed between cellular connection established and position informationavailable at the PDE. See Note 1.
Note 1:The need for separate Control Channel and Traffic Channel delay times is important due to the
differences in network technologies.
All events considered are defined in Table B-1:
Table B-1. Event Time Definitions
Event time Logging Device Event Description
T0 Mobile Station Send Key Depressed
T1 PDE Position Determined by PDE on controlchannel
-
8/10/2019 CDG Test Plan for Location Determination Tech
35/40
CDG Test Plans Document for Location Page35
Determination Technologies Evaluation
T2 MPC Control Channel Position Report Delivered toMPC/Network
T3 MSC or Mobile Station Cellular Connection Established
T4 PDE Mobile station and Channel Information isdelivered to PDE
T5 PDE Position Determined By PDE on traffic channel
T6 MPC Traffic Channel Position Report Delivered toMPC/Network
All those events are neither necessary in sequence, nor all present in all cases or all
technologies.
Category delay times for different network based technology cases are defined in TableB-2:
Table B-2. Category Delay Times
E-911
Case
Call Setup
Delay
Network
Delay
TTFF-CC TTFF-TCH PDE Location
Calculation
Time
TFL
ControlChannel
(T3-T0) (T2-T1) T2 N/A T1 (T6-T0)
TrafficChannel
(T3-T0) (T4-T3)+(T6-T5)
N/A T6 (T5-T4) (T6-T0)
Notes:
Time stamps on individual messages may differ substantially due to the clock
differences between the various network entities. Therefore adjustments may haveto be performed to better determine actual times. The time differences between theMSC, the PDE, the MPC, and the mobile station under test must be recorded
before and after any test suite with an accuracy and precision of 100 milliseconds.
-
8/10/2019 CDG Test Plan for Location Determination Tech
36/40
CDG Test Plans Document for Location Page36
Determination Technologies Evaluation
Appendix C Reporting Formats
As discussed in Section 4, the evaluation of the LDTs shall include reporting of the
following values:
Accuracy
Latency Capacity
Reliability
For all LDTs, the test configuration shall specify:
1. The ground truth methodology used,2. The use of any additional mobile station based and network based antennas,
including:
Number of additional antennas
Antenna type,
Antenna brand,
Antenna characteristics, (manufacturer data sheets shall be supplied in the
final report)
An example test configuration for an LDT could be as follows:
Testing of a Network Based LDT for the Test Scenario U1: SF Bay Area, Company XsPCS Band CDMA Network Test area consists of 4 three sector and 2 omni directionalBase Stations.
1. Ground Truth Methodology Used: Number 3 from Section 3.2.3
2. LDT receivers placed in all base stations in the test area.Additional Antennas
Number of Additional Antennas per LDT Receiver: 1
Antenna Type: Omni Antenna Brand: Specify
Antenna Characteristics: Manufacturers Data Sheets are attached.
C.1 Representation of Accuracy and Latency Results
For evaluating LDTs on the basis of the accuracy and latency criteria, the test results
shall be recorded in the form shown in Table C-1 as well as using graphical PDF andCDF representations in the form shown for a hypothetical LDT test in Figure C-1.
For ease of comparison, a minimum [0, 300 meter] accuracy error axis scale should beused for all graphs.
-
8/10/2019 CDG Test Plan for Location Determination Tech
37/40
CDG Test Plans Document for Location Page37
Determination Technologies Evaluation
Figure C.1. Example PDF and CDF Graphs for Accuracy Results Representation
-
8/10/2019 CDG Test Plan for Location Determination Tech
38/40
CDG Test Plans Document for Location Page38
Determination Technologies Evaluation
Table C-1. Sample Format for Recording Test Data in Accuracy and Latency Evaluation
LDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode: Test Results:
ScenarioRef. No.
A - busy hrB - off peakC - night
TrialNo.
Ground Truth Geolocation Estimate Error inLocation
Additional Accuracy Values for GPS-Enabled LDTs
CallOrigination
Time
Time theLocationReport is
Sentfrom the
PDE
Latency(TFL)
Latitude Longitude Altitude(Optional)
Speed(Optional)
Heading(Optional)
Latitude Longitude Altitude(Optional)
Time ofGeolocation
Estimate
Speed(Optional)
Heading(Optional)
Number ofVisible
Satellites
SatelliteIDs
C/N0values per
VisibleSatellite
HDOP X Y = Y-X
ddmmss dddmmss m Km/hr degrees ddmmss dddmmss m hhmmssdd Km/hr degrees m dB hhmmssdd
U-1A 1
U-1A 2
U-1A 39
U-1A 40
U-1B 1
U-1B 2
U-1B 39
U-1B 40
U-1C 1
U-1C 2
U-1C 39
U-1C 40
U-2A 1
U-2A 2
U-2A 39
U-2A 40
U-2B 1
U-2B 2
-
8/10/2019 CDG Test Plan for Location Determination Tech
39/40
CDG Test Plans Document for Location Page39
Determination Technologies Evaluation
C.2 Representation of Capacity Results
For evaluating LDTs on the basis of the capacity criteria, the test results shall be
recorded in the form shown in Table C-2.
Table C-2. Sample Format for Recording Test Data in Capacity Evaluation
LDT Vendor: LDT Type:
Scenario Class: Coverage Case: Mode: Test Results:
Scenario
Reference No.
System Load Total Number of
Simultaneous Calls
Number of E-911
Calls
Maximum Number
of E-911 Calls
Located
Minimum
TFL
Maximum
TFL
U-1 Unloaded
U-1 Lightly Loaded
U-1 Medium Loaded
U-1 Heavily Loaded
U-2 UnloadedU-2 Lightly Loaded
U-2 Medium Loaded
U-2 Heavily Loaded
C.3 Representation of Reliability Results
For evaluating LDTs on the basis of the reliability criteria, the test results shall berecorded in the form shown in Table C-3.
Table C-3. Sample Format for Recording Test Data in Reliability EvaluationLDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode:
Test Results:
Total Number of
E-911 Calls
Attempted
Number of E-911 Calls
That Return Location
Information Other Than
Cell & Sector
Reliability Minimum
TFL
Maximum
TFL
Scenario
Reference
No.
A B =B/A
U-1U-2
U-3
U-4
U-5
U-6
U-7
U-8
-
8/10/2019 CDG Test Plan for Location Determination Tech
40/40
CDG Test Plans Document for Location Page40
Determination Technologies Evaluation
C.4 Representation of Location Reporting Results
For evaluating LDTs on the basis of the location reporting criteria, the test results
shall be recorded in the form shown in Table C-4.
Table C-4.Sample Format for Recording Test Data in Location ReportingEvaluation
LDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode: Test Results:
TestDescription
Est.Lat
(ddmmss)
Est.Long
(dddmmss)
Est.Alt
(mtrs)
(optional)
TFL MobileStationIdentifier
Demonstrate
ability to reportlocation of aspecific call as
triggered by acall set up