CDG Test Plan for Location Determination Tech

download CDG Test Plan for Location Determination Tech

of 40

Transcript of CDG Test Plan for Location Determination Tech

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    1/40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    2/40

    CDG Test Plans Document for Location Page2

    Determination Technologies Evaluation

    CONTENTS

    1 GENERAL 4 1.1 Purpose, Objectives and Intended Air Interface Standards 4

    1.2 Definitions 4

    2 DEFINITION OF LOCATION DETERMINATION TECHNOLOGIES (LDTS) 7

    2.1 Mobile Station Based Methods 8 2.1.1 MS Based Methods Using Wireless System Signals 8

    2.1.2 MS Based Methods Using Satellite Signals 8

    2.1.3 MS Based Methods Using Wireless System and Satellite Signals 8

    2.2 Network Based Methods 8

    2.2.1 Time Difference of Arrival 8

    2.2.2 Angle of Arrival 9

    2.2.3 Location Fingerprinting 9

    2.3 Hybrid Methods 9

    2.3.1 Hybrid MS Based Methods Using Wireless System and Satellite Signals Plus Network

    Based Methods 9

    2.3.2 Hybrid MS Based Methods Using Wireless System plus Network Based Methods 10

    3 TEST ASSUMPTIONS AND REQUIREMENTS 10

    3.1 Assumptions 10 3.2 Requirements 10

    3.2.1 Network Availability 10

    3.2.2 Raw Timing and Measurement Data 10

    3.2.3 Ground Truth Methodology for Determining Reference Location 10

    3.2.4 Use of Additional Antennae for LDT Testing 11

    3.2.4.1 Use of Additional Antennae for Mobile Station Based Testing 11

    3.2.4.1 Use of Additional Antennae for Network-Based Testing 11

    3.2.5 Test Location Methodology 11

    3.2.6 Restr ictions on Use of Assistance Information and Previous Location Fixes 12

    4 LDT EVALUATION CRITERIA 12

    4.1 Evaluation Through Testing 12

    4.1.1 Accuracy 12

    4.1.1.1 Representation of the results 12

    4.1.1.2 Purpose 13

    4.1.2 Latency 13

    4.1.2.1 Representation of the results 13

    4.1.2.2 Purpose 13

    4.1.3 Capacity 14

    4.1.3.1 Representation of the results 14

    4.1.3.2 Purpose 14

    4.1.4 Reliability 14

    4.1.4.1 Representation of the results 14

    4.1.4.2 Purpose 14

    4.2 Evaluation by Other Means 15

    4.2.1 Impact on the Wireless Network 15 4.2.1.1 Representation of the results 15

    4.2.1.2 Purpose 15

    4.2.2 Location Reporting 15

    4.2.2.1 Representation of the results 16

    4.2.2.2 Purpose 16

    5 TEST SCENARIOS 16

    5.1 Scenario Class Rural 17

    5.2 Scenario Class Suburban 19

    5.3 Scenario Class Urban 20

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    3/40

    CDG Test Plans Document for Location Page3

    Determination Technologies Evaluation

    5.4 Scenario Class Highway 22

    5.5 Scenario class Water 23

    6 ADDITIONAL TESTS FOR SPECIFIC LDTS 24

    6.1 GPS-Enabled Mobile Station Based and Hybrid Based LDTs 24

    6.1.1 GPS Sensitivity Laboratory Tests 24

    6.1.1.1 Background 24

    6.1.1.2 Requirements 24 6.1.1.3 Single Satellite Sensitivity (C/N0) Calibration 25

    6.1.1.4 Test Scenarios 26

    6.1.1.4.1 Receiver Dynamic Range 26

    6.1.1.4.2 Receiver Performance Indoors 27

    6.1.1.4.3 Receiver Performance Limited Satellite Visibility 27

    A LATENCY MEASUREMENTS FOR HANDSET AND HYBRID BASED LDTS 28

    B LATENCY MEASUREMENTS FOR NETWORK BASED LDTS 34

    C REPORTING FORMATS 36

    C.1 Representation of Accuracy and Latency Results 36

    C.2 Representation of Capacity Results 39

    C.3 Representation of Reliability Results 39

    C.4 Representation of Location Reporting Results 40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    4/40

    CDG Test Plans Document for Location Page4

    Determination Technologies Evaluation

    1 General

    1.1 Purpose, Objectives and Intended Air Interface Standards

    The purpose of a Location Determination Technology test is to evaluate the accuracy,latency, reliability, sensitivity, complexity, location reporting capability and capacity ofthe technology under consideration. The CDG Test Plan document contained herein

    provides definitions and guidelines for test criteria and test scenarios for all possibleLDTs that provide solutions in meeting the FCC E-911 Phase II requirements for

    locating mobile stations based on the TIA/EIA-95 and IS-2000 family of dual mode(analog and digital) standards in both the cellular and the PCS bands.

    This document uses the following verbal forms: Shall and shall not identifyrequirements to be followed strictly to conform to the document and from which no

    deviation is permitted. Should and should not indicate that one of severalpossibilities is recommended as particularly suitable, without mentioning or excluding

    others; that a certain course of action is preferred but not necessarily required; or that

    (in the negative form) a certain possibility or course of action is discouraged but notprohibited. May and need not indicate a course of action permissible within thelimits of the document. Can and cannot are used for statements of possibility andcapability, whether material, physical, or causal. The use of must and must not is

    equivalent to the use of shall and shall not.

    1.2 Definitions

    Active Set. The set of CDMA pilots associated with the CDMA Channels containingForward Traffic Channels assigned to a particular mobile station. (See also Candidate

    Set)

    Advanced Forward Link Trilateration (AFLT). A geolocation technique that utilizesthe mobile stations measured time of arrival of radio signals from the base stations

    (and, possibly, other terrestrial measurements).

    AOA.Angle of Arrival.

    Almanac.See GPS Almanac.

    Altitude.The altitude is defined as the Height Above Ellipsoid.

    Assistance Data. The GPS assistance data provided by the base station to the mobilestation for various purposes (e.g., acquisition, location calculation or sensitivity

    improvement).

    Autonomous Mobile Station. A mobile station that is capable of detecting a GPSnavigation signal without any help from the base station. The mobile station may be

    capable of autonomously calculating its own position.

    Base Station (BS). The base station includes the transceiver equipment, MobileSwitching Center (MSC), Mobile Positioning Center (MPC), Position DeterminationEntity (PDE) and any Inter-Working Function (IWF) required for network connection.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    5/40

    CDG Test Plans Document for Location Page5

    Determination Technologies Evaluation

    Candidate Set. The set of CDMA pilots that have been received with sufficient

    strength by the mobile station to be successfully demodulated, but have not beenplaced in the Active Set by the base station. (See also Active Set)

    C/N0. The ratio of received GPS carrier signal power (C) to the power spectral density

    of background noise (N0).

    Circular Error Probability (CERP). The CERP is a measurement that expresses the

    probability of location fix error being within a stated distance from the ground truth.For example, a 67% within 50 meters CERP means that 67% of location attempts

    are located within a circle of 50 meter radius centered at the ground truth. The CERPcan be expressed over the entire set, or any subset, of location estimates determined

    by use of a CDF or PDF graph.

    Code Division Multiple Access (CDMA). A technique for spread-spectrum multiple-

    access digital communications that creates channels through the use of unique codesequences.

    Cold Start Acquisition for an Assisted GPS Receiver. The GPS receiver attached to a

    mobile station may be assisted via the cellular network to increase coverage andaccuracy of the conventional GPS algorithm and speed up the cold start acquisitiontime. One of the goals of assistance is to remedy the long cold start acquisition delay

    associated with the conventional GPS receivers. See section 3.2.6 for restrictions onuse of assistance information available prior to initiation of a location fix attempt.

    Cold Start Acquisition for a Standalone GPS Receiver. Refers to conditions where

    the GPS unit has been turned off for a period of time and has no location informationto reference and check itself with, so it needs to start over by acquiring satellite signalsand calculating a new position based on the current time, ephemeris, error

    corrections, and other satellite information. See section 3.2.6 for restrictions on theuse of assistance information available prior to initiation of a location fix attempt.

    Cumulative Distribution Function (CDF). The cumulative distribution function is a

    method of showing the probability of location error. The Y-axis is scaled from 0 to100% in 1% increments while the X axis varies from 0 to the maximum location errorin 5 meter increments so that the graph ramps up to the right.

    DOP. Dilution of Precision. Measure of location accuracy degradation due to the

    effects geometry related to the source of geolocation signals.

    Ephemeris. The ephemeris data embedded in the GPS signal. The precise (highaccuracy) orbital parameters of one GPS satellite, as transmitted by that satellite in the

    GPS Navigation Message.

    Fix. The process of performing a single position computation.

    FOCC.AMPS Forward Control Channel.

    Geolocation. The process of determining a geographic location.

    GPS. Global Positioning System.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    6/40

    CDG Test Plans Document for Location Page6

    Determination Technologies Evaluation

    GPS Almanac. The almanac data embedded in the GPS signal. The almanac data are

    a reduced-precision subset of the clock and ephemeris parameters for all satellites, astransmitted by every satellite in the GPS Navigation Message.

    GPS Navigation Message. A GPS navigation message containing ephemeris

    information, message and almanac information.

    Ground Truth. The reference coordinates of the mobile station, expressed in latitude

    and longitude, which are compared to an LDTs location fix estimate to determine theassociated location fix error in meters.

    Handoff. The act of transferring communication with a mobile station from one base

    station to another.

    Hard Handoff. A handoff characterized by a temporary disconnection of the Traffic

    Channel. Hard handoffs occur when the mobile station is transferred between disjointActive Sets, the CDMA frequency assignment changes, the frame offset changes, or the

    mobile station is directed from a CDMA Traffic Channel to an analog voice channel.See alsoSoft Handoff.

    HDOP. Horizontal Dilution of Precision.

    Heading.Measured in degrees from True North.

    Height Above Ellipsoid (HAE). The height above the WGS-84 reference ellipsoid, inunits of 1 meter.

    Latitude. Refers to the definition given by MIL-STD-2401, "World Geodetic System1984". WGS-84 shall be the sole geodetic reference for all reported test data.

    LDT. Location Determination Technology.

    LF. Location Fingerprinting.

    Location. The terms location and position are used interchangeably throughoutthis document. In this respect, the definition of the term differs from the historic use of

    location in wireless systems to identify the mobile stations current serving system.See Position.

    Location Report Record. The location information delivered to the network. This

    information consists of the exact time of location, the estimates of latitude andlongitude, the estimate of uncertainty, and any other optional data such as the

    heading, speed, and/or altitude.

    Longitude. Refers to the definition given by MIL-STD-2401, "World Geodetic System1984". WGS-84 shall be the sole geodetic reference for all reported test data.

    Mobile Station (MS). A station that communicates with the base station.

    Position. The geographic position of the mobile station expressed in latitude,longitude and optionally altitude.

    Position Determination Entity (PDE). A network entity which manages the positionor geographic location determination of the mobile station.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    7/40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    8/40

    CDG Test Plans Document for Location Page8

    Determination Technologies Evaluation

    2.1 Mobile Station Based Methods

    Broadly defined, a mobile station based LDT is one that detects signal(s) transmitted

    from multiple base stations and/or satellites. Specifically, such methods may bedivided into three sub-categories:

    2.1.1 MS Based Methods Using Wireless System Signals

    The location determination technologies that use signals transmitted by base stations

    serving the system to perform algorithms such as Advanced Forward Link Trilateration(AFLT) fall into this category.

    2.1.2 MS Based Methods Using Satellite Signals

    The Global Positioning System Navigation type MS based system receives signals from

    multiple satellites. Note that technologies that fall into this category make use of only

    the satellite signals for location determination. Each mobile station is furnished with astandalone GPS receiver in this category.

    2.1.3 MS Based Methods Using Wireless System and Satellite Signals

    The location determination technologies that fall into this category use signalstransmitted by a number of GPS satellites as well as a number of wireless system base

    stations to estimate the mobile station location. The signals from the base stationsmay be used in aiding the mobile stations GPS signal acquisition. The captured GPSsignals may then be used for location estimation. In addition, the base station signals

    may be used in combination with the GPS signals for location estimation.

    2.2 Network Based Methods

    Broadly defined, a Network based LDT detects the signal transmitted from a mobilestation and uses that signal to determine the mobile station location. Within the

    category of Network based methods, there are three techniques that are primarilyemployed: Time Difference of Arrival, Angle of Arrival and Location Fingerprinting.

    These techniques may be employed either individually or in combination. Thefollowing is a brief description of each technique:

    2.2.1 Time Difference of Arrival

    The TDOA technique works by measuring the time of arrival of a radio signal at three

    or more separate receivers. Because radio waves can be assumed to travel at a fixedand known rate (the speed of light), by calculating the difference in arrival time at

    pairs of receivers, it is possible to calculate hyperbolas on which the transmittingdevice is located. If the TDOA system can receive the mobile station signal at morethan three receivers, additional hyperbolas can be calculated to provide a greater

    confidence in the location. The TDOA technique receivers are typically co-located with

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    9/40

    CDG Test Plans Document for Location Page9

    Determination Technologies Evaluation

    the wireless networks cell site base station, in which case the technique may use the

    existing receive antenna already present at a cell site.

    2.2.2 Angle of Arrival

    The AOA technique determines the direction of arrival of the mobile station's emitted

    signal at the LDT receiver antenna. The phase difference of the signal on elements of acalibrated antenna array mounted at the cell site provides a line of bearing to the

    mobile station. The intersection of the lines of bearing from two or more receiversprovides the location although single site location determinations using AOA and

    TDOA techniques are possible. The AOA technique receivers are also typically co-

    located with the wireless networks cell site base station.

    2.2.3 Location Fingerprinting

    The LF technique utilizes the distinct RF patterns (multipath phase and amplitude

    characteristics) of the radio signals arriving at a receiver antenna from a single caller.The unique characteristics of the signal, including its multipath pattern are analyzedand a "fingerprint" is determined for a defined area. The fingerprint is then compared

    to a database of previously "fingerprinted" locations, and a match is made. Bymatching the fingerprint of the callers signal with the database of known fingerprints,

    the callers geographic location is identified to one of the surveyed areas.

    2.3 Hybrid Methods

    The Hybrid methods make use of radiolocation measurements performed by both themobile station and the base stations in conjunction, to produce a more robust

    estimate of location in a single process. Two techniques are primarily employed:

    2.3.1 Hybrid MS Based Methods Using Wireless System and Satellite Signals PlusNetwork Based Methods

    These techniques combine GPS satellite and wireless system assisted MS basedmethods with Network based methods. The mobile station collects geolocation

    measurements from the GPS satellite constellation as well as signals from the wirelessnetworks base stations. The mobile station then sends the information back to thePDE which combines these geolocation measurements together with geolocation

    measurements made by the base station to produce an estimate of the mobile stationslocation. Hybrid based methods use knowledge of the mobile stations reference time

    and pilot phase measurements, as well as round trip delay measurements made by the

    base station to compute the location. This allows base stations to be used to improvethe availability of the location service under the conditions of limited satellite visibility.Hybrid based methods utilize the integration of CDMA and GPS technologies in the

    mobile station, as well as aiding information from the PDE as defined in EIA/TIA-801.The hybrid method may also utilize the integration of AMPS and GPS technologies inthe mobile station, as well as aiding information from the PDE as defined in PN-4662

    (to be published as IS-817).

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    10/40

    CDG Test Plans Document for Location Page10

    Determination Technologies Evaluation

    2.3.2 Hybrid MS Based Methods Using Wireless System plus Network Based Methods

    These techniques combine wireless system assisted MS based methods with Network

    based methods. The mobile station collects measurements from a number of basestations. These measurements are then sent back to the PDE which combines them

    together with measurements made by the network to produce an estimate of the

    mobile stations location.

    3 Test Assumptions and Requirements

    3.1 Assumptions

    The scope of the tests shall be limited to FCC E-911 Phase II mandate compliance.

    Initially, the testing shall focus on locating mobile stations with the first reported

    location fix that is triggered by call initiation.

    Testing for location update (a subsequent location determination) may be done

    simultaneously or at a later date.

    3.2 Requirements

    3.2.1 Network Availability

    The mobile station shall be able to successfully place emergency calls on the wirelessnetwork during the tests. The LDT shall make the location estimate using geolocation

    measurements made on the forward and/or reverse link channels with or withoutaiding messages using the control or traffic channels assigned to the mobile station.

    The LDT shall generate a single Location Data as a response to the emergency call

    placed by the mobile station. The tests may also optionally include collection oflocation estimates for idle mode phones.

    3.2.2 Raw Timing and Measurement Data

    The raw, unedited data generated by or delivered by the LDT to the network shall beavailable for independent analysis and audit.

    3.2.3 Ground Truth Methodology for Determining Reference Location

    There are 4 methods that can be used to collect ground truth for each test site.

    1. The first method is to contract a surveying company.

    2. The second method is useful in areas where there is a clear view of the sky and

    minimal GPS signal blockage is present. This method uses a Differential GPSservice. The GPS receiver receives the local broadcast of differential corrections.

    These corrections are supplied to a GPS receiver in RTCM-SC104 format. The datavalues for static locations are copied from the display. A combination of a few

    reported values may be used to improve the accuracy of the ground truth estimate.For driving locations, we expect to be able to record the NMEA formatted messages

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    11/40

    CDG Test Plans Document for Location Page11

    Determination Technologies Evaluation

    from the GPS receiver into a computer for later plotting on the map in a separate

    map layer. Note that the differentially corrected maps can be very sparse in rurallocations.

    3. The third method is used in downtown locations where there is significant GPS

    Signal blockage and/or contamination. A rolling measurement wheel can be used

    to measure the distance from street intersections to the test site. A rooftopmeasurement using method 2 may also be used as the starting point. Typical

    accuracy is approximately 1 meter.

    4. The fourth method is used only if differential corrections are not available in thearea. Differentially corrected digital maps can be used, however, the accuracy is

    dependent on the map vendors.

    The LDT tests shall clearly specify which technique is being used for ground truth

    determination in each case.

    3.2.4 Use of Additional Antennas for LDT Testing

    3.2.4.1 Use of Additional Antennas for Mobile Station Based Testing

    The use of additional antennas for mobile station testing is permitted for all tests. Any

    use of an external antenna requires that it be specifically noted that the test wascompleted with an external antenna. Tests undertaken with the antennas must be

    specifically labeled with the antenna type and brand used, and the antennascharacteristics (the manufacturers data sheets) be included with the test results. The

    antenna used shall be the same antenna intended for commercial deployment of theLDT under test.

    3.2.4.2 Use of Additional Antennas for Network-Based Testing

    The use of additional antennas to be added to the existing tower antennas is permittedfor all tests. Any use of additional antenna requires that it be specifically noted that

    the network-based test was completed with additional antennas. Tests undertakenwith the antennas must be specifically labeled with the antenna type and brand used,and antennas characteristics (the manufacturers data sheets) must be included with

    the test results. The antenna used shall be the same antenna intended for commercialdeployment of the LDT under test.

    3.2.5 Test Location Methodology

    To most accurately represent real world conditions in a repeatable fashion, the mobilestation should be placed next to a standard phantom head (if available) or humanhead1. The mobile station should be clamped in a standard position next to the head

    at ear level by following these guidelines (variations shall be noted in the test results):1. center the ear piece on the center of the ear,

    2. rotate the mobile station about the ear until the center line of the mobilestation is in line with the line connecting the center of the ear to the center of

    the mouth, and

    1Placement next to a phantom head or human head attempts to simulate the effects ofhead blockage.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    12/40

    CDG Test Plans Document for Location Page12

    Determination Technologies Evaluation

    3. while maintaining the centerline alignment, push the mobile station up to the

    face until there are at least three points of contact between the mobile stationand the user's head.

    If an external GPS-enabled mobile station antenna is used, the antenna should be

    clamped to the phantom head and the orientation noted in the test results.

    3.2.6 Restrictions on Use of Assistance Information and Previous Location Fixes

    For the scope of tests performed in this document, the LDT under test shall not makeuse of any location assistance information, or knowledge of any other information

    related to a previous location fix, that may be available prior to initiation of a newlocation fix attempt. A new location fix attempt starts at the time of call initiation. TheLDT under test shall document in the test report the steps taken to ensure that a

    location fix is both independent of previous location fixes and does not make use ofany location assistance information potentially available prior to call initiation.

    For the case of GPS-enabled LDTs, this restriction includes, but is not limited to, a

    priori knowledge of any previous location fixes, satellite almanac data, satelliteephemeris data, satellite error corrections, satellite position data, satellite velocitydata, satellite time-of-day information, satellite Doppler measurements, satellite code

    phase measurements and GPS correlator presetting computations.

    4 LDT Evaluation Criteria

    4.1 Evaluation Through Testing

    The LDT shall be evaluated in field tests (test scenarios are detailed in section 5) usingvendor hardware and software. The version of the hardware and software used, as well

    as the stage of development (production, prototype) shall be noted.

    The use of simulators for any testing is at the discretion of the Service Provider and isoutside the scope of this document.

    4.1.1 Accuracy

    The accuracy of the geolocation technology is a measure that defines how close thelocation measurements are to the actual location (see 3.2.3) of the mobile station being

    located. The accuracy can only be determined when the LDT provides a location reportwith contents other than sector and cell information. In other words, the accuracyfigures shall be composed of test points and times where the LDT is reliable as defined

    in Section 4.1.4. Multiple measurement trials shall be taken for a particular class orsub-class of test scenarios described in Section 5 to assess the accuracy of the LDT. In

    this case, accuracy shall be defined as a distribution of the relative distance betweenthe location estimates and the actual location as described by a ground truth

    algorithm.

    4.1.1.1 Representation of the results

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    13/40

    CDG Test Plans Document for Location Page13

    Determination Technologies Evaluation

    Since different methods of scoring accuracy yield different results, a technologically

    neutral route shall be followed in all cases. The LDT accuracy shall be represented in atabular form by specifying the ground truth and the corresponding location estimates

    in terms of the latitude, longitude and optionally altitude, speed and heading valuesfor every performed location estimate. The LDT accuracy shall also be recorded

    graphically as a probability density function and a cumulative distribution function for

    individual test scenarios (each requiring a total of 120 location estimates collected over3 distinctive locations as described in Section 5). The cumulative result achieved by

    weighting the test scenarios based on the Service Providers population density and E-911 calling patterns shall also be recorded. The 95% and the 67% CERP, as well as

    CERP values corresponding to 50 meter, 100 meter, 150 meter and 300 meter errorsshall be plotted on the resultant graphs.

    GPS-enabled LDTs shall also report the C/N0measurements per satellite, number ofGPS satellites, GPS satellite IDs, and HDOP. Interpolation of the C/N0calibration data

    collected during the laboratory testing specified in 6.1.1.3 should be used to relatethese reported C/N0measurements back to GPS signal strengths to permit comparison

    of received GPS signal levels among the GPS-enabled mobile station under test.

    Table and graph templates for recording test data and representation of test resultscan be found in Appendix C.

    4.1.1.2 Purpose

    The presentation of data in CDF and PDF forms will allow for independent comparisonof the accuracy of different location determination systems in different tests.

    4.1.2 Latency

    Latency is defined as the time needed from the instant of mobile station call

    origination to the instant the location report record is sent from the PDE (this is equalto TFL). Latency can be broken down into a number of components by defining the

    call set-up delay, network delay and the LDT associated processing delay as describedin detail in Appendix A for GPS-enabled LDTs (both Mobile Station based and Hybridmethods) and Appendix B for Network based LDTs.

    4.1.2.1 Representation of the results

    Latency shall be expressed as the difference between the location report time stampand the mobile station call origination time stamp in a tabular form for each of thelocation estimates performed as referenced in Table C-1 of Appendix C. The associated

    constituent delay components, the call setup delay, network delay and LDT delay,shall be explicitly represented as referenced in Tables A-2 and B-2 for GPS based and

    Network based LDTs, respectively.

    4.1.2.2 Purpose

    The latency of location determination is important in determining the LDTs time to

    locate and the speed of delivery of location data to network. Both consumer servicesand emergency services require fast time-to-first-locate.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    14/40

    CDG Test Plans Document for Location Page14

    Determination Technologies Evaluation

    4.1.3 Capacity

    The capacity of an LDT is defined as the maximum number of independent,

    simultaneous location determinations the technology can sustain for a given wirelesssystems load. Capacity measurements should be made for unloaded, lightly loaded,

    medium load and heavily loaded systems. (Note that the capacity may affect location

    accuracy.) The definitions of unloaded, lightly, medium and heavily loaded systemsare left to the Service Providers conducting the tests to define. These definitions shall

    be included in the representation of the test results.

    4.1.3.1 Representation of the results

    The capacity of an LDT shall be expressed as

    The maximum number of independent, simultaneous location estimates an LDTcan handle, expressed as the number of simultaneous locations, for an unloadedsystem,

    The maximum number of independent, simultaneous location estimates an LDT

    can handle, expressed as the number of simultaneous locations, for a lightly

    loaded system, The maximum number of independent, simultaneous location estimates an LDT

    can handle, expressed as the number of simultaneous locations, for an averageload system,

    The maximum number of independent, simultaneous location estimates an LDTcan handle, expressed as the number of simultaneous locations, for a heavily

    loaded system.These values shall be given for each test scenario. Also an average capacity value shall be

    presented for a weighted inclusive set of test scenarios.

    The template for representation of capacity test results can be found in Table C-2 ofAppendix C.

    4.1.3.2 Purpose

    The capacity measurements show the usefulness of a particular LDT system forlocation based consumer and/or emergency services.

    4.1.4 Reliability

    Reliability is defined as the total number of E-911 calls that result in a location report

    divided by the total number of E-911 calls, for each test scenario and for the weightedinclusive set of test scenarios.

    4.1.4.1 Representation of the results

    The reliability of an LDT shall be expressed as one number per test scenario, and one

    number for the set of all tests with the associated percentage of location requestswhere the LDT is able to return a location estimate other than the cell and sector

    information as referenced in Table C-3 of Appendix C. The associated latencymeasurements shall be reported in conjunction with all reliability measurements.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    15/40

    CDG Test Plans Document for Location Page15

    Determination Technologies Evaluation

    4.1.4.2 Purpose

    The reliability of an LDT gives an indication of the percentage of location estimaterequests that result in location reports other than sector and cell information.

    4.2 Evaluation by Other Means

    4.2.1 Impact on the Wireless Network

    No specific test or measurement is needed for this evaluation. However, the followingissues need to be understood/observed and shall be documented:

    1. Configuration changes in the cellular network.2. Software changes in the cellular network.

    3. Physical footprint size of the LDT equipment, power requirements andenvironmental conditions required, e.g., air conditioning, etc.

    4. If the LDT product is evaluated with one wireless technology, e.g., AMPS and N-AMPS, then how much of the hardware can be re-used (leveraged) for supporting

    another wireless technology, e.g., CDMA, or for supporting two wireless carriersusing the same or different wireless technologies or for supporting multi-band, i.e.,800 and 1900 MHz, wireless technologies.

    4.2.1.1 Representation of the results

    For evaluating the impact on the wireless network, record the following:

    1. Hardware additions

    2. Software additions3. Modifications to the communications link

    4. Physical area needed to house various components of the LDT equipment5. Power requirements of the LDT equipment

    6. Air conditioning requirements of the LDT equipment7. Amount of hardware sharing of LDT equipment working with two or more air

    interfaces or wireless services, e.g., cellular and PCS.

    4.2.1.2 Purpose

    The purpose of these tests is to evaluate the impact of operating the LDT on the

    wireless network in terms of the complexity of the required changes to the wirelessnetwork, the physical requirements of the LDT equipment, etc.

    4.2.2 Location Reporting

    Any scenario defined in Section 5 may be selected for conducting these tests since

    these are functional tests. A location reporting test to demonstrate the ability to reportlocation of a specific call as triggered by a call initiation, in the presence of multiple E-911 calls, shall be conducted.

    The following desirable location reporting tests may be conducted:

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    16/40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    17/40

    CDG Test Plans Document for Location Page17

    Determination Technologies Evaluation

    coverage, the locations selected shall be sufficiently far apart so that the mobile

    stations at these locations will have entirely different base stations in both their ActiveSet and Candidate Set. For GPS-enabled LDTs, the locations shall provide entirely

    different satellite constellations. Tests in one of the three locations shall be conductedat busy hour while tests for the second location shall be conducted at an off-peak

    hour. Tests for the third location shall be conducted at night. The definitions of busy

    hour, off-peak hour and night time are left up to the service provider conducting thetest.

    The Service Provider conducting the test may choose the scenarios to be tested fromthe list of scenarios given in Sections 5.1 to 5.5 based on its network coverage area.

    The set of LDT evaluation criteria given in Section 4 that shall be the outcome of everyconducted test will not only present results for the individual tested scenarios but alsoa cumulative result that is achieved by weighting the tested scenarios based on the

    population density and the wireless E-911 calling patterns.

    To obtain the proper weights for a given service area, the provider should identify thecomplete set of scenarios that are representative of his service area and establish the

    expected fraction of total calls in each scenario. Additionally, the provider shouldestablish the fraction of total calls in each scenario during the peak, off-peak and night

    hours. The actual sites selected for the tests should be representative of the expectedtraffic conditions, as well as, the propagation conditions associated with each scenario.

    Thus, test results of each scenario shall have a weight reflecting its expected spatialand temporal distribution of calls in the service area. Ideally, the sum of the weights

    should be equal to one, however, good results in the high traffic scenarios may reducethe need for tests in the very low traffic scenarios during compliance tests.

    5.1 Scenario Class - Rural

    Sparsely populated geographic areas with isolated dwellings characterize the rural

    class of scenarios. This class specifically excludes corridors along highways and

    freeways. The rural test scenarios listed in Table 5.1 should be repeated for each of thefollowing rural cases applicable to the Service Providers network coverage area:

    AMPS Coverage Area: Isolated Single AMPS Rural Coverage Case

    A single, large AMPS omni-directional (or sectorized) base station coverage areadefines this case with no hand-off candidates. The mobile station can only detect a

    single AMPS FOCC. Only the serving AMPS base station can detect the mobilestation.

    AMPS Coverage Area: Nominal AMPS Rural Coverage Case

    A single, large AMPS omni-directional (or sectorized) base station coverage area

    defines this case with limited hand-off candidates. The mobile station detects andmonitors the strongest AMPS FOCC, though additional weaker control channels

    may be detectable. Multiple base stations may detect the mobile station, but theserving AMPS base station remains the same.

    CDMA Coverage Area: Isolated Single CDMA Base Station Rural Coverage Case

    This case is defined by a single, large CDMA omni-directional (or sectorized) base

    station coverage area with no additional base stations, either above or below the

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    18/40

    CDG Test Plans Document for Location Page18

    Determination Technologies Evaluation

    CDMA T_ADD system parameter. The mobile station can only detect a single base

    station pilot. Only the serving CDMA base station can detect the mobile station.

    CDMA Coverage Area: Nominal CDMA Rural Coverage Case

    This case is defined by a single, large CDMA omni-directional (or sectorized) base

    station coverage area with no other base stations exceeding the CDMA T_ADDsystem parameter. There is only one base station in the mobile stations Active Set.

    Table 5.1. Rural Test Scenarios

    Ref.

    No.

    Environment Condition Number of

    Locations

    No. of

    LocationEstimatesper

    Location

    Notes

    R-1 Flat land, clear viewof sky Outdoor, stationary 3 40

    R-2 Flat land, clear view

    of sky

    Inside car,

    stationary

    3 40

    R-3 Flat land, clear view

    of sky

    Inside car,

    30 mph

    3 40

    R-4 Flat land Inside metal roofed

    building, stationary

    3 40 2

    R-5 Flat land Inside woodbuilding, stationary

    3 40 1

    R-6 Flat land, densefoliage

    Outdoor, stationary 3 40

    R-7 Flat land, dense

    foliage

    Inside car,

    stationary

    3 40

    R-8 Flat land, dense

    foliage

    Inside car,

    30 mph

    3 40

    R-9 Flat land, dense

    foliage

    Inside metal roofed

    building, stationary

    3 40 2

    R-10 Flat land, dense

    foliage

    Inside wood

    building, stationary

    3 40 1

    R-11 Hilly terrain, clearview of sky

    Outdoor, stationary 3 40

    R-12 Hilly terrain, clearview of sky

    Inside car,stationary

    3 40

    R-13 Hilly terrain, clear

    view of sky

    Inside car,

    30 mph

    3 40

    R-14 Hilly terrain Inside metal roofed

    building, stationary

    3 40 2

    R-15 Hilly terrain Inside wood

    building, stationary

    3 40 1

    R-16 Hilly terrain, dense

    foliage

    Outdoor, stationary 3 40

    R-17 Hilly terrain, densefoliage

    Inside car,stationary

    3 40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    19/40

    CDG Test Plans Document for Location Page19

    Determination Technologies Evaluation

    R-18 Hilly terrain, densefoliage

    Inside car,30 mph

    3 40

    R-19 Hilly terrain, dense

    foliage

    Inside metal roofed

    building, stationary

    3 40 2

    R-20 Hilly terrain, dense

    foliage

    Inside wood

    building, stationary

    3 40 1

    R-21 Repeater in anyterrain

    Outdoor, stationary 3 40

    Note(s):

    1. House is made of wood-frame construction.2. The building must be metal roofed and may be also metal sided. The test shall

    be conducted on the ground floor of the building.

    5.2 Scenario Class Suburban

    Medium levels of population density, where 1-2 story residential neighborhoods, 2-3

    story office buildings, and public spaces such as large shopping malls and multi-levelparking garages characterize the suburban class of scenarios. The suburban test

    scenarios listed in Table 5.2 should be repeated for each of the following suburbancases that are applicable to the Service Providers network coverage area:

    AMPS-only Coverage Area: Nominal AMPS Suburban Coverage Case

    A single AMPS omni-directional (or sectorized) base station coverage area defines this

    case with hand-off candidates. The mobile station may detect several AMPS FOCCsand occasionally change the control channel it monitors. Multiple base stations may

    detect the mobile station, with the serving AMPS base station changing occasionally.

    CDMA Coverage Area: Nominal CDMA Suburban Coverage Case

    This case is defined for soft/softer handoff coverage areas where there are 1-3 CDMAomni-directional/sectorized base station(s) in the Active Set. 1-3 base station(s) detect

    the mobile station.

    Table 5.2. Suburban Test Scenarios

    Ref.

    No.

    Environment Condition No of

    Locations

    No of

    LocationEstimates

    per

    Location

    Notes

    S-1 Residential sidewalk Outdoor, stationary 3 40

    S-2 Residential sidewalk Outdoor, walking 3 40

    S-3 Residential 2 lanestreet

    Inside car, stationary 3 40

    S-4 Residential 2 lanestreet

    Inside car,15-40 mph

    3 40

    S-5 Residential house,wood

    Upper floor,stationary

    3 40 1

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    20/40

    CDG Test Plans Document for Location Page20

    Determination Technologies Evaluation

    S-6 Residential house,wood

    Basement, stationary 3 40 1

    S-7 Residential house,

    brick

    Upper floor,

    stationary

    3 40 2

    S-8 Residential house,

    brick

    Basement, stationary 3 40 2

    S-9 Shopping mall No atrium or opensky, stationary

    3 40 3

    S-10 2-3 story officebuilding

    Bottom floor,stationary

    3 40

    S-11 Warehouse Site Inside, metal roofed 3 40 4

    S-12 Parking garage,middle floor

    Inside car, stationary 3 40

    S-13 Parking garage,middle floor

    Outside car,stationary

    3 40

    S-14 Shopping Plazas Outdoor, stationary 3 40 5

    S-15 Shopping Plazas Indoor, stationary 3 40 6

    Note(s):1. Residential house is made of wood-frame construction.2. Residential house is made of brick or concrete construction.

    3. There should be no direct view of the sky from within the shopping mall.4. The building roof is metal sheeting, the building walls may be metallic also. The

    test shall be conducted on the ground floor of the building.5. Shopping plazas (also commonly referred to as strip malls) are distinguished from

    the shopping malls in that they consist of stores adjacent to one another andwhich are independently accessed from the outside. They generally tend to haveopen air parking lots.

    6. Inside one of the shops in a shopping plaza, e.g., inside a supermarket.

    5.3 Scenario Class Urban

    High levels of population density characterize the urban class of scenarios, multi-story/high rise apartment/office buildings as well as medium height and narrow

    streets are typical. The urban test scenarios listed in Table 5.3 should be repeated foreach of the following urban cases that are applicable to the Service Providers network

    coverage area:

    AMPS-only Coverage Area: Nominal AMPS Urban Coverage Case

    This case is defined for the unlikely case of AMPS-only urban coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control

    channel with only minor movement of the mobile station. Multiple base stations

    typically detect the mobile station.

    CDMA Coverage Area: Nominal CDMA Urban Coverage Case

    This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMA

    omni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    21/40

    CDG Test Plans Document for Location Page21

    Determination Technologies Evaluation

    Table 5.3 Urban Test Scenarios

    Ref.No.

    Environment Condition No of Locations

    No ofLocation

    EstimatesperLocation

    Notes

    U-1 Urban canyon-high,

    intersection

    Outdoor, stationary 3 40 1, 8

    U-2 Urban canyon-high,mid-block

    Outdoor, walking 3 40 1, 8

    U-3 Urban canyon-med.,intersection

    Outdoor, stationary 3 40 2, 8

    U-4 Urban canyon-med.,mid-block

    Outdoor, walking 3 40 2, 8

    U-5 Off-street Outdoor, stationary 3 40 3

    U-6 Off-street Outdoor,walking/jogging

    3 40 3

    U-7 Urban canyon-high,

    mid-block

    Inside car,

    stationary

    3 40 1

    U-8 Urban canyon-high,

    Multi-Lane Street

    Inside car,

    10-25mph

    3 40 1

    U-9 Narrow alley, 1 lane

    street

    Inside car,

    stationary

    3 40 4

    U-10 Urban canyon-high,exterior room

    Indoor, stationary,top floor

    3 40 1, 5

    U-11 Urban canyon-high,exterior room

    Indoor, stationary,middle floor

    3 40 1, 5

    U-12 Urban canyon-high,exterior room

    Indoor, stationary,ground floor

    3 40 1, 5

    U-13 Urban canyon-high,

    interior room

    Indoor, stationary,

    top floor

    3 40 1, 6

    U-14 Urban canyon-high,

    interior room

    Indoor, stationary,

    middle floor

    3 40 1, 6

    U-15 Urban canyon-high,

    interior room

    Indoor, stationary,

    ground floor

    3 40 1, 6

    U-16 Urban canyon-high,core

    Indoor, stationary,top floor

    3 40 1, 7

    U-17 Urban canyon-high,core

    Indoor, stationary,middle floor

    3 40 1, 7

    U-18 Urban canyon-high,

    core

    Indoor, stationary,

    ground floor

    3 40 1, 7

    U-19 Urban canyon-med.,

    exterior room

    Indoor, stationary,

    top floor

    3 40 2, 5

    U-20 Urban canyon-med.,

    exterior room

    Indoor, stationary,

    middle floor

    3 40 2, 5

    U-21 Urban canyon-med.,

    exterior room

    Indoor, stationary,

    ground floor

    3 40 2, 5

    U-22 Parking garage,middle floor

    Inside car,stationary

    3 40 9

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    22/40

    CDG Test Plans Document for Location Page22

    Determination Technologies Evaluation

    U-23 Parking garage,middle floor

    Outside car,stationary

    3 40 9

    U-24 Urban low rise Outdoor, stationary 3 40 10

    U-25 Urban low rise Outdoor, walking 3 40 10

    U-26 Urban low rise Inside car,10-25mph

    3 40 10

    U-27 Urban low rise Indoor,Ground floor

    3 40 10

    U-28 Urban residential,brick

    Ground floor,Stationary

    3 40 11

    U-29 Urban residential,

    sidewalk

    Outdoor, walking 3 40 11

    Note(s):

    1. Urban canyon-high includes buildings with between 25-50 stories.2. Urban canyon-medium includes buildings with between 5-10 stories.

    3. Off street area, e.g., a park with preferably plenty of foliage and near the

    downtown dense urban area.4. 4-8 story buildings surround alley on either side.

    5. 4 meters from the window, no interior wall blocking the window access.6. 10 meters from the window, 1 interior wall between the windows and the mobile

    station.7. Near the core of the high-rise building by the elevator.

    8. Location estimates should be collected from the safety of the sidewalk, at either thestreet intersection or mid-block as specified under Environment.

    9. Multi-storied parking garage, in, or on the fringes of the urban core or downtown.

    10.Urban low rise includes streets lined with two or three-storied, side-by-side, brickbuildings covering entire blocks. This portion of the urban area generally lies

    beyond the urban core.11.Area consists mostly of single family brick houses, which are closely spaced.

    5.4 Scenario Class Highway

    Freeways, primary and secondary roads between major population centerscharacterize the highway class of scenarios. Excluded from these areas are heavily

    urbanized areas where buildings are over 2 stories. There is significant overlap inadjacent omni-directional/sectorized base station coverage for mobile station service

    along the driving corridor. Foliage will range from non-existent to a dense canopy. Thehighway test scenarios listed in Table 5.4 should be repeated for each of the followinghighway cases that are applicable to the Service Providers network coverage area:

    AMPS-only Coverage Area: Nominal AMPS Highway Coverage Case

    This case is defined for the unlikely case of AMPS-only highway coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control

    channel with only minor movement of the mobile station. Multiple base stationstypically detect the mobile station.

    CDMA Coverage Area: Nominal CDMA Highway Coverage Case

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    23/40

    CDG Test Plans Document for Location Page23

    Determination Technologies Evaluation

    This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMA

    omni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.

    Table 5.4 Highway Test Scenarios

    Ref.No.

    Environment Condition No of Locations

    No ofLocationEstimates

    perLocation

    Notes

    H-1 Highway Inside car, heavy traffic 3 40

    H-2 Highway Inside car, 30-40 mph 3 40

    H-3 Highway Inside car, max speed limit 3 40 1

    H-4 Highway Area serviced by repeaters,inside car

    3 40

    Note(s):

    1. These tests should be conducted at the maximum posted speed limit, taking intoaccount safety and responsible driving practices.

    5.5 Scenario Class Water

    Proximity to water bodies such as a lake, bay or ocean categorize the water class ofscenarios. There may be a significant RF delay profile due to over-water propagation

    effects. The water test scenarios listed in Table 5.5 should be repeated for each of thefollowing water cases that are applicable to the Service Providers network coverage

    area:

    AMPS-only Coverage Area: Nominal AMPS Water Coverage Case

    This case is defined for the unlikely case of AMPS-only water coverage. The mobilestation typically detects multiple AMPS FOCCs and reselects a different control

    channel with only minor movement of the mobile station. Multiple base stationstypically detect the mobile station.

    CDMA Coverage Area: Nominal CDMA Water Coverage Case

    This case is defined for soft/softer handoff coverage areas where there are 1-6 CDMAomni-directional/sectorized base station(s) in the Active Set. 1-6 base station(s) detectthe mobile station.

    Table 5.5 Water Test Scenarios

    Ref.

    No.

    Environment Condition No of

    Locations

    No of

    LocationEstimates

    perLocation

    Notes

    W-1 Boat, within 2miles from shore

    Stationary 3 40

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    24/40

    CDG Test Plans Document for Location Page24

    Determination Technologies Evaluation

    W-2 Boat, within 2miles from shore

    5-20 knots 3 40

    W-3 Waterfront

    building, exteriorroom

    Indoor, stationary 3 40

    W-4 Waterfront

    building, interiorroom

    Indoor, stationary 3 40

    W-5 Waterfront Outdoor,

    stationary

    3 40

    W-6 Waterfront Inside car,stationary

    3 40

    W-7 Waterfront Inside car,20-40 mph

    3 40

    6 Additional Tests for Specific LDTs

    6.1 GPS-Enabled Mobile Station Based and Hybrid Based LDTs

    6.1.1 GPS Sensitivity Laboratory Tests

    In addition to the tests described in Section 5, these laboratory tests shall be

    performed by any Mobile Station based and Hybrid based LDTs which utilize GPSconstellation measurements at the mobile station for the purpose of geolocation.

    6.1.1.1 Background

    The GPS signal sensitivity of the mobile station in field test environments is assessed

    qualitatively in the test scenarios of Section 5. There is a direct correlation betweenachieved location accuracy and measured signal strength. In highly blockedenvironments, the GPS signal is weaker and more multi-path is present, resulting in

    less accurate location fixes. Therefore the capability of the mobile station to receiveweak GPS signals is reported indirectly by the accuracy, TFL and reliability results.

    The C/N0field measurement data should be used to compare the received GPS signal

    strength levels encountered by each GPS-enabled mobile station under test. The C/N0measurement shall be recorded per location fix. As the C/N0definitions differ between

    GPS manufacturers, it is important to have a calibration phase in a controlledenvironment, using a GPS RF simulator. This permits the reported C/N0measurements from different GPS-enabled mobile stations to be related back to

    common received GPS signal strength values. This will assist interpretation of the

    C/N0values reported during field testing from multiple GPS-enabled mobile stations.

    The laboratory based simulator tests described in this section also provide quantitative

    measurements of the GPS-enabled mobile station receiver sensitivity performance inrelation to the geolocation processing time.

    6.1.1.2 Requirements

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    25/40

    CDG Test Plans Document for Location Page25

    Determination Technologies Evaluation

    A Multi-Channel L1 C/A-Code GPS Satellite Simulator2with at least 45 dB attenuation

    range should be used. The attenuation shall be controllable on an individual channel(satellite) basis. Two phase coherent RF outputs with separate physical locations

    (scenarios) shall provide input to a reference receiver and the mobile station undertest. The reference output shall be at nominal open-sky signal levels and the test

    output signal strength shall be set according to the parameters specified in the

    following test scenarios.

    For these tests, the mobile station under test shall operate in a Cellular/PCS systemwith 3 cell coverage in the location of GPS simulator testing. The restrictions described

    in 3.2.6 for the use of assistance information available prior to initiation of a locationfix shall be applicable to these laboratory tests. Upon call initiation, the mobile station

    and PDE may exchange position location assisting information. The locationhypothesis may be retrieved from either the mobile station or PDE, and then comparedagainst the mobile stations ground truth location to determine the location error.

    6.1.1.3 Single Satellite Sensitivity (C/N0) Calibration

    The GPS simulator should be set in a single satellite configuration to calibrate the

    reported C/N0 output values of different GPS-enabled mobile station receivers to acommon GPS input signal strength definition. For these calibration procedures, themobile station under test should be configured as it will be field-tested.

    The test setup should employ an anechoic chamber to facilitate far-field radiated

    testing of the GPS-enabled mobile station under test. The anechoic chamber setupincludes the GPS simulator source connected to a standard reference radiating

    antenna. The GPS-enabled mobile station under test should be at a fixed distancefrom the radiating source. To account for polarization mismatch between radiating andreceiving sources, the calibration procedure should be conducted for both vertical and

    horizontal polarizations and the measured C/N0values linearly summed to provide theaggregate of the two orientations. Any variations in the suggested laboratory

    procedures shall be noted in the test results.

    Suggested laboratory procedures include the following:

    1. Configure the radiating antenna to use vertical polarization. Account for calibration

    of known cable loss between GPS simulator source and radiating antenna, as wellas anechoic chamber path loss between radiating antenna and receiving GPS-

    enabled mobile station under test. Adjust the GPS simulator level such that theGPS input signal strength received at the mobile station under test is at 125 dBm.

    2. Record the reported mobile station C/N0 value.

    3. The GPS-enabled mobile station under test should be rotated 5 degrees in azimuth

    relative to the GPS simulator radiating antenna. Repeat step 2. Continue until theentire azimuthal plane is measured at 5 degree resolution.

    4. Adjust the mobile station under test elevation angle relative to the GPS simulatorradiating antenna by 5 degrees. Repeat steps 2 and 3.

    2 One commercial GPS simulator option has 4 channels. It has a 47 dB attenuationrange programmable in 0.5 dB increments.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    26/40

    CDG Test Plans Document for Location Page26

    Determination Technologies Evaluation

    5. Repeat step 4 over the elevation range of +/- 90 degrees relative to the GPS

    simulator radiating antenna until the entire sphere of orientation is mapped.3

    6. Repeat steps 2-5 with the radiating antenna configured to use horizontalpolarization.

    7. Compute the linear-mean of the recorded C/N0 measurements from steps 2-6 byfirst summing the vertical and horizontal polarization C/N0 values (in linear terms)

    for each corresponding azimuth/elevation measurement point, and thencalculating the C/N0 linear-mean value for the entire sphere of orientation.

    8. Reduce the GPS simulators output level by 5 dB. Repeat steps 1-7 until Table

    6.1.1.3-1 is completed.

    Table 6.1.1.3-1 GPS Simulator Input Level vs. Mobile Station Under Test Mean

    Output C/N0Value

    GPS Simulator InputLevel at Mobile StationUnder Test

    [dBm]

    GPS-Enabled MobileStation MeanReported C/N0

    [dB-Hz]

    -125

    -130

    -135

    -140

    -145

    -150

    -155-160

    6.1.1.4 Test Scenarios

    These lab scenarios test the effects of a 25 dB difference in GPS satellite signalstrength being combined in the same location estimate. The purpose is to test with a

    larger dynamic range than the 20.9 dB cross correlation protection afforded by the1023 chip CDMA code length when there is 0 Hz Doppler difference between two GPSsignals. The signal levels shall be -125 dBm for the strong signal strength and -150

    dBm for the weak signal(s).

    6.1.1.4.1 Receiver Dynamic Range

    3Care should be taken to ensure any test cables connected to the mobile station under

    test do not affect the antennas receiving characteristics.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    27/40

    CDG Test Plans Document for Location Page27

    Determination Technologies Evaluation

    This lab scenario tests receiver dynamic range. This static test shall utilize a 3-

    satellite constellation with two strong signals and one weak signal. The purpose ofthis test is to determine the receivers cross-correlation detection capabilities. Altitude

    aiding may be applied during this test for 3-D solution. This scenario demonstrateswhether the receiver acquires, detects and uses the cross-correlated measurement in

    the geolocation.

    Geolocations shall be performed over 20 minutes with cold start acquisitions every 20

    seconds to explore the full range of code phase relations for a typical GPS signal.

    6.1.1.4.2 Receiver Performance Indoors

    This lab scenario tests receiver performance indoors. The test shall use a 3-satelliteconstellation, with all satellites transmitting weak signals. Altitude aiding may be

    applied during this test for 3-D solution. This scenario tests the receivers ability toacquire weak GPS signals, when no direct signals are present, and provide a position

    solution. Optionally, this lab scenario may test receiver performance under varioussatellite constellation configurations. The satellite geometry tested shall be

    represented by corresponding Horizontal Dilution of Precision (HDOP).

    Geolocations shall be performed over 20 minutes with cold start acquisitions every 20

    seconds to explore the full range of code phase relations for a typical GPS signal.

    6.1.1.4.3 Receiver Performance Limited Satellite Visibility

    This lab scenario tests system performance in environments where only three, two andone satellite(s) are visible. The GPS constellation simulator shall be setup to generateonly three, two or one satellite signals. This scenario shall determine if the proposed

    system supports three, two and one satellite fix scenarios, respectively.

    Geolocations shall be performed over 20 minutes with cold start acquisitions every 20seconds to explore the full range of code phase relations for a typical GPS signal.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    28/40

    CDG Test Plans Document for Location Page28

    Determination Technologies Evaluation

    Appendix A Latency Measurements for Mobile Station and Hybrid Based LDTs

    This is a method for measuring the time during the test trials from when the location

    estimation is started until the location fix is available. The intent is to make themeasurements in such a way that the time related to network use is insulated fromthe time specifically related to GPS functionality. As the purpose of the test trial is to

    evaluate the GPS technology, not the network performance, the measurements aredefined in such a way that the time related to network delay can be measured

    independently from the time specifically related to GPS processing.

    The network-related delays are: Connection establishment, including Dialing Time and Call Progress through

    the network,

    Assistance information transmission time (this depends on baud rate of datatransmission and amount of transmitted data),

    Measurement data transmission, Position information transmission.

    The GPS related delays are: Assistance data preprocessing (correlators presetting computation) if any, Satellite initial acquisition, Measurement data collection, Position computation.

    All those functions can be distributed throughout the mobile station and the network.

    The three considered modes are: Autonomous MS (no assistance from network, position computation local to

    MS) Network assisted (assistance information from network, but position

    computation still in MS) Network centered (assistance and position computation in the network).

    Hypotheses have been made for the actual sequencing of all phases in those three

    different cases.

    The goal is to split the total TFL time into 4 categories, and to be able to measure them

    independently1. Call setup delay

    Call setup delay is defined as the time elapsed between Start (Send) Keydepressed at the MS and first character of first assistance message received at

    the MS2. Network delay

    Network Delay is defined as the time needed to transmit all messages

    (assistance, measurement and position reporting), excluding call setup delay

    3. GPS processing timeIt is the time used by the total GPS processing time (acquisition + datacollection + position computation). Those functions do not necessary happen

    in the same functional entity.4. LDT delay

    LDT is the time elapsed between cellular connection established and position

    information available at the PDE (Position Determination equipment).

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    29/40

    CDG Test Plans Document for Location Page29

    Determination Technologies Evaluation

    The Network delay and GPS processing time delays are provided for insight into the

    various delay components. The chosen delay category definitions allow for repetitivegeolocation attempts, without necessarily breaking and reestablishing the connection

    between attempts.

    All events considered are defined in Table A-1:

    Table A.1. Event Time Definitions

    Event time Event Description

    T0 Power-Up

    T1 Start (Send) Key Depressed

    T2 Cellular connection establishment

    T3 Request origination from MPC observed

    T4 First Character of First Assistance Message Received at MS

    T5 End of Last Assistance Message (received at MS)

    T6 End of Measurement Data Collection

    T7 Start of Measurement Data Message

    (transmitted from MS)T8 End of Measurement Data Message

    (received at LDT)

    T9 End Of Location Determination

    T10 End Of Location Determination

    (received at LDT)

    Notes:All these events are neither necessarily in sequence, nor all present in all cases.

    Category delay times for different assistance cases are defined in Table A-2:

    Table A.2. Category Delay Times

    E-911 Case Call Setup

    Delay

    Network Delay GPS Time LDT Delay TFL

    Autonomous (T2-T1) (T10-T9) (T9-T1) (T10-T2) (T10-T1)

    Network Assisted (T2-T1) (T5-T2)+

    (T10-T9)

    (T9-T5) (T10-T2) (T10-T1)

    Network Centered (T2-T1) (T5-T4)+

    (T8-T7)

    (T7-T5)+

    (T9-T8)

    (T9-T2) (T9-T1)

    Notes: All message events are defined as the time of transmission at the transmitting end

    of the first character or the time of reception at the receiving end of the last

    character of a given message. Only the Cellular Connection Established event hasa different definition; for CDMA, it is the time of reception of the first character of

    the Service Connect Message on the Forward Traffic Channel as described inTIA/EIA-95-B.

    The time determination depends on events, which should be convenientlyidentifiable in all implementations.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    30/40

    CDG Test Plans Document for Location Page30

    Determination Technologies Evaluation

    The events have to be measured on either side of the transmission; therefore, it is

    necessary to have some kind of time synchronization between both sides of theconnection. A time synchronization with an accuracy and precision of 100

    milliseconds should be sufficient.

    As an event can happen at either the MS side or PDE side, event logging has to be

    made at both sites; the logged analysis may be done on 2 different files.

    Following is a timeline for all considered cases, illustrating the activity on Network andGPS section and justifying the proposed time definitions.

    The time reference used for recording the timing events does not need to be GPS time.

    It is a relative time, which shall be identical within 100ms on both parts of theconnection. It is only for monitoring, and should not be used for GPS assistance.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    31/40

    CDG Test Plans Document for Location Page31

    Determination Technologies Evaluation

    T4

    Timeline

    Start of Assistance Message

    T9

    T10

    End of Position Computation

    End of Position message

    Dial &Call Progress

    Position Message

    Transmission

    Call Setup Delay=(T2-T1)

    Network Delay Time =(T10-T9)

    GPS Processing Time=(T9-T1)

    LDT Delay Time =(T10-T2)

    TFL=(T10-T1)

    Assistance computatio

    Acquisition,

    Measurement Data colle

    Position Computation

    E-911 Autonomous Case

    Network activity GPS activity

    Initialization

    T0

    T1Start Key Depressed

    Power Up

    T2Cellular connection establishment

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    32/40

    CDG Test Plans Document for Location Page32

    Determination Technologies Evaluation

    Timeline

    T10End of Position Message

    Network activity GPS activity

    Initialization

    Dial &Call Progress

    Position Computation

    Position Message

    Transmission

    Call Setup Delay=(T2-T1)

    Network Delay Time =(T5-T2)+(T10-T9)

    GPS Processing Time=(T9-T5)

    LDT Delay Time=(T10-T2)

    TFL=(T10-T1)

    Assistance computatio

    Acquisition,

    Measurement Data colle

    E-911 Network Assisted Case

    T0

    T1Start Key Depressed

    Power Up

    T2Cellular connection establishment

    T4 Start of Assistance Message

    End of Assistance Message T5

    Transmission Assistance

    Messages

    End of Position ComputationT9

    Preparation AssistanceMessages

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    33/40

    CDG Test Plans Document for Location Page33

    Determination Technologies Evaluation

    Timeline

    Call Setup Delay=(T2-T1)

    Network Delay Time =(T5-T4)+(T8-T7)GPS Processing Time=(T7-T5)+(T9-T8)

    LDT Delay Time=(T9-T2)

    TFL=(T9-T1)

    E-911 Network Centered Case

    T0

    T1Start Key Depressed

    T4 Start of Assistance Message

    T7

    End of Assistance Message

    T8End of Measurement Data Message

    End of Position Computation

    Network, PDE activity GPS activity

    T5

    Initialization

    Dial &Call Progress

    Position Computation(PDE)

    Assistance computation,

    Satellite Acquisition,

    Measurement Data collectionStart of Measurement Data Message

    T9

    Measurement Data

    Transmission

    Power Up

    T2Cellular connection establishment

    Transmission AssistanceMessages

    Preparation AssistanceMessages

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    34/40

    CDG Test Plans Document for Location Page34

    Determination Technologies Evaluation

    Appendix B - Latency Measurements for Network Based LDTs

    This is a method for measuring the time during the test trials from when the location

    fix is started until the location result is available. The intent is to make themeasurements in such a way that the time related to cellular network use is insulated

    from the time specifically related to PDE functionality. As the purpose of the test trial

    is to evaluate the PDE technology, not the network performance, the measurementsare defined in such a way that the time related to network use can be measured

    independently from the time specifically related to PDE processing. Timers defined arein no particular order and can be used for both network based location system using

    either or both the control channel and/or traffic channel.

    The network-related delays are: Connection establishment, including Dialing Time and Call Progress through

    the network.

    The PDE related delays are: Time needed to deliver mobile station and channel information to the PDE. Position computation. Time needed to deliver the location data to the network.

    The two considered modes are: Control Channel In the control channel case, no information is provided to

    the PDE for emergency call identification.

    Traffic Channel In the traffic channel case, mobile station identity and radiochannel information is delivered to the PDE before location can be performed.

    Hypotheses have been made for the actual sequencing of all phases in those twodifferent cases.

    The goal is to split the total time into 4 categories, and to be able to measure themindependently:

    Call setup delayCall setup delay is defined as the time elapsed between Send Key depressed at the

    MS and when ringing is delivered.

    Network delayNetwork Delay is defined as the times needed to transmit any messages, excluding

    call setup delay.

    LDT delay, Control ChannelThe time elapsed between the moment that the Send key is depressed and a

    position report is available at the PDE. See Note 1.

    LDT delay, Traffic ChannelThe time elapsed between cellular connection established and position informationavailable at the PDE. See Note 1.

    Note 1:The need for separate Control Channel and Traffic Channel delay times is important due to the

    differences in network technologies.

    All events considered are defined in Table B-1:

    Table B-1. Event Time Definitions

    Event time Logging Device Event Description

    T0 Mobile Station Send Key Depressed

    T1 PDE Position Determined by PDE on controlchannel

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    35/40

    CDG Test Plans Document for Location Page35

    Determination Technologies Evaluation

    T2 MPC Control Channel Position Report Delivered toMPC/Network

    T3 MSC or Mobile Station Cellular Connection Established

    T4 PDE Mobile station and Channel Information isdelivered to PDE

    T5 PDE Position Determined By PDE on traffic channel

    T6 MPC Traffic Channel Position Report Delivered toMPC/Network

    All those events are neither necessary in sequence, nor all present in all cases or all

    technologies.

    Category delay times for different network based technology cases are defined in TableB-2:

    Table B-2. Category Delay Times

    E-911

    Case

    Call Setup

    Delay

    Network

    Delay

    TTFF-CC TTFF-TCH PDE Location

    Calculation

    Time

    TFL

    ControlChannel

    (T3-T0) (T2-T1) T2 N/A T1 (T6-T0)

    TrafficChannel

    (T3-T0) (T4-T3)+(T6-T5)

    N/A T6 (T5-T4) (T6-T0)

    Notes:

    Time stamps on individual messages may differ substantially due to the clock

    differences between the various network entities. Therefore adjustments may haveto be performed to better determine actual times. The time differences between theMSC, the PDE, the MPC, and the mobile station under test must be recorded

    before and after any test suite with an accuracy and precision of 100 milliseconds.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    36/40

    CDG Test Plans Document for Location Page36

    Determination Technologies Evaluation

    Appendix C Reporting Formats

    As discussed in Section 4, the evaluation of the LDTs shall include reporting of the

    following values:

    Accuracy

    Latency Capacity

    Reliability

    For all LDTs, the test configuration shall specify:

    1. The ground truth methodology used,2. The use of any additional mobile station based and network based antennas,

    including:

    Number of additional antennas

    Antenna type,

    Antenna brand,

    Antenna characteristics, (manufacturer data sheets shall be supplied in the

    final report)

    An example test configuration for an LDT could be as follows:

    Testing of a Network Based LDT for the Test Scenario U1: SF Bay Area, Company XsPCS Band CDMA Network Test area consists of 4 three sector and 2 omni directionalBase Stations.

    1. Ground Truth Methodology Used: Number 3 from Section 3.2.3

    2. LDT receivers placed in all base stations in the test area.Additional Antennas

    Number of Additional Antennas per LDT Receiver: 1

    Antenna Type: Omni Antenna Brand: Specify

    Antenna Characteristics: Manufacturers Data Sheets are attached.

    C.1 Representation of Accuracy and Latency Results

    For evaluating LDTs on the basis of the accuracy and latency criteria, the test results

    shall be recorded in the form shown in Table C-1 as well as using graphical PDF andCDF representations in the form shown for a hypothetical LDT test in Figure C-1.

    For ease of comparison, a minimum [0, 300 meter] accuracy error axis scale should beused for all graphs.

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    37/40

    CDG Test Plans Document for Location Page37

    Determination Technologies Evaluation

    Figure C.1. Example PDF and CDF Graphs for Accuracy Results Representation

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    38/40

    CDG Test Plans Document for Location Page38

    Determination Technologies Evaluation

    Table C-1. Sample Format for Recording Test Data in Accuracy and Latency Evaluation

    LDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode: Test Results:

    ScenarioRef. No.

    A - busy hrB - off peakC - night

    TrialNo.

    Ground Truth Geolocation Estimate Error inLocation

    Additional Accuracy Values for GPS-Enabled LDTs

    CallOrigination

    Time

    Time theLocationReport is

    Sentfrom the

    PDE

    Latency(TFL)

    Latitude Longitude Altitude(Optional)

    Speed(Optional)

    Heading(Optional)

    Latitude Longitude Altitude(Optional)

    Time ofGeolocation

    Estimate

    Speed(Optional)

    Heading(Optional)

    Number ofVisible

    Satellites

    SatelliteIDs

    C/N0values per

    VisibleSatellite

    HDOP X Y = Y-X

    ddmmss dddmmss m Km/hr degrees ddmmss dddmmss m hhmmssdd Km/hr degrees m dB hhmmssdd

    U-1A 1

    U-1A 2

    U-1A 39

    U-1A 40

    U-1B 1

    U-1B 2

    U-1B 39

    U-1B 40

    U-1C 1

    U-1C 2

    U-1C 39

    U-1C 40

    U-2A 1

    U-2A 2

    U-2A 39

    U-2A 40

    U-2B 1

    U-2B 2

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    39/40

    CDG Test Plans Document for Location Page39

    Determination Technologies Evaluation

    C.2 Representation of Capacity Results

    For evaluating LDTs on the basis of the capacity criteria, the test results shall be

    recorded in the form shown in Table C-2.

    Table C-2. Sample Format for Recording Test Data in Capacity Evaluation

    LDT Vendor: LDT Type:

    Scenario Class: Coverage Case: Mode: Test Results:

    Scenario

    Reference No.

    System Load Total Number of

    Simultaneous Calls

    Number of E-911

    Calls

    Maximum Number

    of E-911 Calls

    Located

    Minimum

    TFL

    Maximum

    TFL

    U-1 Unloaded

    U-1 Lightly Loaded

    U-1 Medium Loaded

    U-1 Heavily Loaded

    U-2 UnloadedU-2 Lightly Loaded

    U-2 Medium Loaded

    U-2 Heavily Loaded

    C.3 Representation of Reliability Results

    For evaluating LDTs on the basis of the reliability criteria, the test results shall berecorded in the form shown in Table C-3.

    Table C-3. Sample Format for Recording Test Data in Reliability EvaluationLDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode:

    Test Results:

    Total Number of

    E-911 Calls

    Attempted

    Number of E-911 Calls

    That Return Location

    Information Other Than

    Cell & Sector

    Reliability Minimum

    TFL

    Maximum

    TFL

    Scenario

    Reference

    No.

    A B =B/A

    U-1U-2

    U-3

    U-4

    U-5

    U-6

    U-7

    U-8

  • 8/10/2019 CDG Test Plan for Location Determination Tech

    40/40

    CDG Test Plans Document for Location Page40

    Determination Technologies Evaluation

    C.4 Representation of Location Reporting Results

    For evaluating LDTs on the basis of the location reporting criteria, the test results

    shall be recorded in the form shown in Table C-4.

    Table C-4.Sample Format for Recording Test Data in Location ReportingEvaluation

    LDT Vendor: LDT Type: Scenario Class: Coverage Case: Mode: Test Results:

    TestDescription

    Est.Lat

    (ddmmss)

    Est.Long

    (dddmmss)

    Est.Alt

    (mtrs)

    (optional)

    TFL MobileStationIdentifier

    Demonstrate

    ability to reportlocation of aspecific call as

    triggered by acall set up