Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo...

23
October 2006 www.veritest.com [email protected] Integrated EV-DO Comparison for Dell, Lenovo and HP Test report prepared under contract from Dell Inc. Executive Summary Dell Inc. commissioned VeriTest, the testing service of Lionbridge Technologies Inc., to conduct a competitive analysis comparing the performance of integrated EV-DO (Rev 0) wireless cards. VeriTest conducted a series of tests to find which notebook had the best performance in terms of overall data throughput speed. The following notebooks were tested: Dell Latitude D620 HP Compaq NC6400 Lenovo ThinkPad T60 The Dell notebook’s EV-DO rev 0 card is manufactured by Novatel. The HP and Lenovo EV-DO rev 0 cards are made by Sierra Wireless. Each of the notebooks had an Intel Core Duo 1.83GHz processor and 1 GB (2 x 512) of RAM. Further specs can be found in Appendix A. Tests were conducted in the following US cities. Two test locations were used in each city. Each location was tested on two separate days to account for network variability. Key Findings Average Download Speed 839 465 463 0 100 200 300 400 500 600 700 800 900 Kilobits per Second DELL HP LENOVO Chart 1. Average Kbps for FTP, Web Downloading and Email. On average, the Dell D620 download speeds were 82% faster than the HP NC6400 and 84% faster than the Lenovo ThinkPad T60. There was little difference between notebooks in terms of upload speeds which averaged around 130 Kbps. Los Angeles, California Chicago, Illinois New York, New York Integrated EV-DO Comparison for Dell, Lenovo and HP 1

Transcript of Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo...

Page 1: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

October 2006 www.veritest.com • [email protected]

Integrated EV-DO Comparison for Dell, Lenovo and HP Test report prepared under contract from Dell Inc. Executive Summary Dell Inc. commissioned VeriTest, the testing service of Lionbridge Technologies Inc., to conduct a competitive analysis comparing the performance of integrated EV-DO (Rev 0) wireless cards. VeriTest conducted a series of tests to find which notebook had the best performance in terms of overall data throughput speed. The following notebooks were tested:

• Dell Latitude D620 • HP Compaq NC6400 • Lenovo ThinkPad T60

The Dell notebook’s EV-DO rev 0 card is manufactured by Novatel. The HP and Lenovo EV-DO rev 0 cards are made by Sierra Wireless. Each of the notebooks had an Intel Core Duo 1.83GHz processor and 1 GB (2 x 512) of RAM. Further specs can be found in Appendix A. Tests were conducted in the following US cities. Two test locations were used in each city. Each location was tested on two separate days to account for network variability.

Average Downloa

0

100

200

300

400

500

600

700

800

900

Kilo

bits

per

Sec

ond

Chart 1. Average Kbp

On average82% fasterthan the Le

There was terms of upKbps.

• Los Angeles, California • Chicago, Illinois • New York, New York

Integrated EV-DO Comparison for Dell, Lenovo and HP

Key Findings

d Speed

839

465 463DELLHPLENOVO

s for FTP, Web Downloading and Email.

, the Dell D620 download speeds were than the HP NC6400 and 84% faster novo ThinkPad T60. little difference between notebooks in load speeds which averaged around 130

1

Page 2: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 2

The result for each test was calculated by averaging the numbers from multiple test iterations after dropping the high and low data points. From seven to twenty-two iterations were conducted for each test. The following tests were conducted:

A. Ping Test to measure latency and packet loss B. Speed Test to measure throughput using web speed tools at

www.dslreports.com/stest C. Web Downloading Test to measure throughput when downloading 1MB and 2MB

web files D. FTP Test to measure throughput when transferring 1MB and 2MB files to and from

web servers E. Email Send/Receive Test to measure throughput when sending and receiving via

MS Outlook files of sizes 500KB, 1MB and 2MB After all testing was conducted, the findings show that on average the Dell D620 provided 82% more throughput than the HP NC6400 and 84% more throughput than the Lenovo Thinkpad T60. The Dell system had an average throughput speed averaged across the FTP, Web Downloading and Email tests of 839 Kbps. The HP had an average throughput of 465 Kbps and the Lenovo had an average throughput of 463 Kbps. Please refer to the Test Methodology section of this report for complete details of how testing was conducted. All units were tested using default factory settings. VeriTest confirmed that all notebook computers were new and unopened. VeriTest made sure tests were completed with impartiality.

Test Results The following section details the results from testing. Ping Test Goal: Determine if packet loss or latency varies by platform. Summary of Results: All platforms were comparable in this category. Comments: There was little difference in notebook ping times. Little to no packet loss occurred on all tested platforms. Speed Test Goal: Measure throughput with some commonly used web speed tools. Summary of Results: The Dell notebook had the highest average throughput, but the variability in the test results was significant. Due to this variability the results from this test were excluded from the overall averages. Comments: For this speed test, http://www.dslreports.com/stest was used as the reference. This service provides many servers to test against, each using their own proprietary java applet but all producing the same measurement. We used the following servers for testing: speakeasy.net, BroadStar.com and linkline.net. Results from the speed test varied widely compared to the Web,

Page 3: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

FTP and Email tests. In some cases the speed test results were less than half of what was achieved with other throughput tests with significantly more variability. The variability of results when compared to the other tests was significant enough to exclude this test from the overall throughput averages. Below are the results from the speed test. Notebook Kilobits per Second DELL 674.74HP 494.87LENOVO 475.60

Table A. Average Download Speed Notebook Kilobits per Second DELL 121.01HP 119.26LENOVO 118.42

Table B. Average Upload Speed Web Download Throughput Goal: Benchmark throughput when performing web downloads Summary of Results: The Dell Latitude D620 was 70% faster than the HP and 70% faster than the Lenovo when downloading a 1MB zip file from the web. The Dell was 77% faster than the HP and 76% faster than the Lenovo when downloading a 2MB zip file.

0100200300400500600700800900

1,000

kilo

bits

per

sec

ond

1MB 2MB

Web Downloading Throughput

DELLHPLENOVO

Chart 2: Average Kbps for all test run averages for the Web Downloading Test. (Higher is better)

Notebook 1MB(Kbps) 2MB(Kbps)DELL 920 950

Integrated EV-DO Comparison for Dell, Lenovo and HP 3

Page 4: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

HP 539 536LENOVO 543 539

Table C. Average Throughput of Web Downloading Test FTP Test Goal: Benchmark throughput when using FTP to transfer files. Summary of Results: The Dell D620 was 78 – 83% faster than the HP and 74 – 79% faster than the Lenovo when downloading 1 and 2 MB zip files via FTP. Upload results displayed no conclusive performance differences. Comments: Downloads are the main performance measure. There were little uplink differences. The Verizon network commonly capped uplinks at about 130 Kbps.

0100

200300

400

500600

700

800900

1,000

kilo

bits

per

sec

ond

1MB up 2MB up 1MB down 2MB down

FTP Throughput

DELLHPLENOVO

Chart 3: Average throughput for all test run averages for the FTP Test.

Notebook 1MB(Kbps) 2MB(Kbps)DELL 916 953HP 507 514LENOVO 518 523

Table D. Average Download Speed of FTP Test

Notebook 1MB(Kbps) 2MB(Kbps)DELL 136 131HP 135 129LENOVO 134 129

Table E. Average Upload Speed of FTP Test Email Test Goal: Benchmark throughput when sending and receiving email files.

Integrated EV-DO Comparison for Dell, Lenovo and HP 4

Page 5: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Summary of Results: The Dell D620 was 92 - 94% faster than the HP and 95 – 107% faster than the Lenovo when downloading emails with 1 and 2 MB zip file attachments using Outlook. The Dell D620 was 78% faster than the HP and 86% faster than the Lenovo when downloading emails with 500 KB zip file attachments.

05

1015

202530

3540

4550

Seco

nds

500K 1MB 2MB

Email Download Time

DELLHPLENOVO

Chart 4: Average time to download for all test run averages for the Email Test.

Notebook 500KB(Kbps) 1MB(Kbps) 2MB(Kbps)DELL 6 12 24HP 11 23 45LENOVO 11 23 48

Table F. Average Download Time of Emails Test in seconds Test Methodology Dell Inc. commissioned VeriTest to conduct a competitive analysis comparing performance of integrated EV-DO wireless cards. VeriTest conducted a series of throughput tests to find which notebook had the greatest performance. Notebook Configurations The notebooks were to be as close to an out-of-the-box configuration as possible, but some third party software, such as firewalls and virus protection, had to be disabled. This ensured that some of this software, such as email scanning software, did not affect download times. The Lenovo had Symantec Firewall and Virus protection which had to be disabled. The following is a list of the software that was required for testing which needed to be installed:

o Microsoft Office 2003 with Outlook logging enabled for the Email Test. o Wget for DOS (an application distributed under the GNU license) for the Web

Downloading Test.

Integrated EV-DO Comparison for Dell, Lenovo and HP 5

Page 6: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 6

Test Locations The test locations included areas with both strong and weak signals. Locations used were deemed typical for users of integrated EV-DO and included hotels and coffee shops. Some locations provided unreliable connections resulting in data with such large standard deviations as to be statistically useless. Data from these locations was not used in this report. Outdoor locations were not used. Several test runs would take 8 hours or more requiring the availability of AC power to keep the notebooks charged. Test Run Conditions To keep the testing notebooks from possessing any advantages over each other based on location, orientation or configuration, it was required that the following conditions were met before testing could begin:

o Each computer must be placed in the same spot and facing the same direction o Each LCD must be tilted back at approximately 110 degrees. o Each computer must be running on battery only as typical users would do. o Power settings must be set to Always On. o All brightness settings must be maximized.

There are many factors affecting actual throughput analysis such as structures, latency, network traffic, etc. Because these factors were out of our control and testing was not done in a controlled lab the results may not be reproducible. The tests were designed to be objective by ensuring that each notebook was affected by the same or similar environmental factors. Test Run Details After test setup was complete and all test run conditions were met, all notebook tests were repeated from seven to twenty-two iterations except for the ping test. The ping test performed fifty pings per iteration requiring only two iterations for this test. A completed iteration is defined as a single test run once on all three notebooks. Interleaving the tests from notebook to notebook helped ensure that any network traffic or signal fluctuations would affect all notebooks equally. Only one computer was connected to the Broadband service at a time. The test run was complete when all iterations were complete for all tests. Calculating Average Once a test run was complete the highest and lowest data points from each test for each notebook was removed and the remaining data points were averaged. Those results can be found in the Detailed Results section. Test Details The following describes each test in detail and includes information on test development, description of execution and data gathering. A. Ping Test

Test Description A ping sends a data packet out to a location on a network and is generally used to test network connectivity.

Test Development A batch file was written which would execute a ping command and send ten (10) 32 bytes to the following five sites and write the results to a file on the desktop:

Page 7: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 7

• www.espn.com • www.dell.com • www.nasa.gov • www.google.com • www.yahoo.com Test Execution and Data Gathering The Ping Test always ran for two iterations and usually at the beginning of every test run. Double clicking the batch file would run the test. A log file was created on the desktop upon completion.

B. Speed Test

Test Description www.dslreports.com/stest is a commonly used tool for measuring throughput. The servers we connected for this study were BroadStar.com, linkline.net and speakeasy.net.

Test Development No development was necessary for this test. Test Execution and Data Gathering A server was chosen to test with on the page from the above link. The instructions were followed to complete the test from that server using a java applet located on the page. Results were copied into a text file on the desktop and the speed data into an Excel spreadsheet to be averaged.

C. Web Downloading Test

Test Description Wget for DOS was used to download a 1 megabyte and 2 megabyte zip file from a web site. Zip files were used to eliminate the possibility of file transfer compression affecting test results. Test Development The Wget application was installed on each notebook. A batch file executed the wget command with the logging option to download the two zip files and log the results. The zip files were located on a low traffic web server from a local ISP, CableOne. Test Execution and Data Gathering Double clicking the batch file would run the test. A log file was created on the desktop upon completion. The start and stop time data as well as the KB/s from each download were copied into an Excel spreadsheet to be averaged.

D. FTP Test

Test Description FTP is one of the most common methods for transferring large files over the internet. To test throughput speeds via FTP Microsoft XP’s integrated FTP client was used to download and upload a 1 megabyte zip file and a 2 megabyte zip file. Zip files were used to eliminate the possibility of file transfer compression affecting test results.

Test Development

Page 8: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 8

A batch file was written to log onto an FTP server and run put/get commands which would send and receive the files via FTP then log the results to a file on the Desktop. The FTP server used for this test was provided by a low traffic local ISP, CableOne.

Page 9: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 9

Test Execution and Data Gathering Double clicking the batch file would run the test. Upon completion a log file was created on the desktop. The time in seconds it took for each download and upload to complete as well as the KB/s were copied into an Excel file to be averaged.

E. Email Test

Test Description Three emails were downloaded using Microsoft Outlook 2003 to test download speed via SMTP. The three emails each had a zip file attachment of a predetermined size. The sizes were 500 kilobytes, 1 megabyte and 2 megabytes. Zip files were used to eliminate the possibility of file transfer compression affecting test results. Test Development A PHP script was written to automate the process of sending the emails of different sizes. This script resided on a company Linux server. Each of the notebooks was configured with a different email address so that the three emails could be sent and tested by all three notebooks by running the script once. The email accounts were originally set up with Gmail.com but were moved due to traffic congestion to a local ISP, CableOne. Test Execution and Data Gathering The PHP script was executed via a web browser. This placed the test emails in the appropriate email accounts. We then opened Outlook and clicked “Send/Receive” to execute the mail download. The download times were placed in a log file and subsequently moved to an Excel file to be averaged.

Page 10: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 10

Appendix A: System Configurations

System Information Dell Latitude D620 Processor/speed Intel Core Duo 1.83GHz System Ram/type/number of slots 1 GB (2x512) Mother board manufacturer Dell Latitude D620 Integrated EV-DO Manufacturer Novatel OEM OS Win XP

System Information HP Compaq NC6400 Processor/speed Intel Core Duo 1.83GHz System Ram/type/number of slots 1 GB (2x512) Mother board manufacturer HP Compaq NC6400 Integrated EV-DO Manufacturer Sierra Wireless OEM OS Win XP

System Information Lenovo ThinkPad T60 Processor/speed Intel Core Duo 1.83GHz System Ram/type/number of slots 1 GB (2x512) Mother board manufacturer Lenovo ThinkPad T60 Integrated EV-DO Manufacturer Sierra Wireless OEM OS Win XP Appendix B: Testing Software Information

Software Version Associated Test Description

Microsoft Office Outlook 2003 11.0.6353.0 Email Test

Outlook is an email program which was used to test throughput via

SMTP.

Microsoft File Transfer Program 5.1.2600.2180 FTP Test

This is an application integrated into Windows XP and was used to test

throughput via FTP.

Wget 1.8.2 Web

Downloading Test

This is an application which is distributed under the GNU General

Public license and was used to retrieve files via HTTP.

dslreports.com/stest No version info Speed Test A popular website for testing upload and downloading throughput.

Page 11: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 11

Appendix C: Detailed Results The following section details the results from each test run. All numbers in the spreadsheet are averages from all the test iterations executed during that run as described in the Test Methodology section. Please refer to that section for more details. TEST RUN: 1 Testing Location: August 23, 2006 Westfield Mall – Los Angeles, CA RSSI (signal strength): -70 DBM Details: Testing took place on the 3rd floor close to the railing and near the Food court. It was a large open space with tall ceilings. The server we connected to for the speed test was speakeasy.net.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 1,078 154 130 3 1,482 67 1,515 93 Dell Seconds N/A N/A N/A N/A 6 1 12 1 Kilobits 991 53 128 3 755 22 718 28 HP

Seconds N/A N/A N/A N/A 12 1 24 1 Kilobits 950 45 128 3 696 28 697 40 Lenovo

Seconds N/A N/A N/A N/A 13 1 25 1

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 141 1 134 0 1,580 21 1,633 53 Dell Seconds 63 0 130 0 6 0 11 0 Kilobits 139 1 133 1 712 19 719 21 HP

Seconds 64 0 131 1 12 0 24 1 Kilobits 139 0 133 0 689 3 721 3 Lenovo

Seconds 64 0 131 0 13 0 24 1

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 1,052 0 1,274 182 1,158 77 Dell Seconds 4 0 7 1 15 1 Kilobits 468 52 524 31 511 30 HP

Seconds 9 1 17 1 34 2 Kilobits 468 52 524 31 457 24 Lenovo

Seconds 9 1 17 1 38 2

Page 12: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 12

TEST RUN: 2 Testing Location: August 24, 2006 Westfield Mall – Los Angeles, CA RSSI (signal strength): -70 DBM Details: Testing took place, again, on the 3rd floor close to the railing and near the Food court. It was a large open space with tall ceilings. The server we connected to for the speed test was speakeasy.net.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 1,458 98 127 5 1,381 66 1,437 142 Dell Seconds N/A N/A N/A N/A 7 1 12 1 Kilobits 964 48 126 3 756 13 754 8 HP

Seconds N/A N/A N/A N/A 12 1 23 0 Kilobits 968 50 127 5 731 20 743 11 Lenovo

Seconds N/A N/A N/A N/A 12 1 23 0

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 139 1 133 0 1,503 52 1,578 98 Dell Seconds 64 0 131 0 6 0 11 1 Kilobits 139 0 133 0 709 20 703 12 HP

Seconds 64 0 131 0 13 0 25 0 Kilobits 140 0 132 0 677 3 702 3 Lenovo

Seconds 63 0 132 1 13 0 25 1

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 1,052 263 1,115 139 1,158 77 Dell Seconds 4 1 8 1 15 1 Kilobits 526 66 524 0 543 17 HP

Seconds 8 1 17 0 32 1 Kilobits 421 42 495 28 434 22 Lenovo

Seconds 10 1 18 1 40 2

Page 13: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 13

TEST RUN: 3 Testing Location: August 24, 2006 Starbucks – Los Angeles, CA RSSI (signal strength): -55 DBM Details: Testing took place near a window; it was next to a large parking lot on both sides with relatively no large buildings. We were unable to get any speed test results in this test run due to time constraints.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 827 129 927 85 Dell Seconds N/A N/A N/A N/A 11 2 19 2 Kilobits 649 62 649 18 HP

Seconds N/A N/A N/A N/A 13 1 27 1 Kilobits 714 43 653 64 Lenovo

Seconds N/A N/A N/A N/A 12 1 27 3

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 138 1 134 0 994 145 1,122 317 Dell Seconds 64 1 130 0 9 1 17 4 Kilobits 139 0 133 1 616 74 652 57 HP

Seconds 64 0 132 1 15 2 27 2 Kilobits 129 1 132 0 622 7 624 4 Lenovo

Seconds 69 5 132 1 14 1 28 2

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 526 66 743 0 827 158 Dell Seconds 8 1 12 0 21 4 Kilobits 526 0 495 28 482 27 HP

Seconds 8 0 18 1 36 2 Kilobits 421 42 469 25 424 21 Lenovo

Seconds 10 1 19 1 41 2

Page 14: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 14

TEST RUN: 4 Testing Location: August 25, 2006 Starbucks – Los Angeles, CA RSSI (signal strength): -55 DBM Details: Testing took place near a window; it was next to a large parking lot on both sides with relatively no large buildings. The server we connected to for the speed test was linkline.net.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 979 165 128 3 966 159 945 114 Dell Seconds N/A N/A N/A N/A 9 2 19 2 Kilobits 944 86 128 3 666 66 669 52 HP

Seconds N/A N/A N/A N/A 13 1 26 2 Kilobits 702 69 123 6 693 60 659 47 Lenovo

Seconds N/A N/A N/A N/A 13 1 26 2

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 140 1 134 0 808 171 825 120 Dell Seconds 64 0 130 0 11 2 22 3 Kilobits 139 1 133 1 613 84 620 87 HP

Seconds 64 0 131 1 15 2 29 5 Kilobits 139 0 132 0 611 6 600 4 Lenovo

Seconds 64 1 132 1 15 1 29 2

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 1,052 263 892 267 827 118 Dell Seconds 4 1 10 3 21 3 Kilobits 526 66 524 31 543 17 HP

Seconds 8 1 17 1 32 1 Kilobits 468 52 425 20 354 51 Lenovo

Seconds 9 1 21 1 49 7

Page 15: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 15

TEST RUN: 5 Testing Location: September 6, 2006 Springhill Suites Marriott – Chicago, IL RSSI (signal strength): -68 DBM Details: Testing took place near a window on the 6th floor, near the freeway with no other surrounding large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 415 129 125 3 676 63 708 77 Dell Seconds N/A N/A N/A N/A 13 1 25 3 Kilobits 263 26 125 4 451 14 462 14 HP

Seconds N/A N/A N/A N/A 20 1 37 1 Kilobits 262 43 123 4 403 24 404 30 Lenovo

Seconds N/A N/A N/A N/A 22 1 43 3

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 138 2 132 3 625 124 691 88 Dell Seconds 64 1 133 3 15 3 26 3 Kilobits 137 2 132 2 418 23 431 21 HP

Seconds 65 1 133 2 21 1 41 2 Kilobits 137 0 132 0 413 1 407 3 Lenovo

Seconds 65 1 132 2 22 1 43 2

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 526 66 524 93 511 75 Dell

Seconds 8 1 17 3 34 5 Kilobits 324 25 343 13 347 14

HP Seconds 13 1 26 1 50 2 Kilobits 248 29 270 25 255 23

Lenovo Seconds 17 2 33 3 68 6

Page 16: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 16

TEST RUN: 6 Testing Location: September 7, 2006 McDonalds Downtown – Chicago, IL RSSI (signal strength): -52 DBM Details: Testing took place upstairs on the 2nd floor, centrally located downtown and surrounded by large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 420 141 86 16 795 73 838 84 Dell Seconds N/A N/A N/A N/A 11 1 21 2 Kilobits 259 26 80 9 458 12 444 17 HP

Seconds N/A N/A N/A N/A 19 1 39 2 Kilobits 279 30 87 10 463 13 461 16 Lenovo

Seconds N/A N/A N/A N/A 19 1 38 1

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 107 20 106 13 704 155 721 186 Dell Seconds 86 17 168 21 13 3 26 9 Kilobits 96 11 89 9 406 37 409 28 HP

Seconds 94 11 198 19 22 2 43 3 Kilobits 100 1 96 1 413 3 418 5 Lenovo

Seconds 90 10 184 25 22 1 42 4

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 601 86 637 136 695 83 Dell Seconds 7 1 14 3 25 3 Kilobits 351 0 343 13 347 14

HP Seconds 12 0 26 1 50 2 Kilobits 324 25 330 24 316 17 Lenovo

Seconds 13 1 27 2 55 3

Page 17: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 17

TEST RUN: 7 Testing Location: September 8, 2006 Springhill Suites Marriott – Chicago, IL RSSI (signal strength): -68 DBM Details: Testing took place near a window on the 6th floor, near the freeway with no other surrounding large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 353 96 121 4 515 90 518 112 Dell Seconds N/A N/A N/A N/A 18 3 35 7 Kilobits 238 27 121 3 339 48 347 51 HP

Seconds N/A N/A N/A N/A 26 4 51 9 Kilobits 251 30 120 6 356 43 360 49 Lenovo

Seconds N/A N/A N/A N/A 25 3 49 8

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 136 3 132 2 468 91 495 82 Dell Seconds 65 1 133 2 20 3 36 6 Kilobits 136 4 131 2 365 18 376 13 HP

Seconds 65 2 134 2 24 1 47 2 Kilobits 136 0 131 0 432 2 433 2 Lenovo

Seconds 65 1 134 4 21 1 40 2

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 526 0 557 35 579 19 Dell Seconds 8 0 16 1 30 1 Kilobits 281 19 279 9 280 14 HP

Seconds 15 1 32 1 62 3 Kilobits 351 29 343 0 328 12 Lenovo

Seconds 12 1 26 0 53 2

Page 18: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 18

TEST RUN: 8 Testing Location: September 7, 2006 McDonalds Downtown – Chicago, IL RSSI (signal strength): -52 DBM Details: Testing took place upstairs on the 2nd floor, centrally located downtown and surrounded by large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 337 75 115 12 780 63 802 84 Dell Seconds N/A N/A N/A N/A 12 1 22 2 Kilobits 275 36 108 14 452 15 448 18 HP

Seconds N/A N/A N/A N/A 20 1 38 2 Kilobits 271 46 111 8 452 23 455 13 Lenovo

Seconds N/A N/A N/A N/A 20 1 38 1

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 139 3 133 4 827 145 907 131 Dell Seconds 64 1 131 4 11 2 20 3 Kilobits 139 1 132 1 402 94 412 97 HP

Seconds 64 0 132 1 25 15 48 29 Kilobits 139 0 133 0 445 2 451 2 Lenovo

Seconds 64 1 131 1 20 1 39 1

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 601 86 686 53 695 56 Dell Seconds 7 1 13 1 25 2 Kilobits 383 35 357 14 354 14 HP

Seconds 11 1 25 1 49 2 Kilobits 324 25 343 13 328 12 Lenovo

Seconds 13 1 26 1 53 2

Page 19: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 19

TEST RUN: 9 Testing Location: September 10, 2006 Days Inn – New York, NY RSSI (signal strength): -55 DBM Details: Testing took place on the 7th floor not near a window. Location was surrounded by large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 376 124 124 3 861 108 871 121 Dell Seconds N/A N/A N/A N/A 10 2 20 3 Kilobits 212 42 122 4 480 39 474 33 HP

Seconds N/A N/A N/A N/A 18 2 36 3 Kilobits 214 50 118 9 491 72 517 20 Lenovo

Seconds N/A N/A N/A N/A 19 5 34 1

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 140 2 134 1 783 167 772 184 Dell Seconds 63 1 130 1 12 3 24 6 Kilobits 139 2 133 1 474 38 471 10 HP

Seconds 64 1 131 1 19 2 37 1 Kilobits 139 0 133 0 459 6 447 7 Lenovo

Seconds 64 1 131 1 20 2 40 6

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 701 117 743 0 620 421 Dell Seconds 6 1 12 0 28 19 Kilobits 383 35 388 17 395 9 HP

Seconds 11 1 23 1 44 1 Kilobits 383 35 388 17 378 8 Lenovo

Seconds 11 1 23 1 46 1

Page 20: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 20

TEST RUN: 10 Testing Location: September 11, 2006 Days Inn – New York, NY RSSI (signal strength): -55 DBM Details: Testing took place on the 7th floor not near a window. Location was surrounded by large buildings. The server we connected to for the speed test was BroadStar.com.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 326 40 126 3 960 50 982 58 Dell Seconds N/A N/A N/A N/A 9 1 18 1 Kilobits 329 50 125 5 492 43 513 13 HP

Seconds N/A N/A N/A N/A 18 2 34 1 Kilobits 343 48 118 23 481 128 479 117 Lenovo

Seconds N/A N/A N/A N/A 22 13 42 26

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 139 1 133 2 993 30 996 62 Dell Seconds 64 1 132 2 9 0 18 1 Kilobits 134 7 129 3 487 10 488 14 HP

Seconds 67 4 135 3 18 0 36 1 Kilobits 136 1 129 1 486 8 509 3 Lenovo

Seconds 65 2 135 5 19 3 34 2

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 701 234 743 62 724 60 Dell Seconds 6 2 12 1 24 2 Kilobits 383 70 343 66 328 105 HP

Seconds 11 2 26 5 53 17 Kilobits 421 42 405 18 395 27 Lenovo

Seconds 10 1 22 1 44 3

Page 21: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 21

TEST RUN: 11 Testing Location: September 12, 2006 Starbucks – New York, NY RSSI (signal strength): -38 DBM Details: Testing took place on the main level and not near a window. Location was just above the subway and surrounded by taller buildings. The server we connected to for the speed test was linkline.net.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 775 88 124 2 853 57 870 81 Dell Seconds N/A N/A N/A N/A 10 1 20 2 Kilobits 486 22 124 3 475 38 472 29 HP

Seconds N/A N/A N/A N/A 19 1 37 2 Kilobits 486 59 123 2 510 25 515 22 Lenovo

Seconds N/A N/A N/A N/A 17 1 33 2

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 141 1 135 1 820 123 855 72 Dell Seconds 63 0 129 1 11 2 21 2 Kilobits 139 2 134 1 433 33 422 31 HP

Seconds 64 1 131 1 21 2 42 3 Kilobits 139 0 133 0 484 1 481 4 Lenovo

Seconds 64 0 131 1 18 0 36 2

Email Download (Kbps is an estimate)

500K File

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 601 86 686 53 668 51 Dell Seconds 7 1 13 1 26 2 Kilobits 324 25 330 24 334 32 HP

Seconds 13 1 27 2 52 5 Kilobits 383 35 372 15 370 24 Lenovo

Seconds 11 1 24 1 47 3

Page 22: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

Integrated EV-DO Comparison for Dell, Lenovo and HP 22

TEST RUN: 12 Testing Location: September 12, 2006 Starbucks – New York, NY RSSI (signal strength): -38 DBM Details: Testing took place on the main level and not near a window. Location was just above the subway and surrounded by taller buildings. The server we connected to for the speed test was linkline.net.

Web-based Speed Test HTTP Download

Downlink Std Dev Uplink

Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 905 140 125 2 943 31 990 58 Dell Seconds N/A N/A N/A N/A 10 0 17 1 Kilobits 483 4 124 1 498 19 484 31 HP

Seconds N/A N/A N/A N/A 18 1 35 2 Kilobits 507 16 123 2 526 6 520 5 Lenovo

Seconds N/A N/A N/A N/A 16 1 33 0

FTP

Put 1MB Std Dev

Put 2MB

Std Dev

Get 1MB

Std Dev

Get 2MB

Std Dev

Kilobits 140 3 135 1 889 48 846 42 Dell Seconds 64 2 129 1 10 1 21 1 Kilobits 139 1 134 1 450 20 468 15 HP

Seconds 64 1 131 1 20 1 37 1 Kilobits 139 0 134 0 484 1 486 1 Lenovo

Seconds 64 0 131 1 18 0 36 1

Email Download (Kbps is an estimate) 500K

File Std Dev

1MB File

Std Dev

2MB File

Std Dev

Kilobits 701 117 743 62 789 36 Dell Seconds 6 1 12 1 22 1 Kilobits 383 35 357 29 370 16 HP

Seconds 11 1 25 2 47 2 Kilobits 421 42 388 17 395 0 Lenovo

Seconds 10 1 23 1 44 0

Page 23: Integrated EV-DO Comparison for Dell, Lenovo and HP · Integrated EV-DO Comparison for Dell, Lenovo and HP 4 Summary of Results: The Dell D620 was 92 - 94% faster than the HP and

All references, in part or in full, to test results presented in this report must directly reference or link to this complete report. All references should be made to this report which will be posted in the competitive analysis test section of the Lionbridge web site.

Disclaimer of Warranties; Limitation of Liability: VERITEST HAS MADE REASONABLE EFFORTS TO ENSURE THE ACCURACY AND VALIDITY OF ITS TESTING, HOWEVER, VERITEST SPECIFICALLY DISCLAIMS ANY WARRANTY, EXPRESSED OR IMPLIED, RELATING TO THE TEST RESULTS AND ANALYSIS, THEIR ACCURACY, COMPLETENESS OR QUALITY, INCLUDING ANY IMPLIED WARRANTY OF FITNESS FOR ANY PARTICULAR PURPOSE. ALL PERSONS OR ENTITIES RELYING ON THE RESULTS OF ANY TESTING DO SO AT THEIR OWN RISK, AND AGREE THAT VERITEST, ITS EMPLOYEES AND ITS SUBCONTRACTORS SHALL HAVE NO LIABILITY WHATSOEVER FROM ANY CLAIM OF LOSS OR DAMAGE ON ACCOUNT OF ANY ALLEGED ERROR OR DEFECT IN ANY TESTING PROCEDURE OR RESULT. IN NO EVENT SHALL VERITEST BE LIABLE FOR INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES IN CONNECTION WITH ITS TESTING, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN NO EVENT SHALL VERITEST'S LIABILITY, INCLUDING FOR DIRECT DAMAGES, EXCEED THE AMOUNTS PAID IN CONNECTION WITH VERITEST'S TESTING. VERITEST AND THE VERITEST LOGO ARE REGISTERED TRADEMARKS OF LIONBRIDGE TECHNOLOGIES. DELL, THE DELL LOGO, AND LATITUDE ARE REGISTERED TRADEMARKS OF DELL INC. OTHER COMPANIES’ NAMES ARE USED HEREIN FOR IDENTIFICATION PURPOSES ONLY AND BELONG TO THEIR RESPECTIVE OWNERS.

Integrated EV-DO Comparison for Dell, Lenovo and HP 23