https
DNS BenchmarkDNS Benchmark
Resource Files for Advanced Benchmarking
Files that can be used to replace the Benchmark's built-in lists.
divider

“You can't optimize it until you can measure it”

As the previous pages have explained, the DNS Benchmark has been designed to both “just work” easily for the casual user, and also to serve as a powerful, flexible, customizable and expandable tool to facilitate (and encourage) the advanced measurement of many aspects of DNS performance.

The Benchmark incorporates two built-in, replaceable lists which, with their default composition, work well to characterize the performance of popular DNS servers. But those lists necessarily incorporate some (US-centric) assumptions about the domains DNS users visit frequently, and about the publicly available alternative DNS resolvers that might form practical alternatives. For some users, more appropriate lists could be developed and provided to override or augment the lists built into the Benchmark.

The two built-in lists perform the following functions:

The DNS Resolvers List

Though this list is subject to evolution over the lifetime of the benchmark, the v1.0 edition of the DNS Benchmark incorporated and, by default, tested the following seventy (70) publicly available DNS resolvers for comparison against the system's currently configured resolvers, and for comparison to each other:

4.2.2.1
4.2.2.2
4.2.2.3
4.2.2.4
4.2.2.5
4.2.2.6
8.8.4.4
8.8.8.8
62.6.40.162
64.81.45.2
64.81.79.2
64.81.111.2
64.81.127.2
64.81.159.2
64.102.255.44
64.129.67.101
64.129.67.102
64.129.67.103
64.129.67.105
66.92.64.2
66.92.159.2
66.92.224.2
66.93.87.2
66.128.240.7
66.128.240.8
67.19.0.10
67.19.1.10
68.87.64.154
68.87.68.170
68.87.69.154
69.56.222.10
72.45.111.250
72.45.111.251
72.45.127.250
72.45.127.251
75.75.75.75
75.75.76.76
129.250.35.250
129.250.35.251
151.197.0.38
151.197.0.39
151.202.0.84
151.202.0.85
151.203.0.84
151.203.0.85
156.154.70.1
156.154.71.1
198.153.192.1
198.153.194.1
199.45.32.37
199.45.32.38
199.45.32.40
199.45.32.43
203.55.230.104
203.55.230.105
203.215.3.43
204.97.212.10
204.194.232.200
204.194.234.200
205.210.42.205
206.124.64.1
207.126.96.162
208.67.220.220
208.67.222.222
216.27.175.2
216.185.111.10
216.231.41.2
216.254.95.2
vnsc-pri.sys.gtei.net
vnsc-bak.sys.gtei.net
vnsc-lc.sys.gtei.net
vnsc-pri-dsl.genuity.net
vnsc-bak-dsl.genuity.net
vnsc-lc-dsl.genuity.net
google-public-dns-b.google.com
google-public-dns-a.google.com
indnsc70.bt.net
dns.lax1.speakeasy.net
dns.sfo1.speakeasy.net
den.speakeasy.net
dns.dfw1.speakeasy.net
dns.chi1.speakeasy.net
ns2.cisco.com
dnvr-rdns-02.dnvr.twtelecom.net
dnvr-rdns-03.dnvr.twtelecom.net
dnvr-rdns-04.dnvr.twtelecom.net
dnvr-rdns-06.dnvr.twtelecom.net
bos.speakeasy.net
dns.wdc1.speakeasy.net
phl.speakeasy.net
dns.sea1.speakeasy.net
host-66-128-240-7.united.net
host-66-128-240-8.united.net
cache01.theplanet.com
cache02.theplanet.com
phil-dnssec-trial.inflow.pa.bo.comcast.net
atlt-dnssec-trial.s3woodstock.ga.atlanta.comcast.net
bvrt-dnssec-trial.beaverton.or.bverton.comcast.net
cache02.theplanet.com
xplr-72-45-111-250.xplornet.com
xplr-72-45-111-251.xplornet.com
xplr-72-45-127-250.xplornet.com
xplr-72-45-127-251.xplornet.com
cdns01.comcast.net
cdns02.comcast.net
x.ns.gin.ntt.net
y.ns.gin.ntt.net
nsphil.bellatlantic.net
home4.bellatlantic.net
nyc1-qwest.bellatlantic.net
nyc2-qwest.bellatlantic.net
boston1-qwest.bellatlantic.net
boston2-qwest.bellatlantic.net
rdns1.ultradns.net
rdns2.ultradns.net
--- no official Internet DNS name ---
--- no official Internet DNS name ---
world1.bellatlantic.net
nsdc.bellatlantic.net
legacy-ns1.bellatlantic.net
home1.bellatlantic.net
per-qv1-dnsradius5.iinet.net.au
per-qv1-dnsradius6.iinet.net.au
syd-stl-cns1.iinet.net.au
ns3.sprintlink.net
--- no official Internet DNS name ---
--- no official Internet DNS name ---
cache1.dnsresolvers.com
bigguy.gte.net
ns.above.net
resolver2.opendns.com
resolver1.opendns.com
dns.atl1.speakeasy.net
cache01.theplanet.com
ns-legacy.speakeasy.net
dns.nyc1.speakeasy.net

Note that a current list used by any future version of this benchmark can easily be obtained by running the benchmark, deleting all current “system” and “public” resolvers, adding back only the “public” resolvers (this must be done in this sequence because there could be an overlap between the system and public resolver lists), then using the System Menu to “Save Nameserver to .INI file”, thus saving the Benchmark's current public resolver list as an .INI file . . . which will be a text file formatted as shown above.

You can then edit the file to add or remove any resolvers. Once you have an updated list, you may:

We expect this built-in list to evolve over time as we receive feedback from DNS Benchmark users.

If our Benchmark's users provide any locale-specific publicly accessible
resolver lists, such as for specific geographic regions of the Internet,
we will use this page to share them with all other Benchmark users.
The Tested Domains List

The second list incorporated into the Benchmark is the set of “dot com”, or dot-com like, domain names that are sent to each of the benchmarked resolvers for their resolution. In mid-2009, when the DNS Benchmark was being written, the Alexia database was used to obtain the one hundred globally most popular domains. After removing any that might be objectionable due to their nature, despite their popularity, the following fifty (50) domain names were selected for use by the Benchmark:

Google.com
Yahoo.com
Youtube.com
Live.com
Facebook.com
Msn.com
Wikipedia.org
Blogger.com
Myspace.com
Yahoo.co.jp
Baidu.com
Google.co.in
Google.de
Microsoft.com
Rapidshare.com
Google.fr
Ebay.com
Google.co.uk
Wordpress.com
Craigslist.org
Aol.com
Google.it
Flickr.com
Amazon.com
Google.co.jp
Photobucket.com
Imdb.com
Bbc.co.uk
Go.com
Skyrock.com
Ask.com
Friendster.com
Cnn.com
Naver.com
Youku.com
Google.ca
Adobe.com
Ebay.de
Dailymotion.com
Conduit.com
Sohu.com
Vmn.net
Apple.com
Globo.com
About.com
Tagged.com
Mediafire.com
Ku6.com
Soso.com
Livejournal.com

That default domain name list is contained in this simple text file: domains.txt.

Since the need to alter this default domains list should be much more rare than altering the system's default resolver list, no provision for replacing the list was built into the Benchmark's user-interface. However, as was detailed on the command-line options page, the /domains command-line option can be used to replace the Benchmark's built-in list with any alternative user-provided list.

IMPORTANT NOTE: The Benchmark computes and achieves important statistical significance from its benchmark analysis only by acquiring a sufficient number of timing samples from each tested resolver. During the Benchmark's extensive developmental testing, fifty (50) domain lookups per resolver was found to provide the optimal mixture of statistical significance, results repeatability, and total benchmark running time.

Consequently, if the Benchmark's built-in domains list is replaced with one having many fewer than fifty (50) domains, the benchmark will run faster overall, but it will also produce lower reliability results.

And, conversely, if a domain list consisting of more domains were used instead of the Benchmark's current fifty (50) domains default list, the Benchmark's total running time would be increased, but the statistical significance of its results will be improved for increased accuracy.

Here is a list of the top 100 domains (100domains.txt) which could be used to obtain a higher level of statistical significance. Warning! This list has NOT been pruned for possibly-objectionable domain names, so any computer running the Benchmark with this list will apparently be looking up the IPs of all of these domains! This might not be appropriate for use in a corporate setting.

As with the resolver list above, if our Benchmark's users provide any interesting special-
purpose lists of domain names, such as locale-specific domains for specific geographic
regions, we will use this page to share them with all other Benchmark users.


GRC's DNS Benchmark Pages:

Jump to top of page
Gibson Research Corporation is owned and operated by Steve Gibson.  The contents
of this page are Copyright (c) 2014 Gibson Research Corporation. SpinRite, ShieldsUP,
NanoProbe, and any other indicated trademarks are registered trademarks of Gibson
Research Corporation, Laguna Hills, CA, USA. GRC's web and customer privacy policy.
Jump to top of page

Last Edit: Jun 18, 2010 at 08:47 (1,404.98 days ago)Viewed 32 times per day