Service Provider Metrics

Comprehensive evaluation criteria for service provider assessment

IPv6 Mobile Roaming
Score Range: 0 - 10
Description

Support for IPv6 when roaming.

Detailed Description

Support for IPv6 when roaming in a foreign country using the mobile data roaming service.

Only applicable to mobile data services.

Scoring Criteria
0 None
5 Supported but must be explicitly enabled by the user.
10 Works by default.
IPv6 Support
Score Range: 0 - 30
Description

Level of IPv6 support and implementation

Detailed Description

Measures the level of IPv6 support: from no support to full native service by default.

The gold standard is for IPv6 to be available by default to all customers using compatible equipment, and enabled by default on all equipment supplied by the provider.

Scoring Criteria
0 = No support
10 = Optional tunnel
20 = Optional native
30 = Full native by default
Score could be reduced by other factors such as
Not available in all locations.
Not available on all service bands (eg mobile data 3G/4G/5G)
Not available to all customers, or not available by default to all customers using compatible hardware
ISP DNS Resolver IPv6
Score Range: 0 - 10
Description

Does the ISP provide IPv6 DNS resolvers.

Detailed Description

Are DNS resolvers accessed via IPv6 provided by the ISP.

Scoring Criteria
0 no
10 yes
ISP DNS Resolver IPv6 Lookups
Score Range: 0 - 10
Description

Is the default DNS resolver able to perform lookups over IPv6.

Detailed Description

The ISP will supply default DNS resolvers for use by customers. These resolvers should be able to perform DNS queries over IPv6 in order to resolve domains where the DNS is IPv6-only.

This applies only to the default resolver set by the ISP.

This is tested by https://www.ipv6-test.com

Scoring Criteria
0 no
10 yes
ISP Email IPv6
Score Range: 0 - 10
Description

If the ISP offers an email service, does it fully support IPv6.

Detailed Description

Does the email service provided by the ISP support IPv6.

This includes:
* Inbound SMTP
* Outbound SMTP
* Web access (if applicable)
* POP3/IMAP access (if applicable)
* Mobile access (if applicable)

Many ISPs will outsource their email to an external provider such as Microsoft or Google, in which case the scores would reflect those services.

Scoring Criteria
0 not at all
5 partial (add detail)
10 full - inbound and outbound SMTP, access (eg webmail, pop3 etc) all supports IPv6.
ISP Level Traffic Filtering
Score Range: 0 - 10
Description

Does the service allow inbound connections.

Detailed Description

Generally when providing a connection with routable IPv6 addresses, inbound connectivity should be allowed so that users can host services, access their own systems remotely or participate in peer to peer applications.
Control over what inbound connections are allowed should be controlled by the customer's router.
Some providers block inbound connections, preventing certain applications from working.

Scoring Criteria
0 Inbound connections are blocked at the network level.
10 Inbound connections are allowed at the network level and it's possible to open up services as needed with the provided equipment.
ISP Services IPv6
Score Range: 0 - 10
Description

Are internal services (eg mail server, support system etc) accessible over IPv6

Detailed Description

This relates to any services offered by the ISP to customers, including:

* Support Portal
* Email servers
* News servers
* Status page

etc..

Scoring Criteria
0 none
1-9 some
10 all
ISP Website IPv6
Score Range: 0 - 10
Description

Is the ISP's primary website accessible over IPv6.

Detailed Description

Is the main website of the ISP accessible over IPv6.

Scoring Criteria
0 no
10 yes
Prefix Delegation Size
Score Range: 0 - 10
Description

Size of the IPv6 prefix delegated to customers

Detailed Description

Evaluates the size of the IPv6 prefix provided: /64, /62-/58, /56, /48.
The recommended standard (BCOP-690) is to provide a /56 for home users, and a /48 for business customers. Top marks are awarded for any ISP compliant with the standard.
A single /64 is the bare minimum to provide connectivity, but forces the user to have a single flat network. Without a larger prefix it's not possible to create a separate guest network, or other networks for additional purposes - eg multiple tenants, downstream routers, separate networks for untrusted devices like IoT etc.

Scoring Criteria
0 = nothing
1 = /64
5 = /62-/58
10 = /56 or /48
Prefix Stability
Score Range: 0 - 10
Description

How frequently the delegated prefix changes

Detailed Description

How frequently (if at all) the IPv6 prefix delegated by the ISP changes.

Scoring Criteria
0 - fully dynamic, changes daily or every connection
5 - long lease, only changes due to prolonged outage or intentional change
10 - fully static
Provided Equipment Flexibility
Score Range: 0 - 10
Description

Flexibility of the provided equipment

Scoring Criteria
0 - Supports v6 but cannot be configured
5 - Limited features such as pinholing, but less capable than legacy features provided by the same device.
10 - IPv6 features of the supplied equipment equivalent or superior to legacy IP support.
Provided Equipment IPv6 Support
Score Range: 0 - 10
Description

IPv6 support of equipment provided by the provider.

Detailed Description

Level of IPv6 support present in the equipment provided by the supplier (eg phone handset, router).
For a fixed line service this would typically be a router.
For mobile service this would be handsets provided by or directly supported by the telco.

Scoring Criteria
0, Default equipment has no IPv6 support.
1, Default equipment supports IPv6 but has to be explicitly enabled from the backend.
5, Default equipment supports IPv6 but has to be configured by the user.
10, Default equipment supports IPv6 and is enabled by default.
Reverse DNS Control
Score Range: 0 - 10
Description

Ability for users to set reverse DNS entries on the delegated prefix.

Detailed Description

Users may want to set reverse DNS entries on their allocated IP addresses.
This is primarily useful for users who want to host their own email servers, or use services such as IRC that perform reverse lookup checks.

Scoring Criteria
0 No reverse DNS is present at all.
3 Default reverse DNS entries are provided by the ISP.
5 Users can request reverse DNS entries via a support ticket (cost).
7 Users can request reverse DNS entries via a support ticket (free).
10 Users can control their own reverse DNS via a web interface, API or by delegating control to their own nameservers.
Router - Downstream PD Support
Score Range: 0 - 10
Description

Ability of the ISP-supplied router to provide downstream prefix delegation.

Detailed Description

If the ISP delegates a /56, it is possible to sub delegate smaller prefixes to downstream devices.
Some consumer devices such as Apple TV use this functionality. It is also useful for users who want to chain additional routers.

Scoring Criteria
0 - not supported
5 - supported but limited
10 - supported and configurable
Router Flexibility
Score Range: 0 - 10
Description

Can users supply their own router, or are they forced to use the one provided.

Detailed Description

Wether the user is required to use the router supplied by the ISP, or can replace it with equipment of their own choice.
The middle ground is where the supplied equipment can be set to a transparent bridge mode, allowing for the customer's own router to operate behind it.

Scoring Criteria
0 User must use the ISP supplied router.
4 ISP can set the router to bridge mode on request, or supply a different router.
8 Customers can configure the ISP router to bridge mode themselves.
10 Users can use their own equipment freely.
Router Port Control
Score Range: 0 - 10
Description

Does the equipment provided by the ISP allow users to open ports.

Detailed Description

The default provided equipment should provide the facility to open inbound ports.

Not relevant if users are supplying their own router.

Scoring Criteria
0 No port opening functionality provided.
5 Limited support for opening ports.
10 Full control over open ports.