Service Provider Metrics

Comprehensive evaluation criteria for service provider assessment

IPv6 Mobile Roaming
Score Range: 0 - 10
Description

Support for IPv6 when roaming.

Detailed Description

Support for IPv6 when roaming in a foreign country using the mobile data roaming service.

Scoring Criteria
0 None
5 Supported but must be explicitly enabled by the user.
10 Works by default.
IPv6 Support
Score Range: 0 - 30
Description

Level of IPv6 support and implementation

Detailed Description

Measures the level of IPv6 support: from no support to full native service by default.

The gold standard is for IPv6 to be available by default to all customers using compatible equipment, and enabled by default on all equipment supplied by the provider.

Scoring Criteria
0 = No support
10 = Optional tunnel
20 = Optional native
30 = Full native by default
Score could be reduced by other factors such as
Not available in all locations.
Not available on all service bands (eg mobile data 3G/4G/5G)
Not available to all customers, or not available by default to all customers using compatible hardware
ISP Level Traffic Filtering
Score Range: 0 - 10
Description

Does the service allow inbound connections.

Detailed Description

Generally when providing a connection with routable IPv6 addresses, inbound connectivity should be allowed so that users can host services, access their own systems remotely or participate in peer to peer applications.
Control over what inbound connections are allowed should be controlled by the customer's router.
Some providers block inbound connections, preventing certain applications from working.

Scoring Criteria
0 Inbound connections are blocked at the network level.
10 Inbound connections are allowed at the network level and it's possible to open up services as needed with the provided equipment.
Prefix Delegation Size
Score Range: 0 - 10
Description

Size of the IPv6 prefix delegated to customers

Detailed Description

Evaluates the size of the IPv6 prefix provided: /64, /62-/58, /56, /48.
The recommended standard (BCOP-690) is to provide a /56 for home users, and a /48 for business customers. Top marks are awarded for any ISP compliant with the standard.
A single /64 is the bare minimum to provide connectivity, but forces the user to have a single flat network. Without a larger prefix it's not possible to create a separate guest network, or other networks for additional purposes - eg multiple tenants, downstream routers, separate networks for untrusted devices like IoT etc.

Scoring Criteria
0 = nothing
1 = /64
5 = /62-/58
10 = /56 or /48
Prefix Stability
Score Range: 0 - 10
Description

How frequently the delegated prefix changes

Detailed Description

How frequently (if at all) the IPv6 prefix delegated by the ISP changes.

Scoring Criteria
0 - fully dynamic, changes daily or every connection
5 - long lease, only changes due to prolonged outage or intentional change
10 - fully static
Provided Equipment Flexibility
Score Range: 0 - 10
Description

Flexibility of the provided equipment

Scoring Criteria
0 - Supports v6 but cannot be configured
5 - Limited features such as pinholing, but less capable than legacy features provided by the same device.
10 - IPv6 features of the supplied equipment equivalent or superior to legacy IP support.
Provided Equipment IPv6 Support
Score Range: 0 - 10
Description

IPv6 support of equipment provided by the provider.

Detailed Description

Level of IPv6 support present in the equipment provided by the supplier (eg phone handset, router).
For a fixed line service this would typically be a router.
For mobile service this would be handsets provided by or directly supported by the telco.

Scoring Criteria
0, Default equipment has no IPv6 support.
1, Default equipment supports IPv6 but has to be explicitly enabled from the backend.
5, Default equipment supports IPv6 but has to be configured by the user.
10, Default equipment supports IPv6 and is enabled by default.
Reverse DNS Control
Score Range: 0 - 10
Description

Ability for users to set reverse DNS entries on the delegated prefix.

Detailed Description

Users may want to set reverse DNS entries on their allocated IP addresses.
This is primarily useful for users who want to host their own email servers, or use services such as IRC that perform reverse lookup checks.

Scoring Criteria
0 No reverse DNS is present at all.
3 Default reverse DNS entries are provided by the ISP.
5 Users can request reverse DNS entries via a support ticket (cost).
7 Users can request reverse DNS entries via a support ticket (free).
10 Users can control their own reverse DNS via a web interface, API or by delegating control to their own nameservers.
Router - Downstream PD Support
Score Range: 0 - 10
Description

Ability of the ISP-supplied router to provide downstream prefix delegation.

Detailed Description

If the ISP delegates a /56, it is possible to sub delegate smaller prefixes to downstream devices.
Some consumer devices such as Apple TV use this functionality. It is also useful for users who want to chain additional routers.

Scoring Criteria
0 - not supported
5 - supported but limited
10 - supported and configurable
Router Flexibility
Score Range: 0 - 10
Description

Can users supply their own router, or are they forced to use the one provided.

Detailed Description

Wether the user is required to use the router supplied by the ISP, or can replace it with equipment of their own choice.
The middle ground is where the supplied equipment can be set to a transparent bridge mode, allowing for the customer's own router to operate behind it.

Scoring Criteria
0 User must use the ISP supplied router.
4 ISP can set the router to bridge mode on request, or supply a different router.
8 Customers can configure the ISP router to bridge mode themselves.
10 Users can use their own equipment freely.
Router Port Control
Score Range: 0 - 10
Description

Does the equipment provided by the ISP allow users to open ports.

Detailed Description

The default provided equipment should provide the facility to open inbound ports.

Not relevant if users are supplying their own router.

Scoring Criteria
0 No port opening functionality provided.
5 Limited support for opening ports.
10 Full control over open ports.