Testing procedure at Hosttest

Author: Christopher Christopher   | 1 Sept 2021

Here you will find all the information about our approach to the Web hosting test reports.

The most important thing up front:

The aim of our Web hosting test reports is to provide aspiring webmasters with transparent and clear guidance in the decision-making process for the right web hosting package.

The expert Hosttest editorial team carries out the Web hosting tests anonymously, neutrally and objectively. Web hosting providers have no influence whatsoever on the procedure or the outcome of the tests. In addition, there is no monetary influence from external sources. The Web hosting being tested is ordered by the Hosttest editorial team at their own expense on normal end-customer terms and is then thoroughly examined.

Our approach to the test reports

To ensure that the various Web hosting offerings can be compared more easily and that interested parties can make an informed purchase decision, we use standardised processes for our test reports.

So that you can follow our approach to creating the test reports exactly, we present our standardised test process here, step by step and in full detail:

 

Step 1

To find a suitable candidate for the Web hosting test, the Hosttest editorial team selects a web host that is in demand among customers. Both large, well-known brands and smaller, independently owned web hosts are taken into account.

 

Step 2

We then take a closer look at the product range of the selected web host and consider which hosting offering should be examined in more detail in the test. To enable a meaningful comparison between the different web hosts in the test, we make sure that the hosting plans selected for testing have a similar feature set and a comparable price range.

 

Step 3

Before we choose a specific plan, we compare the features of all offered plans with one another and take a closer look at the most important contract details such as terms and notice periods. For webspace packages we select offers that are in a price range of around 2 to 5 euros per month and where the content management system WordPress can be hosted.

 

Step 4

Once we have found a suitable webspace package, it is ordered and a WordPress website is then set up on it. We document our procedure from the ordering process to the configured website and finally check the web hosting package for performance data such as availability and loading times.

 

Step 5

Finally, taking into account our own practical experience, we compile the test report in which we examine and evaluate the selected web hosting in several different categories.

 

Our evaluation criteria for the test reports

To enable optimal comparability between the individual web hosts and hosting packages, we adhere to fixed evaluation criteria in our test report. This allows interested parties to compare the different offers more easily and to make a purchasing decision with greater confidence.

The evaluation criteria are divided into the following points:

Functionality (maximum 5 points)

Here we look at the range of features of the selected web hosting. We not only cover the key criteria such as storage space, databases or included domains, but also provide information about other relevant features in the areas of technology and security. For the assessment, factors such as support for external domains, availability of free SSL certificates or custom PHP settings also play an important role.

User-friendliness (maximum 5 points)

Here we guide prospective customers step by step through the ordering process and then form an impression of the user-friendliness of the management interface provided to customers. We then document and evaluate the procedure for installing and setting up a WordPress website. For the assessment, criteria such as the availability of different payment options or the time until the web hosting is provisioned also play an important role.

Performance (maximum 5 points)

Once the WordPress website is set up on the web hosting, we take a closer look at its performance. We use the Livewatch service to check availability, the Sucuri Load Time Tester to analyse load times, and Google PageSpeed Insights to determine the performance data relevant for search engines. For the assessment, fast accessibility of the web hosting for visitors from Germany is particularly important.

Customer service (maximum 5 points)

Here we take a closer look at the various customer support options provided by the web host. We examine the FAQ sections on the host's website and the direct contact channels to customer support. Our own experiences when contacting customer support are also included in the assessment.

Costs (maximum 5 points)

We then consider the costs and, in this context, the price-performance ratio of the web hosting. We look in more detail at the selection of plans, optional additional costs, and discounts such as time-limited offers or free trial accounts. Furthermore, we examine the potential savings when using included domains and clarify performance parameters such as GB of storage provided per euro.

Test conclusion

The test conclusion provides a summary verdict of the offering. In addition, the points awarded for each evaluation criterion are added together (maximum 25 points) and divided by the number of evaluation criteria (5). This produces the overall score of the review on a scale from 0.0 (worst) to 5.0 (best) points. Finally we convert this score into the familiar school grading system.

5.00 - 4.50 Very good
4.49 - 4.00 Good
3.99 - 3.00 Satisfactory
2.99 - 2.00 Sufficient
1.99 - 1.00 Poor

 

Our performance test

To meaningfully assess the continuous performance of web hosts, we take measurements of three performance metrics for each individual web hosting package at three different times within a month and then calculate an average. In this way we can assess the performance of web hosts over a longer period.

We use the following metrics:

 

Uptime

What is Uptime?

Uptime in web hosting refers to the period during which a server or website is online and available, without outages or interruptions.

How is Uptime measured?

We use a custom-built tool to determine Uptime.

How are Uptime measurements interpreted?

The Uptime value should be around 100% to be rated as good. Values between 98% and 99% are rated as average. All values below 97% are considered poor.

 

TTFB (Time to First Byte)

What is TTFB (Time to First Byte)?

The metric TTFB (Time to First Byte) measures the web server's response time by recording the time between the request for a resource and the arrival of the first byte of the response.

How is TTFB (Time to First Byte) measured?

To measure it we use the Uptrends Website Speed Test with settings Desktop / Chrome / Frankfurt.

How are TTFB (Time to First Byte) measurements interpreted?

TTFB should be under 300ms to be rated as good. Values between 300ms and 500ms are rated as average. All values above 500ms are considered poor.

 

LCP (Largest Contentful Paint)

What is LCP (Largest Contentful Paint)?

The metric LCP (Largest Contentful Paint) measures the render time of the largest image or text block in the viewport, which typically corresponds to the moment the main content of the page has loaded.

Info: While speed tests are usually run from data centres with broadband connections, Google simulates real users in its testing procedures and therefore uses throttled network connections, which is why the measured values here are noticeably higher in comparison.

How is LCP (Largest Contentful Paint) measured?

To determine the LCP (Largest Contentful Paint) we use Google PageSpeed Insights with settings Browser location Europe / throttled mobile connection

How are the LCP (Largest Contentful Paint) measurements interpreted?

The LCP (Largest Contentful Paint) measurement must be under 1500ms to be rated as good. Values between 1500ms and 2500ms are rated as moderate. All values above 2500ms are considered poor.

 

PageSpeed

What is PageSpeed?

Using the PageSpeed metric the load time of a website on a web hosting service can be measured; it indicates how long it takes for the entire website to load in the browser.

How is PageSpeed measured?

To determine PageSpeed we use the Pingdom Website Speed Test with settings Europe / Germany / Frankfurt.

How are PageSpeed measurements interpreted?

The PageSpeed measurement must be under 500ms to be rated as good. Values between 500ms and 1000ms are rated as moderate. All values above 1000ms are considered poor.

 

Performance rating

Ratings: Each of the four metrics should be classified into three categories: good, moderate and poor. Points are assigned to these categories:

  • Good: 3 points
  • Moderate: 2 points
  • Poor: 1 point

Calculation of the total score: The total score is obtained by adding the points from all four metrics. Since each metric can have up to 3 points, the total score ranges from 4 (all metrics are poor) to 12 (all metrics are good).

Conversion to stars: The total score must now be converted into a star rating. The following scale can be used for this:

  • 4 points = 1 star
  • 5-6 points = 2 stars
  • 7-8 points = 3 stars
  • 9-10 points = 4 stars
  • 11-12 points = 5 stars

 

Our code of conduct for test reports

  • In our test reports we address both the strengths and the weaknesses of the offerings.
  • We regularly review the offerings we test to ensure they are up to date and present information about these updates transparently.
  • Our test results are not for sale and we categorically refuse financial contributions from providers intended to influence our evaluations.
  • We are neither invested in companies whose offerings we test nor do we have external investors, in order to preserve our independence and avoid any conflict of interest.
  • Feedback is always welcome! Both customers and providers can express their opinions about our content on our platform.

 

Previously tested web hosting providers

Over the course of a year we publish several new test reports. In addition, we regularly update existing test reports and adjust any changes to the terms or other criteria relevant to the tests.

Detailed test reports are currently available for the following web hosting providers:

IONOS Web hosting Test

Dogado Web hosting Test

Netcup Web hosting Test

Manitu Web hosting Test

PixelX Web hosting Test

Febas Web hosting Test

lima-city Web hosting Test

Rainbow-Web.com Web hosting Test

Serverprofis Web hosting Test

Goneo Web hosting Test

IP-Projects Web hosting Test

Hostinger Web hosting Test

Cloud86 Web hosting Test

 

Updating the test reports

As the web hosting market continually evolves and providers regularly adjust their packages, we also carry out periodic updates of our reviews. This usually takes place annually in January, when we re-examine the range of features, the terms and other test criteria and update the review accordingly if there are any changes. This way our readers can always rely on up-to-date information about the tested web hosting packages.

 

Test procedure updated:

07.05.24: Updated information on the test procedure and performance test

16.12.25: Update to the testing procedure; switch to the school grading system for the overall rating; exclusion of customer reviews from the overall grade

 

If you have any questions about our tests, please contact us.

 

Write a comment


    Tags for this article

  • Intern

More web hosts


More interesting articles

VPS hosting test procedure at Hosttest

Here you will find all the information about our methodology for VPS hosting test reports.

Hosttest Awards

In this article we explain how our rating system works, what the awards mean and why they are an important benchmark for...