Is your business model capable of sustaining a paywall of the most useful value, by eliding the information? Your affiliate links still point to your review effort, but the actual top ranking information is behind the paywall.
Make it a variation on the "businesses pay for business-class stuff, amateurs get the free stuff" model.
For the top say, 20% ranks, it is behind a paywall. People will know which vendors are members of the set of the top 20%, but not their ordinal collection. The bottom 80% members of the set's ordinal collection is displayed. If I'm looking for a site to store Grandma's cat pictures, the bottom 80% is probably good enough.
You could also tilt the paywall so free only reveals who NOT to do business with, and who ranks at the bare minimum acceptability.
You can have the paywall only enforce an embargo, instead of all historical results. Say some period beyond which the businesses that can afford to pay you will not care for the results, like a year or whatever.
You can have a "free hour(s)" once a review cycle just before when you publish where the in-the-know crowd can get the results for the newest review cycle, tied to a YouTube livestream, where you do a monetized Q&A.
There are lots more variations to ponder, but I can't help but think there must be more useful ways to slice and dice the valuation of the information here, and monetize in tranches like finance and entertainment do, instead of all in one go.
I guess the problem is two fold, could I charge some people a premium for premium information? Absolutely, yes.
Does hiding some information behind a paywall fit with my goal of a better review landscape in the web hosting industry? Sadly, no.
Sure, I would come out financially ahead, but the industry basically wouldn't be any different. I'm not going to rank any better or have my information spread more effectively behind a paywall. The number of folks impacted would also surely go down as many wouldn't pay.
If the goal is simply profit maximization at this point, there are definitely avenues to explore like what you've suggested. That's boring to me honestly, unless it can have impact to along with it. I do appreciate your thoughts on the matter and suggestions.
Personally, if it gets to that point I'd rather sell it off and move on to working on something else. Most of us are software developers and entrepreneurs. I'd rather build something more interesting and with more potential. I can make money doing consulting work any day, after 10 years, the allure of simply trying to profit maximize on what I built by introducing barriers doesn't appeal. That might be part of the reason it hasn't been as successful as it maybe could have been. I suppose that's the hill I may die on - open, honest, transparent review data for everyone.
Aha, that makes it much more clear. You likely can achieve your aim with more marketing, along the lines of setting narrative in the industry.
You already have an objective measure to flog, build a "council" or "board" around it, with the "Platinum" members being the providers who were most consistently in the top three ranks in all the past reviews. Get some good writers who can whip up some clickbaity articles that would find placement for some fun.
"You're getting cheated out of bandwidth if you don't use these web hosting providers!"
"Most Web hosting providers don't want to let you know this secret council!"
Make it tongue in cheek, self-parodying maybe to the clickbait industry.
Intermix with and reference to some more serious PR to avenues where industry people are likely to read it, where you lay out your concerns of improving the industry and the benefits to them. Make the report red-orange-green-easy to at-a-glance interpret for non-technical management for good-enough outcomes, then analyze the results into a historical trend for the aggregate industry's progress.
Honey versus vinegar, basically.
Your consulting expertise on designing projects to make it easy to transition between providers, and a calculator to compute when to pull the trigger to perform the transition would probably more than pay the bills.
Maybe the marketing hasn't been great. But nobody seems to care. The status quo benefits the companies that get the most marketing, why invest in trying to change the rules that benefit them?
I tried some more expose type stuff, revealing spam networks operated by hosting companies, publishing pay to play attempts, exposing fake reviews and even getting one CEO on record supporting astroturfing. Despite how outrageous this behavior is, it never gets much attention. That last company I'm talking about tends to be on all those affiliate garbage sites you will see and has popped up in the past few years (https://reviewsignal.com/blog/2018/07/22/hostinger-review-0-...). I make sure to let as many people know as possible anytime I see the brand. But their marketing/astroturfing campaign certainly dwarfs anything I can do. And most people don't care. The publishers take the money, the company takes the customers and funnels more money into deceiving poor customers via affiliates and search. The only loser is customers as a whole, who have little voice or power in the equation at any level.
In little bubble communities, I do have some traction and recognition. People may know, but they tend to be echo small chambers. Sure, some people flow in and get recommendations. But the majority of people, it's just who ranks at the top of search results. They don't invest in doing deeper research. They want to see 'X is the best product' and move on.
That's another problem, nuance. Is there a best web hosting provider? Not even close. Even with a very specific use-case, it's extremely rare to say, yes, this is the best company. I've been tracking 10 years of data and no company comes close to perfect reputation. The extreme top just crack into 80% range in terms of positive sentiment. The generally pretty good are in the 70's. That means 20-30% of people are having bad experiences with the best companies.
I've publish the review data with ranks based simply on statistical numbers, but I don't do ranking for performance benchmarks. I also encourage that it's one data point, simply being in the fastest tier or having the highest consumer opinion doesn't mean it's the best. There could be other factors which matter.
For example, Pantheon is the perfect company for has a great reputation but I wouldn't recommend it to most people to consider. First, they specialize in WordPress and Drupal. So if you're not on those platforms, it's not relevant. Even if you do, they are very opinionated hosting. If you have a development team and want strict Git workflows where code moves up and data moves down, they are fabulous. If you're a semi technical person who mostly does marketing, it's probably a terrible fit because you don't want to learn Git, have to push every change through testing, staging and then production to make progress. But their hosting in my tests were fast. They have great consumer reviews. For the people who it makes sense for, they love it. And I would recommend it to probably less than 10% of people who meet the basic criteria of using WP/Drupal for the reason stated above.
As far as consulting experience goes, I actually end up consulting more for the people who build sites. After running the largest benchmarks for WordPress for ~8 years now, people have brought me on to help test new WordPress products or scale existing sites. That's more interesting and rewarding honestly seeing direct results, being compensated to help them achieve goals. My compensation overall is okay, it's just not coming from reviews these days.
Make it a variation on the "businesses pay for business-class stuff, amateurs get the free stuff" model.
For the top say, 20% ranks, it is behind a paywall. People will know which vendors are members of the set of the top 20%, but not their ordinal collection. The bottom 80% members of the set's ordinal collection is displayed. If I'm looking for a site to store Grandma's cat pictures, the bottom 80% is probably good enough.
You could also tilt the paywall so free only reveals who NOT to do business with, and who ranks at the bare minimum acceptability.
You can have the paywall only enforce an embargo, instead of all historical results. Say some period beyond which the businesses that can afford to pay you will not care for the results, like a year or whatever.
You can have a "free hour(s)" once a review cycle just before when you publish where the in-the-know crowd can get the results for the newest review cycle, tied to a YouTube livestream, where you do a monetized Q&A.
There are lots more variations to ponder, but I can't help but think there must be more useful ways to slice and dice the valuation of the information here, and monetize in tranches like finance and entertainment do, instead of all in one go.