CRO Agency vs Freelancer vs In-House: Who to Hire

WRITTEN BY

Gary Culaev, Founder and CEO, Weblics Consulting

CRO Agency vs Freelancer vs In-House: Who to Hire at Your Revenue

A freelancer will look like the cheapest quote. An in-house hire really will be the most expensive. And the cheapest-looking of the three will cost you the most of your own time. All three are true, and none of them is the number that should decide this. Here's each option priced down to a single test and matched to the revenue where it makes sense, including the cases where we're the wrong call.

Say you're doing about $300,000 a month on roughly 150,000 sessions, and you've asked around for someone to run CRO for the next six months. Three quotes land in your inbox the same week.
‍
A freelancer: $120 an hour, about 20 hours a month. Call it $2,400.
‍
An agency: $6,000 a month.
‍
A full-time CRO manager: $121,000 a year in salary, which is about $10,000 a month before benefits.
‍
On paper the freelancer wins by a mile. Now price what each quote actually buys.

In this guide

Why comparing rates gets the hire wrong
The freelancer quote, priced per test
The agency quote, priced per test
The in-house quote, priced per test
Side by side: the full tradeoffs
Who to hire at your revenue
When Weblics is the wrong hire
FAQ

Why Comparing Rates Gets the Hire Wrong

The rate is the smallest number in this decision. What decides it is who carries each test from the build to the readout, and how many tests your traffic can actually support in a month.
‍
Nobody buys a truck to move house once. You hire a guy with a van, and it's the cheapest move you'll ever make, right up until he's sick on the day and your sofa is still in the old place. Or you pay a moving company more for a crew and someone to call when a box goes missing. The truck only pays off when you're moving every month.
‍
A freelancer is the van. An agency is the crew. An in-house hire is the truck.
‍
The second thing the quotes hide is your traffic. At 150,000 sessions a month, a four-week test can confirm lifts of roughly 10% and up, which works out to about one readable test a month on your main template. We walked through that math in when to start CRO. It applies to all three quotes equally. Nobody you hire can read more tests than your traffic allows, so the fair comparison is the cost of one test, start to finish.
‍
Write down two things before you read on: your monthly revenue, and whether you have a developer with 20 spare hours a month. Those two facts settle most of this.

The Freelancer Quote, Priced Per Test

A CRO freelancer's quote usually covers strategy and analysis, and building the test is left to you. Apexure's 2026 guide to hiring a CRO consultant describes the typical freelance engagement exactly that way: a strategist and analyst first, with production code and page builds left to your team. Invesp estimates that implementing a typical A/B test takes 10 to 30 hours of development work, and 40 to 80 for a complex one.
‍
Rates are all over the place. Apexure puts freelance CRO consultants at $75 to $250 an hour, or $5,000 to $10,000 a month on retainer, and Invesp puts top consultants at $250 to $300. Below that the floor gets noisy: featured profiles on Upwork's own page for hiring CRO freelancers ran from $5 to $295 an hour when we checked in October 2026, and both Apexure and Invesp warn you off the cheap end, under $50 and under $40 an hour. That spread is the first risk. You're choosing between people whose rates differ by a factor of twenty or more, and the rate tells you very little about which one knows how to read a test.
‍
Here's the $2,400 quote, finished. Twenty hours of strategy and analysis at $120 is $2,400, and that is the whole of what the freelancer is paid. The rest is yours to buy. Building the test at 20 developer hours, assuming a $75 an hour Shopify developer, adds $1,500. Design and QA, six hours and four at the same rate, add $750. A testing tool runs $200 to $1,500 a month by Invesp's estimate, so say $300, and Invesp notes that most agencies expect the client to pay for it either way. That's about $4,950 for one test: $2,400 to the freelancer and $2,550 to people the quote never mentioned, plus the hours you spend briefing, chasing and reviewing two suppliers instead of one.
‍
And that is the thinnest possible version of this hire. A rate is not an engagement. Apexure lists two ways of buying the same person: $75 to $250 an hour, or $5,000 to $10,000 a month on retainer. Twenty hours is the first one. An ongoing testing programme is usually the second. Price it the way ongoing work is normally sold, add the design, the build, the QA and the tool, and one test costs $7,550 to $12,550.
‍
That number is the one worth sitting with, because of what it doesn't buy. Your traffic sets the ceiling at about one readable test a month whoever you hire, so the retainer doesn't buy you more tests. It buys the thinking on the same single test, for more than the agency quote further down, with the build, the design and the QA still on your side of the table.
‍
Back on the hourly path, the rate moves the total more than anything else in the column. At $75 an hour the same test comes to about $4,050, at $120 about $4,950, and at Apexure's top rate of $250 about $7,550. Past roughly $190 an hour even the thin hourly version costs more per test than a full-service agency. Put your own candidate's number in before you compare columns.
‍
The hourly path only stays cheap if you already own the rest of the team: a developer with twenty spare hours, somebody to do the design, somebody to run QA across devices. If all three exist and are genuinely free that month, $4,950 beats every other column on this page and you should take it. If any one of them is a maybe, the quote in your inbox is half a quote, and the missing half is the half that ships.
‍
There's also one person holding everything. When they take a two week holiday in the middle of a test, the test waits.

Pro Tip

Put the testing tool account in your company's name before the first test runs. If the freelancer leaves, your test history stays. It's the same question we'd ask of any agency, and How to Choose a CRO Agency covers the rest of that list.

The Agency Quote, Priced Per Test

A mid-tier CRO agency typically charges $6,000 to $15,000 a month, according to Invesp's pricing guide, though the same page quotes $5,000 to $8,000 for mid-tier a few sections later, so read the range loosely. Entry level agencies sit around $2,000 to $5,000. Top tier ones start at $10,000, and Invesp says many of those charge around $16,000. What the fee buys is the whole chain in one place: strategy, design, development, QA and the readout. The line it usually doesn't buy is the testing tool, which Invesp says most agencies expect the client to cover.
‍
Invesp's ranges are one agency's view rather than survey data: the page is written by its CEO, whose agency has run CRO since 2006.
‍
The $6,000 quote at one test a month is $6,000 a test, and with the tool you pay for anyway, $6,300. That lands under the freelance retainer and above the thin hourly version. What the extra $1,350 buys is the part the freelancer left with you: the design, the build, the QA before launch, and a team that doesn't stop when one person is out.
‍
And it's the same test. Your traffic allows about one readable test a month whichever column you pick, so the question was never how many tests each one buys. It's how much of that single test you still have to run yourself afterwards. In the freelancer column that's the design, the build and the QA. In the in-house column it's the same three, because one manager is a strategist. The agency column is the only one where the answer is none.
‍
Not every agency bills by the month. Some, Weblics among them, price per test, which changes the arithmetic in your favour in a slow month and against you in a fast one. Ask which model you're being quoted before you compare it with anything on this page.
‍
Whether that's worth it depends almost entirely on whether you have a developer. With one, you're paying an agency for capacity you already own. Without one, you're paying for the half of the job that otherwise doesn't get done.

The In-House Quote, Priced Per Test

A full-time CRO manager in the US earns about $121,000 on average, according to Salary.com, with the middle half between roughly $113,000 and $135,000. Other trackers land lower: Jobicy's 2026 index puts the average at $101,400. Take the Salary.com figure as the upper case, because that's the one a senior hire will quote you.
‍
Benefits make up 30% of what private employers spend on compensation, per the Bureau of Labor Statistics, so a $121,000 salary costs you roughly $173,000 a year, or about $14,400 a month. That still doesn't include a testing tool or the developer who builds the tests. One CRO manager is a strategist. They aren't a program on their own.
‍
At one test a month, the in-house quote comes to about $16,950 a test once you add the tool, the design, the QA and those 20 developer hours. It's the most expensive option by far.
‍
Until the volume changes. At four tests a month, the same salary and tool spread to about $3,700 a test. Add the design, build and QA each one still needs and you're at about $5,950, a third of the one-test figure. Traffic has to carry several tests at once for that to happen, which usually means well past $1 million a month. That's the truck: expensive to own, cheap per trip once you're making a lot of trips.
‍
It's also the direction the market is moving, at least as agencies see it. In Convert's 2025 survey of agency leaders, 87% of large agencies said their clients are bringing more experimentation in-house. We went deeper on this trade in In-House CRO vs Agency.

Side by Side: The Full Tradeoffs

Priced per test at one test a month, on the same scope of work in every column, the agency comes to about $6,300, the in-house hire about $16,950, and the freelancer either $7,550 to $12,550 on a normal retainer or $4,950 if you buy twenty hours and already own a developer. The differences that matter more sit in the rows below the price.

Freelancer, agency and in-house CRO priced on the same scope: cost per test, who builds it, and what you still run yourself

Who to Hire at Your Revenue

Under $150,000 a month, founder-led work plus a freelancer for scoped jobs usually wins. Between $150,000 and $1 million, an agency. Above $1 million, an in-house lead, often with outside help for the build.

Who to hire for CRO at your revenue: under $150K, $150K to $1M and above $1M, with the case where each choice is wrong

In the middle band, the expensive part of a wrong call is rarely the fee. At $300,000 a month, a single change worth 5% is about $15,000 a month. Say the wrong hire takes three months to show it isn't working and another three to replace. Six months at $15,000 is roughly $90,000 of revenue, about $40,000 of gross profit at a 45% margin, that nobody found while you were finding out.
‍
Whoever you hire, the first month goes faster if the test list already exists. Our product page optimization checklist is the one we hand a new store on day one, and it works as a brief for a freelancer just as well.
‍
The operators who get this right price the whole test. The ones who get it wrong price the hour and pay for the rest later.

When Weblics Is the Wrong Hire

There are two situations where I'll tell you not to hire us, and I'd rather say it here than on a sales call.
‍
The first is when you're under 50,000 sessions a month. We don't run testing programs below that, and it isn't a line for the brochure. Below it, the tests we'd run can't read in a reasonable time, so you'd be paying for results nobody can confirm. Start with the founder-led path above, and when to start CRO explains what to do in the meantime.
‍
The second is when you're past $1 million a month and ready to hire a head of CRO. Do it. The truck has started paying for itself, and a good in-house lead will learn your customers in a way no outside team can. The seat we're the wrong hire for at that size is that one, the strategy seat. What sits around it is a separate question: a head of CRO is one person, not a program, and the stores we see at that size keep an outside team on the build, the QA and the readout, working to their lead's roadmap. What changes past $1 million isn't whether you need outside help, it's who decides what gets tested.
‍
If you're between those two, have the traffic, and don't have a developer sitting on 20 spare hours a month, you're who we built this for. On the flexible plan there's no long-term contract, and you can stop any month. The easiest way to find out is to send us your store. We'll go through it the way this article goes through a quote and come back with what we'd test first.
‍
If you're not, one of the other two quotes is the better hire, and now you know which one.
‍
You're not hiring a rate. You're hiring whoever carries a test from idea to answer.