Experiments | Run A/B tests and read the results by asking.

The most ambitious companies run on Sherpa

A/B test anything.
Run it yourself or let your agents.

Experiments / Homepage testRunning
Goal
Split evenly50% / 50%

For the humans

Set the goal, approve the variants, call the winner.

CodexConnected

Test the new homepage from Figma against the current one for visitors from paid ads.

    Version B is clearly aheadBooked calls from paid ads, 18,937 against 12,418
    Version A12,418
    Version B18,937
    www.offbeats.com

    For the agents

    Agents build full variants, run the test and read the results.

    A/B testing
    built into your site.

    www.offbeats.comVersion A on screen: 0 ms
    Version B
    Page load30 ms

    Describe the test.
    Sherpa builds it and runs it.

    Sherpa / Homepage test
    Live for paid ads
    Offbeats® Studio
    WorkStudioServicesLet’s talk

    An AI-native design studio crafting
    brands and digital experiences
    for fast-growing startups

    Book a callSee work

    We build bold brands and
    memorable websites for ambitious
    startups shaping what comes next.

    Book a callSee work

    FAQ

    Can my agent set up an A/B test?

    Yes. Your agent can build the versions, prepare the test and read the results. Tell it what you want to try and the goal you care about. Your team reviews the versions and approves the launch.

    Can I test a whole page?

    Yes. Test a headline, a form, a new layout or a complete page redesign. Your agent works with your actual website, so you can test changes to both the content and the design.

    Will visitors see the page flicker between versions?

    Sherpa serves the chosen version as the page loads, so visitors see their version from the start. There’s no page swap afterward.

    How do we know which version won?

    Choose a goal, such as a signup or demo request. Sherpa compares the results for each version. Ask your agent to explain the report and help you decide whether there’s enough evidence to choose a winner.

    Can my team and agents work on the same test?

    Yes. Your team can set the goal and review the versions while your agent builds the test and reads the results. You decide when to launch and what to do next.

    Everything your website needs.
    All in one place.

    Your website has places to go.
    Let's get it moving.

    Your next big website change could start with a conversation. See what Sherpa can do with your existing site.

    Try Sherpa

    See your own site on Sherpa.

    1. TodayPick a timePick a time
    2. Before the callWe copy your site over, freeWe copy it, free
    3. On the callYou take it for a spinTry it live
    You'll talk to Ethan, Sherpa's founder.

    Loading times…

    Open the booking page in a new tab ↗