Skip to content
Logo-black
  • Native Commerce Core™
    • IDC-marketscape-q4-2024-resources-hub-cover-562x562@2x

      Constructor is a leader in the IDC marketscape

      Constructor is a Leader in the IDC MarketScape on Worldwide Knowledge Discovery Software for External-Facing Use Cases, 2024.

        • Search & Autosuggest

          Hyper-personalized ecommerce search driven by AI and real-time shopper behavior.

        • Browse

          Personalize your ecommerce category pages for maximum conversions.

        • Recommendations

          Drive upsells and increase RPV with hyper-personalized product recommendations.

        • Collections

          Dynamic, personalized ecommerce collection pages that learn from every search, click, and purchase.

        • Quizzes

          Create smart product recommendation quizzes that drive shopper engagement.

        • Merchant Controls & Intelligence

          Get the ecommerce merchandising controls and insights you need to make high-impact changes that drive revenue.

        • Attribute Enrichment

          Automatically enrich product attributes and categories to give shoppers the best possible experience.

        • AI Shopping Assistant

          Help your online customers discover great products faster.

        • Retail Media

          Constructor Sponsored Listings complement (instead of compete with) your organic results.

        • Cross-Channel & Offsite Discovery

          Create and launch personalized, data-driven marketing campaigns across digital channels.

        • B2B Use-Cases

          Product discovery technology that’s purpose-built to handle the complex needs of B2B ecommerce.

  • Customers
    • Beyond Relevance Featured

      Beyond Relevance Report

      The Data-Backed Case for Attractiveness as the New Standard for Ecommerce Search Performance.

        • Upcoming Events

          Visit us in person at ecommerce industry events.

        • Reports & Guides

          New research, guidance, and insights for the future of retail.

        • Webinars

          Educational webinars, conversations with Constructor partners, and more.

        • Blog

          The latest ideas and news from the frontier of commerce search and discovery.

        • Split/Test Digest

          The most interesting learnings from A/B testing at Constructor.

        • News

          Read Constructor's latest news coverage and press announcements.

        • Documentation

          Learn about the components of Constructor's advanced, AI-powered product discovery suite.

        • About Us

          With AI in our DNA and by keeping ecommerce as our core focus, we’ve built the best product search and discovery solution specifically for the unique needs of retailers.

        • Partners

          Constructor partners with the world’s top retail consultants, systems integrators, and technology platforms.

        • Careers

          Constructor is building the next generation of search solutions.

Login
Book a Demo
  • Native Commerce Core™
    • IDC-marketscape-q4-2024-resources-hub-cover-562x562@2x

      Constructor is a leader in the IDC marketscape

      Constructor is a Leader in the IDC MarketScape on Worldwide Knowledge Discovery Software for External-Facing Use Cases, 2024.

        • Search & Autosuggest

          Hyper-personalized ecommerce search driven by AI and real-time shopper behavior.

        • Browse

          Personalize your ecommerce category pages for maximum conversions.

        • Recommendations

          Drive upsells and increase RPV with hyper-personalized product recommendations.

        • Collections

          Dynamic, personalized ecommerce collection pages that learn from every search, click, and purchase.

        • Quizzes

          Create smart product recommendation quizzes that drive shopper engagement.

        • Merchant Controls & Intelligence

          Get the ecommerce merchandising controls and insights you need to make high-impact changes that drive revenue.

        • Attribute Enrichment

          Automatically enrich product attributes and categories to give shoppers the best possible experience.

        • AI Shopping Assistant

          Help your online customers discover great products faster.

        • Retail Media

          Constructor Sponsored Listings complement (instead of compete with) your organic results.

        • Cross-Channel & Offsite Discovery

          Create and launch personalized, data-driven marketing campaigns across digital channels.

        • B2B Use-Cases

          Product discovery technology that’s purpose-built to handle the complex needs of B2B ecommerce.

  • Customers
    • Beyond Relevance Featured

      Beyond Relevance Report

      The Data-Backed Case for Attractiveness as the New Standard for Ecommerce Search Performance.

        • Upcoming Events

          Visit us in person at ecommerce industry events.

        • Reports & Guides

          New research, guidance, and insights for the future of retail.

        • Webinars

          Educational webinars, conversations with Constructor partners, and more.

        • Blog

          The latest ideas and news from the frontier of commerce search and discovery.

        • Split/Test Digest

          The most interesting learnings from A/B testing at Constructor.

        • News

          Read Constructor's latest news coverage and press announcements.

        • Documentation

          Learn about the components of Constructor's advanced, AI-powered product discovery suite.

        • About Us

          With AI in our DNA and by keeping ecommerce as our core focus, we’ve built the best product search and discovery solution specifically for the unique needs of retailers.

        • Partners

          Constructor partners with the world’s top retail consultants, systems integrators, and technology platforms.

        • Careers

          Constructor is building the next generation of search solutions.

Login
Book a Demo
Back to Blog

Introducing the Experiments Blog: Interesting Learnings from A/B Testing at Constructor

Posted on:
September 3, 2024
Author:
Eli Finkelshteyn
Hexagonal blocks with an outline of a person in the middle
Hexagonal blocks with an outline of a person in the middle

At Constructor, we run a lot of individualized A/B tests, specific to each of our customers, trying to optimize their business KPIs. It’s something we’ve done for years, and it's something unique we do out of the Search and Product Discovery vendors and technologies on the market. The primary goal of the practice is to increase our customers’ revenue, purchases, and related KPIs. 

We know that these tests have driven a lot of added revenue for our customers over the years. These were literal A/B tests, so when I say “know,” I mean that in a statistically significant way. But we realized they have some additional value as well: we now have a lot of learnings from the 1,000+ A/B tests we’ve run over the years across customers in various industries — primarily within ecommerce, but also commerce-adjacent industries along with content search. Plus, those learnings are generally interesting as data points of what sorts of techniques and strategies work well in some industries (but not in others), in different geographies, in varied user bases, and within other ways to slice the data.

In the past, we thought of this data as some of our secret sauce and shared very little outwardly about it, but lately, we’ve been having a change of heart. There are a few main reasons for this:

  1. As part of our mission, we solve not only for the needs of today’s ecommerce retailers, but for the retailers of tomorrow. We believe it is our responsibility to play a role in building a vision for the future. Sharing our learnings is a small thing we can do to help the industry as a whole iterate and evolve. We think everyone can benefit, and ecommerce shopping experiences as a whole can become better.

  2. The original research that currently exists on these topics is largely not statistical – it’s either opinion, or it’s individual data points about what worked on a single site, or what a handful of users said they preferred. There is certainly a place for this type of research, but as a company that strongly believes in data-backed decision making, we felt like sharing our learnings and the data behind them will provide important context, and hopefully save others from learning lessons we’ve already learned.

  3. More selfishly, in terms of company policy, sharing these learnings means our competitors will likely copy them. That means we both get to influence more of the industry, and it also encourages us as a company to not rest on our laurels and encourages our mission to always find ways to make our service better for our customers. Both of these in turn mean ecommerce gets better and it gets better for a larger group of people.

The future of ecommerce will be shaped by those who innovate and push the boundaries of what’s possible. At Constructor, we’re excited to be part of that journey, and we invite you to join us in this evolving conversation.

Subscribe to our Experiments Blog

Get conversion-driving insights delivered straight to your inbox.

What's next?
Eyeglasses icon

Uncover lost revenue opportunities with a complimentary Search Experience Audit.

According to the 2024 State of Ecommerce Search & Product Discovery Survey, nearly 70% of shoppers think the search function on retail websites needs an upgrade. Our team has run over 1000 A/B tests to identify easy-to-implement algorithmic and UX improvements that get results. Use their research to your advantage with a complimentary Search Experience Audit — no strings attached.

Request an Audit
  • Analyze your search results quality
  • Identify "no results" pages
  • Pinpoint irrelevant results for long-form queries
  • Uncover UX opportunities for Search, Autocomplete, and PLPs

According to the 2024 State of Ecommerce Search & Product Discovery Survey, nearly 70% of shoppers think the search function on retail websites needs an upgrade. Our team has run over 1000 A/B tests to identify easy-to-implement algorithmic and UX improvements that get results. Use their research to your advantage with a complimentary Search Experience Audit — no strings attached.

Request an Audit
  • MACH Certified
  • 21972-312_SOC_NonCPA-150x150
  • Cartification-mark_04-09-300x253-1-150x150
Constructor.io Logo
  • Technology
    • Native Commerce Core™
    • Request a Demo
    • The Proof Schedule®
  • Solutions
    • Search & Autosuggest
    • Browse
    • Recommendations
    • Collections
    • Quizzes
    • Merchant Controls & Intelligence
    • Attribute Enrichment
    • AI Shopping Assistant
    • B2B Solutions
  • Resources Hub
    • Events
    • Reports, Guides & Webinars
    • Blog
    • Experiments
    • News
    • Constructor vs Alternatives
    • Documentation
  • About
    • About Us
    • Partners
    • Security & Compliance
    • Careers
  • Technology
    • Native Commerce Core™
    • Request a Demo
    • The Proof Schedule®
  • Solutions
    • Search & Autosuggest
    • Browse
    • Recommendations
    • Collections
    • Quizzes
    • Merchant Controls & Intelligence
    • Attribute Enrichment
    • AI Shopping Assistant
    • B2B Solutions
  • Resources Hub
    • Events
    • Reports, Guides & Webinars
    • Blog
    • Experiments
    • News
    • Constructor vs Alternatives
    • Documentation
  • About
    • About Us
    • Partners
    • Security & Compliance
    • Careers
© 2025 Constructor All rights reserved
  • Terms of Service
  • Privacy Policy