Skip to main content

Complete A/B Testing Reports With Analytics

8 minutes read

a/b testing conversation

Often people want to get a deeper understanding of email A/B testing results than what's available in standard marketing analytics. Generally for good reasons like to go deeper on what other options may have driven the winning email selection. One-off emails are important but often the key messages an organization is trying to share are within email newsletters and marketing campaigns.

The challenge is that email marketing analytics software is often limited to local onboard reporting. Often this does a good enough job of reporting on major metrics like opens, clicks, click-through rates (CTR), etc. What happens when you want to go deep?

The first place you look to get better email analytics is in a specialized data warehouse like Adobe Analytics or Google Analytics. Perhaps you have a cloud data warehouse like Snowflake or something from Amazon. This is a good first step because it's where the marketing cloud email API starts to play a key role.

For the purposes of illustration, this blog entry on email analytics will focus on the Marketo API and Adobe Analytics.

Adobe marketing analytics provides a highly specialized data warehouse for reporting and analytics within the marketing environment. It works equally well with Oracle Eloqua and other email marketing platforms from other vendors.

After you've decided on which marketing analytics platform to use, the next step is to access data in the marketing automation system. In this case, it would be the Marketo send email API that is focused on the API A/B testing results.

For reporting on a b testing, you essentially need to have all of the data that's associated with emails being sent. That is the core elements of the subject, email title, content, opens, clicks, etc.  When using the Marketo API for email analytics data is spread across multiple interfaces. This makes A/B testing reporting a bit more work to achieve.

So What Do You Do?

The first step is getting access to the email A/B results via the Marketo API. You can do this with a developer who hand codes it or no-code data integration connectors from Put It Forward.

This allows you to get access to the data and connect it with Adobe Analytics directly. At this point, you'll need to understand what dimensions and metrics need to be populated within the Adobe marketing analytics sections of the data warehouse. Best practices for email analytics are a related discussion to this and for another time.

The second step is to prepare the data for loading the data via the Marketo API into Adobe Analytics. The temptation is to load it directly into the data warehouse. This is feasible in some instances but introduces a handicap. 

You won't be able to slice and dice the data the way you want because it's not how the Marketo API is structured.  It is not meant to export email a b testing results, just winning email data. 

To get all of the email campaign data into Adobe marketing analytics the first step is to extract the data.  This is done via the various Marketo API options. A common approach for this is called data wrangling.

This data is then temporarily housed in a data stage where it is prepared for loading into Adobe Analytics. The data stage within Put It Forward performs the functions of normalizing, cleansing, and organizing data for the analytics layer. This is where you'll do your deep dive email a b testing reporting.

The Put It Forward data stage contains the various data models, schemas, and structures for mapping Marketo into Adobe Analytics. As well as all of the functions needed to normalize, cleanse and improve the data quality. Importantly it also contains the functions for data governance. Enabling traceability and life cycle management which can be used in compliance and regulatory business scenarios.

Once the data is housed and organized within the Put It Forward Data Stage and prepared for loading into Adobe Analytics. The second step in the data integration begins with the loading into the data warehouse. Using the data integration solution of Put It Forward gives you control of when and where data populates Adobe marketing analytics.

A/B testing analytics

What Does This Get You?

First is a solution for being able to slice and dice email marketing analytics in any way you can think of. For example, you can see all the parameters of Marketo A/B testing results, not just the winner. This helps you understand what parameters drive winning and losing emails. 

What is statistically significant and what went into the winning email selection? You need to understand more than just the subject line results so you can make decisions about how to proceed.

Secondly, this gives you the launchpad for enriching your email marketing analytics via data wrangling.

Third and maybe most importantly, is being able to look beyond the simple click metrics contained within the marketing esp. To develop a deeper understanding of what your audience is really interested in and responding to them.  To do true multivariate analysis on what's being communicated to your audience. Without the limitations of simple in-app A/B testing reports.

Getting the information you're looking to work with out of Marketo or Eloqua into an analytics platform requires tools, skills, and knowledge of the data structures to make it work. For more information on best practices see some of the links below or contact us for an expert discussion.

Related Topics

Adobe Analytics Marketo Integration

Adobe Analytics Eloqua Integration

Identity Resolution

Elsa Petterson

Elsa Petterson
Partner success manager @ Put It Forward

What Critical Challenges IT Transformation Solves Written on November 15, 2023. Learn how to solve IT operations challenges and build a successful IT strategy. 6 minute...

Continue reading

Exposing the Value: Measuring ROI of HR Integration Projects Written on June 5, 2024. Unlock the full potential of your workforce by understanding how to effectively measure...

Continue reading

The Fundamental Guide to Account-Based Marketing CMI's Enterprise Content Marketing research shows that 34% of businesses use account-based marketing and 21% plan to incorporate...

Continue reading

RevOps vs SalesOps
RevOps vs SalesOps: Key Differences and Strategic Impact on Business Growth Written on October 1, 2024. RevOps boosts all revenue areas; SalesOps helps the sales team succeed. ...

Continue reading

Process Mining for Workfront Performance Management Written on July 28, 2024. Learn how Put It Forward's Process Mining solution for Workfront can help you run a better organization,...

Continue reading

Optimize your Go-to-Market Strategy with an Integrated Tech Stack Written on November 3, 2023. Learn how to supercharge your GTM strategy with an integrated tech stack. 6...

Continue reading

5 Steps To Improve Decision-Making with Prediction Insights Written on 18 November 2022. Prediction insights are based on predictive conversion models instead of human "gut" feeling...

Continue reading

Identity Resolution - Customer Experience Core Infrastructure Leveraging What You Have Most companies already have everything that’s needed for identity resolution. It’s...

Continue reading

How Traditional Revenue Operations Differ from Intelligent RevOps Companies face difficulties in providing the best purchase experience and generating high-quality prospects...

Continue reading

Predictive Analytics for Revenue Generation Executive Summary Predictive analytics is a valuable tool for revenue generation. By analyzing past data and trends along...

Continue reading

How to Streamline Quote-to-Cash Processes Written on July 3, 2024. Learn how to streamline your quote-to-cash processes and boost your company's efficiency, reduce errors,...

Continue reading

How to Measure a True Marketing ROI Written on October 2, 2023. Learn how to measure a true marketing ROI and best practices to drive efficiency.  6 minute read What has...

Continue reading

How to Gain More Predictive Insights with Less Technology Written on December 20, 2023. Learn how to drive powerful predictive insights without the need to adopt a new technology.  6...

Continue reading

How to Ensure Critical Events are Operationally Executed Written on January 8, 2024. Learn how to ensure critical events and actions are operationally executed in your...

Continue reading

How to Drive Growth with Intelligent Churn Prediction Model Written on October 20, 2023. Learn how to build a churn prediction model and drive positive outcomes. 6 minute...

Continue reading

How to Create a Customer Experience Strategy: Case Study Today's customers demand better experiences from the brands they interact with. To improve your customer experience,...

Continue reading

How To Close More Deals with 360-Degree Customer View Written on 09 December 2022. Put It Forward's customer 360 analytics platform provides advanced analytics capabilities,...

Continue reading

How to Build a Successful Lead Generation Strategy Written on December 6, 2023. Learn how to build a successful lead generation and demand capture strategy. 6 minute read Marketers...

Continue reading

How to boost the lead-to-cash process by integrating Netsuite Written on September 28, 2023. Discover how to integrate Netsuite and boost lead-to-cash process. 6 minute read In...

Continue reading

Steps: How to Automate IT and Project Management Workflows Written on June 19, 2024. Learn how to automate Workfront and Jira and enhance efficiency, accuracy, operational...

Continue reading

How Sales Managers Grow Their Pipeline with Customer Intent Prediction Knowing the customers’ intent gives marketing and sales teams power over not just their journey through...

Continue reading

How Professionals Identify the Best New Customer with Predictive Models Written on 04 November 2022. Marketing has always been about trying to understand what the customer wants....

Continue reading

How Predictive Customer Lifetime Value Drives Revenue Winning and retaining customers is an expensive investment. That is why it is crucial to invest primarily...

Continue reading

How Process Automation Helps Creative Agencies Compete Written on August 28, 2024. Learn how process automation empowers creative agencies to streamline workflows, enhance...

Continue reading

Harnessing Customer Insights: The Key to Staying Competitive Written on November 20, 2023. Learn how to leverage customer insights from intelligent automation for competitiveness. 6...

Continue reading

Five Ways Intelligent Automation Helps Enterprise Leaders Written on January 17, 2024. Learn how to enhance your team's business processes with intelligent workflow automation.  6...

Continue reading

Financial Planning and Analysis Automated One of the most critical business processes in any company is financial planning and analysis (FP&A) because it provides leadership...

Continue reading

Finance Automation Unleashed: RPA in Finance and AI in Action Written on July 23, 2024. Learn how Robotic Process Automation (RPA) and Artificial Intelligence (AI) transform...

Continue reading

Experience Continuity - Hyper Personalization Through Linked Experiences Experience Continuity - Hyper Personalization Through Linked Experiences When Walt Disney...

Continue reading

Diseconomy - What's Your Next Best Action? Written on October 2, 2023. Learn what is diseconomy at scale and what is your next best action in the face of it.  6 minute...

Continue reading

Developing a Model for Conversion Rate Optimization With Real-Time Insights (CRO) Written on December 11, 2023. Learn how to develop a model for Conversion Rate Optimization...

Continue reading

Seeing Through the Click - Content Awareness Seeing Through the Click - What’s Happening Inside the Content Often, our customers and prospects ask for...

Continue reading

Complete Guide to Customer Identity and Access Management Written on March 4, 2024. Learn how to improve customer experience and productivity by implementing Customer Identity...

Continue reading

But Will it Work? The Pressure for Marketers to Drive Pipeline Conversion Written by: Mark Cowan - CDO, Put It Forward February 26, 2019 But Will it Work? The Pressure for...

Continue reading

AI-Generated Content: Driving Experience-Orchestrated Business Success Written on May 22, 2024. In the rapidly evolving digital landscape, AI-generated content is emerging...

Continue reading

How is AI Empowering Sentiment Analysis? Sentiment analysis is a new area of technology that's being looked at as the next natural step in digital communication. To understand...

Continue reading

Achieving operational excellence with finance automation The future of finance is about delivering valuable insights at a speed Finance chiefs must prioritize reducing costs,...

Continue reading

Complete A/B Testing Reports With Analytics Often people want to get a deeper understanding of email A/B testing results than what's available in standard marketing analytics. Generally...

Continue reading

The Fundamental Guide to the Modern Customer Data Platform The customer data platform market is worth over $2.4 billion. It's a popular form of business software across...

Continue reading