Content is King! Unless...

Content IS King!

There is no doubt about it. We are bombarded with information every waking minute of the day, thanks to a hyper connected lifestyle that has become the norm. In this barrage from electronic media, advertising, social networks, text messages and email communication we tend to subconsciously gravitate towards certain type of information more than others. Information that is rich in content. Content, more importantly original content stands out amongst the noise and gets our attention.

If your goal is to get your audience’s attention, it is obvious that you must focus on the content you provide.

Personalized Content Rules Supreme!

All content however are not created equal. What is appealing to me may not interest you and what motivates you to take action (buy a product, go to a restaurant or watch a movie) may have no impact on a third person. This adds another important dimension to the challenge of getting the content right – it isgetting the right content to the right person. In other words, Personalized Content.

Retailers are fast taking a lesson from this and implementing content driven commerce solutions to present customers with products and services that are relevant, interesting and timely. Personalized content based on a customer’s profile, buying preferences, location or just about any other attribute that can be directly or indirectly gleaned is being used to drive revenue.

And this is beginning to deliver results in increased total revenue, higher revenue per customer and greater customer retention.

Unless...

There is however a wrinkle here (there is always a wrinkle). As great as personalized content is in delivering a positive result, improperly personalized content or irrelevant content has the opposite effect. If you are presented with the content is personalized for my tastes and buying behavior, chances are you would be less inclined to make a buying decision than if you were presented with generic (non-personalized or mass market) content.

Companies implementing personalized-content based commerce solutions now have the added responsibility of making sure that they get this personalization and the delivery of personalized content right, or pay the price for it.

eCommerce and content based commerce platform vendors are providing support for capturing a variety of customer data and building sophisticated rules based on this data to drive personalization and present original content. But who is making sure that these rules are built correctly and the personalized content is being presented correctly.

Testing such implementations is often done by existing manual testing processes that are grossly inadequate in their ability to simulate the variety of personalization options required to test these rules. What is scarier is the hubris that sometimes accompanies these implementations leading to the belief that they will always be done right and don’t require any additional or different methods of testing. We all know what such hubris can lead to.

Content Can Still Be King

There are some steps that can be taken to make sure that personalized content is built and delivered correctly. It involves developing a comprehensive testing strategy to test these implementations and putting in place a testing solution that can consistently run tests in a scalable manner using a representative test data set. Here are a few steps that you can focus on to get started in building such a strategy:

  • Test the User Journey – Follow the footsteps of your user on your site. This will identify issues relating to irrelevant content or incorrectly delivered content that your users may experience on your site
  • Automation – Implement a test automation solution that can help you easily build tests to verify that specific content is being delivered correctly. Since you will need to run the same tests for different personalization criteria and content, automating your tests will deliver huge payoffs
  • Test Data – Build a representative set of test data that covers the entire range of customer attributes used to drive personalization. Then map out the range of content that should be delivered for this personalization. Make sure that you test data handles both positive and negative tests. The latter is sometimes more important the former as it helps avoid presenting incorrect content.
  • Continuous Testing – Content driven commerce requires frequent content updates and also frequent changes to personalization rules. Make sure that you can tie to execution of your tests to these updates that you make. This continuous testing will help you identify issues and let you rectify them before they become a problem.

Do you use personalized content to drive customer engagement and revenue on your site? If so, how do you make sure that you deliver the right content to the right people? Please feel free to share your thoughts and experiences.

Dear Customer, Quality is YOUR problem too!

I usually tell this to my customers at the beginning of an engagement when we discuss product quality. After an initial silence, the response I usually get is, “What do you mean! I am paying you to make sure that my software is built right and just the way I want it. It’s your job to make sure that it works correctly. Why is it my problem!."

I then explain why it is their problem and what they can do about it!

Ensuring software quality has long been seen as the sole responsibility of the product development team - software developers, the QA team, infrastructure and network teams and the project management team. The product development team (whether it is in-house or outsourced) is tasked with understanding the customer’s needs and building a software product to meet these needs.

The challenge however has always been in understanding the customer’s needsand meeting those needs. An exercise that involves getting objective results (meeting those needs) to a subjective problem (understanding customer’s needs) has the odds stacked against it from the beginning. Meanwhile, Qualityas perceived by the customer is often a measure of how well those needs are met.

SDLC processes have been developed and have evolved over decades with the goal to help address this problem. Reducing subjectivity in defining customer needs has been a huge component of the ‘requirements definition’ phase of all SDLCs. Detailed requirements documents, functional and technical specifications, use cases, epics and stories are just a few of the tools that have been used to add objectivity to the customer’s needs. Agile methodologies have gone a step further and included the customer as a key participant in the development process in an effort to improve the understanding of customer’s needs.

While customers are willing to participate in helping with understanding needs, they also must be involved in determining what it means to meet these needs. Establishing Acceptance Criteria and techniques like Behavior Driven Development (BDD) and Test Driven Development (TDD) build rubrics, which can be used to drive tests to assess quality. These help, but don’t solve the problem completely.

The issue here is not with the process, but usually in the unwillingness or inability of the customer (or appropriate business stakeholder) in defining these rubrics with the level of detail that is actually meaningful in assessing quality. Another oft ignored component in this process is the test data. Using the right test data also goes a long way in establishing quality (meeting needs). This is an area where the customer’s participation is critical because they know their data the best. This is especially true for most current software systems where quality depends on a lot more than just source code. It depends on data, configurations, content, rules and usage patterns.

Development teams can do a lot to ensure that the software product they put out is of high quality, but they cannot do it alone. Customer Participation and more importantly Customer Accountability is critical to achieving high quality.

Have you talked to your customer’s about their role in software quality? How have these conversations gone? Would you like to share any of your stories?

A Walk in your Customer's Shoes

The Customer Journey on an eCommerce Site receives a lot of attention. Every site wants to understand what a customer wants or prefers and builds the site to suit that preference. The hope is that this will result in a purchase by the customer and an increase in revenue for the site.

Tools to develop customer journey maps and A/B testing tools to understand customer preferences are numerous. These help define the journey that the customer will make through the site and make sure that the path trodden is filled with objects of interest to the customer and devoid of experiences that will cause them to abandon the journey. They attempt to attract the right customer and interact with them in an appropriate manner to ensure that the customer will transact with the site.

In spite of doing all this, sites often find that they don’t see the results they expect.

So what are they missing?

They are missing the recognition that a customer’s journey includes a key aspect of any journey – the experience. Understanding the customer’s experience is important to ensuring a successful outcome of the journey, i.e., a purchase transaction.

There is an old saying: "You can’t really understand a person until you have walked a mile in their shoes”. If you really want to understand your customer’s experience on your eCommerce site, you just have to get in their shoes and make the journey through your Web site.

This journey will show you what the customer sees and experiences on your site. The personalized content that is presented, the navigation choices available, the promotions that are presented and the product choices that are suggested based on customer targeting rules or past purchases. The experience is also likely to vary based on the means (browser/device etc.) that the customer chooses to access your site. Given that the path taken by different customers through your site can vary significantly (in terms of content, personalization, access method etc.), so will their experience.

Understanding the variety of experiences on your site will help you close the loop between designing the customer journey and validating the impact of that journey on your customer to ensure a successful outcome. This understanding can be gained by testing the eCommerce site with a simulated user (synthetic testing) in a manner that captures the user journey through your site and your site’s response to that journey. Testing every possible variation (different content, personalization and navigation paths) of the customer journey and evaluating the response of the different systems/components that make up your site for all these variations requires what I call Deep Synthetic Testing. The depth in this testing is critical to gathering adequate and relevant data on the customer experience. Data that can then be worked upon by analytics and reporting tools to provide the necessary understanding of the customer experience and validate the journey.

What have you done to understand your customer’s experience on your site? What has worked for you and what has not? Would you be willing to share this?

The Wait is Over! Data Driven Testing is Here

We are extremely thrilled to announce the support for Data Driven Testing and Keyword Driven Testing in eureQa®.

You can now run your test scenarios in eureQa® against large sets of test data directly from the eureQa® Cloud. You don’t have to build any new tests. You can use the tests you currently have and enable them for Data Driven Testing.

You can do this without programming!

With this release we have also made a number of changes to the eureQa® workflows and UI with the goal of making it more user friendly and improving user productivity. You can learn more about the new features added on our Data Driven Testing page.

If you have not already signed up for eureQa®, sign up for a Free Trial today.