Recently, Relay was looking to revamp its messaging strategy to see whether text messages or email were the best form of outreach.
Marketing had a hunch based on customer feedback that SMS would be a more engaging channel for certain customers, but there was no easy way for the product people to run an experiment. For one, Mandrill isn’t integrated into Twilio. But even if they were connected, in order to prove ROI, Relay would need to use a separate vendor to tie message engagement to a site visit and then that visit to a subsequent checkout.
“There was a broad sense of click rate and open rate, but that was about it,” Bordogna said.
To get a better sense of the overall picture, Relay started working with Segment, a data management company that aggregates and normalizes the web and mobile data being collected through disparate third-party sources, everything from customer service to tag management, which it puts into one repository that clients can access through one API.
Segment has hookups with around 200 different vendors across analytics, email, advertising, mobile, SQL, surveys, attribution, live chat, A/B testing, help desks, CRM, fraud, security and deep-linking.
“There’s a lot of janitorial data engineering work that has to go on under the covers,” said Segment CEO Peter Reinhardt.
Having all the raw data in one place lets the engineering folks funnel data from one source to another to run cross-platform queries, like Relay’s experiment around text vs. email.
Relay ran its test with a subset of its user base, noting that customers who received an SMS message were twice as likely to engage with it than the same message via email. Relay also noticed its cart abandonment rate decrease by a few percentage points.
Since piping its data into Segment, there’s been more than a truce between product and marketing. The teams now regularly collaborate on shared projects.
“We look at product and marketing less as two distinct things and more as one continuum focused on the customer life cycle,” said Bordogna.
If a landing page isn’t converting the way it should, for example, or people are abandoning their carts, they create a mini ad hoc crew with members from both the product side and the marketing side to tackle the problem.
“Historically, we haven’t had a great way to say what’s working and what’s not,” Bordogna said. “Now we’re thinking about the intersection between messaging, merchandising, marketing and product and we can run better tests around what we show people on landing pages or on sales pages or in the search results.”