February 5, 2013 at 6:30 pm

How a New York Start-Up Powers a Billboard Chart – and Why Pageviews Trump ‘Likes’

victor hu next big sound

Next Big Sound data scientist Victor Hu, formerly of the U.S. Department of Defense and the New York Yankees

We stopped by Next Big Sound’s New York office for a chat with its data scientist Victor Hu, formerly a mathematician for the U.S. Department of Defense and “stats whiz” for the New York Yankees, to see how the company gauges music popularity for clients including Billboard, which relies on Next Big Sound for one of its charts.

The short story: Next Big Sound measures how popular an artist is in a number of ways, then looks at how fast they are accelerating, and then looks at the acceleration of that acceleration — a concept that might make more sense if you remember your high school calculus. Also, if you’re trying to figure out how popular a musician is, Wikipedia will tell you more than Facebook.

I pulled some key nuggets from our interview to try to distill how Hu does what he does, so that we mere mortals (i.e. normal people for whom high school calculus memories is the closest we normally get to this sort of thing) can try to grasp it.

Public and private data mashed together

“I take all of this rich data that we have — it’s essentially three years of any kind of data you would want to know about an artist, both public  and private,” said Hu. “I’ll look at all the major social media networks combined  with private sales data, radio, and concert data — basically for every  artist. We’ve been tracking this for a long time, and my job is to take [the data] and glean intelligence from it — turn it into insights that we can recommend to our customers… for example, the Billboard charts.”

By public sources, Hu explained that he was referring to Next Big Sound accessing APIs from a number of sources (the site lists Facebook Insights, Google Analytics, iTunes Upload, Twitter, Facebook, YouTube, Vevo, Wikipedia, Last.fm, ReverbNation, SoundCloud, Pandora, Vimeo, Rdio, MySpace, and Instagram).

But what private data sources is he talking about? Well, it’s some of the same numbers Billboard relies on for its other charts, just analyzed differently, and mashed against other sources.

“Private is something like sales data,” added Hu. “There’s no way to get access to that unless you have a relationship with them, which we do. We’re getting it primarily from the labels themselves. The labels who are our customers, they want to see all of their sales numbers in conjunction with the social media numbers, and so they give us this data, so we can put it into our dashboard, and they can see it and slice it in any way they want to.”

“A&R Guys” Use It

“Yeah, that [A&R guys wondering who to sign] is definitely one of the areas that we target,” said Hu. “It’s a sort of a reverse look-up. Instead of taking an artist that you know and finding out what their numbers are [which costs $20 per artist], you say, ‘I want to find artists with these particular numbers.’”

It Watches YouTube Replace Radio as a Sales Driver

“We were asked to do a case study for one of our clients on a particular artist,” remembered Hu. “He was doing very well… his sales numbers just took a spike. It wasn’t in the presence of strong radio play, so that’s very unexpected, given how artists normally progress — if you come out with a hot song, that’s what triggers a lot of your sales. They couldn’t figure out why that was, and they had us look into it more. We followed the rabbit hole down, and it turns out it was because he had released a new video on YouTube right around the time of his spike. That in conjunction with his appearance on an award show — you could see the clear shape of his increasing digital sales come right after the release of his music video, which is not intuitive… to see YouTube tied so closely to sales was, I think, very encouraging.”

It measures the acceleration of acceleration of artist popularity

“Eric [Czech, Next Big Sound chief architect] came up with a way to measure how quickly artists are accelerating,” said Hu. “First we have the Next Big Sound Social 50, and that’s the top artists for social metrics. The harder question is, ‘How do you identify the ones that are up and coming?’ That’s the Next Big Sound chart… We’re looking at the top social media metrics and the acceleration.”

Is that the derivative we remember from calculus?

“It’s the derivative of the derivative,” said Hu.

So it’s the rate of change of the rate of change?

“Exactly,” said Hu. “We’re just fitting a second order polynomial and then seeing what that coefficient is.”

Onward!

It favors new players

“One thing that’s interesting about the chart: We don’t want to feature the same people over and over again. If we feature someone one week, and the next week he’s still accelerating, you can’t just keep them on there forever, you want to rotate it,” said Hu. “Since we’ve been doing it for so long, eventually you reach a point where you’re almost running out of artists. That’s why we narrowed it down from a long list to a smaller list — because we’re trying to feature new, fresh artists every time, it wouldn’t make sense to have the same names over and over again.”

To labels, success has many faces — but not that of the Facebook Like

We wondered what constitutes success for Next Big Sound’s label clients this days. It used to be easy to measure: vinyl (or cassette, or CD) sales. But now, it takes many forms.

“Everything’s still tied to some sort of tangible sales outcome, but it’s expanded, in that it’s not just physical or digital sales,” said Hu. “I think there’s a lot more focus on the 360 model now [where the label's contract grants them a piece of all, or most, of an artist's revenue, including tour receipts]. If you can acquire a fan via having a music video, or getting them to listen to your songs on Hype Machine or Spotify or whatever — even though they might not be paying for that as much as you would want — once you convert the fan, you get them to a concert to buy merchandise, so I think that’s the crux behind a lot of the longer-term thinking: not just focused on the album sale anymore.”

At this point, I mentioned that one problem with the so-called “attention-based economy” is that you can’t make rent by paying attention to your landlord. So do the labels view tweets and Facebook Likes as wins?

“It’s very much ‘Why should we care about Facebook Likes?’ That’s a lot of what we focus our energy on — this blog post that we did about the actual impact of social media on sales was very well received, because that’s what people care about: ‘Do I even care that someone is tweeting about me — what does that translate to in terms of sales?’”

At this point, I mentioned that I’d recently heard that “the kids” are Liking and unfollowing bands on Facebook just to seem cool while not actually wanting to hear from that band in their feed.

“We found consistently that Facebook Likes is not a good indicator of sales,” responded Hu. “It’s much more important to have people coming to your site. Pageviews is a much, much better indicator than Likes. If you think about how you would normally interact with someone’s Facebook page, it makes sense. If you want to know more about them, you’re going to keep hitting their website over and over again, whereas whether you Like them or not — you’re not going to go right from Liking them to buying stuff.”

He also mentioned that Wikipedia visits “are a big driver” of music sales — much moreso than Likes.

“Right before sales spikes and after some sort of event,” he said, “the biggest response is always in Wikipedia… in many ways, it’s a proxy for a Google search, because that’s where they go first.”

So, there you have it: If you want to know who’s popping, check the pageviews on Wikipedia — a non-profit website that does well in Google search results — and not on Facebook, which the stock market says is worth $62 billion, and which is counting in part on those Likes to power its upcoming social search feature.

(more interviews)

  • http://www.fluxresearch.com/ Clyde Smith

    I understand the problem with Facebook Likes. Was there any discussion of how labels or Next Big Sound respond to actual engagement on Facebook such as comments, sharing and, in the case of people selling things via Facebook, actual sales? Or do they just assume the aggregate applies to everyone?