A response on Publishing Perspectives by Porter Anderson to the latest AuthorEarnings report looks to have called out all the big names in self-publishing and e-publishing analysis and advocacy: Joe Konrath, Phoenix Sullivan, and Data Guy himself, author of all the report data. What got their goat is Porter Anderson’s assertion that the AuthorEarnings report come packaged with “the language of self-publishing … a creative corps that cares nothing for the customs and concerns of the industry, and yet seems never to tire of carping at the establishment,” and that “Author Earnings repeatedly has hobbled its own efforts to widen the discussion.”
And as for Data Guy’s methodology, “It might all be searingly accurate, spot on, perfectly right. But we can’t tell that. And, as I mentioned in some commentary on the last report of 2015 at The FutureBook, what’s probably needed is a full analysis by a completely independent, reputable, capable firm, a unit of Nielsen or Forrester or PWC, KPMG, Deloitte, somebody, anybody. Please!”
Respondents weren’t behindhand with their comments. As Thomas Murphy commented, “we recognise, as apparently Mr. Anderson does not, that there are no other sources for the data which Author Earnings analyses in such detail. Mr. Anderson seems somehow to blame Author Earnings for the lack of data, transparency and clarity in what should be key industry indicators. We find it an interesting slant on reality to blame Author Earnings for exposing an industry-wide failure rather than the wider industry itself.” As he acknowledges, “Amazon, one of the few major players in the publishing market, chooses not to share the data they have available to them.” But that isn’t a flaw that AuthorEarnings repeats. As another commentator reminds everyone, “the data used by Author Earnings is available for download. It’s always been available for download. Surely if there was something wrong with the methodology used, it would have been pointed out, and using the same data showed where Authorearnings erred, and why they were wrong.”
Data Guy himself asserts that ” AuthorEarnings is a site by authors for authors, meant to provide data to help authors make informed career decisions. AuthorEarnings has always been a conversation between writers, about how we can best serve our readers, and thus we’re not necessarily too focused on the concerns of other parts of the industry.” And Joe Konrath echoes this in saying: “my concern is not to be understood by the Big 5, or to shame them for their unconscionable contracts, archaic business practices, ongoing mistakes, or naive beliefs in the current state of the industry. I simply want to inform authors, so they can make better business decisions … Author Earnings is offering authors data and a learned opinion. For free. Who else is doing anything even close to that?” And Nik Venture responds to another critic of AuthorEarnings by pointing out that “the data, and methodology, is open and available for all to review. What more can we ask for. Oh, that it’s free. And it is!”
Actually, I’d argue that the independent analysis that Porter Anderson pleads for is the last thing the publishing industry needs. Not because it’s not valuable, but because it’s unlikely. Remember how the ratings agencies fell into disrepute during the Global Financial Crisis because they were in hock to the entities they were supposed to rate independently? I suspect much the same could happen with publishing data. After all, who’s going to buy it besides publishers? The likes of Nielsen have attracted a bad rap for being conservative in their methodology, and for being keener to protect their income stream, their cozy relations with the publishing establishment, and their own rep than to produce meaningful numbers.
Note, circa 2009, how bad the Nielsen situation was before Kindle Store data came along to shake things up. As Steve Weber wrote in TeleRead, then, “BookScan is like an author’s credit report. Just as you can’t get a loan without a decent credit report, you can’t get another book deal if your BookScan numbers stink … Problem is, most authors need a loan to pay BookScan’s subscription fee, $5000 a year for full access.” And as of 2016, it seems that the only individual authors who can afford access to Nielsen BookScan – and who even want to – are the likes of vindictive narcissist Stephen Leather.
Phoenix Sullivan, one of the more neutral and conscientious critics of Data Guy’s past methodology, points out that she “with nothing more than the spreadsheet of data downloaded directly from the Author Earnings site, a calculator, a couple of hours of spare time, and a basic understanding of Amazon sales rank,” pretty much second-guessed Data Guy’s latest admission of around 18 percent overreporting of ebook sales in his past work. And what she says about the latest results is worth repeating in full – so bear with the extended quote here.
Phoenix Sullivan notes that if she, “without multiple servers’ worth of computing power at my disposal, without any analytical programs … can figure this stuff out enough that she can replicate the methodology and point out errors and enhancements to the calculations used, yet astute operatives in the trade are baffled by it all, then I think that tells me more about the operatives than Data Guy’s methodology. I’ve been one of the more vocal indie critics of the Author Earnings Report. Do I believe it’s flawed? Yes. Do I believe it’s MORE flawed than any other report like it on either the trade or indie side? Find me another one like it to compare to and I’ll let you know. Am I gobsmacked surprised that this is BUSINESS INTELLIGENCE being handed to business people on a silver spreadsheet, and for TWO YEARS no industry business has devoted itself to finding a way to validate it, improve upon it, and use the granular data in it? Why wait for a third-party when the data is right there for you to download?”
So far no one has replied to her on that, including Porter Anderson himself. I’d be very interested to see what the reply is when it does come. At the very least, this is a massively interesting curtain-raiser to Data Guy’s public presentation of his methodology at Digital Book World this March.