Notes from this Webinar. I had to leave after the second speaker so they’re not complete.
Alt metrics are a complement to existing metrics, addressing some of the key issues posed by metrics: the lag time of citations, the limitations of impact factor, the time to publication and their focus on a niche audience. The intention of alt metrics is to expand the focus, in order to assess what a broader audience think about research. This has many aspects but one increasingly important one is blogging, currently encompassing 10,000+ blogs with over 1 million mentions of research, from 2006 to now.
Research commentary plays a crucial role in the public understanding of science. It mediates access to research, sometimes providing a more accessible articulation and other times providing a critical focus. The webinar gave an overview of four different types of blog which Alt Metrics are concerned with:
- Newspaper blogs: often hosted on a subdomain, with a large and diverse audience.
- Public education blogs: written by specialists and scientists, with public education as a main goal. They tend to have a social media presence and a large but specific audience.
- Blogs hosted by academic institutions: a lab or department, often used for promoting that groups work, a narrow academic focus and act as a press release outlet for the group.
- Research blogging platforms: these are a large collective domain, aggregating lots of different blogs, with an audience that tends to be researchers, helps build a research community.
One of the guest speakers, Rolf Degen, talked about how the internet has disrupted the work of freelance science writers. What were once 95 weekly science sections had become 34 in 2005 and 19 in 2012. He embraced social media in order to help build the audience for his writing, though encountered the problem of people not following links through to his article from his tweets. He tried to compress the complexity of a science story by taking a screenshot to post on Twitter, inciting readers to click through to the piece itself. Another problem is that people on Twitter like negativity, sarcastic comments and the tearing apart of established studies.
Nonetheless, it’s important to recognise that the ‘dirty side of science’ has been ignored by the media, who get most of their information from big science institutions and their press releases. Many of his followers are well qualified, prone to instantly criticising him if he makes a mistake. His editors have never been experts in his field, with criticism from readers being confined to letter to the editor. For this reason, the quality control is much higher than it has previously been. He argues that social media has created “an acquired taste for criticism” which is greatly beneficial for science writing. It’s creating a climate in which it’s just as much fun to find error in something, as to find great new insights, contributing to a turn away from the bias for positive results.
The next speaker, Neuro Skeptic, spoke about his experiences as a science blogger. He drew a sharp distinction between science blogging and science journalism. Blogs have become an accepted part of the media in a way that they weren’t until recently, leading people to talk less about blogs as they’ve become a normal part of the landscape. He discussed a really interesting case when Science Blogs lost many of its audience in protest over Pepsi Gate, leading this audience to disperse over the media ecosystem. He draws a distinction between science bloggers (as niche content creators and often research active or with research experience) and science journalists (as generalists with a science background). Blogs offer scientists a way to communicate directly with readers (stripping out press officers) but that means they can be used to push an agenda. He warns that we shouldn’t romanticise science blogging as a pristine way of ‘getting the science out’ because it’s agenda driven. This means we can’t take social media popularity as being an intrinsically good thing, because this might mean things are being celebrated within circles we would regard as unscientific.
Some interesting points about their policy for blog tracking which I’d like to know more about:
- Their tracking is based on what they happen to hear about.
- All blogs are weighted equally.
- They are indexed by author, in order that multiple mentions of the same research by the same author will only be counted once.
- They are filtered to ensure quality, in order to avoid counting spam blogs etc.