Back to articles list

Article Level Metrics Workshop

Article

As alluded to in an earlier post, figshare were in attendance at the PLOS ALM (Article Level Metrics) workshop in San Francisco, November 1-3, 2012.


“The digital environment of today’s research enables the collection and analysis of many more data sources and types than ever before, which trace the dissemination and reach of the article itself. Article-level metrics (ALMs) measure these activities at the level of the article and provide a valuable service lacking in traditional metrics: a real-time indicator of impact for research. In addition to the conventional measure of citations, ALMs incorporate altmetrics, newer measures of scholarly interaction based on the social web. Overall, they can provide much-needed new checks and balances, greater speed of feedback, and superior relationship mapping and influence tracking, none of which can be replicated by the traditional impact factor. They can form the basis of recommendation and collaborative filtering systems able to power navigation and discovery of articles synchronized to the needs of the researcher, publisher, institutional decision-maker, or funder”.

A detailed report from the workshop is now available at dx.doi.org/10.6084/m9.figshare.98828


One of the highlights of the event was the Altmetrics Hackathon which took place on the final day.


“To close the PLOS ALM Workshop, PLOS & ImpactStory co-sponsored the Altmetrics Hackathon on November 3, 2012. The purpose of the event was to bring the research community together to articulate concrete problem areas for altmetrics. Together, we worked with developers to seed technical solutions and raised awareness of the pressing need for expanded altmetrics tool development. Full listing of application ideas board, development resources, attendee interests can be found here.”

Final Projects


ReRank It


ReRank It allows users to rank your PubMed search results based on the impact they have had. This application allows users to see which of the articles have produced the most discussion, been cited the most or have been recommended by academics. ReRank was voted winner of the Audience Award at the end of the hackathon.


Application: http://rerank.it/
Source code: https://github.com/dweebit/rerankit
ImpactStory Javascript API: https://github.com/phayes/impactstory.js


AltViz


The AltViz (altmetrics visualization) group worked on better ways to visualize altmetrics data at various levels of aggregation (single article, few articles, many articles). The goal was to find ways to present the data in a meaningful way, that at the same time could easily be embedded into a variety of platforms. They discussed a variety of chart formats including sunburst plots, heat maps, dot charts, tree maps among several others and settled on two versions to implement during the hackathon.


Data sets are available in the git repository:

single article.csv
many articles.csv
alm report 2012-10-10.

Author Centrality Measure


Metrics to assess scientific output have traditionally focused on highly indirect metrics such as journal impact factors. While, article-level metrics are a critical step forward as they focus on a meaningful unit (i.e., the paper), they do not provide a solution to the problem of assessing a scientists overall output. The purpose of this project was to develop such a metric.


“Our proof-of-principle implementation, pulled ALM data from the PLOS ALM API, shows that even middle authors add value”.

One Article, Many URLs


The altmetrics effort to track the dissemination of research is currently impeded by the existence of multiple referral URLs for each single artifact. Additionally, no standard naming convention exists across publishers for those which they publish. This group followed example articles across journals via its article identifier (DOI) and recorded the proceeding referrer URLs across multiple dissemination channels. This dataset will support altmetrics providers’ effort to more effectively capture these traces.



AltGaming – aka - BatSignal


Altmetrics activity changes express the changing levels of interest in a research artifact. The specific pattern of activity depends on the metric being considered (e.g., journal page views, Tweets, bookmark, etc.). Spikes in activity are of interest as they may indicate either sudden interest in a paper (e.g., mainstream news coverage, prize awarded to an author) or manipulation of metrics (i.e., gaming). The group sought to develop a tool to detect deviations from expected activity levels.


“The code we generated is on github. We used the literature in the Mendeley burst detection group to help focus on algorithms that might help. The data sets that we generated are in a dropbox folder. We generated one large dataset that can be used for testing algorithms against, however it will need to be converted into time series sub-data sets”.

Finally, also worth a look at is the output from the Breakout Sessions.


As always, feedback, comments, suggestions and ideas are welcomed. Please get in touch at info@figshare.com or via twitter, facebook or google+.

Comments (9)

  • Prior to buying be worried about is to purchase the perfect and not dangerous method of getting any boobies increase worked on. Yup, despite the fact that one can find free from harm different methods to boost your cans height and width of, you will discover high risk alternatives. Invest time to review about the subject it is usually down the track. But nevertheless, regardless of the fad most typically associated with breast implant surgery treatment at this point, most girls are still sometimes frightened to go to into surgery as a result capabilities undesirable side effects, complications don't forget that due to expensive medical operations. jenny bolton book

    22/07/2015 07:14    by Qwee Qwee

  • Of course, utilize your leading dominating and make an effort research on the cheap video products before buying them all. But, are maintained hesitant it may be try not to find a plenty of data extant website. Firms that offer super-cheap solutions could be make an effort to involved in managing a low-cost stock portfolio. Through pretty much any deal you consider really good, you typically lead to spending money for it after all. Samsung UN78JU7500

    24/07/2015 09:10    by Kaka Lalala

  • Reduced prices for low price Television can be found web based at present. Considering that purchases between the merchants will be secretive, installed be unclear on the subject of looking for items online. In the home net sites help you to try to find bargain Plasma televisions Tv and economical High definition tvs and low prices to similar recurring types. Samsung UN75JU6500 Curved 78 inch

    25/07/2015 08:51    by Sebeka Sebeka

  • I like this post,And I guess that they having fun to read this post,they shall take a good site to make a information,thanks for sharing it to me. girlfriend system guide

    26/07/2015 10:11    by Etetret Etetre

  • What a nice writing style you have for your users. Such a wonderful blog post. Thanks for the great post. Here is my blog to get latest movies on iOS and android. Now download playbox download for iPad/iPhone for free with this site. Thanks for your efforts. I would love to read other articles also.

    28/07/2015 08:04    by Nike Mike

  • Also, there are an excellent availablility of message boards using the net that focus on the top firmness arena and also home entertainment enjoy available to check out. You're going to be liberal to instruction or an brilliant range volunteers will let you look through all of the telvision options available that you can buy right now. To get the best selection, make sure you original know what you are researching. I cannot clearly imply another Tv for pc, think about kinds of television Samsung UN60J6300 review

     

    28/07/2015 08:51    by Yesu Yesu

  • You can find diet plan above a speculation that the majority pounds could be the result of feeding carb that happen to be better retained given that fat compared to scammed while fuel. Best diet entail startling lessing of the sheer number of fat laden calories swallowed. This situation blows your body; also, the outcome is which a body chemistry retards one's metabolism with a view to help you save fat laden calories. Le Facteur Vénus

    30/07/2015 08:32    by Juju Jung

  • Wow factor is here. Great to be here. Feeling relaxed as I have found it. OMG! Great writing style my friend. Regards. Am i using Komento correctly? Please check my blog once cartoon hd on movies and shows for android and iOS

    30/07/2015 14:59    by Nike Mike

You must be logged in to post comments.

Feedback

We appreciate all your comments, questions, suggestions or gratitude.

Login

The username or password entered are wrong.

Reset password

Your password will be sent to your registered e-mail address.

Create account

I agree to the Terms & Conditions *