<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: Who&#8217;s really obsessed with Impact Factor ?</title>
	<atom:link href="http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/feed/" rel="self" type="application/rss+xml" />
	<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/</link>
	<description>(``Logbook" was taken already...)</description>
	<lastBuildDate>Mon, 25 Feb 2013 14:35:03 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: Massimo</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3334</link>
		<dc:creator><![CDATA[Massimo]]></dc:creator>
		<pubDate>Sun, 30 Dec 2012 21:34:38 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3334</guid>
		<description><![CDATA[Hi Luca, thank you for your comment, and I am sorry it took me so long to reply but I have been neglecting my blog for a couple months. I have taken a look at Redner&#039;s paper and it is indeed interesting, although I think that in these cases, as they say, &quot;the devil is in the details&quot;, and especially for an early career scientist I would probably trust the &lt;i&gt;h&lt;/i&gt;-index more than the total number of citations (a graduate student can end up with a single, highly cited paper just by virtue of having been at the right place at the right time).]]></description>
		<content:encoded><![CDATA[<p>Hi Luca, thank you for your comment, and I am sorry it took me so long to reply but I have been neglecting my blog for a couple months. I have taken a look at Redner&#8217;s paper and it is indeed interesting, although I think that in these cases, as they say, &#8220;the devil is in the details&#8221;, and especially for an early career scientist I would probably trust the <i>h</i>-index more than the total number of citations (a graduate student can end up with a single, highly cited paper just by virtue of having been at the right place at the right time).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Luca</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3331</link>
		<dc:creator><![CDATA[Luca]]></dc:creator>
		<pubDate>Fri, 30 Nov 2012 20:15:06 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3331</guid>
		<description><![CDATA[Dear Massimo, I just discovered your blog and I find it very interesting. Talking about the h-index, I was wondering if you are familiar with this paper by Sidney Redner (BU):

http://arxiv.org/abs/1002.0878

According to this work, the average h-index is a simple function of the total number of citation to an individual (h=sqrt(c)/2, c being the number of citation). In other words, the &quot;typical&quot; h-index does not contain any additional information beside the total number of citations. This has nothing to do with your comments in this article, but it&#039;s just a curious fact that I thought you might find interesting.]]></description>
		<content:encoded><![CDATA[<p>Dear Massimo, I just discovered your blog and I find it very interesting. Talking about the h-index, I was wondering if you are familiar with this paper by Sidney Redner (BU):</p>
<p><a href="http://arxiv.org/abs/1002.0878" rel="nofollow">http://arxiv.org/abs/1002.0878</a></p>
<p>According to this work, the average h-index is a simple function of the total number of citation to an individual (h=sqrt(c)/2, c being the number of citation). In other words, the &#8220;typical&#8221; h-index does not contain any additional information beside the total number of citations. This has nothing to do with your comments in this article, but it&#8217;s just a curious fact that I thought you might find interesting.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Me</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3246</link>
		<dc:creator><![CDATA[Me]]></dc:creator>
		<pubDate>Mon, 08 Oct 2012 04:55:58 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3246</guid>
		<description><![CDATA[&quot;I worry about (and have seen cases) letting a single publication on a high profile journal unduly influence (or skew) hiring or tenuring decisions.&quot;

So true.... It seems those days you need that Nature paper to get on the tenure track of the Big universities. 

This is ironic because this skewed selection reminds me of the arguments of Nassim Taleb on luck and success. If the rewards are highly skewed, then on average it is extremely rewarding to bet everything on a few home-run.

I have seen around me students who bet almost everything on a Nature/Science paper because they were told they needed it for a decent career. Results: some of them will succeed (by luck, talent or perseverence) at getting this Nature (and not much else). This will help to pass over deserving student who got &quot;only&quot; a couple of PRL.

Because Academia is very much a (nonlinear) tournament, a small advantage at the beginning turns into a big reward at the end.]]></description>
		<content:encoded><![CDATA[<p>&#8220;I worry about (and have seen cases) letting a single publication on a high profile journal unduly influence (or skew) hiring or tenuring decisions.&#8221;</p>
<p>So true&#8230;. It seems those days you need that Nature paper to get on the tenure track of the Big universities. </p>
<p>This is ironic because this skewed selection reminds me of the arguments of Nassim Taleb on luck and success. If the rewards are highly skewed, then on average it is extremely rewarding to bet everything on a few home-run.</p>
<p>I have seen around me students who bet almost everything on a Nature/Science paper because they were told they needed it for a decent career. Results: some of them will succeed (by luck, talent or perseverence) at getting this Nature (and not much else). This will help to pass over deserving student who got &#8220;only&#8221; a couple of PRL.</p>
<p>Because Academia is very much a (nonlinear) tournament, a small advantage at the beginning turns into a big reward at the end.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Schlupp</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3245</link>
		<dc:creator><![CDATA[Schlupp]]></dc:creator>
		<pubDate>Sun, 07 Oct 2012 16:07:48 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3245</guid>
		<description><![CDATA[Well, for this example, you bring into play another difference: Quantity, which - by a less derogatory word - could also be termed &quot;consistency of research performance&quot;. What could most reasonably be compared to the h-index would be some integrated IF that also takes into account the &lt;b&gt;number&lt;/b&gt; of papers published.  

One can certainly argue whether or not two PRB are &quot;about the same&quot; as one PRL, as they would be per &quot;integrated IF&quot; (*). But one can&#039;t very well argue that one PRL is &quot;more&quot; than 5 PRL plus 10 PRB, as it would be per &quot;average IF&quot;.

(*) Personally, I&#039;d say it depends on the papers and on how well they are appreciated by the community. But I am aware that general opinion would go with the one PRL in most cases.]]></description>
		<content:encoded><![CDATA[<p>Well, for this example, you bring into play another difference: Quantity, which &#8211; by a less derogatory word &#8211; could also be termed &#8220;consistency of research performance&#8221;. What could most reasonably be compared to the h-index would be some integrated IF that also takes into account the <b>number</b> of papers published.  </p>
<p>One can certainly argue whether or not two PRB are &#8220;about the same&#8221; as one PRL, as they would be per &#8220;integrated IF&#8221; (*). But one can&#8217;t very well argue that one PRL is &#8220;more&#8221; than 5 PRL plus 10 PRB, as it would be per &#8220;average IF&#8221;.</p>
<p>(*) Personally, I&#8217;d say it depends on the papers and on how well they are appreciated by the community. But I am aware that general opinion would go with the one PRL in most cases.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Massimo</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3243</link>
		<dc:creator><![CDATA[Massimo]]></dc:creator>
		<pubDate>Wed, 03 Oct 2012 11:07:54 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3243</guid>
		<description><![CDATA[I doubt very much if most of the people in charge of evaluating go, or have ever gone through this kind of reasoning, but I am not denying its validity. 
The question however is different: if, for instance, we take researchers who have already around 13-14 years of activity behind (five years of graduate school, three-four years as a postdoc and six years on the tenure track), what is a better indicator of their scholarly excellence, the average IF of the journals in which they have published or their &lt;i&gt;h&lt;/i&gt;-index ? I say the latter.]]></description>
		<content:encoded><![CDATA[<p>I doubt very much if most of the people in charge of evaluating go, or have ever gone through this kind of reasoning, but I am not denying its validity.<br />
The question however is different: if, for instance, we take researchers who have already around 13-14 years of activity behind (five years of graduate school, three-four years as a postdoc and six years on the tenure track), what is a better indicator of their scholarly excellence, the average IF of the journals in which they have published or their <i>h</i>-index ? I say the latter.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: A</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3242</link>
		<dc:creator><![CDATA[A]]></dc:creator>
		<pubDate>Tue, 02 Oct 2012 11:58:46 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3242</guid>
		<description><![CDATA[A rational for preferring the IF even over actually available individual citation data could be the following:

Assume that a paper has an objective quality measure q with weakly correlates to its (future) number of citations c. Moreover, assume that q can be determined in a somewhat costly procedure, and that review for journals essentially amounts to determining the quality of a paper, comparing it to a benchmark value b and accepting/rejecting based on that. Furthermore, assume that editors and authors behave sufficiently market-like to avoid grossly &quot;overqualified&quot; submissions.

Averaged over all papers appearing in a journal, the variation between q and c would (partially) cancel out, leaving the IF as a reliable estimate for b, which in turn serves as a lower bound for q. In particular, the IF could be a better estimate for q than c.

Now, I&#039;m not claiming this model describes reality at all, but maybe some people do think along such lines?]]></description>
		<content:encoded><![CDATA[<p>A rational for preferring the IF even over actually available individual citation data could be the following:</p>
<p>Assume that a paper has an objective quality measure q with weakly correlates to its (future) number of citations c. Moreover, assume that q can be determined in a somewhat costly procedure, and that review for journals essentially amounts to determining the quality of a paper, comparing it to a benchmark value b and accepting/rejecting based on that. Furthermore, assume that editors and authors behave sufficiently market-like to avoid grossly &#8220;overqualified&#8221; submissions.</p>
<p>Averaged over all papers appearing in a journal, the variation between q and c would (partially) cancel out, leaving the IF as a reliable estimate for b, which in turn serves as a lower bound for q. In particular, the IF could be a better estimate for q than c.</p>
<p>Now, I&#8217;m not claiming this model describes reality at all, but maybe some people do think along such lines?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Massimo</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3231</link>
		<dc:creator><![CDATA[Massimo]]></dc:creator>
		<pubDate>Sat, 22 Sep 2012 12:12:06 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3231</guid>
		<description><![CDATA[In my opinion, when it comes to tenure (and possibly even hiring) the &lt;i&gt;h&lt;/i&gt;-index, even if based on few articles, tells the story much more reliably than impact factor. I worry about (and have seen cases) letting a single publication on a high profile journal unduly influence (or skew) hiring or tenuring decisions.]]></description>
		<content:encoded><![CDATA[<p>In my opinion, when it comes to tenure (and possibly even hiring) the <i>h</i>-index, even if based on few articles, tells the story much more reliably than impact factor. I worry about (and have seen cases) letting a single publication on a high profile journal unduly influence (or skew) hiring or tenuring decisions.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Schlupp</title>
		<link>http://expbook.wordpress.com/2012/09/19/whos-really-obsessed-with-impact-factor/#comment-3228</link>
		<dc:creator><![CDATA[Schlupp]]></dc:creator>
		<pubDate>Thu, 20 Sep 2012 08:12:54 +0000</pubDate>
		<guid isPermaLink="false">http://expbook.wordpress.com/?p=8778#comment-3228</guid>
		<description><![CDATA[It is outrageous of you to want scientists to be judged solely on their h-index.

So, having this obligatory part out of the way, I&#039;d like to mention a reason for the use of IFs in such annual scorecards: They are available right now, while citations take longer to accumulate. The main issue is thus the focus on the extremely short timescale.]]></description>
		<content:encoded><![CDATA[<p>It is outrageous of you to want scientists to be judged solely on their h-index.</p>
<p>So, having this obligatory part out of the way, I&#8217;d like to mention a reason for the use of IFs in such annual scorecards: They are available right now, while citations take longer to accumulate. The main issue is thus the focus on the extremely short timescale.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
