{"id":693,"date":"2016-01-30T09:19:30","date_gmt":"2016-01-30T17:19:30","guid":{"rendered":"http:\/\/kagan.mactane.org\/blog\/?p=693"},"modified":"2020-06-23T20:21:45","modified_gmt":"2020-06-24T03:21:45","slug":"asking-for-self-ratings-guarantees-you-false-information","status":"publish","type":"post","link":"https:\/\/kagan.mactane.org\/blog\/2016\/01\/30\/asking-for-self-ratings-guarantees-you-false-information\/","title":{"rendered":"Asking for Self-Ratings Guarantees You False Information"},"content":{"rendered":"

How many times has an interviewer\u00a0\u2014 either for an actual employer or for a recruiting agency\u00a0\u2014 asked you: “On a scale of 1 to 10, how would you rate yourself at $insert_skill_here<\/code>?”<\/p>\n

If you ask candidates to rate their own skill levels\u00a0\u2014 on any<\/em> scale; it doesn’t matter if it’s 1-5, 1-10, or “beginner, intermediate, advanced”\u00a0\u2014 you’re just asking to have the Dunning-Kruger Effect<\/a> mess up your\u00a0results.<\/p>\n

Let’s<\/span> say you have two candidates for your Java position: One is basically just one step below James Gosling\u00a0\u2014 let’s call her Jane[1]<\/a>. The other is the self-described “brillant[sic]” Ms. Paula\u00a0Bean<\/a>.<\/p>\n

You ask Jane Gosling, “How would you rate yourself in Java, on a scale of 1 to 10?” And Jane thinks, “Well, I’ve got years of experience, I know my way around J2EE like the back of my hand. I still remember Hibernate pretty well, and my grasp of Design Patterns is mostly<\/em> pretty solid. But lots<\/em> of people have that; it’s totally standard! And my Struts and EJB are both rusty. I could stand to refresh on a few patterns… hell, I haven’t done a Memento<\/a> in at least a year; I might even have to look it up to get it right. And I know there’s some new stuff coming out with closures, whatever those are. Well, I guess I’m better than average, so a little above a\u00a0five.”<\/p>\n

“Six,” says Jane. “Ummm… maybe a\u00a0seven?”<\/p>\n

Then you get Paula in, and of course, Paula has no idea<\/em> how much stuff there is out there that she hasn’t even heard of<\/strong><\/em>. She knows she’s brilliant! “Ten!” she answers, without batting an\u00a0eye.<\/p>\n

If you believe either of them<\/em>, you’re going to be wrong. We defined Jane such that if she isn’t a 10, nobody<\/em> is<\/strong>. She’s just hyper-aware of her own imperfections\u00a0\u2014 like most of the experts in any field\u00a0\u2014 and she doesn’t think she’s all that special. And we all know Paula is a\u00a01.<\/p>\n

If you’re an interviewer, why even ask this question at all?<\/strong> It is nearly guaranteed to never<\/strong> get you accurate\u00a0results.<\/p>\n

And if you’re being interviewed, and someone asks you a question like this? Tell them how awful it is, and why. And if they insist on you giving a self-rating of your own skills? Then my advice is to break off negotiations<\/strong>, and tell them you’ll be looking elsewhere for employment.<\/p>\n

Consider: Not only are they unwilling to learn when you point out that they’re doing something fundamentally broken, but also, they used this process to hire everyone else you’ll be working with<\/em>, too. How many Paula Beans are in their\u00a0office?<\/p>\n

You can find someplace\u00a0better.<\/p>\n

<\/div>\n

[1]<\/span> There’s a shortage of famous Java programmers. If this were a Ruby example, I could just use Dave Thomas, Yehuda Katz, or DHH; for Perl, there are Randal Schwartz, Damian Conway, Mark Jason Dominus, and Tom Christiansen. (Curiously, Python seems kind of anti-rock star; I can’t find any big names there\u00a0easily.)<\/p>\n

But the “brillant” Paula Bean makes such<\/em> a great counter-example, I wanted to make this a Java story. Nothing against Java itself; this is all about Paula as a paragon of the Dunning-Kruger\u00a0Effect.<\/p>\n

Obviously, this is excluding the language authors themselves: They have to spend a lot of time working in C to write their languages’ compilers or interpreters, and so they can’t be spending as much time actually writing in<\/em> their own languages. \u2191\u2191<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

How many times has an interviewer\u00a0\u2014 either for an actual employer or for a recruiting agency\u00a0\u2014 asked you: “On a scale of 1 to 10, how would you rate yourself at $insert_skill_here?” If you ask candidates to rate their own skill levels\u00a0\u2014 on any scale; it doesn’t matter if it’s 1-5, 1-10, or “beginner, intermediate, […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[63,108,103,68],"_links":{"self":[{"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/posts\/693"}],"collection":[{"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/comments?post=693"}],"version-history":[{"count":4,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/posts\/693\/revisions"}],"predecessor-version":[{"id":769,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/posts\/693\/revisions\/769"}],"wp:attachment":[{"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/media?parent=693"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/categories?post=693"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kagan.mactane.org\/blog\/wp-json\/wp\/v2\/tags?post=693"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}