Skip to main content

Number 24 - Gift or coal at an engineers sock?

Evaluation systems

It's often being said that people do not leave bad jobs, but bad managers. But this is only partly true: people also leave jobs with poor future prospects. Consequently a company that wants to retain its talent has to have an effective way to reward high performers and evaluate its staff, something even more important to tech companies where everything is constantly shifting and progressing.

But evaluations always rely on the evaluators; the managers. Where people come, results tend always to include biases and noise. The manager might be playing favourites, not be fully aware of the specific field of each employee, have different notions of performance or objective or could also be prone to having a bad (or good) day. Exactly because this tendency to bias and noise is a well known problem, companies have enlisted the help of, well, more noise and bias in the form of more than one evaluators. Most companies' performance evaluation policy includes multiple evaluators beyond the main manager in the form of colleagues, other managers or even the person being evaluated. The idea is that the odd biases and noise will sort of cancel each other out and result in a fairer evaluation.

However, the managers know of this multi-evaluator approach and they often use that knowledge to game the system. Its easy to imagine a manager ranking all his team members as 10/10 to secure promotions and higher salaries to all of them thus making them more popular or a manager that might want to avoid having that difficult conversation with specific team members. 

The problem of incentives is also known and a method has been established to address this too: the normal distribution. By normal distribution I mean that the boss of the manager gives clear instructions as to how many people can get a good "grade", how many can get a normal one and how many can get a bad "grade". The only thing that a manager can do is assign scores and we get a system that is more insulated against managers whims.

Relative evaluation systems like that solve a lot of problems but come with their own baggage as well. For starters, absurd situations might occur where even if all employees gave their best, their scores would not reflect this and the other way around. Furthermore, it leads to competitiveness among peers. Since it is no longer just the quality of your work but what matters instead is how your work stacks versus others and in that sense it can have toxic implications. It is thus my belief that there has to be a better system but I haven't still encountered or conceived of one. I would actually be thrilled to hear some proposals so go ahead and leave a comment if you can give a suggestion!

Until then, the normal distribution will reign supreme!

 



Comments

Popular posts from this blog

Easter feast and task pipelines (48)

A Greek Easter feast As this post goes live, your host and author is most likely indulging in the joys of Easter Sunday. In Greece, where I come from, Easter is the biggest holiday of the year. And, as you might expect from a culture famous for its love of food, the Sunday feast is a central part of the celebration. The meal varies by region and family tradition, but one thing remains constant: roasted lamb. It symbolizes the sacrifice of Jesus, and it's always the star of the table. If you're reading this on Easter Sunday, there’s a good chance I’m savoring some leftover lamb while you scroll through these lines. Now, let me tell you—preparing this feast is no small feat. Roasting the lamb and getting the rest of the meal ready is a coordinated effort, usually involving many helping hands. To make sure everything is done in time for the classic Greek lunch hour (around 14:00), the tasks must be broken down and distributed efficiently. This is where the real planning begins....

I think, therefore I am (35)

I think, therefore I am Consciousness—or self-awareness—feels like one of the most distinctly human traits. Sure, some animals are clever, but only a handful, like certain primates, seem to pass the “mirror test” and recognize themselves in their reflection. So, what exactly is consciousness? The truth is, it’s hard to pin down. Interestingly, an accessible definition of consciousness doesn’t come from philosophy or biology, but from medicine—specifically anesthesiology. In this field, consciousness is defined as the awareness of pain and our surroundings during surgery. It's a practical, measurable approach: you’re either aware or you’re not. This definition not only makes consciousness easier to grasp but also highlights its connection to our sensory perception. This view brings us to the classic "dual theory" of consciousness. In this framework, the body and mind are seen as separate entities, with the brain acting as the “control room.” The mind issues commands, the b...

A chess game played at a two hundred kilometers per hour (66)

A chess game played at a two hundred kilometers per hour That is how the sport of modern fencing is often portrayed by its practitioners, or, frankly, anyone with an inclination to dramatize. Often, in student fencing circles this phrase is used ironically to juxtapose how simple, pragmatic and brutal this sport can sometimes be. However, I am inclined to approach this phrase by visualizing its contents; fencing is indeed an ancient game, requiring wit and is supplemented with technology unimagined by previous generations. It really is a marriage cold calculation and passion. A passion which is shared by the previous blog exploring modern fencing technology, and which drives one to explore developments of fencing technology even deeper. How Horses Became Formula 1 A common passerby would not think of modern slender, antenna-like blades as swords. And they would be completely right, none of the three fencing weapons (saber, foil and epee) are swords. Assuming the sole purpose of a sword...