Skip to main content

Tournament Scoring - Part 6: Summarising the Problem with Scoring Systems

Before I move on to look at my suggestion for a scoring system I want to summarise the problems with scoring systems that are out there already.  If we can work out what is wrong with them, we can use this to design a system that might address these problems.


When I first started playing on online I remember raising a question: Why are draws scored equally? Why isn't the number of supply centres you hold at the end of the game taken into account?

The answer that came back from a site mod was along the lines of the argument I use now.  At the end of a game of Diplomacy you have achieved one of three results: you've won, you've drawn, or you've lost.  If you've won, then you get all the points in the game.  If you've drawn, it doesn't matter what number of SCs you've finished the game on, the result is the same.  If you've lost... well.

At the time, that site used a game result system to score games:

  • 12 points for a win
  • 6 points for a 2-way draw
  • 4 points for a 3-way
  • 3 points for a 4-way
  • 0 points for anything else.
You also got a bonus point for taking over a surrendered position and not surrendering, and if you surrendered from a game you lost a point.  This system was later modified to add 5-way draws at 2 points.  

It was a simple system but it encouraged cherry-picking; that is, players would look for games with newbies in which gave them a decent chance of scoring well, or who even looked to pick up surrendered positions which had a decent chance of a good result.  I remember that, before the system was changed completely (to an Elo-esque system modified for Diplomacy), the site leader was a cherry-picker.  He dropped from the site when cherry-picking became effectively penalised by the new rating system.

The great and good ABC had the same idea: At the final outcome, the only thing that matters is that you've won, you've drawn or you've lost.  Nothing else has any impact on the game.  If that's what Calhamer thought, then that carries more weight with me than anything else.

There is an argument to say that Calhamer wasn't thinking about tournaments specifically with this, but rather in scoring an on-going series of games.  Tournaments are different: they're short, finite series of games and scoring needs to reflect this.  Whereas an on-going series will have a large number of games to differentiate between players, a draw-based scoring system won't easily work for tournaments.  However, DSS systems reflect more of what a game of Dip should be about than SCS systems.  You play for the result, not the number of SCs you can grab.

I've just sumarised what doesn't work with the tournament scoring systems that are often used.  Leaving aside the hybrid systems (that combine the good and bad of both DSS and SCS, and make them unclear as to what you should be doing), neither DSS nor SCS work.

Draw Size Scoring systems just don't produce enough of a difference between players over a short series of games.  Simply, points awarded are usually too similar.  Add to this the fact that players are likely to play for a decent draw, with as few players as possible, and that alliances are likely to be maintained as a way to get this result, DSS produces boring games and a poor scoring system.

Supply Centre Scoring systems, and Ranking or Placement systems which use SC count, pervert the objectives of Diplomacy.  Where did this idea of counting SCs in a draw come from?  Where did the idea that is so pervasive in the thinking of so many experieced players - topping the board - come from?  From the failure of DSS.

SCS systems produce more dynamic games.  They produce more differentiated scoring.  But games degenerate into a grab for SCs.  And Diplomacy was never intended to be about grabbing SCs... unless you're homing in on a solo, of course.  If you win the game, the number of SCs I end the game on doesn't matter: I lost.  If we draw the game, neither of us has achieved any better result than the other.  If I'm on 2 SCs and you're on 15, you've gained more SCs than me... but you weren't able to beat me.

Tournaments might be easier to score using a system that utilises some form as SC count, but that isn't what Diplomacy's about.  We're sacrificing the game for the sake of scoring it.  That's a sad thing.

If we're going to solve the problem, we need some more creative thinking.  How can we differentiate between players while using a draw-based system?

First, we need to change our thinking.  Draw-based systems meet the objectives of Diplomacy much more effectively than SC count systems; that ought to be clear.  But a draw-based scoring system that differentiates between the number of players in the draw doesn't work.  A draw's a draw... when it comes down to it, does it really matter if it's between 2 or 5 players?  So, instead of DSS - Draw Size Scoring - let's just award points for a win, and a draw of any size.  It should be enough to have drawn and not lost.

Second, we need to find a better solution to tie-breakers that recognise SC count.  We're trying to get away from that, after all.  So we need a different way of comparing players who have the same number of points under draw-based system.

And we don't need bonus points.  Bonus points are based on false results.  So let's get rid of them.

The prototype system I've come up with uses a draw-based system, rewards solos but not until all the games in the tournament have been completed, and uses a variation on a very different type of scoring system to those we've looked at previously.

That's what I'm going to look at next: the Mystery scoring system.


TOURNAMENT SCORING series:

  1. Tournament Games are Variants
  2. What should a good scoring system do?
  3. Draw Size Scoring (DSS)
  4. Supply Centre Scoring (SCS)
  5. Other Scoring Systems
  6. Summarising the Problem with Scoring Systems
  7. The Mystery Scoring System Explained
  8. Does Mystery Scoring meet the objectives?

Comments

Popular posts from this blog

Tournament Scoring - Part 5: Other Scoring Systems

There are, perhaps, three other types of scoring system: Placement or Rank scoring, hybrid systems that seek to combine DSS and SCS, and Tier scoring systems.  I want to have a look at each system. Placement or Rank systems Essentially, these are Supply Centre Scoring systems with the addition of bonus points.  I'm going to have a look at some more regularly used systems.  Again, here is the map I will use as an example: England  - 12 SCs Russia  - 9 SCs Turkey  - 8 SCs Italy  - 5 SCs France ,  Germany   and  Austria-Hungary   were eliminated, with 0 SCs each. C-Diplo In a drawn game points are awarded for: Participating in the game: 1 (for an online tournament, I'd only award this for participating and not surrendering). Each SC held at the end of the game: 1 . The player that 'tops the board' (has the most SCs): 38 pts. The second placed player (second highest number of SCs): 14 pts. The third placed player: 7 pts. If players are

The Ethics of Diplomacy - Part 9: Mind Games

I've separated this from gamesmanship because it is something different.  However, mind games have the same impact on the Dip community as gamesmanship, for very similar reasons. Mind games are anything that you can do to get under the skin of another player.  They can be irritants, impoliteness or meant to simply build paranoia. Silence Sending messages and getting no response is frustrating.  I know - I send a lot of messages and find it annoying if I'm getting nothing back from someone with whom I'm supposed to be working. Now, what happens when that silence is  deliberate ?  When someone decides that they're not going to answer messages, or keep their answers to a minimum?  Why would they do  that ? Well, it is usually to cause some disruption in your thinking.  If you're concerned that she isn't messaging back, you're going to be concerned about what your plans were going to be. I know at least one player who hates this, not becaus

WHAT IS DIPLOMACY? - Part 5: Variants

A variant is a game of Diplomacy where the rules or context are different from the standard game as designed by Allan B Calhamer.  There are three types of variants: context variants, map variants and rules variants. Context Variants Context variants are those games that are played with a wider context.  They may be tournament games, other scored games, or remote format  games.  These aren't often recognised as variants as such, as variants tend to be within the other two types discussed below.  But the context the game is being played in will have an impact on how some players will play the game, and so they are certainly a variation of Dip. Maybe they should be called "variations" rather than variants but does it really matter? Map Variants Diplomacy has been adapted to different maps, or boards.  Not surprising as the general idea of the game, pitting competing powers against each other in a localised region and time in history, can be adapted to any number