Brilliant Ratings
If nobody else can see your ratings, and you're already at Level 5, why do ratings matter at all? Whether they go up or down as you solve or not solve problems? What's the incentive to solve problems correctly the first time, or at all?
Note by
Michael Mendrin
7 years, 4 months ago
No vote yet
1 vote
Easy Math Editor
This discussion board is a place to discuss our Daily Challenges and the math and science related to those challenges. Explanations are more than just a solution — they should explain the steps and thinking strategies that you used to obtain the solution. Comments should further the discussion of math and science.
When posting on Brilliant:
*italics*or_italics_**bold**or__bold__paragraph 1
paragraph 2
[example link](https://brilliant.org)> This is a quote# I indented these lines # 4 spaces, and now they show # up as a code block. print "hello world"\(...\)or\[...\]to ensure proper formatting.2 \times 32^{34}a_{i-1}\frac{2}{3}\sqrt{2}\sum_{i=1}^3\sin \theta\boxed{123}Comments
Personal gain and achievement. I don't care what people think about what my ratings and my levels are. I care about my own personal goals, if I am being able to solve a challenging problem, or to judge my own skill level, where I stand in a particular topic.
It's one of the basic philosophies on which Brilliant is built upon. Ratings are like money (I couldn't think of a better analogy), when you see your rating go down or up it triggers an emotional response, same as when you lose some belonging, or like when you're not able to save the ball going in the net in soccer, etc. You feel the sense of failure and nobody likes failure. So you'd want to try again, and again, and again, until you get it right, sometimes just to prove a point. The point that you are not stupid. Hence when you solve a problem correctly and see your rating go up, you feel happy, you feel confident, you feel like you can take on the world (at least I feel that way).
So ratings help us judge our progress and are a vital part of any system where there's a factor of win/lose, like in games, or for educational purposes, like at Brilliant.
Also, even though ratings aren't shown, you can look at the levels a person is at in any given topic by going to their profile which gives an idea of their skills. So you can to some extent compare how you are doing with respect to other people.
Log in to reply
I think solving a problem is its own reward. The trouble with the Brilliant rating system is that it appears to behave fairly randomly, so I lose interest in it.
Log in to reply
I agree with you somewhat about randomness but what I really like here is the passion people have to create and share questions by thinking out of box. So your score is derivative of questions you score but at the same time question's difficulty level is also derivative of people's score and I think for that purpose this score system does fair job.
Log in to reply
Well it's good that we can see a rating for a problem, so that we have an idea of how difficult it is going to be. However, I notice that the actual range of difficulty for problems "between 2000 and 2400" can be considerably greater than what the ratings would suggest.
Log in to reply
Can you clarify what you mean by 'random'?
Is it only that "the actuarial range of difficulty for problems between 2000 and 2400 can be considerably greater"? Does this comment apply only to "newly released" problems (esp those at the top of your newsfeed), or even to historical problems?
Are there other parts of it which confuse you?
Log in to reply
Calvin, I'm a newbie here, only been around for a bit longer than a week. Still getting my bearings, solved a few problems, not really clear what the objectives are, other than just having fun solving problems.
By "random" is that while I can see now how my points are racking up with solving rated problems (and nothing from unrated problems), what's happening with my own ratings is not so clear cut. Kind of like how your credit score is affected by what you do---most of the time, it's unpredictable. I still have little or no idea on how to 1) consistently boost my ratings, and 2) keep it from dropping. So I don't bother with it any more, as it's interfering with my choice of problems to work on.
Log in to reply
Yes! I hate how the problems make you lose so many rating points that you can't even try problems that you don't know exactly how to solve.
In fact, ratings are most useful to me in identifying the problems that can actually increase my points. Other than that, I'm not sure what they're good for.
Log in to reply
Well with some reverse engineering of scoring method I can approximately tell you how it works Calvin above may know better :) Check out the table below which shows my score movement when I attended multiple questions from Algebra http://i58.tinypic.com/6sgfq0.png
I can make following observations from the table: (1) You have level wise minimum points for answering (2) For a question which is above your rating you get approx 10% of the point differential . Or they are giving points based on Ranged table of point differential.
May be I am completely off but that's what I can see
Log in to reply
Now that's funny, it's worthy of a Brilliant question in its own right, "how are Brilliant ratings computed?" Your chart was very illuminating.
But after seeing how it works, I think I understand now, if you're starting at lower than Level 5, the rating system helps encourage you to build it up. But once once you get to Level 5, well, I don't see any problems rated higher than 2500. Yet. What would be the rating of the Riemann Hypothesis? Probably 2600.
Thanks for your feedback.
It can be hard for a new member to understand ratings. We have a brief explanation initially, but cannot do it justice without having you experience the problem solving aspect, along with the interaction of other members.
The simplest understanding is that your ratings drop when you answer a problem incorrectly, and they increase when you answer a problem correctly. The extent of change is dependent on the relative rating of the problem, which then complicates matters.
I'm glad to see that you are beginning to get the hang of ratings. As you realized, you should be much more likely to solve problems with a rating lower than your own. There are definitely problems rated > 2500, but those are very rare creatures.
We previously thought of displaying the change of rating, but felt that it would have been much more complicated to understand. Do you feel that this would be helpful? IE you are told that "solving this problem correctly will raise your rating by 20 points. Solving this problem incorrectly will lower your rating by 30 points"
Log in to reply
Lin, Vikram Pandya already did a pretty good job explaining how the ratings work, below. I have mixed feelings about the value of ratings, am I here to keep boosting my ratings, or just solve problems and ignore the ratings? Right now I'm kind of leaning towards the latter.
Technically speaking, if you look at too many solutions/give a lot of wrong answers at Level 5, your rating could drop to a level such that you reach Level 4. Thus, ratings definitely play an important role even for Level 5 people!
Log in to reply
They don't decrease your rating for clicking on See Solution. But they will definitely decrease it if you solve a question wrong. Of course, I don't think anyone who deserves to be in Level 5 will do enough wrong to get to Level 4. Possibly someone on the borderline...
Does our rating decrease with time?