Inflation of Problem Ratings

Okay, so I have noticed that some problems have become overly inflated in terms of their rating. Problems that I would consider to have a rating of 400-500 have a rating of 1800-2000. This just does not make sense to me. For example, consider the following problem that Calvin shared:

https://brilliant.org/community-problem/santas-elves/?group=7sOgFLxrHVrF

It seems harmless enough, something that they teach you to do in maybe third or fourth grade. However, upon closer inspection you see that the problem's rating is, as of the time of writing this, 1820. To put this in perspective, 1820 is a LEVEL 4 problem. A problem that is ALMOST Brilliant Blue difficulty worthy.

If we could receive some input from the developers on this it would be very nice. Is this just an algorithm problem or are the brilliant crew changing the way that problem ratings are created?

Thank you for your attention to this issue, I hope you have a wonderful day.

#FeatureRequests #Support

Easy Math Editor

This discussion board is a place to discuss our Daily Challenges and the math and science related to those challenges. Explanations are more than just a solution — they should explain the steps and thinking strategies that you used to obtain the solution. Comments should further the discussion of math and science.

When posting on Brilliant:

Use the emojis to react to an explanation, whether you're congratulating a job well done , or just really confused .
Ask specific questions about the challenge or the steps in somebody's explanation. Well-posed questions can add a lot to the discussion, but posting "I don't understand!" doesn't help anyone.
Try to contribute something new to the discussion, whether it is an extension, generalization or other idea related to the challenge.
Stay on topic — we're all here to learn more about math and science, not to hear about your favorite get-rich-quick scheme or current world events.

Markdown	Appears as
`italics` or `_italics_`	italics
`bold` or `__bold__`	bold
- bulleted - list	bulleted list
1. numbered 2. list	numbered list
Note: you must add a full line of space before and after lists for them to show up correctly
paragraph 1 paragraph 2	paragraph 1 paragraph 2
`[example link](https://brilliant.org)`	example link
`> This is a quote`	This is a quote
# I indented these lines # 4 spaces, and now they show # up as a code block. print "hello world"	# I indented these lines # 4 spaces, and now they show # up as a code block. print "hello world"

Math	Appears as
Remember to wrap math in `$` ... `$` or `\[` ... `\]` to ensure proper formatting.
`2 \times 3`	$2 \times 3$
`2^{34}`	$2^{34}$
`a_{i-1}`	$a_{i-1}$
`\frac{2}{3}`	$\frac{2}{3}$
`\sqrt{2}`	$\sqrt{2}$
`\sum_{i=1}^3`	$\sum_{i=1}^3$
`\sin \theta`	$\sin \theta$
`\boxed{123}`	$\boxed{123}$

Comments

We have not changed the algorithm (yet). The rating changes has resulted entirely from attempts. Recall that problem ratings rose on the first day (Sunday/Monday) as many people viewed it, and then dropped down over the rest of the week as answers are entered. We are seeing a similar effect here.

Also, while the problem sounds simple, there were numerous wrong attempts which are possibly due to not understanding how overtime pay works.

Calvin Lin Staff - 7 years, 6 months ago

Thank you for the clarification Calvin, the system sounds better if you explain it in that respect.

Alexander Sludds - 7 years, 6 months ago

In your note, I think you meant 1400-1500? We don't really have problems at 400-500 rating as yet.

I seeded this problem at 1550, and I believe that the true rating is much closer to that level. I tried to reduce the ambiguity of overtime pay by choosing $8 \times 1.5 \times 7 = 1008 > 1000$ and hence it is to be rejected, but I have also received clarifications which indicate that some people believe that overtime rate applies to the entire time period.

Calvin Lin Staff - 7 years, 6 months ago

@Calvin Lin – Why do the ratings not correspond with the level of the student? 2000 is the normal cutoff for level 5 so it makes sense for these two systems to correspond.

Alexander Sludds - 7 years, 6 months ago

Math	Appears as
Remember to wrap math in `\(` ... `\)` or `\[` ... `\]` to ensure proper formatting.
`2 \times 3`	$2 \times 3$
`2^{34}`	$2^{34}$
`a_{i-1}`	$a_{i-1}$
`\frac{2}{3}`	$\frac{2}{3}$
`\sqrt{2}`	$\sqrt{2}$
`\sum_{i=1}^3`	$\sum_{i=1}^3$
`\sin \theta`	$\sin \theta$
`\boxed{123}`	$\boxed{123}$