The RateMyDrawings Rating System
Since the launch of RateMyDrawings, we've constantly adjusted and tweaked our rating system to keep it fair and with the best interests of our artists in mind. Art is very subjective and it is often very difficult to rate and compare one artwork with another. We have much faith in our system - but we do like to remind our artists that the joy of art is all about the joy of creation and motivation for drawing should be based on creating an emotion and expressing your feelings. Having said that, this is RateMyDrawings, so be sure to enjoy the addiction of rating and being rated - just remember to be lighthearted and enjoy everything our community has to offer.
Some of the following systems have been in place since the start of RateMyDrawings and some have been added more recently. Please keep in mind that we constantly monitor and make adjustments to our rating system, and the information below is subject to change to improve fairness or security. Over time we will continue to make adjustments and will update the information below accordingly.
OUR 5 HEART RATING SYSTEM
The RateMyDrawings rating system started as a 10 point system, which was more recently replaced with a 5-heart rating system. People understand that 1 is the lowest, 3 is the middle, 5 is the best and 2 and 4 are right in between. This helps guide people to rate more consistently. Our community started to focus a little too much on numbers, so we shared with our members the idea of removing these numbers and simply displaying hearts and the response was extremely positive. This new system was instantly compatible with our existing system and existing rating data and drawing ranks were uneffected.
The Top Drawings section of our website utilizes an "Overall Rating". This is an adjusted score that each drawing receives based not only on a drawings score, but on the number of times users have favorited a drawing and its number of comments, as we believe these are two important factors of determining top drawings. This adjusted score is then ranked using a Bayes theorem which also takes into account how many ratings a drawing has and the average rating across the website. Put simply, a drawing rated 4.5 with 50 ratings will rank higher than a drawing rated 4.5 with 20 ratings.
COMPETITION LOW RATING PREVENTION
When running drawing competitions for members, we restrict rating to members only. This allows us to record usernames with each rating to enable us to track if users are low rating their competitors for the sake of moving their rank higher. If users are found to be rating unfairly, we will delete or adjust these ratings and at times ban these users either temporarily or permanently.
PREVENTING MASS LOW RATERS
Part of our system includes a low-rate-meter that triggers an alert if any user constantly rates drawings low over a certain period of time. If this alert is triggered, the rating bar is disabled for this user so they can no longer rate any drawing on the website for a period of time. We also record and monitor this activity and may ban offenders that are low rating constantly.
MODERATORS MONITOR LOW RATERS
RateMyDrawings site moderators have access to tools (such as charts like this) that allow them to keep an eye out for users that are regularly rating others drawings low or rating themselves high for the sake of competitiveness. Offenders who are constantly rating other users drawings low will be warned, but also may be banned temporarily from our community. Repeat or extreme offenders will be banned permanently.
IGNORING INACCURATE PROVEN RATES
We have 2 systems in place that at times ignore exceptionally low ratings:
Start low-rate-block - is a system that ignores very low ratings until a drawing has had enough ratings to maintain an accurate average. If you notice one of your low ratings being ignored, this is why. This is to give drawings a chance of being guarded against intentional low ratings for the first ratings of a drawing.
Proven-top-drawings-block - is a system that protects top drawings from being rated low. Once a drawing has received a large number of ratings and received a high average rating, some very low ratings may be ignored. An example might be that if a drawing has a score of 4.8 after 100 ratings, it is fair to assume this is a top drawing and it cannot be rated the lowest rate.
All drawings can only be rated once per User/IP address per days. We allow users to rate any drawing once per week for various technical reasons and website efficiency. Creating additional accounts does not give you the ability to rate additional times. Non-members (guests) are currently allowed to rate drawings with no restrictions under the same system as members as a way to allow our members to receive more feedback on their drawings. More recently, guests are NOT allowed to rate competition drawings. Only members who are logged in can rate in our monthly/event competitions. As a reminder to members that may consider asking friends to rate their drawings, many people rate drawings keeping in mind how a drawing is currently rated. For example, if you have 5 friends that rate your drawing 5, but it does not deserve such high ratings, users are likely to notice this and intentionally rate your drawing low. We do not encourage low rating in any way, but we also do not encourage you to get friends to rate your drawings high - in the end it does not benefit you and you may receive intentional low ratings from other users. Always ask your friends to rate honestly.
In the past, drawing competitions have involved some type of randomness to make choosing winners not completely based on our rating system. More recently, we are introducing that any competition entry is eligible to win as long as they receive a minimum number of ratings. This is to increase fairness and allow members who may not be as skilled to have as much chance of winning as top artists.
DISCUSS RATINGS IN AN ENCOURAGING MANNER
Our community is about encouraging one another as artists and rating discussions that are discouraging will be reviewed. We rarely remove threads from our forums, but if people are constantly complaining about their ratings in a way that promotes a negative atmosphere, we will either point them to this page as a reference or we may remove these posts. Open discussions are always welcome as long as they are not discouraging other artists.
Our rating system goes through constant evaluation and any adjustments we make to our rating system are thoroughly thought through. We have records of rating and drawing data for almost 300,000+ drawings that we can use to test any rating adjustments we may make and we ensure that any adjustments we make are tested to ensure they are of best interest to our website and members as a whole.