New Ratings Discussion - Ratings Conversion

[Laura F.]

Hello Everyone,

It is time to start the discussion regarding the ratings change.  The first item I would like to solicit your feedback is in regards to how to convert the old ratings into our new ratings.

New Ratings:  Lithium calls the new ratings system "Kudos".  We do not have to keep this term, but for ease of discussion I will call the new ratings Kudos for now.  For any message, you will have the option to give it one Kudo.  Think of it as a "Yes, this helped!" rating.  There is no negative option, if you don't like the message, you would not give it a Kudo. If you give a message a Kudo, the author of that message also collects one Kudo.

We have to convert our old 1 - 5 star ratings into Kudos.  The conversion will work as follows:

• Every message that has an average rating of X or higher will get the number of Kudos equal to the number of ratings X or higher.
• The author of a message that has an average rating of X or higher will get Kudos equal to the number of ratings. 

We can choose whatever average rating X we like for the conversion.  Lithium has recommended an average rating of 4.0.  Do you feel 4.0 is an average rating that tells you a particular message is a "good" message?  Should this be lower, higher?  

Thanks in advance for your feedback.   I will start a new thread for each topic I would like feedback on so that I can collect the feedback as needed. 

Regards,

Laura
Web Support & Operations
National Instruments

EDIT: The conversion will take place for an average rating of 4.0 and higher as chosen in our poll. 

Message Edited by Laura F. on 10-02-2008 09:31 AM

[smercurio_fc]

This seems to imply that the assignment of the "kudos" is open to anyone, and basically you can have a situation where, for example, a few folks can get together to drive up each other's kudos count. I believe there was a subthread discussion about only letting the author provide a "yes this helped" rating. I think Experts Exchange works this way, if I'm not mistaken. Was this considered? If so, what was the reason for not implementing it?

To answer your direct question: Given the mess with the ratings I don't think it's really worth it to debate about whether to use 4.0, 3.5, 3.75, or 3.8794465. From my perspective 4.0 seems like a reasonable number. 

[Mathan]

---

Laura F. wrote:

It is time to start the discussion regarding the ratings change. 

---

Vow. Really good news. But when can we expect the new system in action. Expecting soon. '

As smercurio said 4.0 average makes sense.

[MikeS81]

Hi Laura,

how will you present the Kudos? Will you calculate an average from Kudos to overall written messages (from one user)? 

Mike 

[muks]

I feel it is a nice advancement.Though i feel 3.5 can be used as the threshold.

[muks]

Laura are you planning to keep any eligibilty for giving kudos.Now members need to have atleast 50 posts before they can rate.

[Mathan]

---

muks wrote:

Now members need to have atleast 50 posts before they can rate.

---

And they may even don't know that there is a rating system.....

Edit: I misread 'Now' as 'New' in the muks post

Message Edited by mathan on 08-26-2008 03:19 AM

[Graziano]

---

smercurio_fc wrote:

This seems to imply that the assignment of the "kudos" is open to anyone, and basically you can have a situation where, for example, a few folks can get together to drive up each other's kudos count. I believe there was a subthread discussion about only letting the author provide a "yes this helped" rating. I think Experts Exchange works this way, if I'm not mistaken. Was this considered? If so, what was the reason for not implementing it?

To answer your direct question: Given the mess with the ratings I don't think it's really worth it to debate about whether to use 4.0, 3.5, 3.75, or 3.8794465. From my perspective 4.0 seems like a reasonable number. 

---

I agree with Saverio, 100 %. 

More, I think it's important to keep a way to say "this reply is dangerous!", or mostly incorrect.  One star (or two stars) was there for that, even if, of course, that rating system had to be improoved.  

graziano

PS.: if I have to provide a threshold, yes, let's say 4.0 

[Ben]

My guts says "1".

I still remeber that thread years ago where someone one stared me and sais I posted a good reply. Then  someone else questioned why they did not give a good rating. They replied "they did!"

The threshold aside:

Please give us an example how the Kudos would be counted for some of the exceptional threads. I recieved 13 5-star ratings for one of my nuggets. If the threshold was 4, does that get one Kudos or 13?

I am also interested to hear the relpies to the previous questions

Ben

[muks]

---

More, I think it's important to keep a way to say "this reply is dangerous!", or mostly incorrect.  One star (or two stars) was there for that, even if, of course, that rating system had to be improoved.  

---

 I partially accept but the whole point is that the one stars are being misused.