| Pages: [1] 2 3 4 :: one page |
|
|
| Author |
Thread Statistics | Show CCP posts - 4 post(s) |
|
CCP Wonderboy
C C P
C C P Alliance
10
   |
Posted - 2016.03.21 11:18:58 -
[1] - Quote
Hello scientists!
The Project Discovery team is extremely satisfied and impressed with Capsuleer interest for this scientific endeavor, you have been doing a great job so far!
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus. Instead, we will increase the rate of training examples you get, for which you get an immediate rating.
This is only the first step in our attempt to improve Project Discovery and it's data quality, as we might introduce further changes to our scoring procedure. This change will also significantly reduce the heavy load on the MMOS servers and should ensure a smoother experience for everyone.
Feel free to leave any feedback and suggestions here, and may the cytoplasm be with you.
- CCP Wonderboy |
|
Ralph King-Griffin
Devils Rejects 666
The Devil's Warrior Alliance
14823
|
Posted - 2016.03.21 11:24:54 -
[2] - Quote
thank you for this change,
now begone with you ye cytoplasm whoures!
Better the Devil you know.
=]|[=
|
Yadaryon Vondawn
Art Of Explosions
404 Hole Not Found
101
|
Posted - 2016.03.21 11:53:26 -
[3] - Quote
Excellent change! Could you also take a look at the presentation of example/training samples? In the in-game channel we noticed that for some reason every single control image is now Nucleus or Nucleoli. This skews accuracy heavily because they are easily recognized. They seem to be mostly in the 300-500 range.
This is also tied to another request which I am sure  you already have on the table, remove the sample number in the lower right corner. Only show it after one presses submit because people now know that they are control images and will thus vote in a specific way.
Also since this morning the PD servers have been stable as anything. No problems whatsoever.
Keep up the good work o7 |
|
CCP Wonderboy
C C P
C C P Alliance
11
|
Posted - 2016.03.21 11:58:23 -
[4] - Quote
Yadaryon Vondawn wrote:Excellent change! Could you also take a look at the presentation of example/training samples? In the in-game channel we noticed that for some reason every single control image is now Nucleus or Nucleoli. This skews accuracy heavily because they are easily recognized. They seem to be mostly in the 300-500 range.
This is for MMOS to decide, i'll forward this to them to see if they can mix things up a little.
Yadaryon Vondawn wrote:This is also tied to another request which I am sure you already have on the table, remove the sample number in the lower right corner. Only show it after one presses submit because people now know that they are control images and will thus vote in a specific way.
This is already implemented and should roll out soon(tm).
|
|
Mynxee
Signal Cartel
EvE-Scout Enclave
269
|
Posted - 2016.03.21 13:29:41 -
[5] - Quote
Good changes! <3
Lost in space, looking for sigs...
Blog: Cloaky Wanderer
|
Lasse R Farnsworth
Blue Republic
RvB - BLUE Republic
21
|
Posted - 2016.03.21 17:26:59 -
[6] - Quote
+1 :) Nice to see that stuff going in the game. Actually having such a fast response to reports is a nice change of pace. |
Circumstantial Evidence
265
|
Posted - 2016.03.21 19:29:04 -
[7] - Quote
Keep up the good works! And please keep watching the "March Update feedback thread" where numerous suggestions have been made since the feature became available to all players. |
Joia Crenca
Science and Trade Institute
Caldari State
278
|
Posted - 2016.03.21 23:46:53 -
[8] - Quote
Thank you for this change! And thanks for letting us be a part of this project! Now... about future rewards... my favorite ship doesn't look very much like a promised pony... |
Nevyn Auscent
Broke Sauce
3103
|
Posted - 2016.03.22 00:46:36 -
[9] - Quote
Some people seem to still be getting their rating affected by community consensus.
Are old slides still going to affect rating as they get processed? |
Beta Maoye
110
|
Posted - 2016.03.22 02:27:01 -
[10] - Quote
Good to stop calculating accuracy rating for the community consensus.
Will I still see the percentages of community consensus? I think knowing what other people's choices is still an interesting feedback to players. |
|
|
Barrogh Habalu
Imperial Shipment
Amarr Empire
1107
|
Posted - 2016.03.22 09:05:06 -
[11] - Quote
Good change. Not only because of intended effects, but also because sometimes you really need a few more training examples to check yourself and filter out misconceptions.
I also hole that some of the samples will be reviewed by HPA in the future, re-calculating accuracy in the process and enabling better sorting of out results.
Future of T3 cruisers - multi-tool they aspired to be instead of sledgehammer they have become
|
Keta Min
Delicious Entropy
0
|
Posted - 2016.03.22 09:14:07 -
[12] - Quote
CCP Wonderboy wrote:
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus.
This is a problematic change. Now the people who are trying to game the system have no incentive to even try to be correct on the samples that don't affect accuracy. Instead of clicking cytoplasm they can now basically click anything at all.
|
Vardec Crom
The Harpooner's Rest
9
|
Posted - 2016.03.22 23:58:38 -
[13] - Quote
Keta Min wrote:CCP Wonderboy wrote:
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus.
This is a problematic change. Now the people who are trying to game the system have no incentive to even try to be correct on the samples that don't affect accuracy. Instead of clicking cytoplasm they can now basically click anything at all.
How will they know which ones don't affect accuracy? |
Nevyn Auscent
Broke Sauce
3103
|
Posted - 2016.03.23 00:33:04 -
[14] - Quote
CCP Wonderboy wrote:Hello scientists!
The Project Discovery team is extremely satisfied and impressed with Capsuleer interest for this scientific endeavor, you have been doing a great job so far!
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus. Instead, we will increase the rate of training examples you get, for which you get an immediate rating.
This is only the first step in our attempt to improve Project Discovery and it's data quality, as we might introduce further changes to our scoring procedure. This change will also significantly reduce the heavy load on the MMOS servers and should ensure a smoother experience for everyone.
Feel free to leave any feedback and suggestions here, and may the cytoplasm be with you.
- CCP Wonderboy
Something is going funky with this Wonderboy, since I'm showing rating loss still happening despite getting every test sample right. Can you please check you haven't coded every non test sample with a small downwards rating or something, because that's exactly what I'm currently seeing, and it's rather disheartening. |
Keta Min
Delicious Entropy
0
|
Posted - 2016.03.23 10:01:37 -
[15] - Quote
Vardec Crom wrote:Keta Min wrote:CCP Wonderboy wrote:
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus.
This is a problematic change. Now the people who are trying to game the system have no incentive to even try to be correct on the samples that don't affect accuracy. Instead of clicking cytoplasm they can now basically click anything at all. How will they know which ones don't affect accuracy?
Right now the sample number is a hint. Apart from that, the control samples tend to be really clear and obvious, as opposed to the vast majority of the normal samples. |
Yadaryon Vondawn
Art Of Explosions
404 Hole Not Found
101
|
Posted - 2016.03.23 11:48:13 -
[16] - Quote
The bug that gave only Nucleoli and Nucleus control samples seem to be fixed now :) |
ACESsiggy
CajunWaffle
47
|
Posted - 2016.03.23 13:50:20 -
[17] - Quote
Be cool if the images loaded without having to wait 1 minute and the transmission errors for submission. Hopefully this update addressed these problems as well.
GÇ£The open-minded see the truth in different things: the narrow-minded see only the differences.GÇ¥
|
|
CCP Wonderboy
C C P
C C P Alliance
22
|
Posted - 2016.03.23 13:55:06 -
[18] - Quote
ACESsiggy wrote:Be cool if the images loaded without having to wait 1 minute and the transmission errors for submission. Hopefully this update addressed these problems as well.
We should see significant performance increases with this next release. :) |
|
ACESsiggy
CajunWaffle
47
|
Posted - 2016.03.23 14:22:15 -
[19] - Quote
CCP Wonderboy wrote:ACESsiggy wrote:Be cool if the images loaded without having to wait 1 minute and the transmission errors for submission. Hopefully this update addressed these problems as well. We should see significant performance increases with this next release. :)
Sweetness... I can finally work toward getting that combat armor suit :)
GÇ£The open-minded see the truth in different things: the narrow-minded see only the differences.GÇ¥
|
Murkar Omaristos
The Alabaster Albatross
Sev3rance
240
|
Posted - 2016.03.23 16:53:02 -
[20] - Quote
CCP Wonderboy wrote:Hello scientists!
Feel free to leave any feedback and suggestions here, and may the cytoplasm be with you.
omg. may the cytoplasm be with you |
|
|
Vincent Athena
V.I.C.E.
3792
|
Posted - 2016.03.23 17:13:44 -
[21] - Quote
Suggestion: Tie this feature into the "flying spaceships" part of the game.
Method: At data and Relic sites, add the loot item "Special biological sample". If you have a Special biological sample in your hold or hangar when you do Project Discovery, you get the option of "Analyze special sample". If you do so, you get more Kredit and ISK. The actual samples you see are the same ones we all see, you just get more reward.
If you do not want to do Project Discovery, and have some Special biological samples, you can sell them on the market (which means they need a market slot.)
Know a Frozen fan? Check this out
Frozen fanfiction
|
Jadzeer DAXX
Carbide Wine and Beer Industries
6
|
Posted - 2016.03.23 17:23:22 -
[22] - Quote
Can CCP poke HPA and get them to add bigger hamsters to the PD server. It keeps crashing, lagging etc and it's frustrating. |
Jaden Noah
Imperial Dreams
Curatores Veritatis Alliance
9
|
Posted - 2016.03.23 17:31:52 -
[23] - Quote
I may have missed it, but is there somewhere that we can see how to exchange the kredits?
Can the kredit store be linked on the PD page? |
Mars Aspen
Watchtower Bible and Tract Society
0
|
Posted - 2016.03.23 17:34:37 -
[24] - Quote
This seems to me like a really bad idea. It is crude and simplistic. Control examples are so obvious and they are always of only one type. It takes very little learning to match up a control example with a reference example. So you can select any old rubbish if the slide is remotely challenging, having more than one type, and wait for the single control examples to come along. Hey presto, you can score almost as well as a really good analyst who plays with integrity. There is now no reward for trying to work through a more complex slide because you believe in the project and the gameplay is severely compromised too. Surely you can do better than this.
|
Jadzeer DAXX
Carbide Wine and Beer Industries
6
|
Posted - 2016.03.23 17:36:26 -
[25] - Quote
Jaden Noah wrote:I may have missed it, but is there somewhere that we can see how to exchange the kredits?
Can the kredit store be linked on the PD page?
You can buy stuff using AK in the SOE LP stores.
|
Maldiro Selkurk
CHEMO IMMUNO RESISTANT VIRUS X
544
|
Posted - 2016.03.23 18:00:55 -
[26] - Quote
Ive played for hours and hours but im horrible at this aspect of the game (27% accuracy). I dont really understand what this change is or what it is intended t do. Can anyone reword the change in hopes i can grasp what exactly this change is supposed to fix.
Thanks, Maldiro
Yawn,-á I'm right as usual. The predictability kinda gets boring really.
|
Demica Diaz
SE-1
265
|
Posted - 2016.03.23 18:03:07 -
[27] - Quote
Good news and good news on more boost to servers. Its getting bit frustrating that every 3rd picture you spent time on is "lost"  . Also with speed of Kredit gain with higher rank can we have secound labcoat that is mostly white like most SoE "theme" usually is? :D |
AgentMaster
Platinum Octopus
Infernal Octopus
3
|
Posted - 2016.03.23 19:05:55 -
[28] - Quote
CCP Wonderboy wrote:Hello scientists!
The Project Discovery team is extremely satisfied and impressed with Capsuleer interest for this scientific endeavor, you have been doing a great job so far!
However, in order to reduce the exploitability of the feature, we, in collaboration with MMOS and the HPA, have decided to stop calculating Accuracy Rating for the community consensus. Instead, we will increase the rate of training examples you get, for which you get an immediate rating.
This is only the first step in our attempt to improve Project Discovery and it's data quality, as we might introduce further changes to our scoring procedure. This change will also significantly reduce the heavy load on the MMOS servers and should ensure a smoother experience for everyone.
Feel free to leave any feedback and suggestions here, and may the cytoplasm be with you.
- CCP Wonderboy
EDIT: This change should roll out at 15:00 UTC, keep in mind this is only a change to the MMOS API so we expect no downtime. The Project Discovery client will be updated after Easter vacations.
Tell me what you do to prevent the arbitrary choice of answers? Some results evident that they have no resemblance to those examples
For example: https://i.gyazo.com/3723c762d0c9a531e35d604e08395b6b.png
Do not you think that such responses more harm than science help? No matter what answer you give - always get isks?! Ppl is lazy - why they need to lose a time to think - just click and get isk :( how else to explain the absurd answers with high rates of choice?!
Blessed is the man who has nothing to say and yet silent!
|
Memphis Baas
1366
|
Posted - 2016.03.23 19:58:43 -
[29] - Quote
That 77% cytoplasm choice seems to reflect how badly we're metagaming the system, despite all the praise that we're doing a good job. Clearly one way for people to achieve 99% accuracy is to go through the samples as fast as possible and record the consensus for each sample number, then go through again with an alt and answer "correctly."
Good changes so far.
I'd like to see the following:
- It looks like you've reduced the history drop-down list to only the last 6 samples, which kinda sucks. Can you please increase it to 20? We do more than 6 submissions per day.
- For the submissions that are rated negative (lowered accuracy) for by the Project Discovery people, can you implement an option so we can click on that negative rating and get the "results" slide back, so we can see the slide and what we picked wrong? I realize it's a bit of work, and possibly increased server load, to get particular slides re-downloaded, but I'd like to see what I did wrong, or at least what I picked (that was wrong). We learn from our mistakes, if the feedback is provided.
- If the above is not possible, at least compile some more detailed accuracy statistics as feedback: for example, if the screen were to tell me "You're 90% accurate in the nucleus category but only 40% in the cell body category" I'd try to improve in that area.
- EVE has a web browser and Project Discovery has a website with more examples, would you put a link to that into the Project Discovery interface? Not sure if people realize that there are more example slides out there that they could be looking at, through the in-game web browser.
|
NorthCrossroad
EVE University
Ivy League
97
|
Posted - 2016.03.23 20:10:03 -
[30] - Quote
Seems like a good improvement.
If possible, would be great, if latest samples that reached consensus, would be marked in different color in history. AND user would be able to see the actual result of that concensus. Perhaps, even with a possibility for a resercher to leave a note in some very unusual cases.
North |
|
|
|
|
| |
|
| Pages: [1] 2 3 4 :: one page |
| First page | Previous page | Next page | Last page |