|
|
| Author |
Thread Statistics | Show CCP posts - 8 post(s) |
|
CCP Rise
C C P
C C P Alliance
3909
   |
Posted - 2014.03.27 16:24:00 -
[1] - Quote
Hi!
This is a post to give you guys a heads up that we just deployed the first version of a new testing framework to Singularity. As a result, it's possible that you will notice differences between your client behavior compared to other folks', or even differences between two of your characters if they happen to be on different accounts. Don't be alarmed!
If you aren't familiar with A/B testing, it's a strategy at that allows us to try variations in implementation simultaneously, which can be a very valuable data gathering tool.
For this pilot, the only feature affected is a new set of tool tips. The main goal currently is to simply validate our A/B implementation and so we are happy to let you know so you don't think something is broken  .
Thanks for testing o/ |
|
|
CCP karkur
C C P
C C P Alliance
3308
|
Posted - 2014.03.27 16:32:00 -
[2] - Quote
Salpun wrote:Any way to tell which version we are looking at?
log in... if your tooltips (for example on the neocom) are different from the ones you have on TQ, you have the new ones we are testing 
CCP karkur | User Interface Programmer | Team Pirate Unicorns |-á@CCP karkur |
|
|
CCP karkur
C C P
C C P Alliance
3308
|
Posted - 2014.03.27 18:21:00 -
[3] - Quote
Salpun wrote:CCP karkur wrote:Salpun wrote:Any way to tell which version we are looking at? log in... if your tooltips (for example on the neocom) are different from the ones you have on TQ, you have the new ones we are testing Updated my post lol. The bad thing is I cant log in to a client for the next 24 hours or so.  I just checked, and you are not in the group with the new tooltips
CCP karkur | User Interface Programmer | Team Pirate Unicorns |-á@CCP karkur |
|
|
CCP Habakuk
C C P
C C P Alliance
888
|
Posted - 2014.03.28 00:27:00 -
[4] - Quote
@Merida DunBrogh: Thank you for your report about UI Scaling at 90%. I was able to reproduce it and wrote an internal defect about it.
Salpun wrote:For those needing to create new characters/ or use an alt for testing to make sure we are able to test both or all versions could you tell us how you split the characters so we can create testing characters in the opposite group.
Is it random or split alphabetically this time?
It is quite random as far as I know, but it is per account (as already stated by CCP Rise). Just creating new characters will not help in this case.
CCP Habakuk | EVE Quality Assurance | Team Gridlock-á
Bug reporting | Mass Testing |
|
|
CCP Explorer
C C P
C C P Alliance
2100
|
Posted - 2014.03.31 22:15:00 -
[5] - Quote
To explain a bit more how this all works:
Right now we are testing three things on SiSi: We are testing the new tooltips, we are testing the A/B-testing framework, and we are making sure the old tooltips haven't regressed given the above development/changes. For this testing the users on SiSi were split 50/50 into the new tooltips and the old tooltips.
On TQ we will deploy this in at least three phases: First phase will be a "dark" deployment in which everyone but selected CCP devs will have the old tooltips. Second phase will be the experiment where a certain ratio of new players will get the new tooltips. Third phase will be a general rollout to all players (based on positive results from the experiment). It's during the third phase we will do the normal round of devblogs, etc.
Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P
C C P Alliance
2102
|
Posted - 2014.04.01 09:00:00 -
[6] - Quote
Salpun wrote:CCP Explorer wrote:To explain a bit more how this all works:
Right now we are testing three things on SiSi: We are testing the new tooltips, we are testing the A/B-testing framework, and we are making sure the old tooltips haven't regressed given the above development/changes. For this testing the users on SiSi were split 50/50 into the new tooltips and the old tooltips.
On TQ we will deploy this in at least three phases: First phase will be a "dark" deployment in which everyone but selected CCP devs will have the old tooltips. Second phase will be the experiment where a certain ratio of new players will get the new tooltips. Third phase will be a general rollout to all players (based on positive results from the experiment). It's during the third phase we will do the normal round of devblogs, etc. Any idea how long this might take? Not at this time, no. Guessing this might roll out to everyone in the next 1-2 months, but not going to make any promises.
Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Explorer
C C P
C C P Alliance
2102
|
Posted - 2014.04.01 12:50:00 -
[7] - Quote
mkint wrote:Um... If I remember my history correctly, this was done once before several years ago with the neocom, except the users had control of if they wanted to take part or not. And if I recall, 80% of the feedback was ignored anyway.
This version sounds like an excuse to force unwilling players to beta test for you. I wonder if this is necessary because of how sisilauncher.exe was killed in order to add the launcher.exe in spite of universal negative feedback about ever part of the process.
edit: ah, I get it... it's to reduce the amount of feedback on a feature, so you can blame us for not giving you feedback when said feature is awful. Kethry Avenger wrote:So your going to change if for some people without them knowing there was a change first?
Please read http://en.wikipedia.org/wiki/A/B_testing
Erlendur S. Thorsteinsson | Development Director | EVE Online // CCP Games | @erlendur |
|
|
CCP Habakuk
C C P
C C P Alliance
891
|
Posted - 2014.04.05 23:06:00 -
[8] - Quote
Merida DunBrogh wrote:Feedback point:
In the new Capacitor Overview you get to see the number in a constant update, which is awesome.
However, the functionality to see the % of your cap was also gotten rid of(At least on hovering) which is a bad thing because due to the capacitor fo
I am pretty sure, that this was already addressed, but the current version on Singularity is missing some changes to this feature.
CCP Habakuk | EVE Quality Assurance | Team Gridlock-á
Bug reporting | Mass Testing |
|
|
|
| |
|