Pages: [1] 2 :: one page |
|
Author |
Thread Statistics | Show CCP posts - 17 post(s) |
|
CCP Falcon
3792
|
Posted - 2013.08.16 14:00:00 -
[1] - Quote
Hello Capsuleers
A little while ago, CCP Goliath released a blog that detailed some changes coming to the bug reporting system, and our bug reporting tools.
Now he's back, (from outer space), to show you more about the new reporting system, and to explain to you all how you can assist in the never ending quest to eradicate bugs from EVE.
Read all about it in his latest Dev Blog here! CCP Falcon -á || -á EVE Community Team -á || -á EVE Illuminati -á || -á Live Events Organizer
@CCP_Falcon -á || -á-á@EVE_LiveEvents |
|
Mashie Saldana
BFG Tech
661
|
Posted - 2013.08.16 14:26:00 -
[2] - Quote
First? Mashie Saldana Dominique Vasilkovsky
|
Ishtanchuk Fazmarai
1588
|
Posted - 2013.08.16 14:43:00 -
[3] - Quote
It's been interesting to learn how QA is performed and the new bug report function...
...but also I've had some fun trying to figure how the new jump animation was QA tested and released in a bug free albeit nausea-inducting state
I mean, can you figure that some pesky bug prevented it from playing...? What terrible loss to players suffering headaches, migraines or dizziness! The Greater Fool Bar is now open for business, 24/7. Come and have drinks and fun somewhere between RL and New Eden! |
|
CCP Goliath
C C P C C P Alliance
1612
|
Posted - 2013.08.16 14:44:00 -
[4] - Quote
Mashie Saldana wrote:Is this part 2 of 4?
Improved bug reporting is always handy and the ability to attach multiple files at once is welcome.
To be able to communicate with the BH's in a chat style instead of adding additional comments to the original issue field will improve things a lot.
Part 2 of 3, with the third being "how to write the perfect bug report". If you want me to write more stuff though, happy to do it! Would need topic suggestions. CCP Goliath | QA Director | EVE Illuminati | @CCP_Goliath |
|
|
CCP Goliath
C C P C C P Alliance
1612
|
Posted - 2013.08.16 14:48:00 -
[5] - Quote
Ishtanchuk Fazmarai wrote:It's been interesting to learn how QA is performed and the new bug report function... ...but also I've had some fun trying to figure how the new jump animation was QA tested and released in a bug free albeit nausea-inducting state I mean, can you figure that some pesky bug prevented it from playing...? What terrible loss to players suffering headaches, migraines or dizziness!
So, there's a difference between functional testing and user experience testing. When testing the jump animation, it would have been tested that jumping worked as expected - you jump, you go through the gate, the animation plays, the sound plays, you land, etc. A possible user experience test case would have been doing a 40 jump run, for instance. This was done, but only after the problem became apparent on TQ. User experience testing is something we're putting a lot of focus on getting better at, and is also why Sisi feedback is so important to us. CCP Goliath | QA Director | EVE Illuminati | @CCP_Goliath |
|
Darkblad
Hilfe is like Free Entertainment
13
|
Posted - 2013.08.16 14:55:00 -
[6] - Quote
*snip* must. not. post. before. reading. last. paragraph. of. devblog.
And I assume it's intended that bugs reported with the old bug reporting system are still available at https://bugs.eveonline.com/mybugreports.asp ? EvE Infolinks-áGÇô Umfangreiche Sammlung von Links mit informationen ++ber EvE, inklusive Guides und Infos von mir selbst |
|
CCP Goliath
C C P C C P Alliance
1612
|
Posted - 2013.08.16 15:00:00 -
[7] - Quote
Darkblad wrote:New Bug reporting page looks fine. But where's the list of bug reports I've created there? And I assume it's intended that bugs reported with the old bug reporting system are still available at https://bugs.eveonline.com/mybugreports.asp ?
Yes and no. The old site will soon be decommissioned so you will no longer be able to access them. Once the 2 way communication/ability to see reported issues is added to the new site, you'll have that functionality back again. CCP Goliath | QA Director | EVE Illuminati | @CCP_Goliath |
|
Katrina Bekers
Rim Collection RC Test Alliance Please Ignore
185
|
Posted - 2013.08.16 15:05:00 -
[8] - Quote
I use Jira extensively at work (IT dept over three worldwide sites).
You have NO idea how many times, talking with colleagues, I call it "Jita"... << THE RABBLE BRIGADE >> |
Funless Saisima
Strange Energy Gentlemen's Agreement
21
|
Posted - 2013.08.16 15:40:00 -
[9] - Quote
Quote:Please also note that getting bug reports via the in game tool is generally more useful to us than getting them via the site, so if you can use the tool, please do so.
So you go through all that work to get the website up to date, then just tell us to use the old in game tool. Ok. |
|
CCP Goliath
C C P C C P Alliance
1612
|
Posted - 2013.08.16 15:42:00 -
[10] - Quote
Funless Saisima wrote:Quote:Please also note that getting bug reports via the in game tool is generally more useful to us than getting them via the site, so if you can use the tool, please do so. So you go through all that work to get the website up to date, then just tell us to use the old in game tool. Ok.
Most of the work we've been doing is creating the bugs service that interprets the data from the client and site reporting tools and converts them into Jira issues. CCP Goliath | QA Director | EVE Illuminati | @CCP_Goliath |
|
|
Vincent Athena
V.I.C.E. Aegis Solaris
2117
|
Posted - 2013.08.16 15:44:00 -
[11] - Quote
CCP Goliath wrote:Ishtanchuk Fazmarai wrote:It's been interesting to learn how QA is performed and the new bug report function... ...but also I've had some fun trying to figure how the new jump animation was QA tested and released in a bug free albeit nausea-inducting state I mean, can you figure that some pesky bug prevented it from playing...? What terrible loss to players suffering headaches, migraines or dizziness! So, there's a difference between functional testing and user experience testing. When testing the jump animation, it would have been tested that jumping worked as expected - you jump, you go through the gate, the animation plays, the sound plays, you land, etc. A possible user experience test case would have been doing a 40 jump run, for instance. This was done, but only after the problem became apparent on TQ. User experience testing is something we're putting a lot of focus on getting better at, and is also why Sisi feedback is so important to us.
This last paragraph seems so odd. The motion sickness issue was reported by users of Sisi. You stated that Sisi testing is important. Yet you did not do a user experience test until the issue became apparent on TQ? If you are going to wait for it to hit TQ, why is Sisi testing important? If Sisi testing is important, why did you not do the user experience test when the issue was reported on Sisi?
Also the motion sickness issue is very user specific. I do not get it. To test it you would need a susceptible person on the testing team. If you do not have such a person you need to trust your customers are actually right. And you must trust them sufficiently to actually change what you put in the game. http://vincentoneve.wordpress.com/ |
Ishtanchuk Fazmarai
1589
|
Posted - 2013.08.16 16:38:00 -
[12] - Quote
CCP Goliath wrote:Ishtanchuk Fazmarai wrote:It's been interesting to learn how QA is performed and the new bug report function... ...but also I've had some fun trying to figure how the new jump animation was QA tested and released in a bug free albeit nausea-inducting state I mean, can you figure that some pesky bug prevented it from playing...? What terrible loss to players suffering headaches, migraines or dizziness! So, there's a difference between functional testing and user experience testing. When testing the jump animation, it would have been tested that jumping worked as expected - you jump, you go through the gate, the animation plays, the sound plays, you land, etc. A possible user experience test case would have been doing a 40 jump run, for instance. This was done, but only after the problem became apparent on TQ. User experience testing is something we're putting a lot of focus on getting better at, and is also why Sisi feedback is so important to us.
Well, the issue was forwarded as soon as the animation hit Sisi, and nothing happened i.e. the animation was released the same, as if at that stage, what mattered was funcionality (it works in user systems) and not usability (users actually can use it). That is between unfortunate and outrageous depending on who you ask, but also points that it may be difficult to use-test things in a way that allows to do something with user feedback.
This hasn't been the first nor the worst nor likely the last feature that's been delivered in a perfectly functional yet unacceptably unusable state, but on the other hand, it's also evident that the bug hunting process is quite more effective than it used to be. I haven't run into any bug for months (or maybe I'm not paying enough attention, heh) so I would say, keep up the good work against bugs, but also give a look at what players will experience when they use any given bug-free feature.
Because sometimes animations are too abrupt and loot scatter boxes are too small and move too fast, at least to some users/players. The Greater Fool Bar is now open for business, 24/7. Come and have drinks and fun somewhere between RL and New Eden! |
Logix42
HELLSINKER Unsuitable
159
|
Posted - 2013.08.16 18:18:00 -
[13] - Quote
Good to hear about the regression testing being put in place. Automation is win!
Also, very happy that bug reporting is back, time to report ALL THE BUGS Crowdsourcing FTW Dev Post |
Utremi Fasolasi
La Dolce Vita
268
|
Posted - 2013.08.16 19:43:00 -
[14] - Quote
CCP Goliath wrote:A possible user experience test case would have been doing a 40 jump run, for instance. This was done, but only after the problem became apparent on TQ. User experience testing is something we're putting a lot of focus on getting better at, and is also why Sisi feedback is so important to us.
But.. we gave you tons of that feedback as soon as the jump animation hit Sisi - pages and pages in the Test Server forum :-(
It was fixed relatively promptly but it couldn't have been a surprise reaction when it went to TQ in that state. |
Ines Tegator
Towels R Us
343
|
Posted - 2013.08.16 20:30:00 -
[15] - Quote
Yeah, sisi feedback seems to be generally ignored. I follow ship changes fairly regularly. It's pretty much accepted that once a balance change hits sisi, it's final. It gets really obnoxious, when you read entire threads about how X ship is Y broken on sisi (anciallary shield boosters are one change that stands out to my memory) and then CCP seems to be surprised when it causes problems when released and then rushes to do a hotpatch. I kind of feel like Sisi is a "preview server" and not really for testing.
I suppose you guys use it to test bugs and not so much balance/usability/feature stuff- but those things need to be included and prioritized. Above minor bugs, imo, since these things affect player experience a lot more then something small like item stacks failing to auto-split to fit the container. It's not cool to have the battlefield meta turned on it's head literally overnight (patch night), and then turned again two weeks later. It happens with feature things too (unified inventory anone?). It just reeks of sloppiness.
To end on a positive note, most patches have been relatively bug free for the past few expansions or so. Used to be I wouldn't even log on until a week after patch day cause I knew everything would be broken :) Props to the bug hunter team. - Mission Overhaul - Bridging the PVP / PVE Gap - -áIf the game stops teaching people to fear lowsec, maybe people will start going there? |
Kossaw
Body Count Inc. Pandemic Legion
74
|
Posted - 2013.08.16 22:56:00 -
[16] - Quote
I find it more than a little ironic that the example "Bug" you show in the screenshots of your new tool is in fact a particularly nasty and ******** ~feature~ that has dogged Gallente stations for an exceptionally long time. This issue makes it virtually impossible to undock any large ship from a Gallente station and do anything except warp straight ahead ( if you're quick enough ) or jump ( if you have a jump drive )
It would be nice to know that you have actually formally identified this as a bug now, and will actually be working on getting it fixed .
WTB : An image in my signature |
Narcil
Macabre Votum Northern Coalition.
1
|
Posted - 2013.08.17 01:01:00 -
[17] - Quote
I hope this means the gallente administrative outposts are getting fixed! |
Salpun
Global Telstar Federation Offices Masters of Flying Objects
639
|
Posted - 2013.08.17 05:19:00 -
[18] - Quote
Any word when the in game bug reporting tool will be turned back on? |
TheSmokingHertog
TALIBAN EXPRESS
137
|
Posted - 2013.08.17 06:10:00 -
[19] - Quote
Quote:\sarcasm mode
In before...
*Hoping all those test fases create the same result as the launch of the UNI INV*
/end sarcasm mode
Keep it up, we like a great game, that has no hickups :)
|
|
CCP Goliath
C C P C C P Alliance
1613
|
Posted - 2013.08.17 10:01:00 -
[20] - Quote
Kossaw wrote:I find it more than a little ironic that the example "Bug" you show in the screenshots of your new tool is in fact a particularly nasty and ******** ~feature~ that has dogged Gallente stations for an exceptionally long time. This issue makes it virtually impossible to undock any large ship from a Gallente station and do anything except warp straight ahead ( if you're quick enough ) or jump ( if you have a jump drive )
It would be nice to know that you have actually formally identified this as a bug now, and will actually be working on getting it fixed .
I think it's safe to say that if we are using it as an example of a defect, we consider it a defect. It's assigned to a developer and your very own CSM member Sala is on my case about it frequently :). Haven't spoken wih the developer personally, but I imagine it will be a winter fix, CCP Goliath | QA Director | EVE Illuminati | @CCP_Goliath |
|
|
Salpun
Global Telstar Federation Offices Masters of Flying Objects
639
|
Posted - 2013.08.17 12:01:00 -
[21] - Quote
CCP Goliath wrote:Salpun wrote:Any word when the in game bug reporting tool will be turned back on? You mean on Sisi right? Once we have a build that it works in. So likely Monday Was not working on TQ when i checked just now. Patch notes say its still turned off. |
Cerulean Ice
EVE University Ivy League
38
|
Posted - 2013.08.18 14:42:00 -
[22] - Quote
When the old bug reporting site is decommissioned, will our unfiltered bug reports be transfered over to the new site? I submitted a bug report about three days before this dev blog. Should I create a new version of it in the new site? |
|
CCP Habakuk
C C P C C P Alliance
717
|
Posted - 2013.08.18 19:56:00 -
[23] - Quote
Cerulean Ice wrote:When the old bug reporting site is decommissioned, will our unfiltered bug reports be transfered over to the new site? I submitted a bug report about three days before this dev blog. Should I create a new version of it in the new site?
Please create it again. Some of the old bug reports were transferred to the new system, but not those, which were written after the first Dev Blog from CCP Goliath. CCP Habakuk | EVE Quality Assurance | Team Gridlock | Team Five 0 Bug reporting | Mass Testing |
|
|
CCP Habakuk
C C P C C P Alliance
717
|
Posted - 2013.08.18 20:00:00 -
[24] - Quote
Salpun wrote:CCP Goliath wrote:Salpun wrote:Any word when the in game bug reporting tool will be turned back on? You mean on Sisi right? Once we have a build that it works in. So likely Monday Was not working on TQ when i checked just now. Patch notes say its still turned off.
Is the button not showing up in the F12 menu or is it doing nothing? For me it is working now on both TQ and Sisi. CCP Habakuk | EVE Quality Assurance | Team Gridlock | Team Five 0 Bug reporting | Mass Testing |
|
Salpun
Global Telstar Federation Offices Masters of Flying Objects
639
|
Posted - 2013.08.18 21:57:00 -
[25] - Quote
CCP Habakuk wrote:Salpun wrote:CCP Goliath wrote:Salpun wrote:Any word when the in game bug reporting tool will be turned back on? You mean on Sisi right? Once we have a build that it works in. So likely Monday Was not working on TQ when i checked just now. Patch notes say its still turned off. Is the button not showing up in the F12 menu or is it doing nothing? For me it is working now on both TQ and Sisi. Clicking the help button in the neocom would pull up the help menu with the button for the bug reporting tool. Clicking the button would do nothing. I can't test it right now but will try it again when I can tomorrow.
|
Rionan Nafee
Industrie und Handels Konsortium Tribunal Alliance
237
|
Posted - 2013.08.19 07:28:00 -
[26] - Quote
Thank you for the informative Blog.
If I send a bug report for a missing or wrong German translation and select in the field Language "German" should I write in English or German or both in the other fields and the screenshot?
Best Regards Rionen |
|
CCP Habakuk
C C P C C P Alliance
717
|
Posted - 2013.08.19 09:23:00 -
[27] - Quote
Rionan Nafee wrote:Thank you for the informative Blog.
If I send a bug report for a missing or wrong German translation and select in the field Language "German" should I write in English or German or both in the other fields and the screenshot?
Best Regards Rionen
We prefer English bug reports, but you can use German. There is a chance that German bug reports a processed a bit slower and our bug hunters have more work, as they need to translate them into English. All internal reports are in English.
CCP Habakuk | EVE Quality Assurance | Team Gridlock | Team Five 0 Bug reporting | Mass Testing |
|
Rionan Nafee
Industrie und Handels Konsortium Tribunal Alliance
237
|
Posted - 2013.08.19 09:58:00 -
[28] - Quote
CCP Habakuk wrote:We prefer English bug reports, but you can use German. There is a chance that German bug reports a processed a bit slower and our bug hunters have more work, as they need to translate them into English. All internal reports are in English.
Thank you for the information. As it is easier for you I will write the reports in English. Best Regards Rionan |
Jayem See
Biohazard. WINMATAR.
1175
|
Posted - 2013.08.19 11:15:00 -
[29] - Quote
QA is hard graft. The testing scripts are neither interesting to run or interesting to write.
I spent a year testing a Sharepoint/bespoke intranet system at Royal Mail and the biggest challenge was keeping people interested enough to do as you asked.
It's not a pretty job. Thanks for the update though - it's the little things that I appreciate knowing about Aaaaaaand relax. |
Cerulean Ice
EVE University Ivy League
38
|
Posted - 2013.08.19 12:34:00 -
[30] - Quote
CCP Habakuk wrote:Cerulean Ice wrote:When the old bug reporting site is decommissioned, will our unfiltered bug reports be transfered over to the new site? I submitted a bug report about three days before this dev blog. Should I create a new version of it in the new site? Please create it again. Some of the old bug reports were transferred to the new system, but not those, which were written after the first Dev Blog from CCP Goliath. Apparently JPG and PNG file types are not allowed in the new bug reports, though I have EVE take all screenshots in PNG format. http://i.imgur.com/MDy0vXc.png
I have tried submitting the new bug report through the new site, and it tells me there was an unexpected error. I'll save the bug report info in a text file for now, until it's working properly |
|
|
|
|
Pages: [1] 2 :: one page |
First page | Previous page | Next page | Last page |