Update 2.2: Hire a QA DEPARTMENT

yeah, but seriously... I have the upmost respect for FD and a borderline obsessive compulsive disorder about playing E : D - I have to admit I didn't log in a few times last week (post 2.1.03) because I did not want to face the broken mechanics, bugs, etc that are pleagueing (sp) the game right now. I thought about playing and never logged on because I didn't have confidence that some bug would ruin my experience or not. All will get fixed eventually, we have to remember that every time we play it's a WIP.
 
I once read a Microsoft report that stated that the version of Office in production (version 6???) had 100,000 or more open bugs. To be fair, most of these were so obscure that they were never going to get fixed.

Most software ships with hundreds of bugs, because a bug is anything where the design doesn't match the final product. A good release manager will know what bugs it's OK to ship with, and which ones you absolutely must fix; having a fixation on perfection before release just means you're never going to release. You only have to look at all the games and other programs that are stuck in development hell to get an idea of how widespread the problem is. Sourceforge alone is a massive graveyard of projects by idealists who refused to release until it was perfect, and SC is going to end up in the same hole unless Chris Roberts stops adding new stuff and readying what they do have for release.
 
yeah, but seriously... I have the upmost respect for FD and a borderline obsessive compulsive disorder about playing E : D - I have to admit I didn't log in a few times last week (post 2.1.03) because I did not want to face the broken mechanics, bugs, etc that are pleagueing (sp) the game right now. I thought about playing and never logged on because I didn't have confidence that some bug would ruin my experience or not. All will get fixed eventually, we have to remember that every time we play it's a WIP.

All those bugs are few dozen of isolated cases. You can't rely on forums when comes to assessment of the patch, because by design, it will contain mostly negative feedback. Don't forget that for every fuming rant, here, there are thousands of people who are completely fine! ;)
 
All those bugs are few dozen of isolated cases. You can't rely on forums when comes to assessment of the patch, because by design, it will contain mostly negative feedback. Don't forget that for every fuming rant, here, there are thousands of people who are completely fine! ;)

Good point. Another player posted that the official figures showed that less than 10% of Elite players are registered on this forum and if you're enjoying yourself you probably are not going to be posting about it but playing the game instead.
 
I work in QA, pharmaceutical as opposed to software, but they are similar in many respects in that we get the blame from the weather to the Middle East crisis and the UK exit from the EU. In QA you can never win.
Nope, production don't like you, the boss don't like you, and complaining customers don't like you, you simply can't win.
 
Good point. Another player posted that the official figures showed that less than 10% of Elite players are registered on this forum and if you're enjoying yourself you probably are not going to be posting about it but playing the game instead.

That's exactly how game forums work. :)
 
This is code that prevents players from seeing each other's wingman when they are in the same instance and can see each other. That is entirely under their own control. If this isn't a QA fail who bears responsibility for that?
I'm talking about how wings don't always pay out, and are broken where data isn't properly shared, or when you rejoin one after the game ejects you for connection issues, it fakes a reconnection requiring the wing to be re-formed by everybody.
I'm talking about limpets blowing up whenever anybody leaves an instance.
I'm talking about the phantom cargo bug where you eject cargo but it breaks your cargohold door and you can't open or shut it and you still retail the cargo, so very soon after when you think you have space you dont have space and you then have to drop to menu, destroying everybody's limpets, and then when you come back in you bring more AI NPCs with you EVERYTIME. I'm talking about that kinda crap. Completely catchable by QA.
I'm talking about the design decisions in the 2.1 update which led to multiple "tweaks" and changes "rollbacks" of the design. Proper QA prevents poor product from "going out the door" being released in the first place.

Hm... since all that instancing stuff is Peer to Peer and the servers serve as "matchmaking arbiters", I'd guess the culprit is either your or your wingen's borked networking connection.
And please forward all those "but I have 100mbit fibre" to the local black hole that is your ISP. :D
 
When you build a game as massive as ED bugs are going to happen.

Then build an equally capable QA apparatus to catch and fix them. Yes or no?

- - - - - Additional Content Posted / Auto Merge - - - - -

Hm... since all that instancing stuff is Peer to Peer and the servers serve as "matchmaking arbiters", I'd guess the culprit is either your or your wingen's borked networking connection.
And please forward all those "but I have 100mbit fibre" to the local black hole that is your ISP. :D

Nice try but these issues are not isolated to my client. Been reported in two different wings I fly with, USA/UK, 150 LY apart too. Know for a fact it isn't purely a P2P situation. Blaming the ISP is a cop out for not using proper netcode to eliminate the issue.

- - - - - Additional Content Posted / Auto Merge - - - - -

All those bugs are few dozen of isolated cases. You can't rely on forums when comes to assessment of the patch, because by design, it will contain mostly negative feedback. Don't forget that for every fuming rant, here, there are thousands of people who are completely fine! ;)

Rite, so I went to listen to what Steam had to say about it. Overwhelmingly negative reviews since the update from a large cross section of players. Why? Variety of reasons, AI, Implementation, BUGS, content quantity. The BUGS remain the rest has been addressed.
 
Then build an equally capable QA apparatus to catch and fix them. Yes or no?

- - - - - Additional Content Posted / Auto Merge - - - - -



Nice try but these issues are not isolated to my client. Been reported in two different wings I fly with, USA/UK, 150 LY apart too. Know for a fact it isn't purely a P2P situation. Blaming the ISP is a cop out for not using proper netcode to eliminate the issue.

- - - - - Additional Content Posted / Auto Merge - - - - -



Rite, so I went to listen to what Steam had to say about it. Overwhelmingly negative reviews since the update from a large cross section of players. Why? Variety of reasons, AI, Implementation, BUGS, content quantity. The BUGS remain the rest has been addressed.


Like I said I have worked in QA.
Its hard.

I was on sound , I had to look into sound bugs.
And what it was :
You get your reports (not just for you but the full team) usualy in the thousands of bugs going from critical to not an issue but worth looking into
You test it and see if it works on your end.

If it works on your end and all the other PCs that are used for testing then its considered fixed.
Sometimes a bug only happens on one PC , sometimes a bug is due to a limitation or something that is being worked on but will take years to fix

And then you have the bugs that are not bugs but end user errors were they use unsupported programes , have a virus on the PC or just dont have a good PC or internet. (the number of lag repports I used to see when looking at what the genral test guys got)

Anyway you could have a thousands QA testers working on something it does not mean things will be fixed. because they just end up sending it to the devs who often are doing something else more important.

Oh and its not cool to lie about steam ''reviews''
Elite dangerous never had ''Overwhelmingly negative reviews''
Its been ''mostly positive" and mixed , going up and down frequently.

Elite dangerous horizons has mostly positive recent reviews.
 
Rite, so I went to listen to what Steam had to say about it. Overwhelmingly negative reviews since the update from a large cross section of players. Why? Variety of reasons, AI, Implementation, BUGS, content quantity. The BUGS remain the rest has been addressed.

Okay.
Point 1: You're either lying, or we don't look at the same stats.
djikFBQ.png

the base is growing and reviews get better with each update. Please do me a favour and ACTUALLY go and look at the steam charts and reviews.

Point 2:
Steam users make less than 10% of the player base and aren't even the main target group. Mostly just casual players.

Please make a valid argument.
 
Last edited:
Okay.
Point 1: You're either lying, or we don't look at the same stats.
http://i.imgur.com/djikFBQ.png
the base is growing and reviews get better with each update.

Point 2:
Steam users make less than 10% of the player base and aren't even the main target group. Mostly just casual players.

Please make a valid argument.

Chris, with 2000+ hours in the game (I forget the # you and some other guy were comparing), you must know that what you quoted can't be right. 403 review?

Try this https://forums.frontier.co.uk/showt...s-down/page2?p=4131463&viewfull=1#post4131463
 
Last edited:
Okay.
Point 1: You're either lying, or we don't look at the same stats.
http://i.imgur.com/djikFBQ.png
the base is growing and reviews get better with each update.

Point 2:
Steam users make less than 10% of the player base and aren't even the main target group. Mostly just casual players.

Please make a valid argument.

Forgive me, brothers. It gives me great shame to say that I am, in fact, a filthy Steam casual. I even play this game with...an xbox 360 controller:(

I followed the kickstarter and general development progress of Elite, but prior to it's release had little practical interest in it. Even after it initially dropped on Steam, I was so horrified by it's terrible release trailer that I steered well clear, until one day overcome with curiosity I decided to pony up the money and see what everybody was complaining about.

Am I glad I did. The game quickly became one of my most played, and by the time Horizons released I was a sick, sick Elite addict.

That is probably what keeps me flying, the futile hope that somewhere out there in the black deeps...I'll find redemption.
 
Awesome takedown. The blade went in so deep and so fast the OP probably didn't even feel it..or did he?

They have had their logfiles since day 2. I have sent them repeated videos explaining the issue, showing how it happens, and the associated issues. The issues are here the fixes aren't. Weeks later I write up this post in the hopes that perhaps if my exprience with bugs in the game isn't isolated others will also call for increased QA. Well we are on page 6 of this thread so I guess it isn't an isolated thing.

Id share a few thoughts regarding active community management and it's effects on these forums. Active community management is also a strong contributor QA. The lack of which contributes to lack of QA.

However given the current state of the game and these forums, well lets just say my efforts and time and stamina as well as tolerance only goes so far.

- - - - - Additional Content Posted / Auto Merge - - - - -

Okay.
Point 1: You're either lying, or we don't look at the same stats.
http://i.imgur.com/djikFBQ.png
the base is growing and reviews get better with each update. Please do me a favour and ACTUALLY go and look at the steam charts and reviews.

Point 2:
Steam users make less than 10% of the player base and aren't even the main target group. Mostly just casual players.

Please make a valid argument.

Here have a look. [video=youtube;_uAmCBKJ5bY]https://www.youtube.com/watch?v=_uAmCBKJ5bY[/video]
 
Last edited by a moderator:
They have had their logfiles since day 2. I have sent them repeated videos explaining the issue, showing how it happens, and the associated issues. The issues are here the fixes aren't. Weeks later I write up this post in the hopes that perhaps if my exprience with bugs in the game isn't isolated others will also call for increased QA. Well we are on page 6 of this thread so I guess it isn't an isolated thing.

Id share a few thoughts regarding active community management and it's effects on these forums. Active community management is also a strong contributor QA. The lack of which contributes to lack of QA.

However given the current state of the game and these forums, well lets just say my efforts and time and stamina as well as tolerance only goes so far.

- - - - - Additional Content Posted / Auto Merge - - - - -



Here have a look. https://www.youtube.com/watch?v=_uAmCBKJ5bY
They are ''mixed'' on elite dangerous and ''mostly positive'' on horizons.

Most of the hate is by users who dont understand the game anyway
 
Last edited:
Nope, production don't like you, the boss don't like you, and complaining customers don't like you, you simply can't win.

Well, here's the thing; production loves you (QA) because you amongst other things help nail down the hard to find production-only bugs, typically the non-functional ones, like network stability, performance, scalability, etc. Customers loves you, because you are the last defense against bugs, customer love automatically gives you boss love, and the devs love you because you give them the essential and needed information to nail the bugs quickly & effectively.

I don't work in QA, I'm just a stickler for due diligence, death-dealer to bad assumptions, and enjoyer of root cause analysis.
 
Back
Top Bottom