Back to search

One of the really cool innovations that we've implemented in Star Citizen's development is the Evocati test flight. How has that affected our development? How do you plan for that?

TL;DREvocati testing is described as a blessing because internal QA can't cover the volume, and the new flight model will be opened to Evocati weeks early for feedback.

Erin RobertsChief Development Officer

Well, to be honest, it's a blessing, because we have actually quite a large internal test department, but not as big as some, and they cannot manage the amount of tests we need to do. And not just the Evocati are fantastic, but also when everybody joins the PTU and we get that massive surge on the servers. And I tell you, sometimes we think the game's stable and we've gone through Evocati, it feels pretty good, and then we just go to a big open PTU and everything just falls flat. And I know some of the guys have seen that. Having that is an amazing resource to work with. So having people there who are willing to come in and help us do that is brilliant. And Evocati especially. What's really great on the Evocati side is that they're actually willing to get in when the game's, let's say, slightly more broken than usual, or test some feature stuff. Which, interestingly, is one of the things we're actually going to do this time around as well: with the flight model, we're going to basically open up to Evocati probably a number of weeks before we even go into proper testing, just so they can go and fly and give us feedback on that. Because the new flight model is going in, we want more time on it and we want more feedback. If we put it in for the last four weeks and stuff like that... we want to make sure it's balanced well, because it's a big new thing. So that'd be kind of cool. And that's the great thing that Evocati does as well. They're going to go in there. We're going to give them a drop with a bunch of the flight stuff. They're going to go fly, and we can get their feedback, and we'll be able to tweak on that. So by the time it gets to the mass of people in the PTU, it should have had a good number of changes with suggestions from Evocati. But without that group, it would make our jobs very, very difficult. Close to impossible, because you don't release a game this size, with this many people, with about 60 internal QA guys spread over these regions and so forth. And so, no, we're just incredibly lucky to have the support we have.

Jared HuckabyHost, Community

And I'm going to add, for those who may be hearing the term Evocati for the first time and wondering how you can join it: it's through use of our Issue Council, which is our big QA platform where our backers can find bugs, submit bugs, verify the bugs submitted by other backers, and help us narrow down the sources of bugs that crop up during the course of development.

Reverse the Verse›LIVE - Two-in-One Special·
Published on this date.8 Feb 2019