Hopefully you've filed a bug report that includes a detailed description of your system, and a surefire sequence for generating the errors. Or at least the results of several trials. As well you can imagine, the programmers can't fix a bug that they can't corner, in which case you'll end up piggybacking on somebody else.
For myself, I'm getting Stream Errors maybe twice an hour, with an instant reload, the occasional building that's offset a bit and won't respond until I reload, and the red expansion error that everybody else is reporting. Those are the sorts of glitches that will go away as they tune the configuration of the server farm. I watched the memory allocation for a while, and that problem has definitely been solved.
As you may have noticed, the smarter memory management release is scheduled for Aug 11th, and the gear options menu in the lower right corner of your display will include an OPT IN for Hardware Acceleration, so you can isolate the effects of the Hardware Acceleration. You have that same option in Beta, except that you have to Opt Out, so you might want to fiddle with that.