If they will be in full shade, I wouldn’t do it. If part shade, my only concern would be root competition. I would plant the arborvitae far enough away from the aspens to give each room to grow. And, so the roots aren’t fighting for the same nutrients.
Thanks for writing!