YONETANI Tomokazu wrote up a nice bit of explanation about compiling src and pkgsrc as non-root.  He even explicitly names some useful variables to set.