A physical building does not have rights. What matters here is the agreement between sovereign individuals that are choosing to associate. So yes, this concept exists between people that do not physically meet.
The key aspects are:
1. No laws are being broken. This does not mean codes, statutes, ordinances, etc. Those are not laws, they are part of the legal system. Laws cover acts of physical violence, violations of personal property (damage, theft), and acts against personal rights. For example, you and I aren't protected to freely associate if we're agreeing to kidnap someone, steal a car, prevent someone from speaking, etc. We can make an other agreement though; even if that agreement doesn't follow health codes, license requirements, or other infringements on our right to operate freely.
2. You are only making this agreement with people that have made a conscious decision to join in the agreement. This is what makes the agreement private. Otherwise, you are operating "in public", and subject to all the infringements included in the codes, statues, ordinances, regulations, etc of your jurisdictions.
3. This right to freely associate doesn't even need documents. However, if the system tries to challenge your right to freely associate, it will be easier to defend if you have documentation of the organization and evidence of the agreements between private parties.
I think that's it. If I forgot an aspect, I'll do my best to add it to this thread.