Yes.
It's more work for Primal users, but does it matter if it's easy when the only thing other people see is a "loading" spinner?
Sometimes my feed is full of Primal media not loading. I can sit around for minutes for each note, or scroll on to notes that load properly. It just depends on if you really want your stuff seen, zapped, quoted, commented on, etc.
I use Amethyst, and don't use nostr.build, except when showing someone an error, or a screenshot that won't have much significance in the future. For the rest, I use a non-Nostr host to increase decentralization. But, that's a different story.