Posted this on Reddit, but I'll say it again. I believe you've done this out of passion for the field, evident by your prices and your attention to your community following. If people have made it so that it's stressful and not a joy to you, by all means stop without feeling guilty! You live for your own, not others', satisfaction. This isn't some gigantic corporate entity that you're a salve-wage to, you do this because you enjoy it and you're good at it, so don't take something you love and feel the need to put yourself into a position that'll make you resent what you do.
I only had a chance to make one order of the legendary RY4, and I never once felt bitter about it. I instead felt extremely lucky when I did manage to get my hands on this rare beast I'd heard so much about! It's not your fault some people have piss-poor attitudes and can't understand that they're not being treated "unfairly" just because they didn't get what they want. I hate that entitlement bull.... attitude, pardon mah french. (For the record, I'm not speaking of anyone specifically at all, I'm just making a baseless gross generalization because that's the only reason I can come up with for someone being upset!)
That said, I hope that in some way your RY4 becomes available again somehow, even if it takes awhile and the process changes to make it happen. I've waited ~6 months to get my hands on some and foolishly only ordered a 15ml bottle! I'm now going to treat it like a box of fine cubans, heh. Is there no way you can coach someone to create this masterpiece you've made, or at least handle the time-consuming parts to help take the stress off of you? I'm not familiar with your specific process, but it makes sense to me that you should be able to find a happy medium between using quality local ingredients and offloading some of the work/stress. Then again, I'm sure you've already weighed all of these options.
In closing, I think you've made the right decision and am appreciative of all you've done. I wish I could have experienced it more!