Would rubber gaskets in between each component make a difference?
If that's not enough, or if you washers don't dampen the noise.
would the middle part "main body" is this was made of delrin, would this absorb any noise?

regardless I'm extremely happy with this design.... Looking forward to using it