Is the Yellow brake vavle similar to the BVM? The type of retracts should not matter. If the yellow valve is like the BVM that you have pictured, it sounds like you have the servo reversed. Also, if the linkage set up is off just a little, it will leak air. It needs to be a really straight push/pull to make it work right.
Where is your fill valve located. It should fill no matter where the brake valve is positioned. Maybe you have the fill on the wrong end?
You should "t" the line that comes right out of the air tank.