Typically in this type of network your switches would be strictly layer 2 VLANs for these segments and you would put the layer 3 interface for them on the firewall instead.
The you control access between these VLANs via the firewall policies on the firewall.
You can try to mimic that type of setup on the EX switch using firewall filters on your RVI. But these are just packet filters and not stateful firewall policies so this is not preferred as a standard implementation.