Q. Do I have to use the Azure gateway to connect networks via site-to-site VPN?
A. No. While Azure provides a gateway capability that enables a simple site-to-site VPN experience you can also use virtual appliance solutions and there are a number of them in the Azure marketplace such as the Check Point VPN solution.