You can play with some nat rules on iptables (only linux) to let all packets go to hlds ip/port.
The problem is the response will try to go out with just 1 ip address.
That can be fixed if you route SOME USERS to ISP1 and OTHER USERS to ISP2 in your internal network.