You can use iptables to redirect incoming data from a specific IP/range to a specific port. Having more than one input type on a port will lead to unexpected outcomes.
There are plenty of posts about Graylog inputs, ports and iptables in the forum such as this one hopefully that will set you on your way!!