First make sure the port is not blocked by your firewall. Then edit the /etc/httpd/conf/httpd.conf file. Look for the line 'Listen 80', then add an additional line under it 'Listen 2468'.
If you wanted to have apache listen only on the new port, and NOT listen on port 80, then you would just change the existing '80' to '2468'.
Once done editing (use a linux editor, not a windows editor), then save the file, and restart apache
/etc/init.d/httpd restart
or
service httpd restart