Fixed my problem, Followed these steps and it works! Thanks guys!

The default firmware for Linksys (and all replacement firmwares except for one) have a severe problem where they track old connections for FIVE days, which causes the router to hang when using P2P apps, or any software that generates a lot of connections. DHT only aggravates the situation because of the number of connections it generates.

Linksys has yet to address this issue, but there is a fix. If you use alternative firmware, you can put in a start-up script to fix this problem.

Goto http://www.polarcloud.com/tofu/ and download the latest firmware for your Linksys WRT54G/GL or WRTSL54GS router.

Go to the web interface (default password is admin) by typing http://192.168.1.1 into your browser.
Click Administration, then Edit Startup. Put the following commands in the box:

echo 1 > /proc/sys/net/ipv4/icmp_echo_ignore_broadcasts
echo 1 > /proc/sys/net/ipv4/icmp_ignore_bogus_error_responses
echo "600 1800 120 60 120 120 10 60 30 120" > /proc/sys/net/ipv4/ip_conntrack_tcp_timeouts

Click Save, close the window, then click Save settings.
Reboot the router (the Administration page has a Reboot button) and you'll be done.