Direct Connect is not always reliable. Just as trying to browse people is not always reliable. Both you & them need to be properly configured re: firewalls, & need to have spare slots & bandwidth for u/d. Did you see How to use Magnet Links & Direct Connect
If you're trying to connect to a friend then you can send them a magnet link. Then when they start downlding from you, you can browse them & vice versa.