Could be you're running out of file handles or local ports.
Have you followed the instructins in "System Tuning"
in http://www.kegel.com/dkftpbench ?
What does dklimits output?

Finally, it's usually a good idea to have more
total horsepower running the clients than
the server.
- Dan