|
| |||||||
| Register | FAQ | The Twelve Commandments | Members List | Calendar | Arcade | Find the Best VPN | Today's Posts | Search |
| Feature Requests & Bug Reports Is there anything you'd wish to see in Phex, or did you find some bugs? |
 |
| | LinkBack | Thread Tools | Display Modes |
January 9th, 2007
| |||
| |||
 Way too many open files :-/ Hello, When running phex-3.0.99 (self-compiled with LAN-Patch) I very soon get reports about too many open files. lsof says: Quote:
I see the open-files go up as soon as somebody downloads a file (the phex suffering the problem is uploading), a simple mp3-file uploaded by phex leaves about 50-100 file descriptors open (even if the download has been finished) - so after about 10mp3's phex runs out of file descriptors. Setting "File.OpenFilesLimit" to 500 also does not help. I have to admit that I only saw this error on Linux machines till now - so maybe theres a bug in the jdk. (Error happend on 1.5.0_10 & 1.6.0 final) Any ideas what could be wrong, and can I help somehow to detect the problem? Thank you for all your patience, lg Clemens Quote:
Last edited by Linuxhippy; January 9th, 2007 at 03:54 PM.  |
|
January 10th, 2007
| |||
| |||
| I attempted to fix this. Only one file is affected. I only did a quick test, so I'm not sure if this works 100% or introduces other problems. The changes are in: https://phex.svn.sourceforge.net/svn...hex/phex/trunk or at: http://phex.svn.sourceforge.net/view...1=3682&r2=3683 Gregor
__________________  |
|
January 10th, 2007
| |||
| |||
| Log Files... I attached the output of Phex in Debug-Mode, maybe this helps. Its a bzip2'ed txt file, I just appended .txt to be able to upload it. |
|
January 10th, 2007
| |||
| |||
| Hi again, Thanks a lot for your efforts! The "too many open file" Problem has now gone away :-) However now I see another problem. When downloading some files in the lan the downloading client shows "Waiting" and the Candidate state says "Http Error". However about 50% of all downloads complete successful. The uploading phex-client throws the following exceptions (LogLevel=INFO): Quote:
Thank you many many times, Clemens |
|
January 10th, 2007
| |||
| |||
| Difficult to say... it seems to be the download side which decides to closes the connection... BTW: Using Log4J makes logging output much easier to configure, here is a little doc http://www.phex.org/wiki/index.php/Logging_API This is an example log4j.properties: Code: log4j.rootLogger=DEBUG, Console, StandardFile, ErrorFile
log4j.logger.IncomingMessages=WARN
log4j.logger.IncomingMessages.Dropped=WARN
log4j.logger.OUTGOING_MESSAGES=WARN
log4j.logger.LOCALIZATION=WARN
log4j.logger.BANDWIDTH=WARN
log4j.logger.UDP_OUTGOING_MESSAGES=INFO
log4j.logger.UDP_INCOMING_MESSAGES=DEBUG
log4j.logger.phex.common.file=WARN
log4j.logger.phex.common.file.ManagedFileInputStream=WARN
log4j.additivity.phex.common.file.ManagedFileInputStream=false
log4j.logger.phex.common.file.ManagedFileOutputStream=WARN
log4j.additivity.phex.common.file.ManagedFileOutputStream=false
log4j.logger.org.apache.commons.httpclient=WARN, StandardFile, ErrorFile
log4j.logger.httpclient.wire=WARN, StandardFile, ErrorFile
#### Console Appender ####
log4j.appender.Console=org.apache.log4j.ConsoleAppender
log4j.appender.Console.layout=org.apache.log4j.PatternLayout
log4j.appender.Console.layout.ConversionPattern=%d{yyMMdd HH:mm:ss,SSS} %-5p/%c [%t]:: %m%n
#### Standard File Appender ####
log4j.appender.StandardFile=org.apache.log4j.RollingFileAppender
log4j.appender.StandardFile.File=phex.l4j.log
log4j.appender.StandardFile.MaxFileSize=1024KB
log4j.appender.StandardFile.MaxBackupIndex=5
log4j.appender.StandardFile.layout=org.apache.log4j.PatternLayout
log4j.appender.StandardFile.layout.ConversionPattern=%d{yyMMdd HH:mm:ss,SSS}(%r) %-5p/%c [%t]:: %m%n
#### Error File Appender ####
log4j.appender.ErrorFile=org.apache.log4j.RollingFileAppender
log4j.appender.ErrorFile.File=phex.error.l4j.log
log4j.appender.ErrorFile.MaxFileSize=512KB
log4j.appender.ErrorFile.MaxBackupIndex=1
log4j.appender.ErrorFile.Threshold=ERROR
log4j.appender.ErrorFile.layout=org.apache.log4j.PatternLayout
log4j.appender.ErrorFile.layout.ConversionPattern=%d{yyMMdd HH:mm:ss,SSS}(%r) %-5p/%c [%t]:: %m%n
__________________ |
|
January 10th, 2007
| |||
| |||
| To help debug this better try to add the following line to your phexCorePrefs.properties: Download.CandidateLogBufferSize = 1000000 Upload.UploadStateLogBufferSize = 1000000 This gives 1MB of memory data for storing candidate and upload log. You will see a Log Button on the candidate and upload toolbar. Pressing it shows the log of the candidate/upload.
__________________ |
|
January 10th, 2007
| |||
| |||
| Thanks for the logging tips. You're right, it seems the client receives garbage and then resets the connection: Quote:
or later: Quote:
|
|
January 10th, 2007
| |||
| |||
| Thanks for the fix. I now have another problem: 1.) First everything works as it should, but after a few files have been downloaded speed goes to ~10.0kb/s, strange is that in the "Upload"-Tag only 16kb entries are shown. I attached a screenshot to illustrate that behaviour. The slow downloading starts to happen as soon as the 16k uploads begin. I also saw 20kB, 40Kb and 60Kb uploads, but all in this category as soon as the slowdown occurs. 2.) Only a few files come to "Completed!" status, others stuck at "Downloading 100%" with all bytes downloaded. This has been so since the biginning, does not bother me if files are really completly downloaded. The most strange thing is that from machine A-> machine B this never happens, all downloads complete and are always fast. So this happens just from B->A, no firewall. lg Clemens Edit: Attached file deleted (content violates forum rules) Last edited by GregorK; January 10th, 2007 at 02:54 PM. |
|
January 10th, 2007
| |||
| |||
| Its seems out of what ever reason the download connection between the two is interrupted and the download restarts. Since the segment size is 16K this happens every 16K. Raising the default segment size and target time might help. You don't need small segments on LAN anyway. Download speed should be so high that you can easily use values above 1MB, and since you most likely only have one source segmentation, which enables swarming, is not necessary anyway. The other question is why Phex looses connection, or thinks at some point that it cant use persistent keep-alive connections.
__________________ |
|
| |
LinkBacks (?)
LinkBack to this Thread: https://www.gnutellaforums.com/feature-requests-bug-reports/65833-way-too-many-open-files.html | ||||
| Posted By | For | Type | Date | |
| Untitled document | This thread | Refback | November 4th, 2010 11:39 PM | |
|
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| can't open files | laura62 | Tips & Tricks | 1 | September 13th, 2005 02:14 PM |
| how to open .rar files ??? | busted81 | Tips & Tricks | 1 | December 1st, 2004 04:40 AM |
| i can't open my files...! | Meredith | General Mac Support | 0 | October 16th, 2002 10:21 AM |
| sit files. How do I open them? | Unregistered | Open Discussion topics | 1 | April 8th, 2002 01:18 PM |
| Can't open files | Unregistered | General Mac OSX Support | 0 | April 7th, 2002 11:15 AM |
hex.download.DownloadEngine@657c7b]
is in UploadEngine.java again. 
Linear Mode
