CPU leak

Manifest0 · #1 (**permalink**) March 15th, 2007

Greetings!

Today, phex started to eating my CPU... it's on 100%!

Code:

[me@laptop:~]$ top

top - 21:35:18 up  2:16,  0 users,  load average: 10.28, 9.61, 8.25
Tasks:  90 total,   3 running,  86 sleeping,   0 stopped,   1 zombie
Cpu(s): 82.7%us, 10.0%sy,  0.0%ni,  0.0%id,  5.3%wa,  1.0%hi,  1.0%si,  0.0%st
Mem:   1035568k total,  1018552k used,    17016k free,    83060k buffers
Swap:   522072k total,        0k used,   522072k free,   444792k cached

PID     USER   PR  NI  VIRT   RES     SHR S  %CPU %MEM    TIME+  COMMAND                                                                                         
17270  me     18   0  333m  148m  15m S   73.7    14.7       15:30.91 java                                                                                            
4881    root    15   0  317m  40m    17m S   17.2    4.0         6:21.38                     X  

....



[me@laptop:~]$ ps xua
USER PID      %CPU  %MEM    VSZ     RSS         TTY      STAT START   TIME COMMAND
.....
me    10109  0.0       1.4       65472   14500        ?         Ssl    19:52     0:06       thunar /home/me
me    14880  0.3       2.3       41592   24112        ?         Ss     20:03      0:17     gaim
me    16553  0.1       0.0       0           0                ?         Z       20:49      0:03     [file-roller] <defunct>
me    17269  0.0       0.1       4464     1332          ?         Ss     21:16       0:00           /bin/sh /usr/bin/phex
me    17270 82.1      14.7     342864 152696      ?         Sl      21:16      16:42   java -jar /usr/share/java/phex/phex.jar
me    17836  0.1       1.2       23152   12964        ?          S      21:23      0:01 terminal
me    17837  0.0       0.0       2576     532            ?          S      21:23      0:00 gnome-pty-helper
me    17838  0.0       0.1       4812     1760          pts/0    Ss     21:23     0:00        bash
me    18365  0.0       0.1       4816     1692          pts/1    Ss     21:36     0:00        bash
me    18370  0.0       0.0       3848     956            pts/1    R+    21:36     0:00          ps xua



[me@laptop:~]$ java -version
java version "1.6.0"
Java(TM) SE Runtime Environment (build 1.6.0-b105)
Java HotSpot(TM) Client VM (build 1.6.0-b105, mixed mode, sharing)

[me@laptop:~]$ cat phex.log
070315 20:05:20,0309(100) Error/GLOBAL:: Uncaught exception: null in Thread: AWT-EventQueue-0 - Exception: java.lang.NullPointerException
	at phex.query.BrowseHostResults.getProgress(Unknown Source)
	at phex.query.Search.getProgressObj(Unknown Source)
	at phex.gui.tabs.search.SearchListTableModel.getValueAt(Unknown Source)
	at phex.gui.common.table.FWSortedTableModel.getValueAt(Unknown Source)
	at javax.swing.JTable.getValueAt(JTable.java:2652)
	at javax.swing.JTable.prepareRenderer(JTable.java:5666)
	at javax.swing.plaf.basic.BasicTableUI.paintCell(BasicTableUI.java:2067)
	at javax.swing.plaf.basic.BasicTableUI.paintCells(BasicTableUI.java:1969)
	at javax.swing.plaf.basic.BasicTableUI.paint(BasicTableUI.java:1765)
	at javax.swing.plaf.ComponentUI.update(ComponentUI.java:143)
	at javax.swing.JComponent.paintComponent(JComponent.java:758)
	at javax.swing.JComponent.paint(JComponent.java:1022)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JViewport.paint(JViewport.java:747)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JSplitPane.paintChildren(JSplitPane.java:1026)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JLayeredPane.paint(JLayeredPane.java:564)
	at javax.swing.JComponent.paintChildren(JComponent.java:859)
	at javax.swing.JComponent.paint(JComponent.java:1031)
	at javax.swing.JComponent.paintToOffscreen(JComponent.java:5104)
	at javax.swing.BufferStrategyPaintManager.paint(BufferStrategyPaintManager.java:285)
	at javax.swing.RepaintManager.paint(RepaintManager.java:1132)
	at javax.swing.JComponent._paintImmediately(JComponent.java:5052)
	at javax.swing.JComponent.paintImmediately(JComponent.java:4862)
	at javax.swing.RepaintManager.paintDirtyRegions(RepaintManager.java:727)
	at javax.swing.RepaintManager.paintDirtyRegions(RepaintManager.java:683)
	at javax.swing.RepaintManager.seqPaintDirtyRegions(RepaintManager.java:663)
	at javax.swing.SystemEventQueueUtilities$ComponentWorkRequest.run(SystemEventQueueUtilities.java:128)
	at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:209)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:597)
	at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:273)
	at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:183)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:173)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:168)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:160)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:121)

070315 20:05:28,0590(100) Error/GLOBAL:: Uncaught exception: null in Thread: AWT-EventQueue-0 - Exception: java.lang.NullPointerException
	at phex.gui.tabs.search.SearchVisualizer.visualizeSearchStatus(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.updateDisplay(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.cp.SearchControlPanel.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.SearchTab.setDisplayedSearch(Unknown Source)
	at phex.gui.actions.GUIActionPerformer.browseHost(Unknown Source)
	at phex.gui.tabs.network.NetworkTab$BrowseHostAction.actionPerformed(Unknown Source)
	at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1995)
	at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2318)
	at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
	at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
	at javax.swing.AbstractButton.doClick(AbstractButton.java:357)
	at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:1170)
	at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:1211)
	at java.awt.Component.processMouseEvent(Component.java:6038)
	at javax.swing.JComponent.processMouseEvent(JComponent.java:3260)
	at java.awt.Component.processEvent(Component.java:5803)
	at java.awt.Container.processEvent(Container.java:2058)
	at java.awt.Component.dispatchEventImpl(Component.java:4410)
	at java.awt.Container.dispatchEventImpl(Container.java:2116)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4322)
	at java.awt.LightweightDispatcher.processMouseEvent(Container.java:3986)
	at java.awt.LightweightDispatcher.dispatchEvent(Container.java:3916)
	at java.awt.Container.dispatchEventImpl(Container.java:2102)
	at java.awt.Window.dispatchEventImpl(Window.java:2429)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:599)
	at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:273)
	at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:183)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:173)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:168)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:160)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:121)

070315 20:05:37,0643(100) Error/GLOBAL:: Uncaught exception: null in Thread: AWT-EventQueue-0 - Exception: java.lang.NullPointerException
	at phex.gui.tabs.search.SearchVisualizer.visualizeSearchStatus(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.updateDisplay(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.cp.SearchControlPanel.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.SearchTab.setDisplayedSearch(Unknown Source)
	at phex.gui.actions.GUIActionPerformer.browseHost(Unknown Source)
	at phex.gui.tabs.network.NetworkTab$BrowseHostAction.actionPerformed(Unknown Source)
	at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1995)
	at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2318)
	at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
	at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
	at javax.swing.AbstractButton.doClick(AbstractButton.java:357)
	at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:1170)
	at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:1211)
	at java.awt.Component.processMouseEvent(Component.java:6038)
	at javax.swing.JComponent.processMouseEvent(JComponent.java:3260)
	at java.awt.Component.processEvent(Component.java:5803)
	at java.awt.Container.processEvent(Container.java:2058)
	at java.awt.Component.dispatchEventImpl(Component.java:4410)
	at java.awt.Container.dispatchEventImpl(Container.java:2116)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4322)
	at java.awt.LightweightDispatcher.processMouseEvent(Container.java:3986)
	at java.awt.LightweightDispatcher.dispatchEvent(Container.java:3916)
	at java.awt.Container.dispatchEventImpl(Container.java:2102)
	at java.awt.Window.dispatchEventImpl(Window.java:2429)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:599)
	at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:273)
	at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:183)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:173)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:168)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:160)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:121)

070315 20:08:19,0578(100) Error/OUT_CONNECTION:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space
	at java.util.Arrays.copyOf(Arrays.java:2786)
	at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
	at phex.utils.IOUtil.inflate(Unknown Source)
	at phex.common.QueryRoutingTable.updateRouteTable(Unknown Source)
	at phex.msg.MessageDispatcher.handleRouteTableUpdate(Unknown Source)
	at phex.connection.ConnectionEngine.processIncomingData(Unknown Source)
	at phex.connection.OutgoingConnectionDispatcher.connectToNextCaughtHost(Unknown Source)
	at phex.connection.OutgoingConnectionDispatcher.run(Unknown Source)
	at phex.common.ThreadPool$Worker.run(Unknown Source)

070315 20:08:30,0246(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space
	at java.lang.AbstractStringBuilder.<init>(AbstractStringBuilder.java:45)
	at java.lang.StringBuffer.<init>(StringBuffer.java:91)
	at phex.download.RemoteFile.buildDisplayName(Unknown Source)
	at phex.download.RemoteFile.<init>(Unknown Source)
	at phex.query.BrowseHostResults.processResponse(Unknown Source)
	at phex.connection.BrowseHostConnection.sendBrowseHostRequest(Unknown Source)
	at phex.query.BrowseHostResults*****run(Unknown Source)
	at phex.common.ThreadPool$Worker.run(Unknown Source)

070315 20:08:34,0962(100) Error/GLOBAL:: Uncaught exception: Java heap space in Thread: BrowseHostConnection-571cc4-Wdd7404 - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:08:32,0979(100) Error/OUT_CONNECTION:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space
	at phex.share.SharedFilesService.getSharedFiles(Unknown Source)
	at phex.share.ShareManager.handleQuery(Unknown Source)
	at phex.msg.MessageDispatcher.handleQuery(Unknown Source)
	at phex.connection.ConnectionEngine.processIncomingData(Unknown Source)
	at phex.connection.OutgoingConnectionDispatcher.connectToNextCaughtHost(Unknown Source)
	at phex.connection.OutgoingConnectionDispatcher.run(Unknown Source)
	at phex.common.ThreadPool$Worker.run(Unknown Source)

070315 20:08:38,0824(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:08:40,0787(100) Error/GLOBAL:: Uncaught exception: Java heap space in Thread: OutgoingConnectionDispatcher-12a66ea-W5ead9d - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:08:30,0889(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space
	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:39)
	at java.nio.ByteBuffer.allocate(ByteBuffer.java:312)
	at sun.nio.cs.StreamEncoder.<init>(StreamEncoder.java:176)
	at sun.nio.cs.StreamEncoder.<init>(StreamEncoder.java:156)
	at sun.nio.cs.StreamEncoder.forOutputStreamWriter(StreamEncoder.java:40)
	at java.io.OutputStreamWriter.<init>(OutputStreamWriter.java:94)
	at java.io.FileWriter.<init>(FileWriter.java:61)
	at phex.utils.PhexLogger.writeLogMessage(Unknown Source)
	at phex.utils.PhexLogger.error(Unknown Source)
	at phex.utils.NLogger.error(Unknown Source)
	at phex.connection.OutgoingConnectionDispatcher.run(Unknown Source)
	at phex.common.ThreadPool$Worker.run(Unknown Source)

070315 20:09:12,0724(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:12:23,0425(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:13:05,0382(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:13:50,0731(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:14:21,0261(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:14:55,0208(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:15:25,0009(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space

070315 20:15:50,0959(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
	at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
	at phex.connection.PingWorker.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:619)

070315 20:15:50,0960(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
	at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
	at phex.connection.PingWorker.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:619)

070315 20:17:28,0374(100) Error/GLOBAL:: Uncaught exception: null in Thread: AWT-EventQueue-0 - Exception: java.lang.NullPointerException
	at phex.gui.tabs.search.SearchVisualizer.visualizeSearchStatus(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.updateDisplay(Unknown Source)
	at phex.gui.tabs.search.cp.SearchInfoBox.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.cp.SearchControlPanel.setDisplayedSearch(Unknown Source)
	at phex.gui.tabs.search.SearchTab.setDisplayedSearch(Unknown Source)
	at phex.gui.actions.GUIActionPerformer.browseHost(Unknown Source)
	at phex.gui.tabs.network.NetworkTab$BrowseHostAction.actionPerformed(Unknown Source)
	at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1995)
	at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2318)
	at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
	at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
	at javax.swing.AbstractButton.doClick(AbstractButton.java:357)
	at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:1170)
	at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:1211)
	at java.awt.Component.processMouseEvent(Component.java:6038)
	at javax.swing.JComponent.processMouseEvent(JComponent.java:3260)
	at java.awt.Component.processEvent(Component.java:5803)
	at java.awt.Container.processEvent(Container.java:2058)
	at java.awt.Component.dispatchEventImpl(Component.java:4410)
	at java.awt.Container.dispatchEventImpl(Container.java:2116)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4322)
	at java.awt.LightweightDispatcher.processMouseEvent(Container.java:3986)
	at java.awt.LightweightDispatcher.dispatchEvent(Container.java:3916)
	at java.awt.Container.dispatchEventImpl(Container.java:2102)
	at java.awt.Window.dispatchEventImpl(Window.java:2429)
	at java.awt.Component.dispatchEvent(Component.java:4240)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:599)
	at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:273)
	at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:183)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:173)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:168)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:160)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:121)

070315 21:11:00,0841(100) Error/GLOBAL:: java.lang.OutOfMemoryError: Java heap space - Exception: java.lang.OutOfMemoryError: Java heap space
	at java.util.HashMap.resize(HashMap.java:462)
	at java.util.HashMap.addEntry(HashMap.java:755)
	at java.util.HashMap.put(HashMap.java:385)
	at java.util.HashSet.add(HashSet.java:200)
	at phex.common.QueryRoutingTable.createLocalQueryRoutingTable(Unknown Source)
	at phex.msg.MsgManager.updateLocalQueryRoutingTable(Unknown Source)
	at phex.msg.MsgManager$QRPUpdateTimer.sendQueryRoutingTable(Unknown Source)
	at phex.msg.MsgManager$QRPUpdateTimer.run(Unknown Source)
	at java.util.TimerThread.mainLoop(Timer.java:512)
	at java.util.TimerThread.run(Timer.java:462)

070315 21:52:33,0121(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
	at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
	at phex.connection.PingWorker.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:619)

070315 21:52:33,0122(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
	at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
	at phex.connection.PingWorker.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:619)




And Finally:
[me@laptop:~]$ cat phex.error.log 
070315 21:52:33,0121(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
        at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
        at phex.connection.PingWorker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:619)

070315 21:52:33,0122(100) Error/GLOBAL:: Uncaught exception: null in Thread: PingWorker-1ad77a7 - Exception: java.lang.NullPointerException
        at phex.msg.MsgManager.broadcastPingHosts(Unknown Source)
        at phex.connection.PingWorker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:619)

Sorry about the long post...

Best regards,

Manifest0

GregorK · #2 (**permalink**) March 15th, 2007

Looks like you ran into a memory leak. How long was your phex running?
At least a day I assume?

Can you tell us some numbers? How many files are you sharing, how many downloads are running, how many network connections did you configure?

Manifest0 · #3 (**permalink**) March 15th, 2007

Greetings

Quote:

Originally Posted by GregorK

Looks like you ran into a memory leak. How long was your phex running?
At least a day I assume?

I runned phex for about 2 hours in the morning, and it was fine. Now everytime i use phex this is happening...

EDIT: I forgot to say some concrete number: 30 min.

Quote:

Originally Posted by GregorK

Can you tell us some numbers? How many files are you sharing, how many downloads are running, how many network connections did you configure?

Well i don't know the number of files i'm sharing, but it's a lot:
36.5 GB! (It's all Creative Commons, including some friend's music, linux software, and some academic papers!

)
I think that every file has the sha1 sum calculated (I'm not 100% sure, but at least 99%, because every file i look in the library tab has the sha1 calculated. )
I'm downloading 15 files. (But i've them stopped, so i'm not downloading anything)

Network settings:
Max concurrent connections: 50 (this is 50, but i've never had more than 16)
Allow to became an ultrapeer: checked (true)
Force to be an ultrapeer: checked (true)
Connections to ultrapeers: 99
Connections to leaves: 99

Connection settings:
Max download connections global: 27
Max downloads connections per file: 16

Just in case i miss something:

Code:

[me@laptop:~/.phex]$ cat phexCorePrefs.properties
#Phex Preferences
#Thu Mar 15 22:05:30 WET 2007
Bandwidth.MaxUploadBandwidth=17787
Bandwidth.NetworkSpeedKbps=1544
Connection.AutoConnectOnStartup=false
Connection.ForceToBeUltrapeer=true
Connection.Up2LeafConnections=99
Connection.Up2UpConnections=99
Download.AutoRemoveCompleted=true
Download.DestinationDirectory=/home/me/Downloads/p2p
Download.IncompleteDirectory=/home/me/Downloads/Incomplete
Download.MaxWorkerPerDownload=16
Download.MaxWriteBufferPerDownload=131072
Library.LibraryExclusionRegExList[L\:0]='*.txt'

.....

Network.ListeningPort=7840
Network.MaxHostInHostCache=1000
Network.NetworkHistory[L\:0]=Turbo
Network.ServentGuid=2A9105FB14B265E6FFAB54AAF82ABC00
Network.TcpConnectTimeout=60000
Statistic.FractionalUptime=0.12708415
Statistic.LastShutdownTime=1173996330250
Statistic.MaximalUptime=32280005
Statistic.MovingTotalUptime=126029216
Statistic.MovingTotalUptimeCount=25
Statistic.SearchHistoryLength=32
Statistic.TotalDownloadCount=107
Statistic.TotalStartupCounter=85
Statistic.TotalUploadCount=1848
Subscription.SubscriptionMagnets[L\:0]=magnet\:?xs\=http\://draketo.de/magma/polar-skulk/polar-skulk.magma&dn\=Polar_Skulk.magma
Update.LastBetaUpdateCheckVersion=2.1.8.82
Update.LastUpdateCheckTime=1173781225071
Update.LastUpdateCheckVersion=3.0.2.100
Update.RunningBuildNumber=100
Update.RunningPhexVersion=3.0.2

Code:

[me@laptop:~/.phex]$ cat phex.bk
#PHEX Config Values
#Tue Jan 30 03:45:56 WET 2007
allowToBecomeLeaf=true
allowToBecomeUP=true
allowUploadQueuing=true
arePartialFilesShared=true
autoReadoutDownloadedMagma=true
connectedToLAN=true
copyBeforePreviewing=true
downloadCandidateLogBufferSize=0
enableHitSnooping=true
fallbackPreviewMethod=
forceToBeUltrapeer=false
forceUPConnections=true
fractionalUptime=0.009211289696395397
freeloaderFiles=0
freeloaderShareSize=0
hasConnectedIncomming=false
hostErrorDisplayTime=1000
httpProxyHost=
httpProxyPort=80
incompleteDir=/home/me/Downloads/Incomplete
initialSegmentSize=16384
isChatEnabled=true
isDeflateConnectionAccepted=true
isHttpProxyUsed=false
isNoVendorNodeDisconnected=false
lastBetaUpdateCheckVersion=0
lastShownUpdateInfoId=0
lastShutdownTime=1170128751695
lastUpdateCheckTime=1169691446603
lastUpdateCheckVersion=3.0.0.99
leaf2peerConnections=0
leaf2upConnections=5
logType=1
loggerVerboseLevel=6
mAutoCleanup=true
mAutoConnect=true
mAutoJoin=true
mCurrentNetwork=<General Gnutella Network>
mDisconnectApplyPolicy=false
mDisconnectDropRatio=70
mDownloadAutoRemoveCompleted=false
mDownloadDir=/home/me/Downloads/p2p
mDownloadMaxBandwidth=2147483647
mFindDown=true
mFindMatchCase=false
mFindText=
mListeningPort=7840
mMaxUpload=4
mMaxUploadPerIP=1
mMyIP=
mNetConnectionTimeout=8000
mNetMaxHostToCatch=1000
mNetMaxRate=2147483647
mNetMaxSendQueue=500
mProgramClientID=2A9105FB14B265E6FFAB54AAF82ABC00
mProxyHost=
mProxyPassword=
mProxyPort=1080
mProxyUse=false
mProxyUserName=
mPushTransferTimeout=30000
mSearchMaxConcurrent=10
mSh*****owseDir=true
mUIDisplayTooltip=true
mUploadAutoRemoveCompleted=false
mUploadDir=
mUploadFileExclusions=
mUploadFileInclusions=*
mUploadMaxBandwidth=11469
mUploadMaxSearch=64
maxConcurrentConnectAttempts=50
maxConnectToHistorySize=10
maxDownloadsPerIP=1
maxMessageLength=65536
maxNetworkTTL=7
maxSearchTermHistorySize=10
maxTotalBandwidth=16384
maxTotalDownloadWorker=27
maxUploadQueuePollTime=120
maxUploadQueueSize=10
maxWorkerPerDownload=9
maximalUptime=5570989
maximumSegmentSize=10485760
minUploadQueuePollTime=45
minimizeToBackground=false
minimumAllowedTransferRate=1
monitorSearchHistory=true
movingTotalUptime=5570989
movingTotalUptimeCount=1
networkSpeedKbps=256
offlineConnectionFailureCount=100
openFilesLimit=0
otherOsAudioCommand=xterm -e mplayer %filepath%
otherOsBrowserCommand=mozilla -remote openURL(%filepath%,new-window)
otherOsImageCommand=ee %filepath%
otherOsVideoCommand=xterm -e mplayer %filepath%
peerConnections=4
runningBuildNumber=97
runningPhexVersion=2.8.8
searchHistoryLength=10
searchMonitorFile=
searchRetryTimeout=30000

....

segmentMultiple=4096
segmentTransferTime=90
showBetaUpdateNotification=true
showCloseOptionsDialog=true
socketConnectTimeout=60000
socketRWTimeout=60000
subscriptionMagnets_1=magnet\:?xs\=http\://draketo.de/magma/polar-skulk/polar-skulk.magma&dn\=Polar_Skulk.magma
thexCalculationMode=2
totalDownloadCount=5
totalStartupCounter=2
totalUploadCount=0
ttl=7
up2leafConnections=31
up2peerConnections=0
up2upConnections=32
uploadStateLogBufferSize=0
urnCalculationMode=2
useProxyAuthentication=false
usedLocale=en_US

Well I guess it's all!

Best regards,

Manifest0

GregorK · #4 (**permalink**) March 15th, 2007

Ok... some tuning tips

'Max concurrent connections' setting is fine. On Linux a limit on this value is not really necessary, values over 20 or 30 are more then fine.. 99 should be no problem either.
You should limit your 'Connections to ultrapeers', 32 is the default and good. More will result in heavy bandwidth use, I would not go over 40 or 45...
Your value of 'Connections to leaves' is very high also, 30 is the default, higher values cause a slight bandwidth increase but also higher us of system resources.

Raising 'Max download connections global' and 'Max downloads connections per file' will speed up downloads dramatically. If your memory and CPU can handle it (most systems today should easily) a global of 99 and per file of 30-70 will reveal the full Phex download power.

Try to reduce the number of shared files. Offering high number of shared files increases CPU use. Together with your high connection settings your Phex node was likely flooded with many queries from all the connected nodes and had a hard time going through all the shared files to identify and return query results.

The file phex.bk can be deleted it is not used anymore.

Hope that helps.

Manifest0 · #5 (**permalink**) March 15th, 2007

Thanks for the tips!
I've made the changes and then looked to see what happened... And changing the settings options didn't make any difference on the CPU load, instead removing some files worked!

p.s.: I've found a way to count the number of files:

Code:

$ du -ha dir | wc -l

and the number of files i removed was 12971!

This is somehow ironic, since gnutella is for sharing!

Thanks for the amazing support!

Manifest0

arne_bab · #6 (**permalink**) March 16th, 2007

If you share very many files, Phex has to check them all everytime a search requests comes in, and with your high connection setting, you'll get very many request each sec.

If you want to keep sharing all files, you could check, if Phex can manage your share, if you have only 32 connections to Ultrapeers.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
memory leak in 4.0.8 pro	Gerard	General Mac OSX Support	4	January 25th, 2005 08:00 PM
memory leak in 4.08 pro?	Gerard	Open Discussion topics	4	August 21st, 2004 10:46 AM
Memory Leak	Jordan	General Discussion	10	January 22nd, 2003 07:06 PM
2.3 leak?	Unregistered	General Linux Support	6	April 14th, 2002 02:05 PM
Mem leak	Unregistered	User Experience	2	September 24th, 2001 04:58 AM