Thread: Heavy disc load
View Single Post
  #9 (permalink)  
Old June 8th, 2023
kermithermos kermithermos is offline
Disciple
 
Join Date: May 18th, 2023
Posts: 19
kermithermos is a great assister to others; your light through the dark tunnel
Default

Yes you are right its only one tread, I thought there were several for each file.

I interpreted these kind of lines wrong ...

Code:
...
230608 15:13:09.432(T684351)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.432(T684351)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.432(T684351)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.443(T684362)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.443(T684362)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.443(T684362)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.455(T684374)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.455(T684374)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.455(T684374)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.466(T684385)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.466(T684385)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.466(T684385)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.477(T684396)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.477(T684396)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
230608 15:13:09.477(T684396)(156) DEBUG/phex.download.DownloadDataWriter [SWDownloadWorker-55a0eb24-PhexPool-thread-15]:: Triggering write cycle.
...
... as different threads but the thread number 15 is always the same.

I tested your new version.
Now my settings for buffer size are correctly used and/or the logger handles displays it right now. Buffers are flushed about 90% and it is more or less identical with the output from iotop. Great!

Code:
230608 15:15:22.334(T817253)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 5242880 bytes.
230608 15:15:22.334(T817253)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total data written was: 5242880 bytes.
230608 15:15:22.334(T817253)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Time for complete write cycle.
230608 15:15:22.334(T817253)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: MaxWriteBufferPerDownload 4718592 - MaxTotalDownloadWriteBuffer 37748736
230608 15:15:22.334(T817253)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@585a9eb3, amount: 3895740 bytes.
230608 15:15:28.572(T823491)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 3895740 bytes.
230608 15:15:28.572(T823491)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total data written was: 3895740 bytes.
230608 15:15:28.572(T823491)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230608 15:15:41.018(T835937)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230608 15:15:41.018(T835937)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: MaxWriteBufferPerDownload 4718592 - MaxTotalDownloadWriteBuffer 37748736
230608 15:15:41.018(T835937)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 3263005 bytes.
230608 15:15:41.018(T835937)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: No data was written
230608 15:15:41.018(T835937)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230608 15:15:51.284(T846203)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230608 15:15:51.285(T846204)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: MaxWriteBufferPerDownload 4718592 - MaxTotalDownloadWriteBuffer 37748736
230608 15:15:51.285(T846204)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 3263005 bytes.
230608 15:15:51.285(T846204)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: No data was written
230608 15:15:51.285(T846204)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230608 15:16:15.839(T870758)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230608 15:16:15.839(T870758)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: MaxWriteBufferPerDownload 4718592 - MaxTotalDownloadWriteBuffer 37748736
230608 15:16:15.839(T870758)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 4344349 bytes.
230608 15:16:15.839(T870758)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: No data was written
230608 15:16:15.839(T870758)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
Reply With Quote