Gnutella Forums  

Go Back   Gnutella Forums > Current Gnutella Client Forums > Phex (Cross-platform) > Development & Coding > Development Open Discussion
Register FAQ The Twelve Commandments Members List Calendar Arcade Find the Best VPN Today's Posts

Development Open Discussion Anything else about the Phex development


Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old April 7th, 2010
Apprentice
 
Join Date: October 3rd, 2008
Posts: 6
zageyiff is flying high
Default Features doubts

Hi all,

I've trying to find specific information about the features that Phex uses but I haven't been able to find anything.

* Which gnutella version is phex implementing. As I found there are different specification.

* Which search mecanism it uses. Looking at the source code I've found it uses Dynamic Queries, I just want to make sure here. And is it the only mechanism used?

* I've been looking for a way to do a hashcode search programatically using the phex source code. I haven't found anything, can anyone point me in the right direction.

* It would be great to have a firewall to firewall transfer, which I see is in the roadmap (http://www.phex.org/wiki/index.php/Roadmap). The question here is if there is an estimated time for when the development on this feature will start and how long will it take?
I see there's also a feature to support the limewire's mojito DHT which may help with the firewall to firewall transfer. Is there any estimated time for this as well?

* Is there a way that when bootstraping the phex client, it will find the clients in the local area network. I suppose it would by doing a multicast or broadcast in the network to identify which phex peers are on the same network. This will help in doing downloads faster if the file being wanted to download is within the same network.

* I have found some topics related to this. How would be the best way to manage fake results when these fakes constantly change their host or their sha1 hashcodes?

* Does phex have a limit handling large files?

* Are there any plans on implementing UPnP and NatPMP??
Reply With Quote
  #2 (permalink)  
Old April 8th, 2010
Phex Developer
 
Join Date: May 8th, 2001
Location: Stuttgart, Germany
Posts: 988
GregorK is flying high
Default

Quote:
Originally Posted by zageyiff View Post
* Which gnutella version is phex implementing. As I found there are different specification.
Phex is implementing the most current version, lets call it 0.6, and is additionally supporting a long list of protocol extension.

Quote:
Originally Posted by zageyiff View Post
* Which search mecanism it uses. Looking at the source code I've found it uses Dynamic Queries, I just want to make sure here. And is it the only mechanism used?
Yes it uses Dynamic Queries. Older search methods are not supported anymore.

Quote:
Originally Posted by zageyiff View Post
* I've been looking for a way to do a hashcode search programatically using the phex source code. I haven't found anything, can anyone point me in the right direction.
Phex supports hashcode queries, though they are not generally supported on the Gnutella network. You can assume that your hashcode searches wont return very satisfactory results, they will usually get dropped very fast.
Check out ResearchSettings.startSearch()

Quote:
Originally Posted by zageyiff View Post
* It would be great to have a firewall to firewall transfer, which I see is in the roadmap (http://www.phex.org/wiki/index.php/Roadmap). The question here is if there is an estimated time for when the development on this feature will start and how long will it take?
I see there's also a feature to support the limewire's mojito DHT which may help with the firewall to firewall transfer. Is there any estimated time for this as well?
We are looking for developers who would like to work on these topics. If you like to contribute you would be very welcome.

Quote:
Originally Posted by zageyiff View Post
* Is there a way that when bootstraping the phex client, it will find the clients in the local area network. I suppose it would by doing a multicast or broadcast in the network to identify which phex peers are on the same network. This will help in doing downloads faster if the file being wanted to download is within the same network.
Yes that would be a very nice feature. We have some ideas how we would like to improve local network support. Though we currently don't have the time and resources to work on this topic. Like already mentioned above, we would be happy to get help.

Quote:
Originally Posted by zageyiff View Post
* Does phex have a limit handling large files?
Yes: 2^63 - 1 bytes ~ 8 exabytes

Quote:
Originally Posted by zageyiff View Post
* Are there any plans on implementing UPnP and NatPMP??
Yes, once we found someone who would like to help.
__________________
Reply With Quote
  #3 (permalink)  
Old April 8th, 2010
arne_bab's Avatar
Draketo, small dragon.
 
Join Date: May 31st, 2002
Location: Heidelberg, Germany
Posts: 1,881
arne_bab is a great assister to others; your light through the dark tunnel
Default

Hi,

Welcome to the Gnutella Forums!

I’ll directly come to your questions:

* Phex implements Gnutella 0.6 with almost all extensions except the DHT.

* The search mechanism is dynamic querying on the requester side. Also it supports Query Routing (via QRT) on the forwarding part.

* Hash-searching can only be done efficiently using the DHT which isn’t yet implemented. So you can only search for the filename and then match the returned hashes.

* The RoadMap progressing slowly right now – job vs. hoppy.

* Currently Phex gets all download-sources via the download mesh. I don’t know if there are additions for local broadcasts. But it would be nice, I think.

* For fake files you can either check for some common names (i.e. weed out all *.qt files for they can phone home), check for the host and ban it (only works if the fake files are intended to be downloaded and not just an attack on the network structure) or implement something like credence for Phex: Credence: Thwarting P2P Pollution

* I don’t know a limit for the file size.

* See RoadMap info…

For what do you want to use it?

EDIT: Posting collision
__________________

-> put this banner into your own signature! <-
--
Erst im Spiel lebt der Mensch.
Nur ludantaj homoj vivas.
GnuFU.net - Gnutella For Users
Draketo.de - Shortstories, Poems, Music and strange Ideas.

Last edited by arne_bab; April 8th, 2010 at 11:13 PM.
Reply With Quote
  #4 (permalink)  
Old April 9th, 2010
Apprentice
 
Join Date: October 3rd, 2008
Posts: 6
zageyiff is flying high
Default

Thanks GregorK and arne_bab for the quick response.

I have more questions regarding the answers

Quote:
Originally Posted by GregorK View Post
Phex is implementing the most current version, lets call it 0.6, and is additionally supporting a long list of protocol extension.
Is there some place where I can check the list of these protocol extensions??

Quote:
Originally Posted by GregorK View Post
Yes it uses Dynamic Queries. Older search methods are not supported anymore.
Are there plans to improve the search mechanism, maybe by using some of the features of the called "Gnutella2" features or by the protocol modifications made by limewire?

Quote:
Originally Posted by GregorK View Post
Phex supports hashcode queries, though they are not generally supported on the Gnutella network. You can assume that your hashcode searches wont return very satisfactory results, they will usually get dropped very fast.
Check out ResearchSettings.startSearch()
Thanks to pointing on this direction, actually what I was looking for was to find more candidates to one download. And this method is called when you select search in the candidates table. I found the logic that if the search term is less than two characters it will include the urn in the query search, but I think using only the search term is better. Even phex handles automatically adding the candidates to the SWFownloadFile which is great.


Quote:
Originally Posted by GregorK View Post
We are looking for developers who would like to work on these topics. If you like to contribute you would be very welcome.
This would be good. We are actually two developers who are working with phex, and we have some basic knowledge of the mojito DHT. We would be glad to help here. We need to get more familiar with the source code and read more about mojito DHT. But surely we can help. Let me know how we can get an agreement here.

Quote:
Originally Posted by GregorK View Post
Yes that would be a very nice feature. We have some ideas how we would like to improve local network support. Though we currently don't have the time and resources to work on this topic. Like already mentioned above, we would be happy to get help.
We actually have seen something about these, and have seen some working code. Our doubt would be how to add those nodes into phex. We can help here as well, let me know.

Quote:
Originally Posted by GregorK View Post
Yes, once we found someone who would like to help.
I guess this have something to do with multicast as well, which I imagine would be the mechanism of the LAN discovery.

As a resume, we would be glad to help. I think there are two main topics here: mojito DHT and multicast.
About mojito DHT, it will be a task that will take time. Having this we can use it as base for the firewall-to-firewall.
About multicast, it will help with the LAN discovery and with the upnp and natpmp. Which I guess will be less time consuming than DHT

Quote:
Originally Posted by arne_bab View Post
* Hash-searching can only be done efficiently using the DHT which isn’t yet implemented. So you can only search for the filename and then match the returned hashes.
Yes we actually found the code that does what we wanted, thanks

Quote:
Originally Posted by arne_bab View Post
* Currently Phex gets all download-sources via the download mesh. I don’t know if there are additions for local broadcasts. But it would be nice, I think.
What do you mean by download mesh? I haven't heard about it.

Quote:
Originally Posted by arne_bab View Post
* For fake files you can either check for some common names (i.e. weed out all *.qt files for they can phone home), check for the host and ban it (only works if the fake files are intended to be downloaded and not just an attack on the network structure) or implement something like credence for Phex: Credence: Thwarting P2P Pollution
I took a look at the page you sent. Looks like and interesting program, but how well is it supported? Does it have a good user base so it's working as expected? Also I think they gathered the limewire's source code and modify it, so if we want to integrate into phex it will be hard.

Quote:
Originally Posted by arne_bab View Post
* See RoadMap info…
Actually I've done that it's just that I didn't see anything about it.

Quote:
Originally Posted by arne_bab View Post
For what do you want to use it?
We want to use it as a gnutella API. Basically for download audio files and do keyword searches.
Reply With Quote
  #5 (permalink)  
Old April 10th, 2010
arne_bab's Avatar
Draketo, small dragon.
 
Join Date: May 31st, 2002
Location: Heidelberg, Germany
Posts: 1,881
arne_bab is a great assister to others; your light through the dark tunnel
Default

Quote:
Originally Posted by zageyiff View Post
What do you mean by download mesh? I haven't heard about it.
The download mesh is an extension to http used by Gnutella. Basically all downloaders and uploaders exchange the sources they know (just like a completely decentral BitTorrent server).

The headers are X-Alt (IPs+ports of other down- and uploaders) and X-NAlt (non working IPs+ports for preventing spam and getting offline nodes out of the mesh).

As soon as you've seen a download going from 5 sources to 400 sources in half a minute, you know its efficiency

Quote:
I took a look at the page you sent. Looks like and interesting program, but how well is it supported?
Sadly it isn’t supported at all. It was implemented on top of LimeWire, but rejected by the limewire team. so it’s only a proof of concept (it worked quite well — at least for the tests I did back then).

This had the potential of stopping spam once and for all, so I thought it might interest you.

Quote:
Actually I've done that it's just that I didn't see anything about it.
I meant my info I wrote above — sorry for not being clearer.

Quote:
We want to use it as a gnutella API. Basically for download audio files and do keyword searches.
That’s great! http://groups.yahoo.com/group/the_gdf/message/23708

If I can do anything to help, please tell me. I’m no Java coder, but I have some background knowledge from supporting Phex users in here and discussing in the_gdf (the Gnutella development forum).

The current discussion in the GDF might also be interesting to you: More intelligent searches via a GGEP extension: "a AND (b OR c)"

the_gdf : The Gnutella Developer Forum (GDF)
Yahoo! Groups
__________________

-> put this banner into your own signature! <-
--
Erst im Spiel lebt der Mensch.
Nur ludantaj homoj vivas.
GnuFU.net - Gnutella For Users
Draketo.de - Shortstories, Poems, Music and strange Ideas.
Reply With Quote
Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -7. The time now is 01:06 PM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
SEO by vBSEO 3.6.0 ©2011, Crawlability, Inc.

Copyright © 2020 Gnutella Forums.
All Rights Reserved.