|
Title: Distributed file processing with bittorrent protocol Post by: spndr7 on December 30, 2010, 03:07:21 PM https://i.imgur.com/eptvL.gif
We propose distributed processing using bittorrent protocol .In this method we will divide the file to be processed into pieces and process each piece separately and distribute the processed pieces in the network till all the pieces are gathered .In this way bittorrent protocol may greatly help on distributed computing .Possible Applications --- 1.File compression 2.Media compression (Audio/video) 3.Analysis of Raw data Title: Re: Distributed file processing with bittorrent protcol Post by: spndr7 on December 30, 2010, 03:10:22 PM One of the evident application in case of audio/video processing it would be such that,after the p2p processing,2 files will be available for the new clients joing the p2p network .The will have choice between quality and file size of the media file .
Title: Re: Distributed file processing with bittorrent protcol Post by: Cdecker on December 30, 2010, 04:01:08 PM Looks to me like a Map/Reduce framework with the storage being replaced by Bitcoin. This will only work when the peers are highly trusted, or the results are easy to check.
If the peers cannot be trusted I could just take my slice and add advertisements or return garbage. Title: Re: Distributed file processing with bittorrent protcol Post by: spndr7 on December 31, 2010, 02:38:58 AM like share ratio there can be introduced a new concept of "process ratio",rate of supplying processed data with respect to the rate of input of unprocessed data.
Together share ratio and process ratio will help in identifying trusted peers just like in torrent network . Title: Re: Distributed file processing with bittorrent protocol Post by: spndr7 on January 01, 2011, 03:12:53 AM Even if each computer contributes 100MHz of clock processing then in a typical p2p swarm of a popular file there more than 1000 peers contributing more than 100 Ghz of of cumulative operating power .
The delay may be in piece transmission both raw and processed . Title: Re: Distributed file processing with bittorrent protocol Post by: spndr7 on April 09, 2011, 11:36:48 AM My college seminar report on Distributed file processing (http://www.fileden.com/files/2009/9/21/2581208//sipendra_final7.pdf)
Title: Re: Distributed file processing with bittorrent protocol Post by: spndr7 on April 09, 2011, 11:38:21 AM Please read if interested and give your views .
|
