Distributed file processing with bittorrent protocol

[spndr7]

We propose distributed processing using bittorrent protocol
.In this method we will divide the file to be processed into pieces and process each piece separately and distribute the processed pieces in the network till all the pieces are gathered .In this way bittorrent protocol may greatly help on distributed computing .Possible Applications ---

1.File compression

2.Media compression
  (Audio/video)

3.Analysis of Raw data

[1715003197]

1715003197

[1715003197]

1715003197

[1715003197]

1715003197

[1715003197]

1715003197

[spndr7]

One of the evident application in case of audio/video processing it would be such that,after the p2p processing,2 files will be available for the new clients joing the p2p network .The will have choice between quality and file size of the media file .

[Cdecker]

Looks to me like a Map/Reduce framework with the storage being replaced by Bitcoin. This will only work when the peers are highly trusted, or the results are easy to check.

If the peers cannot be trusted I could just take my slice and add advertisements or return garbage.

[spndr7]

like share ratio there can be introduced a new concept of "process ratio",rate of supplying processed data with respect to the rate of input of unprocessed data.

Together share ratio and process ratio will help in identifying  trusted peers just like in torrent network .

[spndr7]

Even if each computer contributes 100MHz of clock processing then in a typical p2p swarm of a  popular file there more than 1000 peers contributing more than 100 Ghz of of cumulative operating power .

The delay may be in piece transmission both raw and processed .

[spndr7]

My college seminar report on Distributed file processing

[spndr7]

Please read if interested and give your views .