Bitcoin Forum

Bitcoin => Pools => Topic started by: kinlo on April 28, 2012, 03:29:33 PM



Title: block origin, which pool mined that block?
Post by: kinlo on April 28, 2012, 03:29:33 PM
Hi,

Some time ago, I've created a site called blockorigin, to get a view on the pools that are mining blocks. 
The site has information about the last 2 weeks of blocks: every block is labeled with the pool that generated the block.
I've also created a ranking of pools, and a nice pie chart so you can visualize the pools.

I've never created some kind of official announcement of this project, so here it is.

The website is at http://blockorigin.pfoe.be


I'd like to invite everybody to have a look, and please, if you know of any pools that are not visible on this website, inform me so I can add that pool.  I'm currently still at 19% of unknown blocks, and would like to be as complete as possible.

Should any other features be interesting too, feel free to comment


Title: Re: block origin, which pool mined that block?
Post by: Graet on April 28, 2012, 03:38:50 PM
Nice work man :)
Been enjoying it for a while :D


Title: Re: block origin, which pool mined that block?
Post by: Fiyasko on April 28, 2012, 03:40:55 PM
Hey this is really cool!, *golfclap*
Thankyou goodsir!


Title: Re: block origin, which pool mined that block?
Post by: P4man on April 28, 2012, 03:48:39 PM
Nice job, very useful site. Thank you for your work.

If I may make one small suggestion, its to add percentages to the pie chart.

It would also be very interesting to see historical data and their trends, so you could see pools becoming more or less popular. So rather than a pie chart, you could show a line graph with one line per pool and show that pools % over time. Id love to see that.


Title: Re: block origin, which pool mined that block?
Post by: kinlo on April 28, 2012, 04:36:08 PM
If I may make one small suggestion, its to add percentages to the pie chart.
I've changed graph engine.  Is this better?

It would also be very interesting to see historical data and their trends, so you could see pools becoming more or less popular. So rather than a pie chart, you could show a line graph with one line per pool and show that pools % over time. Id love to see that.
That does seem to be very interesting to have.  I'll look into it


Title: Re: block origin, which pool mined that block?
Post by: DeathAndTaxes on April 28, 2012, 04:48:40 PM
It is nice to see Deepbit <30%.  Maybe someday DB will stabilize at ~25% and the top 3 combined will be <50%.


Title: Re: block origin, which pool mined that block?
Post by: Graet on April 28, 2012, 05:08:02 PM
If I may make one small suggestion, its to add percentages to the pie chart.
I've changed graph engine.  Is this better?
I think so and Ozcoin being in green matches our site theme  ;D
Well done


Title: Re: block origin, which pool mined that block?
Post by: Mousepotato on April 29, 2012, 07:42:03 PM
Pool hoppers rejoice!

Edit: Is there a delay on reporting?  MtRed found a new block 8 minutes ago but I haven't seen anything show up on BlockList yet.


Title: Re: block origin, which pool mined that block?
Post by: Sukrim on April 29, 2012, 09:01:42 PM
It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).


Title: Re: block origin, which pool mined that block?
Post by: eleuthria on April 29, 2012, 10:19:21 PM
It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).

It's limited usability for someone looking to hop with it.  But it does give "accurate" accounting of which pool mined which block.  Blockchain.info is normally pretty accurate, but it does occasionally misreport who mined a block.  Back when we had the 1tx mystery miner, it was completely skewing the results because they would relay their blocks through other pools (mostly Eligius, but sometimes Deepbit/Slush/BTC Guild), skewing the stats for those pools.

Obviously there's always a chance of a pool claiming blocks that they didn't mine, though that shouldn't occur too frequently (why would a pool claim blocks somebody else mined?).


Title: Re: block origin, which pool mined that block?
Post by: kinlo on April 29, 2012, 10:57:47 PM
Edit: Is there a delay on reporting?  MtRed found a new block 8 minutes ago but I haven't seen anything show up on BlockList yet.

Yes.  I can't really scrape every website after a block is found - pool operators would get angry with me :)
Besides, pools like deepbit delay their stats....


Title: Re: block origin, which pool mined that block?
Post by: kinlo on April 29, 2012, 10:59:06 PM
It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).

Actually, I've found it to shown some insight into "cheating" pool operators.  Look at ecki, they find a block from time to time, but their data is never correct - every time another pool found the same block - pools I know that are not incorrect...


Title: Re: block origin, which pool mined that block?
Post by: rjk on April 29, 2012, 11:28:38 PM
It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).

Actually, I've found it to shown some insight into "cheating" pool operators.  Look at ecki, they find a block from time to time, but their data is never correct - every time another pool found the same block - pools I know that are not incorrect...
How superbly interesting. Great site btw.


Title: Re: block origin, which pool mined that block?
Post by: DeathAndTaxes on April 30, 2012, 03:20:45 PM
What I would like to see is some standardized method for pools to mark origination IN the block.  The only disadvantage would be that gives hoppers accurate information to hop with but honestly prop pools should just die.  Slush is finally given up on the broken score method and going to DGM.  Other than Deepbit that leaves what 1 or 2 pools > 100 GH/s still using prop.

A method of strongly signing blocks would make accurate stats simple and cheatproof.  In time I expect all prop pools to die off.



Title: Re: block origin, which pool mined that block?
Post by: kinlo on April 30, 2012, 07:05:25 PM
What I would like to see is some standardized method for pools to mark origination IN the block.  The only disadvantage would be that gives hoppers accurate information to hop with but honestly prop pools should just die.  Slush is finally given up on the broken score method and going to DGM.  Other than Deepbit that leaves what 1 or 2 pools > 100 GH/s still using prop.

Note that many pools already mark the blocks.  This is not done with a digital signature - anyone can mine a block and put in such a marker from another pool, but nevertheless, many blocks are already traceable this way.

Currently blockorigin doesn't use this method, but I'm considering adding this in the future.

Pools known to mark their blocks are: eligius, triplemining, ozcoin, slush, BTC Guild, Eclipse MC, BitLC, nmcbit, bitclockers and mkalinin


Title: Re: block origin, which pool mined that block?
Post by: Red Emerald on April 30, 2012, 08:35:56 PM
Pools known to mark their blocks are: eligius, triplemining, ozcoin, slush, BTC Guild, Eclipse MC, BitLC, nmcbit, bitclockers and mkalinin
p2pool also marks their blocks with a special transaction.


Title: Re: block origin, which pool mined that block?
Post by: kinlo on July 25, 2012, 11:41:14 AM
We're currently down to about 15% of blocks unidentified.   

Who can help figuring out who found blocks such as blocks 190666, 190645, 190618 or 190617? Any assistance is greatly apreciated


Title: Re: block origin, which pool mined that block?
Post by: fireduck on August 07, 2012, 03:02:29 PM
192710 - hhtt (http://hhtt.1209k.com/)




Title: Re: block origin, which pool mined that block?
Post by: kinlo on August 08, 2012, 11:59:23 AM
192710 - hhtt (http://hhtt.1209k.com/)

Thanks, added pool to the website.


Title: Re: block origin, which pool mined that block?
Post by: eckmar on September 05, 2012, 12:14:43 PM
Hi Kinlo,

It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).

Actually, I've found it to shown some insight into "cheating" pool operators.  Look at ecki, they find a block from time to time, but their data is never correct - every time another pool found the same block - pools I know that are not incorrect...
Could you tell me please in a bit more details what "cheating" is ongoing in our pool?
(I am the operator of https://miner.ecki.net:444)

Do you consider in your chart that we are operating different pool-servers in Europe and Asia?
I would like to provide the IP addresses to you or whatever you need so that our pool is shown up correct in your static chart.

Sunny regards from holiday island Koh Samui (Thailand),
 Eckmar Eckel


Title: Re: block origin, which pool mined that block?
Post by: Graet on September 05, 2012, 03:23:35 PM
Hi Kinlo,

It's just a collection of website scrapers it seems, nothing that pool hoppers didn't have a year ago too... nice work nevertheless but of limited usability (and cheating pool operators won't be pointed out by this).

Actually, I've found it to shown some insight into "cheating" pool operators.  Look at ecki, they find a block from time to time, but their data is never correct - every time another pool found the same block - pools I know that are not incorrect...
Could you tell me please in a bit more details what "cheating" is ongoing in our pool?
(I am the operator of https://miner.ecki.net:444)

Do you consider in your chart that we are operating different pool-servers in Europe and Asia?
I would like to provide the IP addresses to you or whatever you need so that our pool is shown up correct in your static chart.

Sunny regards from holiday island Koh Samui (Thailand),
 Eckmar Eckel

https://bitcointalk.org/index.php?topic=66026.msg1161968#msg1161968
pretty much covers it
might be worth checking your software and announcing the correct blocks - this will help avoid this type of accusation confusion :)


Title: Re: block origin, which pool mined that block?
Post by: kinlo on September 05, 2012, 06:43:09 PM
Eckmar,

I should learn to write more clearly.  I don't claim you are cheating, I'm sure it is very well possible that you do find blocks when you say you do. However, the data you provide on your site is plain wrong.  Not being transparent about what your pool finds is usually an indication that you might be altering the list of blocks you find, but I currently have no proof that you are indeed cheating.

If I look at your site, on https://miner.ecki.net:444/blocks.php you claim that you found block 197,288.  However, exactly the same block number has been found by Deepbit.  Only one pool finds a certain block, it is not possible that 2 pools find the same block - if they do one of the blocks becomes an orphan/invalid block, and you wouldn't get any reward from it as it gets discarded by the network.

The problem with your pool is that almost every block you find has this problem, almost every time another pool found the same block number.   In other words, the block numbers you claim to have found on your site are plain wrong. 

I strongly recommend looking into it.  Also, please do NOT supply people the block number, although that number is informative, it is more useful to give the block hash, or generation hash for the blocks you find.  A simple listtransactions on your bitcoin client will give the generation hash for the blocks, and publishing that information will make sure that I have correct information, as calculating the block number is somewhat difficult, and implemented completely wrong on your site.

Please give me an URL where you publish the block hashes or block generation hashes, so I can have accurate information about your pool.

For more information do not hesitate to contact me on IRC (nick kinlo) or by sending a private message on this board.


Title: Re: block origin, which pool mined that block?
Post by: P4man on September 05, 2012, 07:40:15 PM
Graet linked to a discussion about this. The answer is provided by shadesofmarble here:
https://bitcointalk.org/index.php?topic=66026.msg1162121#msg1162121

Quote
Block numbers are off. Blocknumber+1 is the correct one. So just a bug in the pool software Smiley

IOW, Eckmar is reporting the wrong blockheight.


Title: Re: block origin, which pool mined that block?
Post by: eckmar on September 06, 2012, 01:46:11 AM
Hi Great,

...
https://bitcointalk.org/index.php?topic=66026.msg1161968#msg1161968
pretty much covers it
might be worth checking your software and announcing the correct blocks - this will help avoid this type of accusation confusion :)
Many thanks for this very helpful link.  :)

I will talk to the developer and we will fix this problem today.

Sunny regards from holiday island Koh Samui,
 Ecki


Title: Re: block origin, which pool mined that block?
Post by: eckmar on September 06, 2012, 02:11:44 AM
Hello kinlo,

...
I should learn to write more clearly.  I don't claim you are cheating, I'm sure it is very well possible that you do find blocks when you say you do. However, the data you provide on your site is plain wrong.  Not being transparent about what your pool finds is usually an indication that you might be altering the list of blocks you find, but I currently have no proof that you are indeed cheating.
...

...
Actually, I've found it to shown some insight into "cheating" pool operators.  Look at ecki, they find a block from time to time, but their data is never correct - every time another pool found the same block - pools I know that are not incorrect...

Well if you are talking public on a board end of April about "cheating pool operators" and mention our pool as an example, I think it would be at least fair if you would contact me by PM or Email and ask for explanation.
Do you agree?
Instead you are telling me about 4 months later: "I don't claim you are cheating."
Your end of April announcement sounds very different from your current statement to me.
May be you can rephrase it?
Please keep in mind that you can easily destroy reputation of a pool by stating that the pool operator is cheating!

I strongly recommend looking into it.  Also, please do NOT supply people the block number, although that number is informative, it is more useful to give the block hash, or generation hash for the blocks you find.  A simple listtransactions on your bitcoin client will give the generation hash for the blocks, and publishing that information will make sure that I have correct information, as calculating the block number is somewhat difficult, and implemented completely wrong on your site.
...
Well this "implemented completely wrong" looks to me that we just report the blocks which we found with +1, so the previous block should be ours.
I let the programmer fix this problem today.

Again, please give everybody the chance of feedback before you blame him in public "cheating" in future.
Thanks for that in advance.

Sunny regards from holiday island Koh Samui,
 Ecki

P.S.: Nevertheless I like your chart. Good work!

Edit 6.9.2012 13.00 h:
The original program code subtracts -1 from the block number (for no reason?), this bug has been fixed now in our current code.
Right now we are reworking all the block numbers in our database so that the "Last 30 Blocks Found" list should be correct in a few hours.


Title: Re: block origin, which pool mined that block?
Post by: kinlo on September 07, 2012, 02:21:10 PM
Hello kinlo,

Well if you are talking public on a board end of April about "cheating pool operators" and mention our pool as an example, I think it would be at least fair if you would contact me by PM or Email and ask for explanation.
Do you agree?

You are right, I hereby apologize for my behavior.  I did try to contact you on irc - Graet told me you came online under the nick Eckmar from time to time - but after several attempts to find you I totally forgot about it.  I should have made further attempts to contact you.  I hereby retract my comments about your pool.

Well this "implemented completely wrong" looks to me that we just report the blocks which we found with +1, so the previous block should be ours.
I let the programmer fix this problem today.

Well, once the number is wrong, it's hard to know what's going on on your pool.   Thanks for fixing it.

Can I ask again for links to blockexplorer using blockhashes or transaction hashes?  You can retrieve that information from your bitcoin client, and they are much more reliable - when a block becomes invalid my site will no longer link that block to your site.

P.S.: Nevertheless I like your chart. Good work!

Thanks!


Title: Re: block origin, which pool mined that block?
Post by: kinlo on September 07, 2012, 02:48:11 PM
And on a lighter note, we're below 10% of unknown blocks!

I still need everyone's help to figure out which pool found one of those unidentified blocks!

Should you know which pool mined blocks such as 197654, 197652 or 197650, or any other block that remains unknown on the blocklist at http://blockorigin.pfoe.be/blocklist.php, feel free to contact me so this site can be more accurate!


Title: Re: block origin, which pool mined that block?
Post by: eleuthria on March 04, 2013, 05:26:33 AM
Hi kinlo,
  I noticed blockorigin stopped recognizing blocks from BTC Guild.  Not quite sure why, nothing has changed software side other than moving some servers around.  All the blocks still contain either 'BTC Guild' or 'Mined by BTC Guild' somewhere in the coinbase message.  The last block identified as BTC Guild on blockorigin was #223477.  I'm not sure if any are missing before that, but none show up after it.


Title: Re: block origin, which pool mined that block?
Post by: kinlo on March 04, 2013, 03:17:37 PM
Hi eleuthria,

I noticed blockorigin stopped recognizing blocks from BTC Guild.  Not quite sure why, nothing has changed software side other than moving some servers around.

Actually, you gave me the url that I used on irc, and that one stopped working :)

In any case, the url has been updated, and it seems that it is working again.  Thanks for the update.


Title: Re: block origin, which pool mined that block?
Post by: eleuthria on March 04, 2013, 04:12:51 PM
Hi eleuthria,

I noticed blockorigin stopped recognizing blocks from BTC Guild.  Not quite sure why, nothing has changed software side other than moving some servers around.

Actually, you gave me the url that I used on irc, and that one stopped working :)

In any case, the url has been updated, and it seems that it is working again.  Thanks for the update.

Ah, sorry :).  It's been so long I don't remember giving out a URL, so I just assumed it was reading my coinbase flags.  Thanks for correcting it!


Title: Re: block origin, which pool mined that block?
Post by: kinlo on May 26, 2013, 05:54:53 PM
Added AsicMiner.  They have grown dangerously large....