Bitcoin Forum

Bitcoin => Bitcoin Discussion => Topic started by: nvK on October 16, 2013, 12:56:13 PM



Title: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 12:56:13 PM
We have put this together as an experiment / proof of concept a few months ago.
BTCLook is a custom visualization of the entire blockchain, using the D3.js graphics library. To make things speedy we have the whole blockchain in REDIS (ie. in RAM).

I think we you will really like playing with it.
Just break the bubbles to expand.

Free to use :)

Some examples:
  • Example 1 of visualization  (http://btclook.com/txn/ee56b14eac26272dfb036e776254029014eea1005ea8aac874c33ef4dff87282#e3a2f916a1ab4c18962e8a5ef9931ed4de588a06309ce13eec3976bd1df8486a,7dd5ba5501eaa8156568b9732983c118a9094f5c82f692cc6d0595b51aeb6802,67b3d848209f9973764dd059ca8dec393f1db334033e30d4b3c8e4582248918a,8b6473e9601cd9d50d90e3718bd54d9bf9d70402556ae42b18987ed832133bd9,6a7d6d49c6f5e5785c0f83dc8312a6a9661befbd58b4e7562d687aa4109dddc2,e72eaf2071e6f221d0500ac71de5d3c9581b311dcb41de7298f413495ca3b1d7,0c7afe7a7d9a9ce95fbbae57fc8ab25b83787e698205e682b473769c497ffdfb,9e4070fb3244971a23eaa958de88df88d3d3a1689a927244fe8381ca9ede5804,7a250081bd766d94e7b4ac99dc3f22fd24d2506cbdf9304c74128299875e4edc,646b2e398057a5bd1a31325b8984b2dbc76e4cf8af87e9a58f6157da9a952789,c139c6d0dff5c34cfac1f2f7c4409798cbc00f1277a7d1a7b68796da1c2f9e7a,440199fe23e7752d70089f6245bace29053aca364a1c5824a0617e72e74aff9b)
  • Example of bitcointalk.org tip jar address  (http://btclook.com/addr/17RTTUAiiPqUTKtEggJPec8RxLMi2n9EZ9) click on transaction links on the right to visualize



Some notes:
  • Pubkeys with many transactions are not rendered for performance reasons.
  • Satoshi dice-related pubkeys make for complex ledgers! Some of those pubkeys have 100k+ transactions on them... We don't try too hard to show them all.
  • Testnet also available at testnet.btclook.com

Have fun!

Screenshot:

https://i.imgur.com/F1z48ww.png (http://btclook.com)



Our other project is coinkite.com more info here (https://bitcointalk.org/index.php?topic=309431.0)


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: hivewallet on October 16, 2013, 01:32:40 PM
Whoa, very cool! You guys are some real badasses!


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: kik1977 on October 16, 2013, 01:38:11 PM
That's awesome guys, thanks!

Is there a way to zoom in and out when you visualise transactions? When I follow a transaction, it happens it leads to regions outside of the screen and I'm not able to see them..

 


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 01:39:45 PM

Thanks!


That's awesome guys, thanks!

Is there a way to zoom in and out when you visualise transactions? When I follow a transaction, it happens it leads to regions outside of the screen and I'm not able to see them..

 

No, we had to slowdown developing features because we need to put time on Coinkite, when we have some time we have a whole bunch of stuff we want to add to it.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: TheEmperor on October 16, 2013, 01:44:58 PM
Quote

No, we had to slowdown developing features because we need to put time on Coinkite, when we have some time we have a whole bunch of stuff we want to add to it.

Will definitely be following this. A very cool idea and would love to see what additional features will be added in the future.  ;D


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 02:13:37 PM
Holy S@#$t lots of traffic.

If you get a few server hiccups just refresh.

PS, phones have a hard time rendering D3.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Mitchell on October 16, 2013, 02:19:36 PM
When I try to checkout my address / the bitcointalk.org tip jar  I keep getting this error:
Quote
Internal trouble fetching/understanding this ledger; sorry.
Truncated results. Only most recent entries shown (out of about 308)


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 02:20:06 PM
Whats the address?


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Mitchell on October 16, 2013, 02:20:32 PM
Whats the address?
1freekgtN1BGj5bjnyPo9p8kVrH2Hd6PJ

I refreshed a few time, but no luck :(
Edit: Aaand the server is down. Are you sure you have a strong enough server to handle this?
Edit2: Server is backup again.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 02:26:12 PM
Whats the address?
1freekgtN1BGj5bjnyPo9p8kVrH2Hd6PJ

I refreshed a few time, but no luck :(
Edit: Aaand the server is down. Are you sure you have a strong enough server to handle this?
Edit2: Server is backup again.

This box is just a proof of concept, not meant to be pounded by reddit.

Still looking into your address not been displayed.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Mitchell on October 16, 2013, 02:27:30 PM
Whats the address?
1freekgtN1BGj5bjnyPo9p8kVrH2Hd6PJ

I refreshed a few time, but no luck :(
Edit: Aaand the server is down. Are you sure you have a strong enough server to handle this?
Edit2: Server is backup again.

This box is just a proof of concept, not meant to be pounded by reddit.

Still looking into your address not been displayed.
Ah, I see. Well as you can see it's already popular (which is a good sign!) :P
No worries dude, take your time. Bugs can be a bitch to fix.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 02:36:16 PM
Whats the address?
1freekgtN1BGj5bjnyPo9p8kVrH2Hd6PJ

I refreshed a few time, but no luck :(
Edit: Aaand the server is down. Are you sure you have a strong enough server to handle this?
Edit2: Server is backup again.

This box is just a proof of concept, not meant to be pounded by reddit.

Still looking into your address not been displayed.
Ah, I see. Well as you can see it's already popular (which is a good sign!) :P
No worries dude, take your time. Bugs can be a bitch to fix.

Thanks, we gotta focus on the other site.
Issue noted.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: dserrano5 on October 16, 2013, 02:51:23 PM
FWIW I tried my address 12345Vypv2QSmuRXcciT5oEB27mPbWGeva and got this "Internal trouble fetching/understanding this ledger; sorry" too.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 16, 2013, 02:53:12 PM
FWIW I tried my address 12345Vypv2QSmuRXcciT5oEB27mPbWGeva and got this "Internal trouble fetching/understanding this ledger; sorry" too.

Noted, once traffic dies down a bit we will look into some of this issues.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 01:09:46 PM
FWIW I tried my address 12345Vypv2QSmuRXcciT5oEB27mPbWGeva and got this "Internal trouble fetching/understanding this ledger; sorry" too.


The address is in the DB, but the web worker cached the version before it had any activity.
It's an easy fix, but it's quite a bit of work, time we don't have right now.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Nancarrow on October 21, 2013, 02:33:03 PM
That's awesome guys, thanks!

Is there a way to zoom in and out when you visualise transactions? When I follow a transaction, it happens it leads to regions outside of the screen and I'm not able to see them..


It doesn't seem that you can zoom out or scroll away at the moment. But what you can do is click and drag on a transaction. You can move it around and it'll drag connecting transactions with it (and they wobble around prettily - some sort of energy-minimisation algorithm I take it?). That way you should still be able to follow transactions to your heart's content.

*My* problem is that it looks like I can enter transaction ids to make pretty bubbles with, but not addresses. Every time I try an address I get a table of transactions, but no bubbles. I WANT MY BUBBLES.  :'(


Never mind, I think I get it now. The bubbles are transactions, not addresses, so you can't really make a bubblegram from addresses. Once you have a transaction table for an address you can click on a transaction and see bubbles there. Mmmm, bubbles.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 02:34:31 PM
That's awesome guys, thanks!

Is there a way to zoom in and out when you visualise transactions? When I follow a transaction, it happens it leads to regions outside of the screen and I'm not able to see them..

 

It doesn't seem that you can zoom out or scroll away at the moment. But what you can do is click and drag on a transaction. You can move it around and it'll drag connecting transactions with it (and they wobble around prettily - some sort of energy-minimisation algorithm I take it?). That way you should still be able to follow transactions to your heart's content.

*My* problem is that it looks like I can enter transaction ids to make pretty bubbles with, but not addresses. Every time I try an address I get a table of transactions, but no bubbles. I WANT MY BUBBLES.  :'(


We like mo'bubbles too, but no time to add more features.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: e4xit on October 21, 2013, 02:45:43 PM
Neat work guys!

FWIW I too am having difficulty searching by address, but by transaction is fine!

Cool project though...  ;D


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: charleshoskinson on October 21, 2013, 03:24:46 PM
I've been trying to get around to using redis. Anything special?


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 08:39:18 PM
I've been trying to get around to using redis. Anything special?

Get ready to spend a lot of money on RAM.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 10:00:30 PM
Here is the alleged SR money moved.

http://btclook.com/txn/011c3ab10f8fcf815fe19ad1f44be47da372654c861a5b338dcb35aa4d094573


https://i.imgur.com/jdBfp85.png


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: charleshoskinson on October 21, 2013, 10:44:56 PM
i got 32 gb in my laptop. How much more would I need?


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 10:55:41 PM
i got 32 gb in my laptop. How much more would I need?

That would do.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: imrer on October 21, 2013, 11:13:27 PM
Amazing project! Are you planning to monetize it somehow?


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 11:14:48 PM
Amazing project! Are you planning to monetize it somehow?

That was for fun, we are doing Coinkite.com to pay bills


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Mitchell on October 21, 2013, 11:26:25 PM
Amazing project! Are you planning to monetize it somehow?

That was for fun, we are doing Coinkite.com to pay bills
Fun is one of the most important things while developing something. So doing things like this is always good :3


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: nvK on October 21, 2013, 11:31:36 PM
Amazing project! Are you planning to monetize it somehow?

That was for fun, we are doing Coinkite.com to pay bills
Fun is one of the most important things while developing something. So doing things like this is always good :3

Fun is one of the most important things while doing anything :)



All props to my biz partner Peter who put the BlockChain => REDIS together.
PS: he can't sign up for a new account, forum locked.


Title: Re: Entire Blockchain in REDIS Visualised With D3.js, Have Fun (BTCLook.com)
Post by: Mitchell on October 21, 2013, 11:34:39 PM
Amazing project! Are you planning to monetize it somehow?

That was for fun, we are doing Coinkite.com to pay bills
Fun is one of the most important things while developing something. So doing things like this is always good :3

Fun is one of the most important things while doing anything :)



All props to my biz partner Peter who put the BlockChain => REDIS together.
PS: he can't sign up for a new account, forum locked.
I agree with that! And he did a great job. I wish you (both) good luck with Coinkite!