x3m (OP)
Newbie
Offline
Activity: 23
Merit: 10
|
|
August 20, 2018, 01:28:02 PM |
|
AFAIK it all starts from importing a blockchain into a graph database, then you can start analyzing behavioral patterns, relations between addresses, ... Does anyone know where can I get further info regarding this subject? What will be the impact of this analysis with the rise of LN, sidechains and other anonymity solutions? Thanks.
|
|
|
|
|
|
|
|
|
Remember that Bitcoin is still beta software. Don't put all of your money into BTC!
|
|
|
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
|
|
TheArchaeologist
|
|
August 20, 2018, 01:43:43 PM |
|
AFAIK it all starts from importing a blockchain into a graph database..
What exactly is a graph database? Making things visual is just so we as a human can easier understand things. At a lower level it just tables and columns What will be the impact of this analysis with the rise of LN, sidechains and other anonymity solutions?
Anything no longer recorded on-chain (like with lightning) isn't available on the blockchain so it can't be used for analyzing.
|
Sooner or later you're going to realize, just as I did, that there's a difference between knowing the path and walking the path
|
|
|
x3m (OP)
Newbie
Offline
Activity: 23
Merit: 10
|
|
August 20, 2018, 01:52:17 PM |
|
AFAIK it all starts from importing a blockchain into a graph database..
What exactly is a graph database? Making things visual is just so we as a human can easier understand things. At a lower level it just tables and columns What will be the impact of this analysis with the rise of LN, sidechains and other anonymity solutions?
Anything no longer recorded on-chain (like with lightning) isn't available on the blockchain so it can't be used for analyzing. https://en.wikipedia.org/wiki/Graph_databaseIn order to perform an analysis you must have the right tools. Actually it's not just tables and columns if you compare graph to relational databases. They have been designed for different scopes.
|
|
|
|
x3m (OP)
Newbie
Offline
Activity: 23
Merit: 10
|
|
August 20, 2018, 04:24:14 PM |
|
Thanks for all the links. Browsing around I've already ran across https://www.chainalysis.com/ but unfortunately it's a product. What I'm looking for are tutorials, documents, scientific papers (maybe based on graph theory) that can explain me the basis of chain analysis and then decide if it's worthwhile to dive more deep into the subject. If you think about use cases it may have the potential to become a new branch of computer forensics.
|
|
|
|
Conasse
Jr. Member
Offline
Activity: 336
Merit: 5
Culotte Jaune Officielle
|
|
August 20, 2018, 07:42:33 PM |
|
Sorry if the question is stupid to you but isn't the basis of chain analysis about big data and primitive AI?
|
Bouffe ma chatte, pas la planète!
|
|
|
bob123
Legendary
Offline
Activity: 1624
Merit: 2481
|
|
August 21, 2018, 08:22:51 AM |
|
What exactly do you want to achieve?
Do you want to build a tool which allows you to analyze specific patterns between addresses/individuals ? This would for example represent transactions/addresses and their relations in a human-readable way.
Or do you want to create a program which automatically collects and processes data (e.g. which is looking for specific events etc. happening) ?
These two differ quite heavily and so does the approach.
|
|
|
|
x3m (OP)
Newbie
Offline
Activity: 23
Merit: 10
|
|
August 21, 2018, 11:39:06 AM |
|
What exactly do you want to achieve?
Do you want to build a tool which allows you to analyze specific patterns between addresses/individuals ? This would for example represent transactions/addresses and their relations in a human-readable way.
Or do you want to create a program which automatically collects and processes data (e.g. which is looking for specific events etc. happening) ?
These two differ quite heavily and so does the approach.
I would say the first example is more suitable but at the moment I'm not going to build a tools I'd rather like to understand the theory and the approach. Any suggestion? IMHO I do not see it hard to achieve the second result ... scheduling a blockchain analyzer could be enough at a first stage. BTW my request could be somehow related to this post (but it's much more generic) https://bitcointalk.org/index.php?topic=267618.0
|
|
|
|
TheArchaeologist
|
|
August 21, 2018, 12:13:12 PM |
|
If you are looking for this kind of information you could just use/build a parser for all unspent transactions. I also made a parser myself which parses all used addresses (420 Million plus at the moment). But this is all done by using a traditional relational database since I'm not fully aware what a graph database is
|
Sooner or later you're going to realize, just as I did, that there's a difference between knowing the path and walking the path
|
|
|
x3m (OP)
Newbie
Offline
Activity: 23
Merit: 10
|
|
August 21, 2018, 01:14:05 PM |
|
If you are looking for this kind of information you could just use/build a parser for all unspent transactions. I also made a parser myself which parses all used addresses (420 Million plus at the moment). But this is all done by using a traditional relational database since I'm not fully aware what a graph database is Interesting, can you share some details? Have you used a RDBMS like MySQL or similar? Have you had any issues importing the blockchain in the DB? What did you do it for? Did you discover something interesting? Please share.
|
|
|
|
TheArchaeologist
|
|
August 21, 2018, 02:44:21 PM |
|
Have you used a RDBMS like MySQL or similar?
Yes, I used MariaDB and SQLite3. Have you had any issues importing the blockchain in the DB? Not really , but be prepared it takes a lot of time and diskspace especially when you add some indexes. What did you do it for? Did you discover something interesting? To do some analysis. I started with finding addresses with easy to guess brainwallets. You can see some info in this thread: https://bitcointalk.org/index.php?topic=4768828And some more detailled info in this thread: https://bitcointalk.org/index.php?topic=2488493.0 (last page)
|
Sooner or later you're going to realize, just as I did, that there's a difference between knowing the path and walking the path
|
|
|
|