[ANNOUNCE] Abe 0.7: Open Source Block Explorer Knockoff

[John Tobey]

I'm currently using blockchain.info API. Check out this URL to get the unspent outputs:

http://blockchain.info/unspent?address=1A9YA62QvpmE32wu9h4tgC3GHQiUhiTAXi

Abe has a slightly different syntax: http://localhost:2750/unspent/1A9YA62QvpmE32wu9h4tgC3GHQiUhiTAXi

and this URL to get the total sent and received amounts (much clearer than blockexplorer.com IMO):

http://blockchain.info/address/1A9YA62QvpmE32wu9h4tgC3GHQiUhiTAXi?format=json

This would be a nice feature to support.

[1714234877]

1714234877

[1714234877]

1714234877

[1714234877]

1714234877

[antonimasso]

Hello John,

When sending Bitcoins to an address, new inputs don't appear in the transactions list until there is at least one confirmation. Are you filtering them out programatically? Can they show up even though they still have no confirmations?

Thanks,

Toni

[mjb]

I have a question regarding the number of public keys that the blockchain has "seen":

Code:

select count(pubkey_id) from pubkey;
+------------------+
| count(pubkey_id) |
+------------------+
|         16794956 | 
+------------------+
1 row in set (3 min 50.15 sec)

Is it really only 16.8 millions (as of a few days ago)? Or is there something wrong with my database?

[antonimasso]

I get more or less the same amount:

Code:

mysql> select count(pubkey_id) from pubkey;
+------------------+
| count(pubkey_id) |
+------------------+
|         17263860 |
+------------------+
1 row in set (58.19 sec)

[John Tobey]

Hello John,

When sending Bitcoins to an address, new inputs don't appear in the transactions list until there is at least one confirmation. Are you filtering them out programatically? Can they show up even though they still have no confirmations?

Bitcoind does not write unconfirmed transactions to the blockfile.  You would have to run in RPC mode to see them.  See the comments about default-loader in abe.conf: https://github.com/jtobey/bitcoin-abe/blob/d3f1e2ff6714b1fc4dce11f67d1625304cb5f4ca/abe.conf#L271-296

[xchrix]

is it possible to calc the current block reward trough the abe API?

[ShadesOfMarble]

Do you really need an API call for that?

Code:

$blockreward = 50 * pow(0.5, floor($current_block / 210000));

[xchrix]

Do you really need an API call for that?

Code:

$blockreward = 50 * pow(0.5, floor($current_block / 210000));

thanks for the formula. this is ok for bitcoin. but i think about all the other altcoins out there. its very hard work to get every formula for each altcoin. i thought maybe there is an easy way trough abe 

[John Tobey]

Do you really need an API call for that?

Code:

$blockreward = 50 * pow(0.5, floor($current_block / 210000));

thanks for the formula. this is ok for bitcoin. but i think about all the other altcoins out there. its very hard work to get every formula for each altcoin. i thought maybe there is an easy way trough abe 

No, sorry.  The block chain shows only past block rewards, almost every alt chain has a different formula, and I know of no RPC call that returns it, so finding the current or future reward in general is not trivial.

[xchrix]

Do you really need an API call for that?

Code:

$blockreward = 50 * pow(0.5, floor($current_block / 210000));

thanks for the formula. this is ok for bitcoin. but i think about all the other altcoins out there. its very hard work to get every formula for each altcoin. i thought maybe there is an easy way trough abe 

No, sorry.  The block chain shows only past block rewards, almost every alt chain has a different formula, and I know of no RPC call that returns it, so finding the current or future reward in general is not trivial.

past block rewards would also help! but as i see there is also no API call available for getting rewards from the last block

[mandros]

Sorry if it's already been asked but I don't see it in the TODO.txt.

It would be great to be able to purge from the database the already spent transactions (after +6 confirmations or so).

This would reduce the database and would still be useful for those applications which only need to work with unspent and new transactions.

In the meantime would it be fine deleting those transactions directly on the database? (or would it break Abe?)

Thanks.

[John Tobey]

Sorry if it's already been asked but I don't see it in the TODO.txt.

It would be great to be able to purge from the database the already spent transactions (after +6 confirmations or so).

This functionality exists in experimental form on the no-statistics branch in Git.  Search "no-statistics" and "default-trim-depth" in this thread.

This would reduce the database and would still be useful for those applications which only need to work with unspent and new transactions.

In the meantime would it be fine deleting those transactions directly on the database? (or would it break Abe?)

Thanks.

I don't know.  It probably won't severely break Abe.  You might see some wrong numbers, negative values and the like in affected blocks.  The no-statistics branch shows wrong totals in some places.

[John Tobey]

I have transferred the Git repository to: https://github.com/bitcoin-abe/bitcoin-abe .  Thanks to Patrick for setting this up.  According to GitHub, the old URL will continue to work, but to avoid confusion, you can run

Code:

git remote set-url origin https://github.com/bitcoin-abe/bitcoin-abe.git

in the bitcoin-abe directory.

I have changed the copyright holder from "John Tobey" to "Abe developers".  Since I don't have much time to maintain Abe any more, I invite other interested people to join the team.

[lavajumper]

I'm trying to set up Abe for an alt-coin. Everything works fine, except the addresses reported in transactions are not in the correct 'address space'.
ie. our addresses start with 'N', when you click on a block, the from and to addresses all start with 'g'

A search for an address returns correctly.( If you search for 'Nksjfisaudh7shd', the correct data shows up ).

I'm trying to find where this 'translation' takes place. I've double checked the magic number and address version.

Any ideas where to look?

[lavajumper]

I'm trying to set up Abe for an alt-coin. Everything works fine, except the addresses reported in transactions are not in the correct 'address space'.
ie. our addresses start with 'N', when you click on a block, the from and to addresses all start with 'g'

A search for an address returns correctly.( If you search for 'Nksjfisaudh7shd', the correct data shows up ).

I'm trying to find where this 'translation' takes place. I've double checked the magic number and address version.

Any ideas where to look?

Found it! ( DUH...FAQ.html )

[Mannfred]

I get the following error massage:


no chain_id
catch_up_rpc: abort
Opened e:\bitcoin\daten\blocks\blk00080.dat
Exception at 13228858152345733452
Failed to catch up {'blkfile_offset': 123332745, 'blkfile_number': 100080, 'chai
n_id': None, 'loader': None, 'dirname': 'e:\\bitcoin\\daten', 'id': D
ecimal('2')}
Traceback (most recent call last):
  File "Abe\DataStore.py", line 2639, in catch_up
    store.catch_up_dir(dircfg)
  File "Abe\DataStore.py", line 2897, in catch_up_dir
    store.import_blkdat(dircfg, ds, blkfile['name'])
  File "Abe\DataStore.py", line 3024, in import_blkdat
    b = store.parse_block(ds, chain_id, magic, length)
  File "Abe\DataStore.py", line 3055, in parse_block
    d['transactions'].append(deserialize.parse_Transaction(ds))
  File "Abe\deserialize.py", line 92, in parse_Transaction
    d['txOut'].append(parse_TxOut(vds))
  File "Abe\deserialize.py", line 67, in parse_TxOut
    d['value'] = vds.read_int64()
  File "Abe\BCDataStream.py", line 72, in read_int64
    def read_int64  (self): return self._read_num('<q')
  File "Abe\BCDataStream.py", line 110, in _read_num
    (i,) = struct.unpack_from(format, self.input, self.read_cursor)
OverflowError: Python int too large to convert to C long



What is to do?

[Mannfred]

No Solution.

Delete Database and load again. Duration about three Weeks....

[imrer]

Amazing piece of work!

[Jouke]

Some hours ago I received this error:

Traceback (most recent call last):
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 2633, in catch_up
    if not store.catch_up_rpc(dircfg):
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 2806, in catch_up_rpc
    store.import_block(block, chain_ids = chain_ids)
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 1737, in import_block
    tx['tx_id'] = store.import_and_commit_tx(tx, pos == 0)
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 2259, in import_and_commit_tx
    tx_id = store.import_tx(tx, is_coinbase)
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 2193, in import_tx
    pubkey_id = store.script_to_pubkey_id(txout['scriptPubKey'])
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/DataStore.py", line 2573, in script_to_pubkey_id
    for opcode, data, i in deserialize.script_GetOp(script):
  File "/home/jouke/bitcoin-abe/bitcoin-abe/Abe/deserialize.py", line 247, in script_GetOp
    nSize = ord(bytes)
IndexError: string index out of range

Edit:

I guess it has to do with transaction:  ebc9fa1196a59e192352d76c0f6e73167046b9d37b8302b6bb6968dfd279b767

[toolbag]

I'm getting that same error. Anyone have any solutions that don't involve reloading everything? Heh...