[ANNOUNCE] Abe 0.7: Open Source Block Explorer Knockoff

[John Tobey]

Is a /q/getdifficulty a possibility?

For you?  Done!  Please test.

[Tittiez]

For you?  Done!  Please test.

I will when I get a chance, thanks!

[mav]

By the way, I don't know if anyone has ever loaded the whole thing in SQLite.  I'll be surprised if it works and more surprised if it takes under a month.  I recommend MySQL or better for the BTC chain.  And regardless of database, an initial run with --no-serve --commit-bytes=100000 will probably speed it up.

I ran for ... about 5 days trying to populate sqlite on my i5 laptop.

It got to block 187400ish so far and is more than 5GB.

To anyone else who is considering using sqlite, it's not a good solution compared to mysql or postgres. It's possible, but not good.

[ErebusBat]

By the way, I don't know if anyone has ever loaded the whole thing in SQLite.  I'll be surprised if it works and more surprised if it takes under a month.  I recommend MySQL or better for the BTC chain.  And regardless of database, an initial run with --no-serve --commit-bytes=100000 will probably speed it up.

I ran for ... about 5 days trying to populate sqlite on my i5 laptop.

It got to block 187400ish so far and is more than 5GB.

To anyone else who is considering using sqlite, it's not a good solution compared to mysql or postgres. It's possible, but not good.

Took me about 7.5 days, then electrum server complained about not being 64bit, I haven't ad time to look into it past there.

[Eisenhower34]

Regarding your two small code examples posted above, I wrote an MySQL query to get the confirmations for each block. I only wanted to crosscheck with you if I understood everything right and didnt make a misstake here:

Code:

SELECT (
    (SELECT b.block_height AS maxheight
    FROM block b
    JOIN chain c ON c.chain_last_block_id = b.block_id
    WHERE c.chain_id = 1) - chain_candidate.block_height
) AS cofirmations, chain_candidate.block_id
FROM chain_candidate
WHERE chain_candidate.chain_id = 1
    AND chain_candidate.in_longest = 1

[John Tobey]

Regarding your two small code examples posted above, I wrote an MySQL query to get the confirmations for each block. I only wanted to crosscheck with you if I understood everything right and didnt make a misstake here:

Code:

SELECT (
    (SELECT b.block_height AS maxheight
    FROM block b
    JOIN chain c ON c.chain_last_block_id = b.block_id
    WHERE c.chain_id = 1) - chain_candidate.block_height
) AS cofirmations, chain_candidate.block_id
FROM chain_candidate
WHERE chain_candidate.chain_id = 1
    AND chain_candidate.in_longest = 1

I think this is correct.

[Atheros]

I have upgrade my server to 64bit. I have abe running at http://abe.bitcoinstats.org:2750 for anyone who wants to demo it. I'll list it in the wiki.

[Icoin]

I had to rebuild my server with ubuntu 12.04 64bit after the switch im not able to run abe anymore. I suspect that the change from python 2.6 to 2.7 aswell as the change from mysql 5.1 to 5.5 has something to do with it, since i use the same abe.conf as before and it was running on ubuntu 10.04 32bit.
I allways end up with this error:

Code:

Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/opt/abe/Abe/abe.py", line 2023, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/opt/abe/Abe/abe.py", line 1976, in main
    args, argv = readconf.parse_argv(argv, conf)
  File "Abe/readconf.py", line 57, in parse_argv
    _include(set(), val, arg_dict, config_name, strict)
  File "Abe/readconf.py", line 77, in _include
    entries = read(fp)
  File "Abe/readconf.py", line 153, in read
    js, c = scan_json(fp, c)
  File "Abe/readconf.py", line 259, in scan_json
    return _scan_json_compound(fp, c, ']')
  File "Abe/readconf.py", line 247, in _scan_json_compound
    cs, c = scan_json(fp, c)
  File "Abe/readconf.py", line 261, in scan_json
    return _scan_json_compound(fp, c, '}')
  File "Abe/readconf.py", line 247, in _scan_json_compound
    cs, c = scan_json(fp, c)
  File "Abe/readconf.py", line 264, in scan_json
    raise SyntaxError('Invalid initial JSON character: ' + c)
SyntaxError: Invalid initial JSON character: ?

Python 2.7.3
mysql  Ver 14.14 Distrib 5.5.24, for debian-linux-gnu (x86_64) using readline 6.2

i guess thats realy a python problem since i tried it with dbtype = sqlite3 and got the same result

[John Tobey]

I had to rebuild my server with ubuntu 12.04 64bit after the switch im not able to run abe anymore. I suspect that the change from python 2.6 to 2.7 aswell as the change from mysql 5.1 to 5.5 has something to do with it, since i use the same abe.conf as before and it was running on ubuntu 10.04 32bit.
I allways end up with this error:

Code:

Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/opt/abe/Abe/abe.py", line 2023, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/opt/abe/Abe/abe.py", line 1976, in main
    args, argv = readconf.parse_argv(argv, conf)
  File "Abe/readconf.py", line 57, in parse_argv
    _include(set(), val, arg_dict, config_name, strict)
  File "Abe/readconf.py", line 77, in _include
    entries = read(fp)
  File "Abe/readconf.py", line 153, in read
    js, c = scan_json(fp, c)
  File "Abe/readconf.py", line 259, in scan_json
    return _scan_json_compound(fp, c, ']')
  File "Abe/readconf.py", line 247, in _scan_json_compound
    cs, c = scan_json(fp, c)
  File "Abe/readconf.py", line 261, in scan_json
    return _scan_json_compound(fp, c, '}')
  File "Abe/readconf.py", line 247, in _scan_json_compound
    cs, c = scan_json(fp, c)
  File "Abe/readconf.py", line 264, in scan_json
    raise SyntaxError('Invalid initial JSON character: ' + c)
SyntaxError: Invalid initial JSON character: ?

Python 2.7.3
mysql  Ver 14.14 Distrib 5.5.24, for debian-linux-gnu (x86_64) using readline 6.2

i guess thats realy a python problem since i tried it with dbtype = sqlite3 and got the same result

This error has nothing to do with the database but perhaps relates to the Python version.  The error occurs while reading the config file.  Unfortunately, Abe did not report the line number where it thought the syntax was wrong.  I have committed a change to the parser that should let it report the error location in abe.conf.

Given that the invalid character is reported as '?' and no '?' occurs in the file you sent by PM, I suspect an encoding issue.

[Icoin]

Thanks for the Support - Everything works

[Remember remember the 5th of November]

I see that Abe is still under development, when can we expect 0.7?

[John Tobey]

I see that Abe is still under development, when can we expect 0.7?

At the moment the holdup is writing a change log.  Then I'll try to find all the pieces I need to build the Windows installer and update pypi.  Anything particular you need?

[grazcoin]

I see that Abe is still under development, when can we expect 0.7?

At the moment the holdup is writing a change log.  Then I'll try to find all the pieces I need to build the Windows installer and update pypi.  Anything particular you need?

I would be glad to have the following features:

Support for multisig addresses:
===================
http://abe.bitcoinstats.org:2750/address/3JEFRC6tuXRjxG6YUDtYzEmYEphf5pb86C
https://blockchain.info/address/3JEFRC6tuXRjxG6YUDtYzEmYEphf5pb86C

Support for unspent:
============
http://blockchain.info/unspent?address=3JEFRC6tuXRjxG6YUDtYzEmYEphf5pb86C
(something in the direction on listunspent in https://en.bitcoin.it/wiki/Original_Bitcoin_client/API_calls_list)

A tool to convert address to pubkey
=====================
http://blockchain.info/q/pubkeyaddr/12oESJ63gKmf7EtqEdrV7Xnid8dmYTBKE3

and as a bonus, it could be nice to have something like:
http://blockchain.info/multiaddr?active=3871TUSvEuHqHZZnswWtQSs31vK6LWnwcG|383TnXCdXnCkhQy4fwm6ZN2sf7XpZ4YJmp|3JEFRC6tuXRjxG6YUDtYzEmYEphf5pb86C

Since blockchain.info does not support testnet, there is currently no way to get the above data for testnet.

greetings,
Grazcoin

[Remember remember the 5th of November]

I see that Abe is still under development, when can we expect 0.7?

At the moment the holdup is writing a change log.  Then I'll try to find all the pieces I need to build the Windows installer and update pypi.  Anything particular you need?

As a matter of fact there are a few things. Currently ABE doesn't gracefully handle Ctr+C and so I have to execute the queries you gave a couple of pages back AND reset the blkoffset number to either 0 or a value which I've stored for emergencies.
And though it happened a long time ago, I had a very nasty problem where the bitcoin days destroyed value was 0 every few transactions/blocks and since I could not arbitrarily delete any blocks manually I was forced to reimport the blockchain all over again and this usually takes 2 weeks for me.

And not sure if there was a workaround, but while Abe is importing blocks, the webserver is off and there is no way for me to view the chain imported thus far.

[ErebusBat]

I see that Abe is still under development, when can we expect 0.7?

At the moment the holdup is writing a change log.  Then I'll try to find all the pieces I need to build the Windows installer and update pypi.  Anything particular you need?

As a matter of fact there are a few things. Currently ABE doesn't gracefully handle Ctr+C and so I have to execute the queries you gave a couple of pages back AND reset the blkoffset number to either 0 or a value which I've stored for emergencies.
And though it happened a long time ago, I had a very nasty problem where the bitcoin days destroyed value was 0 every few transactions/blocks and since I could not arbitrarily delete any blocks manually I was forced to reimport the blockchain all over again and this usually takes 2 weeks for me.

And not sure if there was a workaround, but while Abe is importing blocks, the webserver is off and there is no way for me to view the chain imported thus far.

I have a query that will give you import status.  PM me if you want it.

[Remember remember the 5th of November]

The import status is easily viewable from the ABE import output. What I am talking about is being able to use the web interface while abe is still importing.

[John Tobey]

The import status is easily viewable from the ABE import output. What I am talking about is being able to use the web interface while abe is still importing.

Two processes using slightly different abe.conf.  (Shared portions can be in a third file named by the config=FILE directive.)

• Process 1 does not include the new/loading chain in datadir but does serve web requests.
• Process 2 includes the chain but does not serve web requests.

Any issues?

As for Ctrl-C, I seldom have troubles that a simple restart does not solve.  Please provide details that help me reproduce the issue.

As for days destroyed, is it a feature you need?  Would the bug be detectable if we removed the days destroyed from the site?

A tool for deleting a block (or a chain) would be nice to have, I agree.

Support for unspent:
============
http://blockchain.info/unspent?address=3JEFRC6tuXRjxG6YUDtYzEmYEphf5pb86C
(something in the direction on listunspent in https://en.bitcoin.it/wiki/Original_Bitcoin_client/API_calls_list)

A tool to convert address to pubkey
=====================
http://blockchain.info/q/pubkeyaddr/12oESJ63gKmf7EtqEdrV7Xnid8dmYTBKE3

These two seem pretty simple, but I'd have to look closer.  Multisig addresses seem harder.  I'm thinking about relaxing the license terms to encourage development.  I suppose internals documentation would help too.  BTC will have to reach $50 or more before I can justify serious Abe time to my spouse.  If new features are worth money to you, feel free to PM me or start a bounty.  Frankly, while I love to see BTC succeed, my passion for Abe came more from a wish to encourage alternative chains.  Now there are several, so I am happy.

[Greedi]

Nice done!

but i have a problem

no matter what i set in abe.conf
i get
/home/bitcoin-abe# python -m Abe.abe --config abe.conf
Abe initialized.
Listening on http://localhost:2750

and i've set the port to 5000
and ip to the local lan ip, since it only me that should access it

[Remember remember the 5th of November]

Two processes using slightly different abe.conf.  (Shared portions can be in a third file named by the config=FILE directive.)

• Process 1 does not include the new/loading chain in datadir but does serve web requests.
• Process 2 includes the chain but does not serve web requests.

Would you mind sharing this config file where it does not scan the blockchain and import? I don't think I will be able to figure it out myself .
But I am using a tad bit older version, with schema_version Abe29.

EDIT: Nope, made it work myself.

[John Tobey]

no matter what i set in abe.conf
i get
/home/bitcoin-abe# python -m Abe.abe --config abe.conf
Abe initialized.
Listening on http://localhost:2750

and i've set the port to 5000
and ip to the local lan ip, since it only me that should access it

Have you removed the '#' from those lines?

#port 2750
#host localhost

should become

port 5000
host XX.XX.XX.XX

Which version or Git commit do you use?