Bitcoin Forum
December 08, 2016, 04:24:01 AM *
News: To be able to use the next phase of the beta forum software, please ensure that your email address is correct/functional.
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 [20] 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 »
  Print  
Author Topic: [ANNOUNCE] Abe 0.7: Open Source Block Explorer Knockoff  (Read 175738 times)
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 13, 2013, 06:34:47 PM
 #381

I was expecting 50*210000 + 25*(height-209999) as well, that was why I was wondering if it added fees or something.

chain/Bitcoin/q/totalbc/100000 : 5000049.98
chain/Bitcoin/q/totalbc/200000 : 10000037.06486171
chain/Bitcoin/q/totalbc/220998 : 10774961.89978955

The numbers are actually below what the formula gives.  After block 100000, there had been 100001 blocks (counting block 0), so the expected total was 5000050, 0.02 more than actual.  After block 200000, expected 10000050, 12.93513829 more than found.  After 220998, expected 10774975, 13.10021045 more than found.  It looks okay to me, although we could take off another 100 for at least two cases of duplicate 50BTC coinbase transactions, if I recall correctly.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
1481171041
Hero Member
*
Offline Offline

Posts: 1481171041

View Profile Personal Message (Offline)

Ignore
1481171041
Reply with quote  #2

1481171041
Report to moderator
1481171041
Hero Member
*
Offline Offline

Posts: 1481171041

View Profile Personal Message (Offline)

Ignore
1481171041
Reply with quote  #2

1481171041
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1481171041
Hero Member
*
Offline Offline

Posts: 1481171041

View Profile Personal Message (Offline)

Ignore
1481171041
Reply with quote  #2

1481171041
Report to moderator
1481171041
Hero Member
*
Offline Offline

Posts: 1481171041

View Profile Personal Message (Offline)

Ignore
1481171041
Reply with quote  #2

1481171041
Report to moderator
Jouke
Sr. Member
****
Offline Offline

Activity: 427



View Profile WWW
February 13, 2013, 07:02:39 PM
 #382

I was expecting 50*210000 + 25*(height-209999) as well, that was why I was wondering if it added fees or something.

chain/Bitcoin/q/totalbc/100000 : 5000049.98
chain/Bitcoin/q/totalbc/200000 : 10000037.06486171
chain/Bitcoin/q/totalbc/220998 : 10774961.89978955

The numbers are actually below what the formula gives.  After block 100000, there had been 100001 blocks (counting block 0), so the expected total was 5000050, 0.02 more than actual.  After block 200000, expected 10000050, 12.93513829 more than found.  After 220998, expected 10774975, 13.10021045 more than found.  It looks okay to me, although we could take off another 100 for at least two cases of duplicate 50BTC coinbase transactions, if I recall correctly.


Interesting to see those numbers Smiley

/tx/2c637592a4b4a95cf4b19260730c66de540d7d3b14d8d352de591c5ee6eac0fc indeed has bitcoins destroyed Smiley

Koop en verkoop snel en veilig bitcoins via iDeal op Bitonic.nl
Jouke
Sr. Member
****
Offline Offline

Activity: 427



View Profile WWW
February 13, 2013, 09:19:32 PM
 #383

I've reimplemented /unspent so it should outperform /address. 

Let me know if this helps.

It works great Cheesy

Koop en verkoop snel en veilig bitcoins via iDeal op Bitonic.nl
Jouke
Sr. Member
****
Offline Offline

Activity: 427



View Profile WWW
February 15, 2013, 11:30:26 AM
 #384

Am I correct that firstbit is not yet available trough api-calls?

Koop en verkoop snel en veilig bitcoins via iDeal op Bitonic.nl
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 15, 2013, 04:32:38 PM
 #385

Am I correct that firstbit is not yet available trough api-calls?

No, there is /q/fb/ADDRESS and /q/addr/FIRSTBITS.  However, firstbits is disabled by default, since it requires a big table.  (Something like 99% of all addresses are single-use "change addresses" but must be remembered for firstbits.)  Also, please note that Abe's algorithm probably differs slightly from firstbits.com and blockchain.info's.  See elsewhere in this thread for details.

More info, including how to turn on Abe's firstbits support, is in README-FIRSTBITS.txt.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
Jouke
Sr. Member
****
Offline Offline

Activity: 427



View Profile WWW
February 16, 2013, 12:39:19 AM
 #386

Am I correct that firstbit is not yet available trough api-calls?

No, there is /q/fb/ADDRESS and /q/addr/FIRSTBITS.  However, firstbits is disabled by default, since it requires a big table.  (Something like 99% of all addresses are single-use "change addresses" but must be remembered for firstbits.)  Also, please note that Abe's algorithm probably differs slightly from firstbits.com and blockchain.info's.  See elsewhere in this thread for details.

More info, including how to turn on Abe's firstbits support, is in README-FIRSTBITS.txt.

Oh nice!

In readme.txt: "The Abe.reconfigure module turns firstbits on and off once you have upgraded Abe's schema."

How do I updrage Abe's schema?

Koop en verkoop snel en veilig bitcoins via iDeal op Bitonic.nl
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 18, 2013, 02:59:18 PM
 #387

Oh nice!

In readme.txt: "The Abe.reconfigure module turns firstbits on and off once you have upgraded Abe's schema."

How do I updrage Abe's schema?

You already have a schema supporting firstbits, so just ignore that step.  Sorry it's unclear, but upgrading is for databases created by earlier versions of Abe, before firstbits support.  Anyway, to upgrade, just use the new version of bitcoin-abe and include "--upgrade" after "python -m Abe.abe".

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 23, 2013, 02:30:11 PM
 #388

I've added a branch to the code repository: no-statistics.

no-statistics is an experimental branch of Abe that lacks certain features present in the master branch.  The features are Percent Coin-Days Destroyed and Chain Age.  Removing these features simplifies the code and reduces Abe's storage and processing requirements.

I have only lightly tested it, but I consider it the direction of future development.  I would like to reimplement the original statistics and others, but their inclusion should be a configurable option so as not to burden applications that do not need them.

There is not (yet) an option to convert a database in the original format to one that uses the no-statistics branch or vice versa.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 24, 2013, 02:34:41 AM
 #389

I've added a branch to the code repository: no-statistics.

This branch can now TRIM SPENT OUTPUTS, transactions, and addresses from the database.  It is not polished code, but it basically seems to work.  Loading the blockchain may be a little slower than before, since it does all the same SQL work, plus some deleting.  The space reduction appears to be "only" around 50% as of Block 134000 (under PostgreSQL 8.4).  This may be due in part to all those early unspent coinbase outputs.

To use the new feature, pass --default-trim-depth=6 (EDIT: make that --default-trim-depth=40 thanks to the March 12 fork) when creating the database.  Replace "6" with a higher number for defence against corruption by long side chains, at the cost of slightly more space.  See "default-trim-depth" in abe.conf for details and caveats.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
molecular
Donator
Legendary
*
Offline Offline

Activity: 2142



View Profile
February 24, 2013, 03:55:52 PM
 #390

it's awesome to see you keep improving.

I don't have use for the newer features, but let me say I frequently use bitcoin-abe for various analyses on the blockchain.

A big thanks!

PGP key molecular F9B70769 fingerprint 9CDD C0D3 20F8 279F 6BE0  3F39 FC49 2362 F9B7 0769
Jouke
Sr. Member
****
Offline Offline

Activity: 427



View Profile WWW
February 25, 2013, 12:07:09 AM
 #391

Wow, that is seriously awesome! I am going to set up a public server so everyone is able to use this great piece of software.

Koop en verkoop snel en veilig bitcoins via iDeal op Bitonic.nl
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
February 25, 2013, 09:54:13 PM
 #392

I am not receiving email at John.Tobey@gmail.com since three days ago.  If you sent email there in the last 72 hours, it did not reach me, and GMail is not sending delivery failure messages.  I've filled out the forms and await a solution in the next couple of days, or I'll be an ex-GMail user.  I'll check my personal messages here.

Sorry for any inconvenience.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
K1773R
Legendary
*
Offline Offline

Activity: 1526


/dev/null


View Profile
March 19, 2013, 12:55:39 AM
 #393

i stoped supporting I0Coin due to its memhogging, how do i cleanly delete the I0Coin chain from the MySQL DB? (already uncommented it in abe.conf)

[GPG Public Key]  [Devcoin Builds]  [BBQCoin Builds]  [Multichain Blockexplorer]  [Multichain Blockexplorer - PoS Coins]  [Ufasoft Miner Linux Builds]
BTC/DVC/TRC/FRC: 1K1773RbXRZVRQSSXe9N6N2MUFERvrdu6y ANC/XPM AK1773RTmRKtvbKBCrUu95UQg5iegrqyeA NMC: NK1773Rzv8b4ugmCgX789PbjewA9fL9Dy1 LTC: LKi773RBuPepQH8E6Zb1ponoCvgbU7hHmd EMC: EK1773RxUes1HX1YAGMZ1xVYBBRUCqfDoF BQC: bK1773R1APJz4yTgRkmdKQhjhiMyQpJgfN
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
March 19, 2013, 05:51:15 PM
 #394

i stoped supporting I0Coin due to its memhogging, how do i cleanly delete the I0Coin chain from the MySQL DB? (already uncommented it in abe.conf)
Sorry, I haven't written this feature.  You can remove the currency from the main page by finding its chain_id (in the chain table) and deleting all matching rows from chain_candidate and chain, I think.  It's been a while since I did this.

Then reclaiming the block and tx space is a matter of identifying rows in a half dozen tables and deleting them in dependency order, being careful not to delete other chains' data.  Or you could disable keys, delete in any order, and enable keys again, but this is not advisable while other chains may be loading.  I seem to remember "clean" chain removal taking me 20-30 minutes.  In 1-2 hours I could develop a utility that does it all, but it's still a to-do.

Quote from: TODO.txt
* Admin interface to delete chains, etc.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
SgtSpike
Legendary
*
Offline Offline

Activity: 1344



View Profile
March 19, 2013, 06:14:42 PM
 #395

Is there a list somewhere of all of the publicly-available servers/websites running Abe?  When blockchain.info was down, I went looking for one, but couldn't find any that were still running.
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
March 19, 2013, 06:33:43 PM
 #396

Is there a list somewhere of all of the publicly-available servers/websites running Abe?  When blockchain.info was down, I went looking for one, but couldn't find any that were still running.
The wiki page links to http://abe.bitcoinstats.org:2750/, which appears current.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
notawake
Jr. Member
*
Offline Offline

Activity: 58


View Profile
March 21, 2013, 02:18:41 AM
 #397

My Abe installation was stuck on Namecoin block 99501 (2013-03-10 13:15:28). Attempting to rescan the block chain yielded the following error:

Code:
block 326226 already in chain 3
commit
Exception at 463166665
Failed to catch up {'blkfile_number': 1, 'dirname': '/home/notawake/.namecoin', 'chain_id': None, 'id': Decimal('2'), 'blkfile_offset': 463114051}
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 2428, in catch_up
    store.catch_up_dir(dircfg)
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 2493, in catch_up_dir
    store.import_blkdat(dircfg, ds, blkfile['name'])
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 2626, in import_blkdat
    store.import_block(b, chain_ids = chain_ids)
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 1662, in import_block
    tx['tx_id'] = store.import_and_commit_tx(tx, pos == 0)
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 2147, in import_and_commit_tx
    tx_id = store.import_tx(tx, is_coinbase)
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 2091, in import_tx
    store.binin(txout['scriptPubKey']), pubkey_id))
  File "/usr/local/lib/python2.7/dist-packages/Abe/DataStore.py", line 464, in sql
    store.cursor.execute(cached, params)
DataError: value too long for type character varying(20000)

The next Namecoin block, 99502, has a size of 52606 bytes. In order to allow 99502 (and subsequent blocks) to be imported into the Abe database, I dropped the txout_detail view (because PostgreSQL does not allow changing the column types in tables used by views), removed the length restriction from the column txout_scriptpubkey in the table txout, and recreated the txout_detail view.

I'm sure this solution is dangerous if someone manages to stuff much larger blocks into a block chain, but I do not know a reasonable limit for this column yet.

Bitcoin: 1HZRowLTkmF6M8V11vj2dmVf2r9VK7dVfo | Namecoin: MxT6tjJZcYZeWUGNgsAMxJ7wpDgKMdub4y

Output Transactions for a Given Address to CSV Format
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
March 21, 2013, 02:55:05 PM
 #398

The next Namecoin block, 99502, has a size of 52606 bytes. In order to allow 99502 (and subsequent blocks) to be imported into the Abe database, I dropped the txout_detail view (because PostgreSQL does not allow changing the column types in tables used by views), removed the length restriction from the column txout_scriptpubkey in the table txout, and recreated the txout_detail view.

I'm sure this solution is dangerous if someone manages to stuff much larger blocks into a block chain, but I do not know a reasonable limit for this column yet.

Thanks for the report.  It's too bad that junk got into the Namecoin blockchain.  Do you have the actual script length?  http://explorer.dot-bit.org/tx/1474553 shows the transaction size as 32767, and the long script would be most of that, but that explorer may have truncated it.  You can verify this with something like:

Code:
SELECT MAX(LENGTH(txout_scriptPubKey)) FROM txout JOIN tx USING (tx_id) WHERE tx_hash = '0bb558f73a543f2631acbd8c5614d3ed2171eb710a586b4485b8303d4a4a0b61';

I'll consider simply increasing the column width, but that has the side effect of making MySQL create the column as type TEXT rather than VARCHAR (unless using binary-type=binary).  This may not be so bad.  The column does not take part in any joins, and the vanilla app never searches it.  Anyone?

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
John Tobey
Hero Member
*****
Offline Offline

Activity: 481



View Profile WWW
March 22, 2013, 03:43:32 PM
 #399

FYI, http://abe.john-edwin-tobey.org is current with the BTC chain using the no-statistics branch and the HOMEPAGE template variable to make chain/Bitcoin the default view.  It uses the new abe_loader script (in tools/) to stay up-to-date, and the FCGI process has read-only SQL permissions.

Problems?  Please report them here or by email to jtobey@john-edwin-tobey.org.

Can a change to the best-chain criteria protect against 51% to 90+% attacks without a hard fork?
ShadesOfMarble
Donator
Hero Member
*
Offline Offline

Activity: 543



View Profile
March 22, 2013, 07:44:10 PM
 #400

Any news on multisig support? Are you working on it or waiting for donations? Smiley

Review of the Spondoolies-Tech SP10 „Dawson“ Bitcoin miner (1.4 TH/s)

[22:35] <Vinnie_win> Did anyone get paid yet? | [22:36] <Isokivi> pirate did!
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 [20] 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 »
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!