Bitcoin Forum
April 27, 2024, 08:49:03 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 ... 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 [87] 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 ... 231 »
  Print  
Author Topic: Armory - Discussion Thread  (Read 521678 times)
justusranvier
Legendary
*
Offline Offline

Activity: 1400
Merit: 1009



View Profile
January 07, 2013, 01:01:17 PM
 #1721

It's becoming quite a massive undertaking, as I've ended up basically rewriting the wallets from scratch.  But it's being rewritten in order to give it the flexibility to things like this without redesigning it again. 
Will the new design allow you to add brain wallet capability?
"If you don't want people to know you're a scumbag then don't be a scumbag." -- margaritahuyan
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714207743
Hero Member
*
Offline Offline

Posts: 1714207743

View Profile Personal Message (Offline)

Ignore
1714207743
Reply with quote  #2

1714207743
Report to moderator
1714207743
Hero Member
*
Offline Offline

Posts: 1714207743

View Profile Personal Message (Offline)

Ignore
1714207743
Reply with quote  #2

1714207743
Report to moderator
Carlton Banks
Legendary
*
Offline Offline

Activity: 3430
Merit: 3071



View Profile
January 07, 2013, 01:08:12 PM
Last edit: January 07, 2013, 04:58:54 PM by Carlton Banks
 #1722

It's becoming quite a massive undertaking, as I've ended up basically rewriting the wallets from scratch.  But it's being rewritten in order to give it the flexibility to things like this without redesigning it again.
Will the new design allow you to add brain wallet capability?

A contentious issue! Search the thread, etotheipi is a little undecided on sanctioning the use of brain wallets (clarity edit: he also has a tentative idea to make them a little less disaster prone)

Vires in numeris
HostFat
Staff
Legendary
*
Offline Offline

Activity: 4214
Merit: 1203


I support freedom of choice


View Profile WWW
January 07, 2013, 03:41:49 PM
 #1723

Are you going to open a translation project on transifex.com or crowdin.net?

NON DO ASSISTENZA PRIVATA - http://hostfatmind.com
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 07, 2013, 03:54:02 PM
 #1724

Are you going to open a translation project on transifex.com or crowdin.net?

Armory source code is not in the correct condition for translations.  There is currently no unicode support, and I never implemented any of the hooks for adding translations/localizations...

That said, the new wallet files will have unicode support, and I'll take the opportunity to upgrade the GUI to go with it.  At the same time, I will add those hooks needed for translations.  THEN, I can start soliciting help doing translations.  Until then, there's not much to that can be done (any unicode characters added by the user, just about anywhere, crash Armory).

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
cypherdoc
Legendary
*
Offline Offline

Activity: 1764
Merit: 1002



View Profile
January 07, 2013, 11:59:39 PM
 #1725

Feature request: In addition to the existing passwords for the wallets, which are really passwords covering the secret keys of the wallets, it would be nice to have a password for viewing. Now, starting Armory, all the balances and addresses are shown directly.


The only problem is that this passphrase will be typed all the time, and the encryption key will have to sit in memory the whole time Armory is open.  There's no way users will pick a different passphrase for their private keys and their public keys, and that makes this a pretty significant risk...  I might only offer the feature on offline/watching-only wallets and plaster warnings everywhere (not that it necessarily helps, but users should be aware of the risks they take by using passwords that protect important things, on things that aren't that important).

But I totally appreciate the desire to not have someone steal your laptop and learn (1) that you have $100k BTC probably at your house on an offline computer and (2) the address to your house.

I would not have a problem with dealing with a separate password for this.

me too.
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 09, 2013, 04:24:29 AM
 #1726

Just pushed 0.86.8 to the testing branch.  At this point will just be released as 0.87.  Fixed tons of bugs I can't even enumerate (most of them tiny). 

@ HostFat:  I think you'll be pleasantly surprised.  All QR codes are inflatable!  It works in Linux, at least...

Also got permission from mav to add his JSON-RPC code to the project (committed as armoryd.py).  The code is not up to my quality standards yet, but is fantastic skeleton for me to finally get that support in there.  I may be posting questions here for others more knowledgeable about JSON servers.  So far, it looks like what he's got works, but it needs some more security features, and some more commands.  Will be making that a priority, actually...

Please test!

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
pvz
Newbie
*
Offline Offline

Activity: 53
Merit: 0


View Profile
January 09, 2013, 12:41:46 PM
 #1727

Just pushed 0.86.8 to the testing branch.  At this point will just be released as 0.87.   ...

Also got permission from mav to add his JSON-RPC code to the project (committed as armoryd.py).  ...

Very good to hear!!!
Thanks mav and etotheipi.

This way Armory is more valuable for back-end solutions and gives a lot of opportunities to add functionality for bitcoin (business) users with the network security and blockchain of the original bitcoin client and the wallet security of Armory.

Standing ovation.
Keep up the good work!

Concerning the dependencies, is txjson-rpc still required for armoryd.py?
If so, it is preferable to add it to the dependencies (to be able to use armoryd.py)

Please test!

Just started right now!
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 10, 2013, 10:02:22 PM
 #1728

Alright, so I finally have a "release candidate" for 0.87 (it is 0.86.9-testing).  I just uploaded the installers to the code.google downloads page.  As soon as I get a sanity check, I'll turn it into 0.87-beta and finally release it with all the extra goodies...

http://code.google.com/p/bitcoinarmory/downloads/detail?name=armory_0.86.9-testing_win64.msi
http://code.google.com/p/bitcoinarmory/downloads/detail?name=armory_0.86.9-testing_windows_all.msi
http://code.google.com/p/bitcoinarmory/downloads/detail?name=armory_0.86.9-1_amd64.deb
http://code.google.com/p/bitcoinarmory/downloads/detail?name=armory_0.86.9-1_i386.deb




Now, someone with networking/JSON/python-twisted experience please help me.  I'm working on creating the JSON-RPC server, and I have all the pieces together except for the authentication.  I know I just need very simple Digest authentication using username and password in a file only readable by the user.  However, for such a "simple" thing, there's like 800 different ways to get there, and I have no idea how to do it.

From my research, I think I have found all the pieces I need, but I'm not sure how to put them together yet ... it's like a jigsaw puzzle.   I see that I need:

    twisted.web.guard.resource.Resource to be protected
    twisted.cred.portal.IRealm that creates "avatars" (incarnations of the user on the server)
    twisted.web.guard.DigestCredentialFactory specifying the realm
    twisted.cred.portal.Portal to that links the realm to a ...
    twisted.cred.checkers.FilePasswordDB object specifying the user/pass list
    twisted.web.guard.HTTPAuthSessionWrapper



The server code and launch without authentication looks like:

Code:
class Armory_Json_Rpc_Server(jsonrpc.JSONRPC):
   ...

reactor.listenTCP(RPC_PORT, \
                  server.Site(Armory_Json_Rpc_Server(self.wallet)), \
                  interface="127.0.0.1")
You can see the full source code as mav gave me here (with slight modifications, and adding all the complicated pieces above)

Anyone want to help me figure out how to create and hook together all these things?  Guarded resources, realms, avatar factories, a portals, etc? (sounds like I'm playing a RPG computer game with knights and wizards and magic, doesn't it?)



Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
mav
Full Member
***
Offline Offline

Activity: 169
Merit: 107


View Profile
January 11, 2013, 09:51:24 AM
 #1729

The changes to add auth are in the link below. Manually tested only. Returns the string "Unauthorized" if the user is unauthorized (no username or wrong password), otherwise returns the desired json. Credit must go to the author of txjsonrpc for including a nice wrapper for auth.

https://github.com/thedawnrider/BitcoinArmory-Daemon/commit/32cfd4697fed5546c57f5815b15a37f79988db74

inspired entirely by

https://github.com/bbqsrc/txjsonrpc/blob/master/examples/webAuth/server.tac

and if you want to do password storage differently than a text file (which I know you don't)

https://twistedmatrix.com/documents/8.1.0/api/twisted.cred.checkers.ICredentialsChecker.html

Hope this helps.
wachtwoord
Legendary
*
Offline Offline

Activity: 2324
Merit: 1125


View Profile
January 11, 2013, 01:39:41 PM
 #1730

Hi,

I am not sure whether this the right place for this. Etotheipi, if you prefer I ask this in a separate thread just say so and I'll move it.

What I am asking? I am looking to improve my security and so want to start using Armory in the online<-->Offline wallet configuration. However I do not have a suitable system for being an offline system and honestly, this is not the configuration I would choose. Having a system dedicated only to my wallet that is only ever booted up for getting coins from my cold wallet seem awfully wasteful and there is a risk the system doesn't even boot when I finally have to use it. if that happens of course I can recover the wallet and recover on a new system but this only proves that a dedicated offline wallet is unnecessary. It is only necessary for the private keys (aka the cold wallet) to never reside on a computer that is at that time connected to the internet.

So what I am proposing is the following configuration. I only have 1 pc with an internet connection and two installations of Armory.

1) An "offline" Armory that only gets started by me when I have physically disconnected the pc from the internet (As  required remove any Ethernet cable, any wireless network card and any wireless dongle, even disale Bluetooth if this is present). Furthermore the wallet file resides on removable medium (most likely flash drive) which is only ever plugged in when the pc is disconnected from the internet.

2) A normal online wallet with a watch-only version of the wallet in cold storage and hot-wallets as required.

Questions I have:

1) Do you agree this configuration is equally secure as a configuration in which a dedicated offline system?
2) The biggest risk here (but also in the proposed configuration with the dedicated offline system) is keeping the offline wallet files physically secure. Especially as you will want to keep backups (flash storage is frail). Do you agree?
3) Why do you recommend making a paper backup? Personally I really do not trust paper (it decays even faster than any other sort of media). I would like to hear your thoughts because you have obviously put more thought into this than I.
4) Finally, atm I already use Armory (although not yet for the majority of my funds) in a configuration with 1 (hot) wallet on a system connected to the internet. I have encrypted the wallet with a very long pass-phrase (>50 characters to give an indication). Will using a offline configuration with a real and watch only wallet really improve my security? What exact use cases do I protect myself against?

Thank you Smiley
chrisrico
Hero Member
*****
Offline Offline

Activity: 496
Merit: 500


View Profile
January 11, 2013, 06:13:25 PM
 #1731

1) Do you agree this configuration is equally secure as a configuration in which a dedicated offline system?

I'm not etotheipi, but no this is not as secure as an offline computer. You could have a virus on your computer that gathers your wallet information while you are offline and the wallet is unlocked, and then transmits it once the computer is back online.

2) The biggest risk here (but also in the proposed configuration with the dedicated offline system) is keeping the offline wallet files physically secure. Especially as you will want to keep backups (flash storage is frail). Do you agree?

I think the scenario I outlined above is a bigger risk. At least with an offline wallet, you know that it cannot be attacked except by someone in the same physical location.

3) Why do you recommend making a paper backup? Personally I really do not trust paper (it decays even faster than any other sort of media). I would like to hear your thoughts because you have obviously put more thought into this than I.

You can make archival quality prints, which is I think mostly a function of the paper used. The reason for backing up on paper is that digital media can always fail. Paper is long lasting and easily securable.

4) Finally, atm I already use Armory (although not yet for the majority of my funds) in a configuration with 1 (hot) wallet on a system connected to the internet. I have encrypted the wallet with a very long pass-phrase (>50 characters to give an indication). Will using a offline configuration with a real and watch only wallet really improve my security? What exact use cases do I protect myself against?

If you have a virus, it can log your passphrase when you enter it, and then empty your wallet at its convenience. This is impossible with an offline computer keeping your wallet. I recommend the Raspberry Pi. It is cheap, low powered, and eminently hackable.
picobit
Hero Member
*****
Offline Offline

Activity: 547
Merit: 500


Decor in numeris


View Profile
January 11, 2013, 07:25:19 PM
 #1732

Another possibility would be to have the offline wallet in a virtual machine without internet access.  Of course a virus could still get access to the file in which the virtual machine harddisk is placed, and thus the "offline" wallet, but the virus would more or less need to be tailored to attack your personal configuration.  So if you keep thousands of bitcoins, you definitely want a dedicated offline machine, but for anything less I would guess that the virtual machine - or even the setup you suggested above - would for all practical purposes be secure.
Ploo
Full Member
***
Offline Offline

Activity: 125
Merit: 100


View Profile
January 11, 2013, 07:41:23 PM
 #1733

I'm looking to generate a raw plain hex signed tx that's ready to push later via blockchain/pushtx or bitcoind/sendrawtx.

I've noticed that copy raw tx returns the same value pre and post signing, which i presume to be the unsigned data. Is this a bug?
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 11, 2013, 11:40:48 PM
Last edit: January 12, 2013, 12:39:33 AM by etotheipi
 #1734

The changes to add auth are in the link below. Manually tested only. Returns the string "Unauthorized" if the user is unauthorized (no username or wrong password), otherwise returns the desired json. Credit must go to the author of txjsonrpc for including a nice wrapper for auth.

https://github.com/thedawnrider/BitcoinArmory-Daemon/commit/32cfd4697fed5546c57f5815b15a37f79988db74
...

@mav

You're amazing!  You made that look so easy... I guess you just have experience with this to realize that I didn't need all that extra garbage to do something so simple.  Thanks so much -- now I can get around to actually implementing all the RPC commands.  Ideas are welcome for how to deal with it for things that aren't the same for bitcoind and Armory:  for instance, bitcoind has accounts, Armory has wallets.  I was thinking it could be a multi-wallet interface, instead of accounts and you give it the wallet ID where you would otherwise put an "account" in the JSON interface.  Mapping other functionality over for watch-only wallets may be kind of fuzzy.  There's also things where Armory can provide a bit more than bitcoind could -- for instance, the ability to sweep or import private keys could be added (I'm thinking I could have that happen in another thread so that it wouldn't have to go offline... [wait, I could do that in Armory GUI, too... ...?]).


I'm looking to generate a raw plain hex signed tx that's ready to push later via blockchain/pushtx or bitcoind/sendrawtx.

I've noticed that copy raw tx returns the same value pre and post signing, which i presume to be the unsigned data. Is this a bug?

@Ploo
Yes!  I actually was just messing with something and found this bug and fixed it.  I don't know if I fixed it in the testing branch yet, but I'll definitely try to get it in, soon.  I was annoyed, myself, that I couldn't get the raw tx out of it...


1) Do you agree this configuration is equally secure as a configuration in which a dedicated offline system?
2) The biggest risk here (but also in the proposed configuration with the dedicated offline system) is keeping the offline wallet files physically secure. Especially as you will want to keep backups (flash storage is frail). Do you agree?
3) Why do you recommend making a paper backup? Personally I really do not trust paper (it decays even faster than any other sort of media). I would like to hear your thoughts because you have obviously put more thought into this than I.
4) Finally, atm I already use Armory (although not yet for the majority of my funds) in a configuration with 1 (hot) wallet on a system connected to the internet. I have encrypted the wallet with a very long pass-phrase (>50 characters to give an indication). Will using a offline configuration with a real and watch only wallet really improve my security? What exact use cases do I protect myself against?

@wachtwoord
The alternative you describe is really not much better than just maintaining an encrypted wallet on your hot computer.  What it prevents is someone who has gotten remote access to your machine and manually digging around your filesystem looking for wallet files.  That's not to say that such things don't happen, but I believe the real threats are viruses that get on your computer and siphons off data and send it back to "home base" when it finds it (it will farm the data and send it back the next time it's online).  In this case it probably doesn't even have to send any data back... it just reads your wallet when decrypted and creates a transaction sending all BTC to its owner the next time it's online.

Any computer with access to the internet is vulnerable to these viruses.  You can get them from various exploits usually relating to your browser, or opening PDF/.xls documents with embedded exploits, etc.  However, in order to compromise a truly-offline computer, there's a couple orders-of-magnitude more work for the attacker to do.  They must (1) find a way to hide data on your USB key that (2) exploits an auto-run vulnerability when plugged into the offline computer, and then (3) be able to automatically find the data and copy it back, hidden, on the USB key to get it back to the offline computer.  And these exploits are much more complicated when they don't even know what OS the offline system is.  And if I can find another way to transfer data between systems not using USB keys, then this would even an order of magnitude better...

I would look into this idea posted by N.Z..   It's a bit more work but is definitely a very reasonable solution for a single-computer setup (in fact, I've been thinking about bundling the tails packages like N.Z. suggested, to make this easier).  This means that your wallet only ever touches this sandbox that has no access to internet, and is reset to default configuration on every boot.

As for question 3 (paper backups), you just said in question 2 that you believe flash storage is frail.  This is exactly why you make paper backups.  If you print a paper backup and put it in a safe-deposit box or fold it into a book on your bookshelf, it will still be readable 20+ years from now . It doesn't even have to survive "well", as you could pull the data out of a terribly-faded copy with a bit of work.  I mean, you've seen books that are 50+ years old and their pages are still readable.

Now compare that to any kind of digital media.  You can drop a flash drive, or sit on it or bend it, or put it too close to a magnet, or it just decays and it's no longer usable.  What's your confidence level that even a well-treated USB drive sitting in a metal box will still work 5 years from now?  20 years?    Even CDs and DVDs have expected lifetimes of 2-10 years, but that varies widely depending on lots of factors.  With the paper backup, unless it physically burns to ash, you know it will still provide the data you need to recover your wallet in 20 years.... probably much longer than that.

Another possibility would be to have the offline wallet in a virtual machine without internet access.  Of course a virus could still get access to the file in which the virtual machine harddisk is placed, and thus the "offline" wallet, but the virus would more or less need to be tailored to attack your personal configuration.  So if you keep thousands of bitcoins, you definitely want a dedicated offline machine, but for anything less I would guess that the virtual machine - or even the setup you suggested above - would for all practical purposes be secure.

@picobit
This is probably strictly better than just having an encrypted hot wallet, since it definitely much more complicated to automatically find data in a VM.  It's not as good as an offline solution, but I bet a lot of viruses sit around scanning directories looking for wallets, and it would have to be kind of advanced to be able to pick apart the VM filesystem and/or memory space.  It's definitely doable, but probably not deterministic (especially if you use some obscure OS in your VM).   
(EDIT: though, I'd still place this at substantially less-secure than a real offline solution)

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
Ploo
Full Member
***
Offline Offline

Activity: 125
Merit: 100


View Profile
January 12, 2013, 12:37:11 AM
 #1735

Speaking of storing wallets - how many bits is the seed?

Oh, and the new testing build has raw txs working fine. Thanks
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 12, 2013, 12:42:47 AM
 #1736

Speaking of storing wallets - how many bits is the seed?

It's ultimately 64 bytes:  32-bytes for the root key and 32 bytes for the chaincode.  It's not necessary to have that much entropy, but that's how I designed it a year ago and then it stuck.  The new wallets will probably use 24 bytes of entropy (192 bits) for the root seed, and then you back that up instead of the rootkey&chaincode (those still exist, but they will be derived from the 24-byte seed).

Oh, and the new testing build has raw txs working fine. Thanks

Wow, that was fast!  Glad to see that fixed the problem for you Smiley


Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 12, 2013, 02:14:24 AM
 #1737

Well, I was quite inconvenienced by the upload interface at googlecode, but then I found their upload script.  Now it's a breeze! 
A short python script, and I can upload all the installers correctly tagged, and even spit out a list of forum-formatted strings like below! 

Version 0.87-beta for Ubuntu/Debian 64-bit
Version 0.87-beta for Ubuntu/Debian 32-bit
Version 0.87-beta for Windows 64-bit
Version 0.87-beta for Windows 32- and 64-bit
SHA256 hashes of all installers

Hopefully, this will streamline my release process, since I've always found it to be quite a pain to manually select and upload each individual file, tag them consistently, and then copy the links to a post like this Smiley

Please do a quick sanity check on the download and install process.  If there are no problems with running these, I'll merge into master which will trigger notifications!

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 13, 2013, 03:33:01 PM
 #1738

Armory version 0.87-beta is released.  You should get notifications next time you restart.  If not, Get it here!

@justusranvier:  this time I remembered to tag and sign the repo on this release.  "git tag -v v0.87-beta" should give you a thumbs up.

However, I have found two subtle bugs that trigger rarely, but clearly need to be fixed.  I don't think it's critical, but since I'll be setting up a JSON-RPC server and it will be expected to run reliably, I'm going to have to fix them.  They are:

(1) Armory crashes just after a blockfile split -- the logic to handle a split in real-time was working at one point, but the upgrade to accommodate Bitcoin-Qt 0.8+ seems to have broken it.
(2) If Armory receives two blocks in the same heartbeat (2 sec), it apparently loses sync and no longer see new blocks.  If you leave Armory running long enough, it will happen just by chance.  If you have tx that are stuck at X confirmations, then you can right click on the tx and "Show on Blockchain.info" to see if you are out of sync.  

If you are hit by (2), simply restart.  Though, you should still be able to send and receive coins in this state, but none of the transactions will get past 0 zero confirmations.

Spent the day yesterday exercising and socializing, so I'm sore and introverted today.  I plan to spend most of the day hiding in my office and fixing these bugs, and hopefully also get a working RPC server going.  Thanks again to mav, who gave me an excellent template for the RPC server, and also got it setup with authentication.  Looks like I just gotta fill in the RPC commands and fix those bugs!

THEN back to the new wallets Smiley

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 14, 2013, 03:30:44 AM
Last edit: January 14, 2013, 09:11:22 PM by etotheipi
 #1739

Can someone please help me out understanding how listtransactions really works in Bitcoin-Qt?  This is weird and non-intuitive, and I've spend ungodly amounts of time trying to figure out what they're doing when I just want to spit out my pre-computed ledger (which is what I would expect users to want).  I'm going to add my own version (probably "listledger"), but I feel like I need to have some matching behavior to Bitcoin-Qt, if I don't go insane first.

I'm going to give some hypothetical transactions, and maybe someone can tell me how to break them into outputs of the RPC call "listtransactions".  I'll pay 1.0 BTC for the answers because I've wasted way too much time on this already (1 BTC for all answers, not each)!  It's easily worth that much to have someone tell me (or do the research for me) and save my sanity!  I'm not looking for "the gist", I need details!  Mainly it has to do with transactions that have multiple outputs.  Specifically, how many "results" are produced by listtransactions for each one of these tx, and what are the {"address", "amount", "category", and "fee"}  (and signs on them).  

Addresses A, B, C and D are in my own wallet.  X,Y,Z are other addresses.  

Transaction #1 (SIMPLE Out, No Fee)
------
IN:  A  10
IN:  B   5
---
OUT: X   3
OUT: C  12
-----


Transaction #2 (SIMPLE Out, With Fee)
-----
IN:  A  10
IN:  B   5
---
OUT: X   3
OUT: C  11
--
FEE:     1
-----


Transaction #3 (SIMPLE In, No fee)
-----
IN:  X  10
IN:  Y   5
---
OUT: A   3
OUT: Z  12
-----


Transaction #4 (SIMPLE In, With Fee)
-----
IN:  X  10
IN:  Y   5
---
OUT: A   3
OUT: Z  11
--
FEE:     1
-----


Now the not-so-simple ones (Multi output)

Transaction #5  
-----
IN:  A  10
IN:  B   5
---
OUT: C   3
OUT: D   5
OUT: Z   6
--
Fee:    1
-----


Transaction #6
-----
IN:  A  10
IN:  B   5
---
OUT: C   3
OUT: X   5
OUT: Z   7
-----



Transaction #7
-----
IN:  X  10
IN:  Y   5
---
OUT: C   3
OUT: D   5
OUT: Z   6
--
FEE:     1
-----


Transaction #8
-----
IN:  A  10
IN:  B   5
---
OUT: C   3
OUT: D  12
-----


Transaction #9
-----
IN:  A  10
IN:  B   5
---
OUT: C   3
OUT: D  10
OUT: D   1
--
FEE:     1
-----


Transaction #10
-----
IN:  A  10
IN:  B   5
---
OUT: C  15
-----

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
etotheipi (OP)
Legendary
*
Offline Offline

Activity: 1428
Merit: 1093


Core Armory Developer


View Profile WWW
January 14, 2013, 09:46:01 PM
Last edit: January 15, 2013, 01:18:39 AM by etotheipi
 #1740

I implemented a crappy version of listtransactions that probably doesn't behave much like the bitcoind version, but it is just as confusing (so at least there's something in common).  For each incoming transaction it gives one entry per txOut you own.  For each outgoing transaction, it gives one entry for the total output value (i.e. for your own contributions minus change) and one entry for each non-change receiving address (which can be sending or receiving depending on whose/howmany outputs there are).  I'm sure people will try to use it and complain.  Then I'll fix it to match what they were expecting...

However, I added my own version of listtransactions called "getledger" and "getledgersimple".  It has one entry per transaction and is a pure partition of your wallet activity.

For each transaction "getledgersimple" returns:
  • "direction" is {'send', 'receive', 'toself'}.  To self is any tx for which you own all inputs and outputs.
  • "amount" is the total BTC exchanged (inputs - outputs + change + fee)).  It is always positive.  For example, if I send someone 10 BTC with 0.05 BTC fee and 5 BTC change to myself, "amount is 10".  For to-self tx, change address is assumed to the be the address with the higher generation order (since the wallets always generate change addr after recipients are selected)
  • "netdiff" is the change in your wallet balance induced by the transaction.  For the above transaction, netdiff would be -10.05. If you send money to yourself, netdiff will be the negative of the fee paid.  Summing all returned "netdiff" values returned will give you your wallet balance
  • "fee" is the fee paid for the transaction.  It is always positive, and the caller only has to pay attention to it on outgoing tx if they want (and make it negative).  Or they may want to know how much fee was paid to determine how safe an incoming tx is. (returns zero in bitcoind for incoming transactions)
  • "txsize" is size in bytes of the tx (included for same reason as fee)
  • "firstrecip" is the first "target" of the transaction.  For simple transactions this is your own address for incoming tx, or the other person's address for outgoing tx
  • "changerecip" is the first address that may reasonably be interpretted as change.  Someone sending you money as part of a multi-output tx, this will return the first output address that isn't yours.  Or if the transaction is outgoing, it's the first txout with address in your wallet.

For each transaction "getledger" returns the same as the simple one, but with the following additional output.  This accommodates users that want to handle more-complex, multi-recipient transactions and kind of just want all the information:
  • "senderme":  list of all [address,value] pairs on the input side that are part of this wallet
  • "senderother" list of all [address,value] pairs on the input side that are not part of this wallet
  • "recipme":  list of all [address,value] pairs on the output side that are part of this wallet
  • "recipother" list of all [address,value] pairs on the output side that are not part of this wallet


mav originally setup the thing to handle watching-only wallets only.  I will eventually upgrade it to work on any wallet, and maybe even multiwallet.  But for now it's actually starting to have usefulness, and I'll hold off digging into too many more calls until I get some feedback.   For now, I want to dig into fixing the instability issues I referred to earlier with blocksplits and simultaneous blocks.

P.S. -- This is all on the armoryd branch, and you must have a armoryd.conf file in your Armory home dir specifying "username:password", then use that in the URL for the connecting client.  






Example of simple and nonsimple getledger calls:

getledgersimple
Code:
$ python armoryd.py --testnet getledgersimple
[
    {
        "amount": 10.0,
        "blockhash": "00000000067a1fb9e9634cf2b39f1728392882475c7fcda32db30724584707b6",
        "blocktime": 1357795104,
        "changerecip": "mqMK7xSkrNK5auTzHEJBndtxJiRZW6HMHK",
        "comment": "",
        "direction": "received",
        "fee": 0.00050000000000000001,
        "firstrecip": "mreAZm1osfLWZTKMcaAaQuUqZW59Ysikr5",
        "netdiff": 10.0,
        "txid": "e6582b82cf24888a86aee8b819a8e32f34033f2870d399dd0bcc1b9331331370",
        "txsize": 292,
        "txtime": 1357795104
    },
    {
        "amount": 0.25,
        "blockhash": "000000004a769f6db14bdff5374ce3790d756d4f49770a0f2203087133d3ec3a",
        "blocktime": 1358106188,
        "changerecip": "mzDVubTfVQGfxncSSajjxaRYttXfGJrWdQ",
        "comment": "",
        "direction": "sent",
        "fee": 0.00050000000000000001,
        "firstrecip": "n1NWE4QPX7FbxeBQaPhbr6rEwvHR1RjBWT",
        "netdiff": -0.2505,
        "txid": "747f357c8287da26fcd423e45974e2e1ba367216f0115d15eb2cdd66c4abc767",
        "txsize": 258,
        "txtime": 1358106188
    },
    {
        "amount": 13.5,
        "blockhash": "00000000db486e1907269bdff3fd0b62b1a8c7c51f214e89e57650403922bab9",
        "blocktime": 1358113003,
        "changerecip": "n1Q3DWs7pH5uvME4o3rDYDTd4ZgiqSPCUx",
        "comment": "",
        "direction": "toself",
        "fee": 0.00050000000000000001,
        "firstrecip": "mgdsaZL9WKbKrfxGRw8Rpi9FdRuaMMyyYJ",
        "netdiff": -0.00050000000000000001,
        "txid": "f53bdc6f3a1b573d2efa892591140caf5c88739c42248efdacfb0fd97da4287b",
        "txsize": 618,
        "txtime": 1358113003
    }
]

getledger

Code:
    {
        "amount": 10.0,
        "blockhash": "00000000067a1fb9e9634cf2b39f1728392882475c7fcda32db30724584707b6",
        "blocktime": 1357795104,
        "changerecip": "mqMK7xSkrNK5auTzHEJBndtxJiRZW6HMHK",
        "comment": "",
        "direction": "received",
        "fee": 0.00050000000000000001,
        "firstrecip": "mreAZm1osfLWZTKMcaAaQuUqZW59Ysikr5",
        "netdiff": 10.0,
        "recipme": [
            {
                "address": "mreAZm1osfLWZTKMcaAaQuUqZW59Ysikr5",
                "amount": 10.0
            }
        ],
        "recipother": [
            {
                "address": "mqMK7xSkrNK5auTzHEJBndtxJiRZW6HMHK",
                "amount": 14.499499999999999
            },
            {
                "address": "mi6hyHi3zVPx8sgB6wuf6cKkXPswa5NFDf",
                "amount": 0.5
            }
        ],
        "senderme": [],
        "senderother": [
            {
                "address": "mqy7NzHrcFLu32YK1ow6L4V2YC4PFCChHB",
                "amount": 25.0
            }
        ],
        "txid": "e6582b82cf24888a86aee8b819a8e32f34033f2870d399dd0bcc1b9331331370",
        "txsize": 292,
        "txtime": 1357795104
    },
    {
        "amount": 0.25,
        "blockhash": "000000004a769f6db14bdff5374ce3790d756d4f49770a0f2203087133d3ec3a",
        "blocktime": 1358106188,
        "changerecip": "mzDVubTfVQGfxncSSajjxaRYttXfGJrWdQ",
        "comment": "",
        "direction": "sent",
        "fee": 0.00050000000000000001,
        "firstrecip": "n1NWE4QPX7FbxeBQaPhbr6rEwvHR1RjBWT",
        "netdiff": -0.2505,
        "recipme": [
            {
                "address": "mzDVubTfVQGfxncSSajjxaRYttXfGJrWdQ",
                "amount": 9.7494999999999994
            }
        ],
        "recipother": [
            {
                "address": "n1NWE4QPX7FbxeBQaPhbr6rEwvHR1RjBWT",
                "amount": 0.25
            }
        ],
        "senderme": [
            {
                "address": "mreAZm1osfLWZTKMcaAaQuUqZW59Ysikr5",
                "amount": 10.0
            }
        ],
        "senderother": [],
        "txid": "747f357c8287da26fcd423e45974e2e1ba367216f0115d15eb2cdd66c4abc767",
        "txsize": 258,
        "txtime": 1358106188
    },
    {
        "amount": 13.5,
        "blockhash": "00000000db486e1907269bdff3fd0b62b1a8c7c51f214e89e57650403922bab9",
        "blocktime": 1358113003,
        "changerecip": "n1Q3DWs7pH5uvME4o3rDYDTd4ZgiqSPCUx",
        "comment": "",
        "direction": "toself",
        "fee": 0.00050000000000000001,
        "firstrecip": "mgdsaZL9WKbKrfxGRw8Rpi9FdRuaMMyyYJ",
        "netdiff": -0.00050000000000000001,
        "recipme": [
            {
                "address": "n1Q3DWs7pH5uvME4o3rDYDTd4ZgiqSPCUx",
                "amount": 1.7490000000000001
            },
            {
                "address": "mgdsaZL9WKbKrfxGRw8Rpi9FdRuaMMyyYJ",
                "amount": 13.5
            }
        ],
        "recipother": [],
        "senderme": [
            {
                "address": "mzDVubTfVQGfxncSSajjxaRYttXfGJrWdQ",
                "amount": 9.7494999999999994
            },
            {
                "address": "n34NnSRwMTUaHnx4R5ykmcjecoDn8uVXUA",
                "amount": 3.25
            },
            {
                "address": "n34NnSRwMTUaHnx4R5ykmcjecoDn8uVXUA",
                "amount": 2.25
            }
        ],
        "senderother": [],
        "txid": "f53bdc6f3a1b573d2efa892591140caf5c88739c42248efdacfb0fd97da4287b",
        "txsize": 618,
        "txtime": 1358113003
    }
]


P.S -- As far as I can tell, the ultra-high-precision values/amounts are due to the python-JSON library display.  It's a display issue caused by the fact that someone a long time ago decided the JSON interface should transport floats for amounts, instead of strings or satoshis, and the JSON library just prints the raw floats.  Luckily, double-precision values have enough precision that this will never screw up from a simple round() call.  But clearly, this is sub-optimal.  And since I'm using a built-in json.dumps call in python, I can't really modify the behavior.  

I'm thinking I could add a "setamtcoding COIN" or "setamtcoding STRING" to tell the RPC server to always encode values as longs (in Satoshis) or string values with at most 8 decimal places.  I could also make the last argument to every RPC call be "COIN" or "STRING" to tell the server what to output for that particular call.  But that seems kind of messy.

Founder and CEO of Armory Technologies, Inc.
Armory Bitcoin Wallet: Bringing cold storage to the average user!
Only use Armory software signed by the Armory Offline Signing Key (0x98832223)

Please donate to the Armory project by clicking here!    (or donate directly via 1QBDLYTDFHHZAABYSKGKPWKLSXZWCCJQBX -- yes, it's a real address!)
Pages: « 1 ... 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 [87] 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 ... 231 »
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!