|
Title: Please test (if you dare): next-test 2013-04-12 Post by: Luke-Jr on April 12, 2013, 07:43:02 PM Superceded with next-test 2013-07-21 (https://bitcointalk.org/?topic=260749) next-test is a branch of the master bitcoind & Bitcoin-Qt code with as many pull requests merged as possible, to aid in testing them. This branch can be used to test many pull requests in your daily Bitcoin use. The goal is to help pull requests get the testing they need to be merged into the main tree, so once you test a change, please comment in the relevant pull request (ideally with details). Please note these might possibly corrupt your wallet. No warranty of any kind of provided. BACKUP YOUR WALLET
Today's next-test includes the following pull requests (green are merged now; red are disputed):
Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Gavin Andresen on April 12, 2013, 08:03:54 PM For the record:
I think testing a gazillion pulls at once is madness, because if something doesn't work it can be incredibly difficult to figure out which of the gazillion changes made it break. Assuming that just once change made it break and not some subtle interaction between two or three or six changes... If you want to help test, I think it would be much more helpful if you find a feature you care about, grab the binaries that the pull-tester creates, test thoroughly, and then report results in the pull request on github. Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Luke-Jr on April 12, 2013, 08:24:05 PM If you want to help test, I think it would be much more helpful if you find a feature you care about, grab the binaries that the pull-tester creates, test thoroughly, and then report results in the pull request on github. Indeed, thorough testing of individual pull requests is by far better (and safer).Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: kerogre256 on April 12, 2013, 08:45:05 PM For the record: Agree too many things .... I think testing a gazillion pulls at once is madness, because if something doesn't work it can be incredibly difficult to figure out which of the gazillion changes made it break. Assuming that just once change made it break and not some subtle interaction between two or three or six changes... If you want to help test, I think it would be much more helpful if you find a feature you care about, grab the binaries that the pull-tester creates, test thoroughly, and then report results in the pull request on github. Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: phatsphere on April 12, 2013, 08:46:20 PM I'm not really sure how you devs are organized, but at another project I'm working on we have a patchbot. Translated to this here, it would make a new build every time a new changeset is posted to a pull request. Then it runs the test suite. If it passes, it reports back to the pull request and provides a link to download this specific binary.
Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Luke-Jr on April 12, 2013, 08:48:40 PM I'm not really sure how you devs are organized, but at another project I'm working on we have a patchbot. Translated to this here, it would make a new build every time a new changeset is posted to a pull request. Then it runs the test suite. If it passes, it reports back to the pull request and provides a link to download this specific binary. That's exactly what the Pull Tester Gavin mentioned does already...Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Sukrim on April 12, 2013, 08:50:19 PM If you look at the pull requests this seems to be the case with bitcoin too... however the bot doesn't seem to build trunk + all pull requests at once, only trunk + single pull request.
I'm not too sure what to test with these binaries though, maybe if I "need" 2-3 features I can save on building time? On a different note, is there a buildbot that one can run and that would somehow help devs? I don't mind donating some CPU time and space for a VM that builds and tests builds automatically in the background if it means having a better/more stable client... Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Luke-Jr on April 12, 2013, 08:54:59 PM If you look at the pull requests this seems to be the case with bitcoin too... however the bot doesn't seem to build trunk + all pull requests at once, only trunk + single pull request. Yes, combining many pull requests is not trivial and requires a real human to do.I'm not too sure what to test with these binaries though, maybe if I "need" 2-3 features I can save on building time? Well, the idea is you can run it as your ordinary everyday client (with the awareness that it has a lot of untested and potentially broken code) and maybe hopefully stumble upon some bug we're not thinking to test for explicitly.Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Sukrim on April 12, 2013, 09:20:55 PM I'd recommend to implement something along the lines of "non-final builds of bitcoin-qt need to have mainnet explicitly enabled, just like official releases need to enable testnet explicitly".
Might make it easier for people to try out stuff like this and minimizing potential losses of "real" coins. A con would be of course that then there would be an artificial ecosystem and bugs with mainnet (like the "database heavy blocks" hard fork recently) might be lost. The main focus on these releases seems to be something else though anyways (checking if several pull requests cause strange effects with each other). Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: niko on April 12, 2013, 09:32:24 PM Since this is posted in the general forum board, can someone explain to me like I'm five:
Are there Windows installers available with only one thing changed, or at most a group of strongly related changes? Any chance developers can decide on high-priority pull requests, and build multiple installers for people to test on their machines? If so, is there a list of recommended things to try when testing? Where to get testnet coins? Does it even make sense to spend human users' time testing this, as opposed to automating testing in some way? Title: Re: Please test (if you dare): next-test 2013-04-12 Post by: Luke-Jr on July 22, 2013, 10:04:56 PM Superceded with next-test 2013-07-21 (https://bitcointalk.org/?topic=260749) |