Title: Nxt :: Asset Exchange Test Post by: mcjavar on March 09, 2014, 12:49:31 AM Nxt :: Asset Exchange Test I have set up a test management tool using Test Pad for the Asset Exchange Testing. I decided to only register one account for the testers, instead of registering separate accounts for everyone (any paying $9/user/month). Please PM me for the password. How to use Test Pad The login screen. https://ontestpad.com/login (https://ontestpad.com/login) http://www.nextcoin.de/TP/1ot_login.JPG This is the project overview, where you can select te test cases. http://www.nextcoin.de/TP/2ot_project_ov.JPG This is the test case detailed view. On the right, marked with yellow, you see the test runs. Every testrun (when a test was carried out by someone) has its own column. http://www.nextcoin.de/TP/3ot_test_case.JPG You can start a testrun by clicking the marked icon. http://www.nextcoin.de/TP/4ot_test_case_play.JPG You click through the test case using the marked pop up. http://www.nextcoin.de/TP/5ot_test_case_play2.JPG When the test is through, the testcase is marked as successfull. http://www.nextcoin.de/TP/6ot_test_case_play3.JPG You can create test cases using this tool AND you can also edit all existing ones, therefore only well known community members will get access to the tool. This is to ensure quality testing. Please let me know about your thoughts. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 09, 2014, 02:08:00 AM 3-4
Purpose: 1k+ users issue a same asset(with same name ,e.g.Doge), Level 3 Prereq: secretphrase,balance Test Data: balance = >1000 name=Doge (same name) Steps: 1. enter secrephrase 2. enter the name 3. enter a quantity 4. click issue asset 5. verify only one user succeeded i can help create test cases in Test Pad Title: Re: Nxt :: Asset Exchange Test Post by: allwelder on March 09, 2014, 03:21:13 AM I used the welys's client for test.
Where did my anther 5 issued asset(named Nxt) go? http://s25.postimg.org/h0rrfezor/issued_asset.jpg (http://postimg.org/image/h0rrfezor/) Title: Re: Nxt :: Asset Exchange Test Post by: mcjavar on March 09, 2014, 03:38:26 AM 3-4 Purpose: 1k+ users issue a same asset(with same name ,e.g.Doge), Level 3 Prereq: secretphrase,balance Test Data: balance = >1000 name=Doge (same name) Steps: 1. enter secrephrase 2. enter the name 3. enter a quantity 4. click issue asset 5. verify only one user succeeded i can help create test cases in Test Pad Thank you, I´ve sent you the password for Test Pad. Title: Re: Nxt :: Asset Exchange Test Post by: mcjavar on March 09, 2014, 03:39:19 AM I used the welys's client for test. Where did my anther 5 issued asset(named Nxt) go? http://s25.postimg.org/h0rrfezor/issued_asset.jpg (http://postimg.org/image/h0rrfezor/) You sold it? Or someone else sold it? (becaue you are using a simple passphrase) Title: Re: Nxt :: Asset Exchange Test Post by: allwelder on March 09, 2014, 02:59:36 PM I used the welys's client for test. Where did my anther 5 issued asset(named Nxt) go? http://s25.postimg.org/h0rrfezor/issued_asset.jpg (http://postimg.org/image/h0rrfezor/) You sold it? Or someone else sold it? (becaue you are using a simple passphrase) Thank you. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 10, 2014, 02:19:13 AM funciton test Level-1,contain 8 test cases
1-1 Purpose: Issue Asset- Level 1 Prereq: secretphrase,balance Test Data: balance = {0, <1000, 1000,>1000} name len(0,1,2,3,4,5,6,7,8,9,10,11,100) quantity=(-1,0,0.1,1,100,1000,100000000000000000000000) Steps: 1. enter secrephrase 2. enter name 3. enter quantity 4. click issue 5. verify transaction is correct 1-2 Purpose: place ask order- Level 1 Prereq: secretphrase,asset id,asset quantity Test Data: assetid={other acccount issued asset,i issued asset} balance = {0, 1, >1} price(-1,0,1.0,>1) quantity=(-1,0,0.1, =1, asset.quantity,> asset quantity) Steps: 1. enter secrephrase 2. enter assetid/select a asset 3. enter quantity 4. enter price 5. click place-ask-order 6. verify transaction is correct or not 1-3 Purpose: place bid order- Level 1 Prereq: secretphrase,asset id,asset quantity,balance Test Data: assetid={other acccount issued asset,i issued asset balance = {0, =quantity*price, > quantity*price } price(-1,0,1.0,>1) quantity=(-1,0,0.1, =1, asset.quantity,> asset quantity) Steps: 1. enter secrephrase 2. enter assetid/select a asset 3. enter quantity 4. enter price 5. click place-bid-order 6. verify transaction is correct or not 1-4 Purpose: cancel ask order- Level 1 Prereq: secretphrase,asset ask order Test Data: ask order Steps: 1. enter secrephrase 2. enter orderid/select a ask-order 3. click cancel-place-ask-order 4. verify this order is cancelled or not 1-5 Purpose: cancel bid order- Level 1 Prereq: secretphrase,asset bid order Test Data: bid order- Level 1 Steps: 1. enter secrephrase 2. enter orderid/select a bid-order 3. click cancel-place-bid-order 4. verify this order is cancelled or not 1-6 Purpose: check asset quantity- Level 1 Prereq: secretphrase,asset id ,asset.quantity Test Data: quantity=asset.quantity-1, asset.quantity, asset.quantity+1 Steps: 1. enter secrephrase 2. enter asset id/select a asset 3. enter quantity 4. place a ask order 5. verify this order is correct or not 6. verify quantity=your quantity. 1-7 Purpose: place a ask order, don’t match- Level 1 Prereq: secretphrase,bid-order Test Data: price < bid-order.price Steps: 1. enter secrephrase 2. select a bid order 3. enter price 4. click place-ask-order 5. verify transaction is correct or not 6. verify balance=balance-fee 7. verify your asset quantity= your asset quantity -quantity 1-8 Purpose: place a bid order, don’t match- Level 1 Prereq: secretphrase,ask-order Test Data: price < ask-order.price Steps: 1. enter secrephrase 2. select a ask order 3. enter price 4. click place-bid-order 5. verify transaction is correct or not 6. verify balance=balance-quantity*price-fee 7. verify your asset quantity don’t change tester ,please test these test cases. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 11, 2014, 03:47:45 AM Asset Test Report: (windows xp)one pc run 4 test-tools, one notebook run 4 tools too, every peer place bid 1000 orders(Asset:aaa), at GMT 2014-03-10 08:40:00 at the same time. Asset:aaa peer place order confirmed orders account workstation http://tn01.nxtsolaris.info:6876 1000 dead, T1 PC-A http://node10.mynxtcoin.org:6876 1000 920 T2 PC-A http://node9.mynxtcoin.org:6876 1000 925 T3 PC-A http://testnxt-jp.cloudapp.net:6876 1000 all M =1450 M PC-A http://testnxt-ne.cloudapp.net:6876 1000 0 T1 NB-B http://testnxt-we.cloudapp.net:6876 1000 12 T2 NB-B 127.0.0.1:6876 0.8.8 1000 all M =1450 M NB-B 127.0.0.1:6876 1000 all M =1450 M NB-B insert table show incorrect ??? 1. NRS can only show 1000 transactions. 2. account M should finished 3000, actual 1450 confirmed, this half orders were confirmed. don’t know how many orders placed successfully. 3. why account T1(18417951495642174144) have no orders confirmed?. Test1 18417951495642174144 Test2 9404937923603975012 Test3 14940513848409477098 Master 1562462127635514638 after modifing the test tools, i will test the case again tomorrow. after rechecked the balance, found bugs. Test3 14940513848409477098 1.balance has a little wrong before balance:5100 issued 1000 bid order ,sum(quantity*price)=54.81 fee =1000 new balance 5100-1000-54.81=4045.19 (NRS 4045) 2. NRS can only show 925(bid orders),others 75 confirmed don't show ,but in my test tool, show these transactions Test2 9404937923603975012 1.balance has a little wrong balance:5100 issued 1007 bid order ,sum(quantity*price)=54.65 fee =1007 new balance 5100-1000-54.81=4038.35(4037.81 NRS) 2. NRS can only show 932(bid orders),others 75 confirmed don't show ,but in my test tool, show these transactions Title: Re: Nxt :: Asset Exchange Test Post by: salsacz on March 14, 2014, 04:16:45 PM nice pictures, but I really have no idea how to get to the Asset Exchange (link) and how to run it (do I need to install anything?)
Title: Re: Nxt :: Asset Exchange Test Post by: l8orre on March 14, 2014, 05:13:49 PM nice pictures, but I really have no idea how to get to the Asset Exchange (link) and how to run it (do I need to install anything?) I have to admit that I don't know how to operate this either. I am using FreeRider to make the tests. Maybe on Monday I can push an update of FreeRider, where I can Flags where to put in tests! And an explanation here on how to do it! Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 15, 2014, 01:00:31 PM Asset Test Report: (windows xp)one pc run 4 test-tools, one notebook run 4 tools too, every peer place bid 1000 orders(Asset:aaa), at GMT 2014-03-10 08:40:00 at the same time. Asset:aaa peer place order confirmed orders account workstation http://tn01.nxtsolaris.info:6876 1000 dead, T1 PC-A http://node10.mynxtcoin.org:6876 1000 920 T2 PC-A http://node9.mynxtcoin.org:6876 1000 925 T3 PC-A http://testnxt-jp.cloudapp.net:6876 1000 all M =1450 M PC-A http://testnxt-ne.cloudapp.net:6876 1000 0 T1 NB-B http://testnxt-we.cloudapp.net:6876 1000 12 T2 NB-B 127.0.0.1:6876 0.8.8 1000 all M =1450 M NB-B 127.0.0.1:6876 1000 all M =1450 M NB-B insert table show incorrect ??? 1. NRS can only show 1000 transactions. 2. account M should finished 3000, actual 1450 confirmed, this half orders were confirmed. don’t know how many orders placed successfully. 3. why account T1(18417951495642174144) have no orders confirmed?. Test1 18417951495642174144 Test2 9404937923603975012 Test3 14940513848409477098 Master 1562462127635514638 after modifing the test tools, i will test the case again tomorrow. after rechecked the balance, found bugs. Test3 14940513848409477098 1.balance has a little wrong before balance:5100 issued 1000 bid order ,sum(quantity*price)=54.81 fee =1000 new balance 5100-1000-54.81=4045.19 (NRS 4045) 2. NRS can only show 925(bid orders),others 75 confirmed don't show ,but in my test tool, show these transactions Test2 9404937923603975012 1.balance has a little wrong balance:5100 issued 1007 bid order ,sum(quantity*price)=54.65 fee =1007 new balance 5100-1000-54.81=4038.35(4037.81 NRS) 2. NRS can only show 932(bid orders),others 75 confirmed don't show ,but in my test tool, show these transactions (Level 3-2 :purpose: 1k+ bidorders match a ask order.) Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 15, 2014, 01:01:54 PM nice pictures, but I really have no idea how to get to the Asset Exchange (link) and how to run it (do I need to install anything?) Asset Tester version 0.2 Windows Platform https://bitbucket.org/btc2nxt/nxt_tester/downloads/Nxt_Tester_Win32_64.rar Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 15, 2014, 02:58:38 PM Level 3-1 Test Case
Purpose: multi-bidorder VS multi-ask-order account T1, balance=2098.99 at GMT 08:10, place 1000 ask orders(asset=aacoin), price=1, quantity between 1 and 10 succeeded 999 ask orders( i can see 1000 transaction in test-tool with 974 ask orders and 27 old transaction. And when i first time login NRS with account T1, i saw 1025 transaction in NRS with 26 old transactions) account t7, balance=4044 at GMT 08:10, place 1000 bid orders(asset=aacoin), price=1, quantity between 1 and 10 succeeded 999 bid orders(total cost 54.93) Test-tools showed 196 bid orders don’t match , sum=10.94 if t1 has placed successfully 999 ask orders. account ask/bid costs fee new balance NRS showing balance t1(2098.99) +43.99(54.93-10.94) -999 1143.98 1203.65 (?) t7(4044) -54.93 -999 2990.07 2990.07 (OK) if t1 has placed successfully 974 ask orders. t1(2098.99) +43.99 -974 1168.98 1203.65 (?) i guess ask-orders may has been miscalculated. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 16, 2014, 05:35:29 AM Level 3-1 Test Case Purpose: multi-bidorder VS multi-ask-order account T1, balance=2098.99 at GMT 08:10, place 1000 ask orders(asset=aacoin), price=1, quantity between 1 and 10 succeeded 999 ask orders( i can see 1000 transaction in test-tool with 974 ask orders and 27 old transaction. And when i first time login NRS with account T1, i saw 1025 transaction in NRS with 26 old transactions) account t7, balance=4044 at GMT 08:10, place 1000 bid orders(asset=aacoin), price=1, quantity between 1 and 10 succeeded 999 bid orders(total cost 54.93) Test-tools showed 196 bid orders don’t match , sum=10.94 if t1 has placed successfully 999 ask orders. account ask/bid costs fee new balance NRS showing balance t1(2098.99) +43.99(54.93-10.94) -999 1143.98 1203.65 (?) t7(4044) -54.93 -999 2990.07 2990.07 (OK) if t1 has placed successfully 974 ask orders. t1(2098.99) +43.99 -974 1168.98 1203.65 (?) i guess ask-orders may has been miscalculated. nxt.8.10, re-tested this case , Ok. account T8, balance=4036 at GMT 04:40, place 998 ask orders(asset=t8coin), price=1, quantity between 1 and 10 succeeded 996 ask orders Test-tools showed 101 ask orders don’t match , sum=5.57 account t9, balance=946 at GMT 04:40, place 998 bid orders(asset=t8coin), price=1, quantity between 1 and 10 succeeded 896 bid orders(total cost 49.16) account ask/bid costs fee new balance NRS showing balance t8(4036-1000) +49.16 -996 2089.16 2089.16 (OK) t9(946) -49.16 -896 0.84 0.84 (OK) Title: Re: Nxt :: Asset Exchange Test Post by: bestcoin3f on March 16, 2014, 05:42:18 AM This information is very useful, thank you.
Title: Re: Nxt :: Asset Exchange Test Post by: l8orre on March 16, 2014, 09:57:12 AM just ran successfullyy the followint test: place 5 bid orders with delay of 0.1seconds for FreeRiders __AE_TESTASSET for 1.00, 1.01 , 1.02, 1.03 , 1.04 NXT then switched accts and issued 5 ASK orders opposing price. 3 ASK and BID orders got matched, the other 2 ASK and 2 BID orders were not matched due to matching algo. Code: test reports go here Code: test comments go here Title: Re: Nxt :: Asset Exchange Test Post by: l8orre on March 16, 2014, 10:17:07 AM I have just updated FreeRider to include a 'nxtTestCases' class, that allows scripting of NRS queries, and a Win6 that has basic buttons and text edits to disply results.
I am currently running a test where 1000 BID orders are issued with increasing prices in increments of 0.01Nxt as per CfB, jetty uses a queue wirth max length 50, so that qeuries are discarded whenever this queue is full. Ubuntu, needs Qt4, python requests module, and python3 You can download FreeRider here: git clone https://github.com/l8orre/FreeRider for questions and comments, PM me or ask here ... update: this looks good, because I have orders from 100 .. 1099 sitting in the order book ! check out the FreeRiders! Later, I'll try to SELL them with ONE collective ASK order from the issuer, and calculate the moneyTransfer involved edit: just kicking up a MASSIVE SELL wall of 2500 SELL orders for FreeRiders - time delay is 500ms between two queries price increment is 0.01Nxt, Volume is random between 1..12 hey guys and gals - try to get some! Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 17, 2014, 04:35:23 AM Level-2 bid-ask match test cases,contain 6 test cases
2-1 Purpose: multi-bids equal 1 ask-order Level 2 Prereq: secretphrase,ask order Test Data: bid orders (1,2,3,10 bid-orders) Steps: 1. enter secrephrase 2. select a ask-order 3. place a -bid-order(quantity,price=ask-order) 4. verify this order is correct or not 5. verify balance=balance-quantity*price-fee 6. verify asset=asset+quantity 7. repeat step3 use 2,3,10 bid-orders,total quantity=askorder.quantity 8. repeat step4,5,6, check is correct or not 2-2 Purpose: multi-asks equal 1 bid-order Level 2 Prereq: secretphrase,bid order Test Data: ask orders (1,2,3,10 ask-orders) Steps: 1. enter secrephrase 2. select a bid-order 3. place a ask-order(quantity,price=bid-order) 4. verify this order is correct or not 5. verify balance=balance+quantity*price-fee 6. verify asset=asset - quantity 7. repeat step3,4,5 use 2,3,10 ask-orders,total quantity=bidorder.quantity 8. repeat step4,5,check is correct or not 2-3 Purpose: multi-bids match 1 ask-order Level 2 Prereq: secretphrase,ask order Test Data: bid orders (1,2,3,10 bid-orders),total quantity<,= ,> askorder.quantity Steps: 1. enter secrephrase 2. select a ask-order 3. place a -bid-order(quantity,price=ask-order) 4. verify this order is correct or not 5. verify balance=balance-quantity*price-fee 6. verify asset=asset+quantity 7. repeat step 3 use 2,3,10 bid-orders,total quantity>,=, or < askorder.quantity 8. repeat step3,4,5,6, check is correct or not 2-4 Purpose: multi-asks match 1 bid-order Level 2 Prereq: secretphrase,bid order Test Data: ask orders (1,2,3,10 ask-orders),total quantity<, ,> bidorder.quantity,price<,=,> bidorder.price Steps: 1. enter secrephrase 2. select a bid-order 3. place a ask-order(quantity< or> bidorder.quantity,price<,=,or > bid-order.price) 4. verify this order is correct or not 5. verify balance=balance+quantity*price-fee, if price>=bidorder.price 6. verify asset=asset-quantity 7. repeat step 3 use 2,3,10 ask-orders,total quantity>,=, or < askorder.quantity 8. repeat step3,4,5,6, check is correct or not 2-5 Purpose: multi-bids match 1 ask-order, and cancel the askorder Level 2 Prereq: secretphrase,ask order Test Data: bid orders (1,2,3,10 bid-orders) ,a ask order total quantity<,=,> askorder.quantity price = or > askorder.price Steps: 1. enter secrephrase 2. select a ask-order 3. place a -bid-order(quantity,price=ask-order) 4. verify place this order is correct or not(maybe unconfirmed) 5. cancel the ask order 6. verify cancel succeed 7. verify balance=balance-quantity*price-fee 8. verify asset=asset+quantity, if bid-order confirmed faster than cancel askorder confirmed, else asset don’t change. 9. repeat step3 use 2,3,10 bid-orders,total quantity=askorder.quantity,repeate step 5 10. repeat step6,7,8, check is correct or not. Maybe some of bids matched successfully,check the balance,and asset quantity. in this case ,we can cancel bid orders too. 2-6 Purpose: multi-asks match 1 bid-order, and cancel the bidorder Level 2 Prereq: secretphrase,bid order Test Data: ask orders (1,2,3,10 bid-orders) ,a bid order total quantity<,=,> bidorder.quantity price = or > bidorder.price Steps: 1. enter secrephrase 2. select a bid-order 3. place a ask-order(quantity,price<,=,or >ask-order) 4. verify place this order is correct or not(maybe unconfirmed) 5. cancel the bid order 6. verify cancel succeed 7. verify balance=balance+quantity*price-fee 8. verify asset=asset-quantity, if ask-orders confirmed faster than cancel bidorder confirmed, else balance don’t change. 9. repeat step3 use 2,3,10 ask-orders,total quantity<,= or >bidorder.quantity,repeate step 5 10. repeat step6,7,8, check is correct or not. Maybe some of asks matched successfully,check the balance,and asset quantity. in this case ,we can cancel ask orders too. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 17, 2014, 04:35:58 AM ontestpad updated
Title: Re: Nxt :: Asset Exchange Test Post by: coinmine33 on March 17, 2014, 05:51:29 AM good information foe me. thank you.
Title: Re: Nxt :: Asset Exchange Test Post by: l8orre on March 17, 2014, 12:45:01 PM possible bug in AE -pls try to reproduce!
assetIssuer 9840660337823721473 I have tried to issue several assets today, but it seems to fail. In total, I made seven attempts, but only one got through. Detail: issuing three assets, getting TX ids. after ~90minutes, no TX_ids any longer (unknown TX) , but also no assets: TX: 15181402849793554666 - Mon Mar 17 10:45:19 2014 issuedAsset TX: 17515598319859627363 - Mon Mar 17 10:45:48 2014 issuedAsset TX: 9095011876083935376 - Mon Mar 17 10:46:20 2014 issuedAsset tried again, this time looking closely at the balances: edit : third attempt did it. aprently, TX can be unwound - I had expiry 100 , so maybe that was it. Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 18, 2014, 03:19:23 AM possible bug in AE -pls try to reproduce! assetIssuer 9840660337823721473 I have tried to issue several assets today, but it seems to fail. In total, I made seven attempts, but only one got through. Detail: issuing three assets, getting TX ids. after ~90minutes, no TX_ids any longer (unknown TX) , but also no assets: TX: 15181402849793554666 - Mon Mar 17 10:45:19 2014 issuedAsset TX: 17515598319859627363 - Mon Mar 17 10:45:48 2014 issuedAsset TX: 9095011876083935376 - Mon Mar 17 10:46:20 2014 issuedAsset tried again, this time looking closely at the balances: edit : third attempt did it. aprently, TX can be unwound - I had expiry 100 , so maybe that was it. i remember that i often fail issuing asset in test-tools many times, so i issued it in firefox instead Title: Re: Nxt :: Asset Exchange Test Post by: btc2nxt on March 19, 2014, 04:41:31 AM Level 3-3 1k+ ask-orders match a bid order
1. T6=745405442906404637 balance=910.39 (have 979 trans before) place a bid order qty=4000, price=5 2. t11=12363926192274692767 balance=1377 placed 997 ask order(t11 issued asset 11coin, ) , qty 1-10, price1-10(GMT3) 3. T11 has succeed placing 997 ask orders, but only 110 ask orders can be seen with sum 42.35 and 55 ask orders left with sum 36.3(price>=6) after matching 4. bid order left quantity=3835 t11 1377 -1000 -36.3 -110 42.35 273.05 275.25(NRS) (?) t6 910.39 -3835*0.05 -(42.35-36.3) -1 711.59 709.39(NRS) (?) T11,T6 balance are all wrong. T11 gained 2.2 more, and T6 lost 2.2. btw ontestpad updated |