Bitcoin Forum
March 28, 2024, 12:14:10 PM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 [2]  All
  Print  
Author Topic: Downloadable MtGox Historical Candles  (Read 7894 times)
whydifficult (OP)
Sr. Member
****
Offline Offline

Activity: 287
Merit: 250



View Profile WWW
August 20, 2013, 08:21:43 AM
Last edit: August 20, 2013, 10:59:17 AM by whydifficult
 #21

When there are no trades during a giving candle interval the candles are removed from the files. While instead they should have an OHLC of close of the previous candle, I guess this could be the cause.

EDIT: I will update the candles including empty candles ASAP.

Gekko a nodejs bitcoin trading bot!
Realtime Bitcoin Globe - visualizing all transactions and blocks
Tip jar (BTC): 1KyQdQ9ctjCrGjGRCWSBhPKcj5omy4gv5S
1711628050
Hero Member
*
Offline Offline

Posts: 1711628050

View Profile Personal Message (Offline)

Ignore
1711628050
Reply with quote  #2

1711628050
Report to moderator
1711628050
Hero Member
*
Offline Offline

Posts: 1711628050

View Profile Personal Message (Offline)

Ignore
1711628050
Reply with quote  #2

1711628050
Report to moderator
1711628050
Hero Member
*
Offline Offline

Posts: 1711628050

View Profile Personal Message (Offline)

Ignore
1711628050
Reply with quote  #2

1711628050
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1711628050
Hero Member
*
Offline Offline

Posts: 1711628050

View Profile Personal Message (Offline)

Ignore
1711628050
Reply with quote  #2

1711628050
Report to moderator
nitrous
Sr. Member
****
Offline Offline

Activity: 246
Merit: 250


View Profile
August 20, 2013, 11:37:55 AM
 #22

I'm looking forward to it. In the meantime, the candles I'm downloading seem to have a slight variation from the ones you've calculated, leading to completely different backtesting results. Would you mind taking a look when you get a chance? I'm not sure where the variation stems from.

Hi, I had a look at the difference between whydifficult's daily BTCUSD data and the data from bitcoincharts, and I noticed that whilst bitcoincharts data is aligned to midnight GMT for each datum, whydifficult's data is aligned to 17:00 GMT for each day, so that is likely the source of the differences wrt his data. This difference alignment shouldn't really cause a problem though. As for my data, I'll have a look at that now (remember I used 900s/1800s intervals, not 900m/1800m).

Donations: 1Q2EN7TzJ6z82xvmQrRoQoMf3Tf4rMCyvL
MtGox API v2 Unofficial Documentation: https://bitbucket.org/nitrous/mtgox-api/overview
MtGox API v2 Unofficial Documentation Forum Thread: https://bitcointalk.org/index.php?topic=164404.0
nitrous
Sr. Member
****
Offline Offline

Activity: 246
Merit: 250


View Profile
August 20, 2013, 11:45:43 AM
 #23

I'm looking forward to it. In the meantime, the candles I'm downloading seem to have a slight variation from the ones you've calculated, leading to completely different backtesting results. Would you mind taking a look when you get a chance? I'm not sure where the variation stems from.

Ok, I looked at my data too and unfortunately I can't compare the two datasets. For example, my 1800s candles (due to the currently available bq data) only goes up to 23 May 2013, whilst the bitcoincharts data will only start at 22 Jun 2013, so unfortunately I can't really compare the two.

Donations: 1Q2EN7TzJ6z82xvmQrRoQoMf3Tf4rMCyvL
MtGox API v2 Unofficial Documentation: https://bitbucket.org/nitrous/mtgox-api/overview
MtGox API v2 Unofficial Documentation Forum Thread: https://bitcointalk.org/index.php?topic=164404.0
TradesLikeAPotato
Newbie
*
Offline Offline

Activity: 41
Merit: 0


View Profile
August 20, 2013, 05:15:55 PM
 #24

Make sure you select custom time, I have candles from your start date up to yesterday because I copied 5 month intervals into my Excel sheet.
nitrous
Sr. Member
****
Offline Offline

Activity: 246
Merit: 250


View Profile
August 20, 2013, 06:09:26 PM
 #25

Make sure you select custom time, I have candles from your start date up to yesterday because I copied 5 month intervals into my Excel sheet.

Thanks. Ok I believe I see the reason now - bitcoincharts reuses the closing price of the last datum for the opening price of the next, whereas I only included trades within the range t and t+i (where t is the unix timestamp at the start of the candle and i is the candle interval). Both ways make sense - bitcoincharts gives the theoretical price for a trade if you were to do it at t, whereas whydifficult's and mine give the price for the first trade - however our way conforms to the official use of the term 'opening price' http://www.investopedia.com/terms/o/openingprice.asp. Except for the opening price, most of my data agrees with that of bitcoincharts', except for where the opening price is the same as the high, low or closing, in which case my values differ in about 5% of cases.

Make of this what you will. I don't think it makes too much of a difference anyway - backtesting is an approximation, and during real trading your actual trade prices are likely to be different from those given by the candles anyway. All of these datasets seem to be accurate, albeit inconsistent with each other, but these inconsistencies seem easily explained.

Donations: 1Q2EN7TzJ6z82xvmQrRoQoMf3Tf4rMCyvL
MtGox API v2 Unofficial Documentation: https://bitbucket.org/nitrous/mtgox-api/overview
MtGox API v2 Unofficial Documentation Forum Thread: https://bitcointalk.org/index.php?topic=164404.0
nitrous
Sr. Member
****
Offline Offline

Activity: 246
Merit: 250


View Profile
August 20, 2013, 06:22:34 PM
 #26

On a sidenote, I am working on my own platform which will offer candles for a lot of different exchanges / markets in a similar format as the candles above. If you want to get notified you can signup on our website:

wizbit

Nice, wizbit look's great! Will you support different formats, date ranges and intervals? I know a few people using forex tools would like ISO dates (ideally separate date/time fields).

Donations: 1Q2EN7TzJ6z82xvmQrRoQoMf3Tf4rMCyvL
MtGox API v2 Unofficial Documentation: https://bitbucket.org/nitrous/mtgox-api/overview
MtGox API v2 Unofficial Documentation Forum Thread: https://bitcointalk.org/index.php?topic=164404.0
TradesLikeAPotato
Newbie
*
Offline Offline

Activity: 41
Merit: 0


View Profile
August 20, 2013, 06:45:15 PM
 #27

Make sure you select custom time, I have candles from your start date up to yesterday because I copied 5 month intervals into my Excel sheet.

Thanks. Ok I believe I see the reason now - bitcoincharts reuses the closing price of the last datum for the opening price of the next, whereas I only included trades within the range t and t+i (where t is the unix timestamp at the start of the candle and i is the candle interval). Both ways make sense - bitcoincharts gives the theoretical price for a trade if you were to do it at t, whereas whydifficult's and mine give the price for the first trade - however our way conforms to the official use of the term 'opening price' http://www.investopedia.com/terms/o/openingprice.asp. Except for the opening price, most of my data agrees with that of bitcoincharts', except for where the opening price is the same as the high, low or closing, in which case my values differ in about 5% of cases.

Make of this what you will. I don't think it makes too much of a difference anyway - backtesting is an approximation, and during real trading your actual trade prices are likely to be different from those given by the candles anyway. All of these datasets seem to be accurate, albeit inconsistent with each other, but these inconsistencies seem easily explained.

Thanks for taking a look! I've got one more issue. When I test with the BTCe candles, I end up with a profit of 41664823177.120% on ema 1/5 hourly. I've got no idea what's causing that! Anyone have any ideas?

Here is the log: http://pastebin.com/M061Q03M
nitrous
Sr. Member
****
Offline Offline

Activity: 246
Merit: 250


View Profile
August 20, 2013, 06:49:39 PM
 #28

Make sure you select custom time, I have candles from your start date up to yesterday because I copied 5 month intervals into my Excel sheet.

Thanks. Ok I believe I see the reason now - bitcoincharts reuses the closing price of the last datum for the opening price of the next, whereas I only included trades within the range t and t+i (where t is the unix timestamp at the start of the candle and i is the candle interval). Both ways make sense - bitcoincharts gives the theoretical price for a trade if you were to do it at t, whereas whydifficult's and mine give the price for the first trade - however our way conforms to the official use of the term 'opening price' http://www.investopedia.com/terms/o/openingprice.asp. Except for the opening price, most of my data agrees with that of bitcoincharts', except for where the opening price is the same as the high, low or closing, in which case my values differ in about 5% of cases.

Make of this what you will. I don't think it makes too much of a difference anyway - backtesting is an approximation, and during real trading your actual trade prices are likely to be different from those given by the candles anyway. All of these datasets seem to be accurate, albeit inconsistent with each other, but these inconsistencies seem easily explained.

Thanks for taking a look! I've got one more issue. When I test with the BTCe candles, I end up with a profit of 41664823177.120% on ema 1/5 hourly. I've got no idea what's causing that! Anyone have any ideas?

Here is the log: http://pastebin.com/M061Q03M

The perfect trade strategy? xD

I don't know, sorry. I'm sure whydifficult can help you though.

Donations: 1Q2EN7TzJ6z82xvmQrRoQoMf3Tf4rMCyvL
MtGox API v2 Unofficial Documentation: https://bitbucket.org/nitrous/mtgox-api/overview
MtGox API v2 Unofficial Documentation Forum Thread: https://bitcointalk.org/index.php?topic=164404.0
TradesLikeAPotato
Newbie
*
Offline Offline

Activity: 41
Merit: 0


View Profile
August 21, 2013, 03:44:14 AM
 #29

Well, any ideas whydifficult?
whydifficult (OP)
Sr. Member
****
Offline Offline

Activity: 287
Merit: 250



View Profile WWW
August 21, 2013, 09:10:13 AM
 #30

Well, any ideas whydifficult?

Hmm that's very strange, I did heard some similar things before though.

Unfortunately I am not able to reproduce it, could you please send me the candle file you used + the EMA settings? That way I can debug the behaviour more easy without staring in the dark.

Gekko a nodejs bitcoin trading bot!
Realtime Bitcoin Globe - visualizing all transactions and blocks
Tip jar (BTC): 1KyQdQ9ctjCrGjGRCWSBhPKcj5omy4gv5S
TradesLikeAPotato
Newbie
*
Offline Offline

Activity: 41
Merit: 0


View Profile
August 22, 2013, 01:42:23 AM
 #31

Well, any ideas whydifficult?

Hmm that's very strange, I did heard some similar things before though.

Unfortunately I am not able to reproduce it, could you please send me the candle file you used + the EMA settings? That way I can debug the behaviour more easy without staring in the dark.

Of course, I should've done it from the start. EMA 5 short, 1 long, .25 threshold, .2 fee.

https://mega.co.nz/#!2Et0GLbT!YATk7xQsBKrVSSZmF9_8DQ0Mrcld9GDlhZMPOEogC9M (URL won't hyperlink for some reason ¯\_(ツ)_/¯)
Pages: « 1 [2]  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!