PROFITS - ATPx [Automated Trading Platform eXtended]

[Nova!]

Ok so this might be a design breaker.
I've been slow on release because I wanted to make sure everything works correctly the first time for 99% of you with minimal setup and watching.

After I completed the MtGox module I noticed that it would run for awhile and then it would just sort of drop out.
It was working fine before I implemented the JavaFX based UI, and so I stripped the UI out and tried again, sure enough it worked just fine.

This of course begs the question, what the heck is the UI doing that's causing the MtGox module to choke up especially when the BTCe module seems to be alright.

As it turns out it has to do with the way the MtGox module works.  Since the MtGox module uses the streaming websockets API, it has an event driven architecture and consumes an "OnMessage" event each time a message arrives.  This message is passed to the scripting engine for further processing because frankly that's the easiest way to deal with it.

The problem is that JavaFX appears to be overriding the scripting API or forcing it to run on the event dispatch thread even though the MtGox connector is actually running on it's own thread.  This means that the UI has to fire an event for all the backed up MtGox events to be processed.  I'm assuming that JavaFX forces the scripting engine onto the event dispatch thread because it uses a lot of javascript itself, trying to be an HTML5 compliant tech and all.  However it's unacceptable for ALL javascript to be running through the UI.

The obvious solution is to completely refactor the MtGox connector so that it doesn't rely on the scripting engine at all.  However the scripting engine is used in numerous places throughout the code.  Not the least of which is the custom programmable trading logic module.  Since it's all event driven, having the system hold off on processing events until the UI fires an event onto the Event dispatch thread is not going to work out well at all.

I'm going to put more thought into this.  I don't want to chuck out all the work that's been done on the UI so far.  However it may be that I end up dropping JavaFX in favor of Swing if I can't figure out any other way around it, but generally speaking I'd prefer not to do so.

Has anyone worked with JavaFX and run into similar problems?  Thanks!

[daybyter]

I don't really understand your overall design, but it sounds to me, like your UI is tied too closely to the API implementations.

I wouldn't even tie any UI to the trading engine. Was one of my mistakes in my app design.

[Viceroy]

I was thinking the exact same thing.  The "engine" and the way you "talk to the engine" are completely different animals (should be?) but I have not looked at any of the code or tried to use the software so my opinion means little in this context.  My sense, again not looking at any other this beyond the posts in this thread, is that you should be talking to the engine with a script language of some kind.  Lisp, for example.  Why do you need any user interface at all at this point?  (again, forgive my lack of knowledge on this specific software).

[Askit2]

I could be missing the point as well. I like the UI idea. I love the limit orders and BTC-e support, MTGoX streaming ticker etc. Is there a way to make a  small change to have to UI only send data and get replies?

What I mean is maybe instead of having the modules as part of the UI apparently only have the UI send the module when it periodically checks the bots. Like send trading logic, request balances or send some specific trade related action command. If the Bot sees something have it act then send the results to the UI. That way the UI could try working on them whenever but the bot can still fire fast when a trade arises. I would worry that the trade might be held up waiting for a UI especially if different machines are used for bots with one UI.

I am betting it would require a fair amount of rewriting though.

[Nova!]

I've solved the problem by revising the design.  It seems to be working fine now.

Let me try and explain what the problem was more succinctly and then you'll understand the solution.

You had 2 components at play here.  The ExchangeModule and the UIComponent.
I originally wanted the exchange module to run as a standalone service and just have the UI subscribe to a datafeed that would be streaming off the exchange module.
This design was unworkable because the UI isn't particularly interested in the exchange data so much as the signals data being generated by the other modules.
Because of the complex interplay between signals and exchanges, it made more sense to have the UI marshall the exchange and signals modules and for expediency they should all share a static informational nexus point.

The exchange module(s) update the nexus with the most current exchange data and nexus notifies the signals modules and ui modules with the latest data.

The problem was that the UI, because it was using JavaFX was forcing all javascript to run through the Event Dispatch Thread.
There is a lot of javascript at play.  A lot of it is just hooks to allow scripts to run and implement some custom functionality at key points, but the fact is there is a lot of it.

JavaFX for some reason is forcing all contexts onto a single context and a single thread.  This means that any data no matter what thread it was running on would have to wait for the EDT to fire an action before it could be processed.  This of course caused a back-up and even a halting to occur.
 
The solution was to drop JavaFX as the UI toolkit.  It was causing problems and I'm just lucky I caught it early enough.

The new design, which appears to be working, uses the NetBeans Platform and nbm bundles in place of what we were calling modules before.
The current UI is mostly swing, it really didn't take that long to re-implement and I think I like the netbeans gui designer a lot more than the JavaFX gui designer

I'll be posting some screenshots soon.  Also I'm waiting on the logo to come back then the site expressvest.com will be up later today or early tomorrow.

[Ianwhitbread]

cant wait
 

[Askit2]

Nova have you been testing APTx lately?
I only ask because I am curious how it handles MTGoX's cloudflare on the API. The rest sounds super great. I am excited to see it work hopefully soon.

[Ianwhitbread]

is expressvest  all ok

still getting the parked domain

or did I just get the wrong link

[Askit2]

I hope NOVA is ok. It has been a while since the last update.
I also hope everything is going pretty good or great!

[Viceroy]

What he needs right now is a good mechanic in Utah, more than anything else.

Anybody know a good mechanic in/near Salt Lake/Provo/Grand Junction?



let's keep our fingers crossed he can get across those mountains.

[daybyter]

Lets hope, he is doing ok. But most of the time, the type of the car is important for the choice of the mechanic...

I've found a list of shops, but I have no clue how good they are?

http://www.automd.com/shops/UT/

Maybe there's a car forum in the US, where you can find folks with more knowledge? (I'm in Germany, so I have no clue about such a forum).

[Viceroy]

I'm sure there are plenty of qualified mechanics in that area.  Here's a few who have a good rating:

http://www.automd.com/shops/search?question=&location=provo%2C+utah&make=&sort_by=1

[daybyter]

I would start with the brand of the car and then look for a forum for that brand (i.e. Ford forum, or whatever car he drives).

The folks there should know a specialist in the area.

But it also depends on the kind of problems he has (engine, suspension etc).

[Viceroy]

His last communication, moments ago, was optimistic.  I think he'll be just fine.  I am a few hundred miles east of him so I can go get him if it starts to snow or anything but right now it is 35+ degrees so no worries of that

[Askit2]

Hopefully Nova is ok. It has been a bit over 10 days since he had troubles.

I recently discovered an issue with MTGoX that likely Nova already knows about but just incase he doesn't I will post it.

MTGoX won't generate codes or move US Dollars from them to anything but a bank account by wire transfer. Because of delays and expense I think one of three things must happen eventually. 1, Only arbitrage currencies you can get a code for. 2, Don't arbitrage MTGoX at all. 3, By the time the money would get turned around you could likely lose money from float plus the wire fees. 3 is essentially lose money waiting on them.

I found the problem trying to arbitrage by hand a $15 difference between Gox and BTCe. I really really wish I could have sent cash to BTCe.

The more important part is I hope Nova is doing well and back on the road.

[joesmoe2012]

Hopefully Nova is ok. It has been a bit over 10 days since he had troubles.

I recently discovered an issue with MTGoX that likely Nova already knows about but just incase he doesn't I will post it.

MTGoX won't generate codes or move US Dollars from them to anything but a bank account by wire transfer. Because of delays and expense I think one of three things must happen eventually. 1, Only arbitrage currencies you can get a code for. 2, Don't arbitrage MTGoX at all. 3, By the time the money would get turned around you could likely lose money from float plus the wire fees. 3 is essentially lose money waiting on them.

I found the problem trying to arbitrage by hand a $15 difference between Gox and BTCe. I really really wish I could have sent cash to BTCe.

The more important part is I hope Nova is doing well and back on the road.

I didn't realize gox allowed codes for any currencies at this point.

[Askit2]

Truthfully Gox likely doesn't.

It seems I am always a little under-informed. Since the issue that supposedly caused it related to USD I guessed other currencies might remain untouched. Then again why would it.

Either way it explains the overpricing of USD at GoX. I had no other currencies so I couldn't test at the time. Also it could be a location thing I thought maybe US peeps couldn't get codes but it might be far more widespread.

[Askit2]

I would really enjoy an update on either profits or Nova!. I hope he has gotten somewhere by now. I miss this thread being active. Anyways because of Gox issues it would be awesome to have a bot that ran well on another exchange. Honestly between bleeding the fees, ticker going AWOL and the like I really hope there isn't a worse exchange to use.

Hopefully everything is working out.

[Ianwhitbread]

I agree too

Hope he is well and will update soon

[Viceroy]

He is a nomad at the moment.  Just got an update this AM.  He is seeking a better wifi solution.  Hold tight...