Hey !

I worked on a very similar project a few months ago. I used the exact same tools you do to achieve my goal. I gave up as the performances of my model were poor. I figured out that it's not possible to build a model based on technical analysis. You've to take fundamental analysis into account (typically market sentiment)
My input is that you'll have to use Technical Analysis (patterns) + Fundamental Analysis (sentiments) + Adapt it to general Market trends (Bull/Bear/Sideway).
In the end, I stopped using deep learning and use a real time based algorithm to find known patterns. You should look into this kind of algorithm rather than AI.
Analyze what traders are doing, automate, trade faster than them. There is room for newcomers.

Good luck !