Automate forward testing of backtest optimization results and shortlist most profitable ones.
Automate forward testing of backtest optimization results and shortlist most profitable ones.
13 Nov 2014, 14:04
Dear Spotware
One very valuable tool for algo traders would be to automate the process of validating the backtest optimization results.
When I do optimization I select a sample period let say from 2011 to 2013 and I run the optimization process which works well and produce superb results where I can view the graphs and statistics. This is all great, but I then need to validate the results by running forward tests.
What normally happens is that a great looking backtest produces unprofitable results out of sample due to possible curve fitting and other issues that could come by optimizing with minute data. Ideally my out of sample will be tick data to mimic the real world as close as possible. This now becomes a tedious process as I then need to apply and execute each of the optimization results out of sample as a forward test to filter the golden nuggets from the rest.
Please, please could we include this as the next feature with optimization so that I can select an out of sample period and instruct cAlgo to run through all / selected number of the profitable backtest results and then select the actual profitable ones that were achieved out of sample?
THIS WILL BE GOLD AND SET YOU APART FROM THE REST OF THE RETAIL PLATFORMS LIKE METATRADER!
Replies
jobenb
13 Nov 2014, 14:11
RE:
Invalid said:
Hi jobenb,
There's a feature request Walk Foward Optimization
I know mate, I don't have enough "power" to vote anymore. I used all my votes. :-(
However I want to elaborate on it here so that I can explain a scenario / use case for it and maybe let people realise how valuable this would be! People focus too much on backtesting only while forward testing is where you make or break it!
@jobenb
Invalid
13 Nov 2014, 14:08
Hi jobenb,
There's a feature request Walk Foward Optimization
@Invalid