February performance review for Danica-9am algorithmic system

Article Index
February performance review for Danica-9am algorithmic system
AUD/USD performance
EUR/USD performance
GBP/USD performance
USD/CAD performance
USD/CHF performance
USD/JPY performance
AUD/JPY performance
CHF/JPY performance
EUR/AUD performance
EUR/CHF performance
EUR/GBP performance
EUR/JPY performance
GBP/CHF performance
GBP/JPY performance
All Pages

During the month of February, the second month of real-time documented performance, the system kept running on complete autopilot, with no code upgrades or parameter changes. This document consists of a summary section followed by 14 subsections, dedicated to the individual exchange rates tracked by the system. Those contain color-coded charts of the performance and details pertinent to the specific currency pairs. Usage strategies and effects of various approaches to selecting the forecasts to trade are discussed. For comparison with the previous month, you may want to take a look at January review.

 

 

No changes in the algorithm

No code upgrades or parameter changes took place during the month.

Figures of merit

The figure of merit used, Pearson correlation coefficient between the forecast and real logarithmic returns on a day scale, is a measure of forecasting quality.

By construction, the Pearson correlation coefficient is a quantity bounded between -1 (the forecast move and reality are total opposites) and 1 (the forecast is perfect). A success or lack thereof on every trading day makes a contribution to this quantity.

In order to make a large positive contribution, one needs a coincidence of a large move in a currency pair with a large forecast move in the same direction. Since a hypothetic rational operator of the system will not pursue small forecast moves, understanding this to be a noisy system, a forecast with large magnitude is more likely to result in a successful trade.

By the same property of a product, an impact on the Pearson correlation coefficient of even a large forecast move in a wrong direction can be moderated if the actual price move turned out to be negligible -- again what we want, since in this case the effect of the system's imperfection on the operator's portfolio is likely to be similarly insignificant.

Likewise, an impact of a wrong forecast move of negligible magnitude will be negligible both for the Pearson correlation and for the operator's portfolio since in this case, the operator is likely to ignore the trading idea.

Finally, the worst case is the one when the system predicts a large movement in the currency pair and a large movement does materialize -- but in the opposite direction. In this case, a large negative contribution to Pearson is recorded.

Why use Pearson correlation coefficient instead of running a model portfolio? This independent figure of merit, characterizing the forecasting component regardless of the money management strategy used, allows one to split the complex problem of trading system development into independent tractable pieces, and solve each piece of the problem separately, eventually combining a winning forecasting system with a winning money management one, having an independent quality assurance process for each.

Performance tables

As started in the previous report, I take last day of the month's forecast as the basis for the month's performance. In the tables, data for the "month" column are taken from the "month" column of the last day's forecast, which reports 24-trading-day running average of the Pearson correlation figure of merit. End of February 2010 data are taken from the February 27 update. End of January 2010 data are taken from the January 30th update.

market Pearson correlation of log return and its forecast for day close
month since inception
to end of Februaryto end of January
AUD/USD-0.06720.0464 0.0473
EUR/USD-0.02750.0617 0.0628
GBP/USD-0.02960.0958 0.0949
USD/CAD0.272 0.00772 0.00366
USD/CHF-0.02410.0352 0.0369
USD/JPY0.110 0.0277 0.0252
AUD/JPY0.314 0.0468 0.043
CHF/JPY0.0267 -0.00781 -0.00894
EUR/AUD0.229 0.138 0.137
EUR/CHF0.141 -0.0157 -0.0166
EUR/GBP0.238 -0.0365 -0.043
EUR/JPY0.0327 0.0549 0.0546
GBP/CHF0.302 0.0377 0.0333
GBP/JPY-0.01260.116 0.117
mean over markets0.1070.0434 0.0419
standard deviation over markets0.139 0.0493 0.0505
precision of the mean0.0370.0131 0.0135

Table 0.1.Forecasting quality for day close, February 2010. For precision of the mean, Gaussian distribution is assumed. This "precision" refers to the mean over markets.

The month's effect on the performance since inception was, as Table 1 indicates, positive for GBP/USD, USD/CAD, USD/JPY, AUD/JPY, CHF/JPY, EUR/AUD, EUR/CHF, EUR/GBP, EUR/JPY, and GBP/CHF (10 markets in total) -- their performance since inception improved, and in some cases quite significantly so. Outstanding results in forecasting quality for day close, as measured by the Pearson correlation coefficient between logarithmic returns and their forecasts, have been obtained for AUD/JPY and GBP/CHF. Overall, the mean over markets for the Pearson correlation coefficient was 0.107 +- 0.037 where the latter number gives a (Gaussian) estimate of the precision of the mean.

market Pearson correlation of log return and its forecast for day high
month since inception
to end of February to end of January
AUD/USD0.247 0.238 0.237
EUR/USD0.193 0.198 0.197
GBP/USD0.344 0.246 0.241
USD/CAD0.270 0.163 0.160
USD/CHF0.182 0.213 0.214
USD/JPY0.462 0.162 0.155
AUD/JPY0.529 0.250 0.244
CHF/JPY0.416 0.226 0.220
EUR/AUD0.268 0.256 0.255
EUR/CHF-0.3180.229 0.233
EUR/GBP0.344 0.165 0.160
EUR/JPY0.397 0.168 0.162
GBP/CHF0.414 0.210 0.204
GBP/JPY0.446 0.214 0.206
mean over markets 0.300 0.210 0.206
standard deviation over markets 0.206 0.0338 0.0349
precision of the mean0.0551 0.00904 0.00934

Table 0.2. Forecasting quality for day high, February 2010.

market Pearson correlation of log return and its forecast for day low
month since inception
to end of Februaryto end of January
AUD/USD0.224 0.184 0.182
EUR/USD0.253 0.258 0.257
GBP/USD0.0901 0.267 0.266
USD/CAD0.377 0.221 0.218
USD/CHF0.350 0.226 0.223
USD/JPY0.152 0.203 0.204
AUD/JPY0.13 0.0792 0.0782
CHF/JPY0.308 0.181 0.175
EUR/AUD0.26 0.228 0.226
EUR/CHF-0.0437 0.189 0.190
EUR/GBP0.418 0.243 0.238
EUR/JPY0.351 0.246 0.242
GBP/CHF0.520 0.212 0.208
GBP/JPY0.181 0.243 0.243
mean over markets0.2550.213 0.211
standard deviation over markets0.147 0.0470 0.0469
precision of the mean 0.0393 0.0126 0.0125

Table 0.3. Forecasting quality for day low, February 2010.

For day low and high, the result of the v0.5 upgrade performed in January, seems to be felt -- the Pearson correlation coefficients went up for both low and high.

Usage strategies

January performance report discussed two hypothetic strategies. One strategy, called Day Range, would consist in submitting market orders as soon as possible after the release of the forecast, buying and selling forex pairs in the direction of the forecast day trend for close, provided that the predicted change for the daily high and low would be in the direction of that trend. That is, selling not unless lower low, lower high, lower close are expected; buying not unless higher low, higher high, higher close are expected. Each such market order would be accompanied with a stop loss and and a take profit target. These would be set on the previous day's low and high, depending on the direction of the trade. That is, if the order is a sell, previous day's high would serve as a stop-loss and previous day's low would be the profit target; the roles would change for a buy order.

A subsequent quantitative study revealed that the Day Range strategy would not be successful unless more strict and specific conditions are imposed when selecting potential trades for execution.

Another strategy, referred to as Close-to-Close, would be obtained by removing profit target from the Day Range strategy. It was analyzed quantitatively in pure form and with a stricter requirement of a large forecast magnitude. In both cases, it was found to be superior to the Day Range strategy. As a result, there will be no red-green-magenta-cyan Day Range strategy plots in this report.

These two strategies are the easiest to analyze and lend themselves to full automation. Users of the system eager to get more involved may want to go for a Close-to-High or Close-to-Low strategy which would involve monitoring of the market on time scales finer than once a day, having Close-to-Close as a fall-back safety net if no attractive opportunities to close the deals with profit better than expected from Close-to-Close are found during the day. However, such an algorithmically-aided, as opposed to fully algorithmic, trading strategy, in theory has the potential of delivering results worse than the pure system would have delivered, especially if the operator's intervention tends to take quick limited profits and let the losses run -- or if it tends to take losses while letting profits turn into losses.

Effects of trade idea selection

The following 14 subsections are dedicated to the specific currency pairs, useing a particular method of charting to illustrade performance. Three charts will be presented for each. The first chart will show all trade ideas. This corresponds to trading in every pair every day.

The second chart will highlight the days when forecasts for all three components of a day's candlestick were pointing in the same direction. I call this level zero (L0) requirement or L0 trigger.

Likewise, L1 trigger combines L0 with a stricter requirement of a sufficiently large forecast magnitude.

Table 0.4. Effect of trade idea selection on proportion of wins and losses for 14 popular forex pairs during February 2010. Day scale.

  allL0 triggerL0 and L1 trigger
wins17912163
losses1579937
wins/losses1.141.221.70

Table 0.4 shows that while L0 reduces the total number of trades, and L1 reduces it even more, the quality of trade selection, at least as judged by the ratio of wins to losses, grows quite impressively as the selection becomes more and more strict. Note that such a simple counting approach leaves the question of the relative impact of these wins and losses open. Therefore it can only serve as a supplement to more quantitative studies.



Last Updated ( Thursday, 11 November 2010 14:06 )
 

The charts are courtesy of .