February 2011 performance review for Danica-9am algorithm

Article Index
February 2011 performance review for Danica-9am algorithm
AUD/USD performance
EUR/USD performance
GBP/USD performance
USD/CAD performance
USD/CHF performance
USD/JPY performance
AUD/JPY performance
CHF/JPY performance
EUR/AUD performance
EUR/CHF performance
EUR/GBP performance
EUR/JPY performance
GBP/CHF performance
GBP/JPY performance
All Pages

During February 2011, the second month of the second year of live performance, the system continued on auto-pilot without parameter changes. This document consists of a summary section reporting the figures of merit for the forecasting quality, followed by 14 subsections, dedicated to the individual exchange rates tracked by the system. Those contain our usual green-yellow-blue-red color-coded charts of the performance (2 for the two hypothetic strategy triggers for each currency pair, 28 in total) and details pertinent to the specific currency pairs.

Looking at the most important figure of merit, namely the correlation coefficient between predicted and actual returns for close, the forecasting system eked out a marginally positive result this month. The main contributors to the positive performance were USD/JPY where the system was able to quickly readjust to the yen rally in the second half of the month, and AUD/JPY.

For comparison with the previous month, you may want to take a look at the January 2011 performance review.

Figures of merit

The figure of merit used, Pearson correlation coefficient between the forecast and real logarithmic returns on a day scale, is a measure of forecasting quality.

By construction, the Pearson correlation coefficient is a quantity bounded between -1 (the forecast move and reality are total opposites) and 1 (the forecast is perfect). A success or lack thereof on every trading day makes a contribution to this quantity.

In order to make a large positive contribution, one needs a coincidence of a large move in a currency pair with a large forecast move in the same direction. Since a hypothetic rational operator of the system will not pursue small forecast moves, understanding this to be a noisy system, where a forecast with large magnitude is more likely to result in a successful trade.

Why use Pearson correlation coefficient instead of running a model portfolio? First, we do run model portfolios -- see Demi -- but that's a separate product involving additional optimization choices. Second, this independent figure of merit, characterizing the forecasting component regardless of the money management strategy used, allows one to split the complex problem of trading system development into independent tractable pieces, and solve each pieces of the problem separately, eventually combining a winning forecasting system with a winning money management one, having an independent quality assurance process for each.

For those interested in the relative frequency of being "right" vs being "wrong", these outcomes, judged by the prediction success for close (as opposed to high and low which are a lot easier to predict), are counted.

Performance tables

In the tables, data for the "month" column are taken from the "month" column of the last day's forecast, which reports 24-trading-day running average of the Pearson correlation figure of merit. It must be noted that the "month" column is for rough orientation only as it gives the average over 24 most recent trading days which may not necessarily be the month. In contrast, the conclusions on the basis of the "since inception" columns are strict. The mean over markets for the Pearson correlation coefficient for the month was negative. End of February 2011 data are taken from the February 28 update. End of January 2011 data are taken from the January 31 update.

market Pearson correlation of log return and its forecast for day close
month since inception
to end of Februaryto end of January
AUD/USD0.0634 0.0346 0.0343
EUR/USD-0.0796 0.0498 0.0513
GBP/USD-0.041 0.0663 0.0672
USD/CAD-0.197 -0.00571 -0.00463
USD/CHF-0.0283 0.0313 0.0327
USD/JPY 0.296 0.0108 0.0081
AUD/JPY 0.202 0.0405 0.04
CHF/JPY 0.0861 -0.017 -0.018
EUR/AUD 0.148 0.142 0.141
EUR/CHF -0.2 -0.0295 -0.0246
EUR/GBP -0.00682 -0.0258 -0.0263
EUR/JPY -0.167 0.0268 0.0279
GBP/CHF0.0644 0.0279 0.0271
GBP/JPY0.111 0.0814 0.081
mean over markets 0.0179 0.0310 0.0312
standard deviation over markets0.149 0.0460 0.0456
precision of the mean 0.0399 0.0123 0.0122

Table 0.1. Forecasting quality for day close, February 2011. For precision of the mean, Gaussian distribution is assumed. These RMS and "precision" refer to market-to-market variation.

market Pearson correlation of log return and its forecast for day high
month since inception
to end of February to end of January
AUD/USD 0.697 0.267 0.266
EUR/USD0.209 0.266 0.266
GBP/USD 0.433 0.269 0.266
USD/CAD 0.508 0.212 0.21
USD/CHF 0.687 0.274 0.268
USD/JPY 0.601 0.2 0.196
AUD/JPY 0.443 0.272 0.272
CHF/JPY 0.285 0.249 0.246
EUR/AUD 0.541 0.302 0.297
EUR/CHF 0.354 0.303 0.299
EUR/GBP 0.122 0.206 0.202
EUR/JPY 0.147 0.212 0.212
GBP/CHF 0.802 0.261 0.258
GBP/JPY 0.528 0.224 0.224
mean over markets0.454 0.251 0.249
standard deviation over markets0.210 0.0346 0.0342
precision of the mean0.0562 0.00925 0.00913

Table 0.2. Forecasting quality for day high, February 2011.

market Pearson correlation of log return and its forecast for day low
month since inception
to end of February to end of January
AUD/USD0.585 0.23 0.227
EUR/USD0.296 0.311 0.311
GBP/USD0.591 0.263 0.26
USD/CAD0.118 0.258 0.259
USD/CHF0.525 0.272 0.267
USD/JPY0.431 0.226 0.223
AUD/JPY0.289 0.116 0.116
CHF/JPY0.544 0.226 0.223
EUR/AUD0.472 0.291 0.288
EUR/CHF0.334 0.318 0.318
EUR/GBP0.378 0.301 0.3
EUR/JPY0.278 0.266 0.266
GBP/CHF0.557 0.256 0.252
GBP/JPY0.61 0.266 0.264
mean over markets 0.429 0.257 0.255
standard deviation over markets 0.150 0.0501 0.0502
precision of the mean 0.0400 0.0134 0.0134

Table 0.3. Forecasting quality for day low, February 2011.

Discussion of performance

As Table 0.1 indicates, this month's effect on the performance figures for daily close since inception was net negative.

The mean value of correlation coefficients for high and low went up as they did every month since January 2010. The improvement is due to the v1.0 upgrade performed in June 2010 and the v0.5 upgrade performed in January 2010.

The system performed very well for USD/JPY and AUD/JPY, with EUR/AUD, GBP/JPY, CHF/JPY and GBP/CHF being other net positive performers (in descending order of performance). EUR/AUD maintains its status as the most predictable currency pair.

The following 14 subsections are dedicated to the specific currency pairs, using a particular method of charting to illustrate performance. Two charts will be presented for each. The first chart will show all trade ideas. This corresponds to trading in every pair every day.

The second chart will highlight the days when forecasts for all three components of a day's candlestick were pointing in the same direction. I call this level zero (L0) requirement or L0 trigger. The rest of the days will be colored in black.

Table 0.4. Effect of trade idea selection on the proportion of wins and losses for 14 popular forex pairs during February 2011. Day scale.


allL0 trigger
direction predicted correctly 167 109
direction predicted incorrectly169 121
correct/incorrect0.988 0.901

Surprisingly, unlike other months with net positive correlation for close, th L0 trigger did not enrich the stream of outcoms with wins, as Table 0.4 indicates.



Last Updated ( Friday, 01 April 2011 12:50 )
 

The charts are courtesy of .