June performance review for Danica-9am algorithmic system

Thursday, 01 July 2010 16:48
Article Index
June performance review for Danica-9am algorithmic system
AUD/USD performance
EUR/USD performance
GBP/USD performance
USD/CAD performance
USD/CHF performance
USD/JPY performance
AUD/JPY performance
CHF/JPY performance
EUR/AUD performance
EUR/CHF performance
EUR/GBP performance
EUR/JPY performance
GBP/CHF performance
GBP/JPY performance
All Pages

During the month of June, the sixth month of live performance, the system went through a major upgrade. The upgrade is expected to further improve prediction quality for daily high and low (as measured by Pearson correlation coefficients between predicted and actual logarithmic returns) while its effect on the prediction quality for daily close is uncertain. This document consists of a summary section followed by 14 subsections, dedicated to the individual exchange rates tracked by the system. Those contain color-coded charts of the performance and details pertinent to the specific currency pairs. For comparison with the previous month, you may want to take a look at the May review.

 

 

Changes in the algorithm

Refer to the original announcement.

Figures of merit

The figure of merit used, Pearson correlation coefficient between the forecast and real logarithmic returns on a day scale, is a measure of forecasting quality.

By construction, the Pearson correlation coefficient is a quantity bounded between -1 (the forecast move and reality are total opposites) and 1 (the forecast is perfect). A success or lack thereof on every trading day makes a contribution to this quantity.

In order to make a large positive contribution, one needs a coincidence of a large move in a currency pair with a large forecast move in the same direction. Since a hypothetic rational operator of the system will not pursue small forecast moves, understanding this to be a noisy system, a forecast with large magnitude is more likely to result in a successful trade.

Why use Pearson correlation coefficient instead of running a model portfolio? This independent figure of merit, characterizing the forecasting component regardless of the money management strategy used, allows one to split the complex problem of trading system development into independent tractable pieces, and solve each pieces of the problem separately, eventually combining a winning forecasting system with a winning money management one, having an independent quality assurance process for each.

Pearson correlation coefficient for close could be interpreted as an average daily return (expressed as a fraction of price rather than fraction of capital) of a hypothetic portfolio where every trade is weighted according to the magnitude of the predicted return, if the returns had not been logarithmic. 

Performance tables

In the tables, data for the "month" column are taken from the "month" column of the last day's forecast, which reports 24-trading-day running average of the Pearson correlation figure of merit. End of June 2010 data are taken from the June 30 update. End of May 2010 data are taken from the May 31 update.

market Pearson correlation of log return and its forecast for day close
month since inception
to end of June to end of May
AUD/USD -0.0345 0.0469 0.0479
EUR/USD 0.112 0.0541 0.0511
GBP/USD -0.213 0.0724 0.0746
USD/CAD 0.145 0.005910.00313
USD/CHF 0.0119 0.0384 0.0333
USD/JPY -0.0497 0.0328 0.0317
AUD/JPY -0.109 0.0559 0.0581
CHF/JPY -0.0746 -0.00374 -0.00139
EUR/AUD 0.236 0.146 0.144
EUR/CHF -0.0339 0.00796 -0.0091
EUR/GBP -0.2 -0.0342 -0.0331
EUR/JPY -0.0847 0.0431 0.0485
GBP/CHF -0.112 0.0297 0.0309
GBP/JPY -0.411 0.102 0.106
mean over markets -0.0583 0.0427 0.0418
standard deviation over markets 0.161 0.0450 0.0463
precision of the mean 0.0431 0.0120 0.0124

Table 0.1. Forecasting quality for day close, June 2010. For precision of the mean, Gaussian distribution is assumed. These RMS and "precision" refer to market-to-market variation.

This month's effect on the performance since inception was, as Table 0.1 indicates, positive for EUR/USD, USD/CAD, USD/CHF, USD/JPY, EUR/AUD, and EUR/CHF (6 pairs in total) -- their performance since inception improved compared to end of May. It must be noted that the "month" column is for rough orientation only as it gives the average over 24 most recent trading days which may not necessarily be the month. In contrast, the conclusions on the basis of the "since inception" columns are strict. The mean over markets for the Pearson correlation coefficient for the month was negative.

market Pearson correlation of log return and its forecast for day high
month since inception
to end of June to end of May
AUD/USD 0.423 0.255 0.25
EUR/USD 0.498 0.225 0.219
GBP/USD -0.0199 0.262 0.265
USD/CAD 0.435 0.19 0.184
USD/CHF 0.326 0.227 0.223
USD/JPY 0.485 0.184 0.179
AUD/JPY 0.568 0.272 0.263
CHF/JPY 0.219 0.241 0.244
EUR/AUD 0.643 0.277 0.27
EUR/CHF 0.67 0.251 0.215
EUR/GBP 0.438 0.155 0.142
EUR/JPY 0.437 0.192 0.185
GBP/CHF 0.336 0.227 0.224
GBP/JPY 0.316 0.221 0.22
mean over markets 0.412 0.227 0.220
standard deviation over markets 0.177 0.0361 0.0374
precision of the mean 0.047 0.0097 0.0100

Table 0.2. Forecasting quality for day high, June 2010.

market Pearson correlation of log return and its forecast for day low
month since inception
to end of June to end of May
AUD/USD 0.595 0.204 0.197
EUR/USD 0.366 0.264 0.265
GBP/USD 0.22 0.241 0.239
USD/CAD 0.579 0.246 0.238
USD/CHF 0.115 0.241 0.241
USD/JPY 0.0111 0.204 0.204
AUD/JPY 0.394 0.0981 0.0923
CHF/JPY 0.472 0.203 0.197
EUR/AUD 0.547 0.262 0.259
EUR/CHF 0.1 0.224 0.216
EUR/GBP 0.332 0.268 0.263
EUR/JPY 0.341 0.243 0.244
GBP/CHF 0.0812 0.206 0.206
GBP/JPY 0.153 0.244 0.244
mean over markets 0.308 0.225 0.222
standard deviation over markets 0.197 0.0432 0.0443
precision of the mean 0.0526 0.0115 0.0118

Table 0.3. Forecasting quality for day low, June 2010.

In all three tables, the precisions of the mean "since inception" improved (uncertainties went down) compared to May. It is remarkable that at the same time, the mean values for low, high and close went up. For day low and high, we again attribute the improvement to the v1.0 upgrade performed this month and the v0.5 upgrade performed in January. Negative performance for close continues; since the live launch in late December 2009, February 2010 remains the only month of solid positive performance for close.

The figures of merit for the low and high play the role of a canary in a coal mine, ruling out the possibility of some of the less subtle problems. The continued (indeed, improving) high quality of daily low and high forecasts indicates that the canary is alive.

Usage strategies

Continued lackluster performance of forecasting for daily close makes us switch research attention to strategies relying more heavily on the stably high forecasting quality for daily high and low, and not so heavily on daily close. The break-through of the month in this direction was the realization that in order to use such a strategy (Day Range Strategy for short) effectively, one will need to use a forecasting regime (defined by the value of an adjustable parameter nicknamed Fred in our reports) which is different from the maximum of the Pearson correlation coefficients. A decision has been made to let Danica be the system optimized for the high predictability of daily extremes in terms of correlation coefficients, leaving the question of an optimal trading strategy for this forecasting regime open. Another system with a definite usage strategy (Day Range Strategy referred to above) using the daily high and low, in combination with their predicted directions for the day, as stop loss, profit target and direction for the day, is about to be launched in parallel to Danica.

System performance in the individual markets

The following 14 subsections are dedicated to the specific currency pairs, useing a particular method of charting to illustrade performance. Two charts will be presented for each. The first chart will show all trade ideas. This corresponds to trading in every pair every day.

The second chart will highlight the days when forecasts for all three components of a day's candlestick were pointing in the same direction. I call this level zero (L0) requirement or L0 trigger.

Table 0.4. Effect of trade idea selection on proportion of wins and losses for 14 popular forex pairs during June 2010. Day scale.


allL0 trigger
direction predicted correctly183 132
direction predicted incorrectly179 129
correct/incorrect1.02 1.02

Table 0.4 shows little or no effect on the quality of trades from the L0 trigger this month, as judged by the simple tally of wins and losses. Note that such a simple counting approach ignores the problem of the relative impact of these wins and losses. Therefore it can only serve as an illustration to supplement more quantitative studies.



Last Updated ( Monday, 02 August 2010 14:36 )
 

Active algorithmic systems:

Danica: daily, updated at 9am Eastern time
Heidi: hourly, updated at the start of an hour

Add to Google Reader or Homepage

The charts are courtesy of .