April performance review for Danica-9am algorithmic system

Article Index
April performance review for Danica-9am algorithmic system
AUD/USD performance
EUR/USD performance
GBP/USD performance
USD/CAD performance
USD/CHF performance
USD/JPY performance
AUD/JPY performance
CHF/JPY performance
EUR/AUD performance
EUR/CHF performance
EUR/GBP performance
EUR/JPY performance
GBP/CHF performance
GBP/JPY performance
All Pages

During the month of April, the fourth month of live performance, the system kept running on complete autopilot, with no parameter changes. This document consists of a summary section followed by 14 subsections, dedicated to the individual exchange rates tracked by the system. Those contain color-coded charts of the performance and details pertinent to the specific currency pairs. For comparison with the previous month, you may want to take a look at March review.

 

 

Changes in the algorithm

No parameter changes took place during the month. A minor code upgrade of no direct relevance to forecast modeling was performed and announced on April 19.

Figures of merit

The figure of merit used, Pearson correlation coefficient between the forecast and real logarithmic returns on a day scale, is a measure of forecasting quality.

By construction, the Pearson correlation coefficient is a quantity bounded between -1 (the forecast move and reality are total opposites) and 1 (the forecast is perfect). A success or lack thereof on every trading day makes a contribution to this quantity.

In order to make a large positive contribution, one needs a coincidence of a large move in a currency pair with a large forecast move in the same direction. Since a hypothetic rational operator of the system will not pursue small forecast moves, understanding this to be a noisy system, a forecast with large magnitude is more likely to result in a successful trade.

By the same property of a product, an impact on the Pearson correlation coefficient of even a large forecast move in a wrong direction can be moderated if the actual price move turned out to be negligible -- again what we want, since in this case the effect of the system's imperfection on the operator's portfolio is likely to be similarly insignificant.

Likewise, an impact of a wrong forecast move of negligible magnitude will be negligible both for the Pearson correlation and for the operator's portfolio since in this case, the operator is likely to ignore the trading idea.

Finally, the worst case is the one when the system predicts a large movement in the currency pair and a large movement does materialize -- but in the opposite direction. In this case, a large negative contribution to Pearson is recorded.

Why use Pearson correlation coefficient instead of running a model portfolio? This independent figure of merit, characterizing the forecasting component regardless of the money management strategy used, allows one to split the complex problem of trading system development into independent tractable pieces, and solve each pieces of the problem separately, eventually combining a winning forecasting system with a winning money management one, having an independent quality assurance process for each.

Performance tables

In the tables, data for the "month" column are taken from the "month" column of the last day's forecast, which reports 24-trading-day running average of the Pearson correlation figure of merit. End of April 2010 data are taken from the April 30 update. End of March 2010 data are taken from the March 31 update.

market Pearson correlation of log return and its forecast for day close
month since inception
to end of Aprilto end of March
AUD/USD -0.0484 0.0443 0.045
EUR/USD 0.119 0.0567 0.0552
GBP/USD -0.238 0.087 0.0908
USD/CAD 0.0161 0.00773 0.00738
USD/CHF 0.0204 0.0306 0.0335
USD/JPY -0.118 0.0244 0.0244
AUD/JPY -0.211 0.0456 0.0476
CHF/JPY -0.0478 -0.00357 -0.00392
EUR/AUD 0.0744 0.135 0.136
EUR/CHF 0.239 -0.0172 -0.0107
EUR/GBP 0.1 -0.0244 -0.0282
EUR/JPY -0.0747 0.0531 0.0538
GBP/CHF 0.0214 0.0356 0.0365
GBP/JPY -0.262 0.117 0.12
mean over markets -0.0293 0.0423 0.0434
standard deviation over markets 0.144 0.0467 0.0472
precision of the mean 0.0385 0.0125 0.0126

Table 0.1. Forecasting quality for day close, April 2010. For precision of the mean, Gaussian distribution is assumed. This "precision" refers to the mean over markets.

This month's effect on the performance since inception was, as Table 0.1 indicates, positive only for EUR/USD, USD/CAD, CHF/JPY, and EUR/GBP (4 pairs in total) -- their performance since inception improved. EUR/USD, USD/CAD, USD/CHF, EUR/AUD, EUR/CHF, EUR/GBP, GBP/CHF (7 pairs out of 14) showed positive Pearson correlation coefficients for the month. It must be noted that the "month" column is for rough orientation only as it gives the average over 24 most recent trading days which may not necessarily be the month. In contrast, the conclusions on the basis of the "since inception" columns are strict. Overall, the mean over markets for the Pearson correlation coefficient for the month was negative but consistent with zero, with a negative change to the since-inception figure.

market Pearson correlation of log return and its forecast for day high
month since inception
to end of April to end of March
AUD/USD0.227 0.237 0.236
EUR/USD0.288 0.206 0.203
GBP/USD0.15 0.251 0.251
USD/CAD0.406 0.174 0.169
USD/CHF0.106 0.211 0.213
USD/JPY0.366 0.166 0.161
AUD/JPY-0.0234 0.248 0.250
CHF/JPY0.261 0.233 0.229
EUR/AUD0.318 0.258 0.257
EUR/CHF0.158 0.222 0.233
EUR/GBP0.471 0.172 0.167
EUR/JPY0.289 0.174 0.170
GBP/CHF0.280 0.212 0.213
GBP/JPY0.0685 0.22 0.220
mean over markets 0.240 0.213 0.212
standard deviation over markets0.136 0.0314 0.0336
precision of the mean 0.0364 0.00838 0.00898

Table 0.2. Forecasting quality for day high, April 2010.

market Pearson correlation of log return and its forecast for day low
month since inception
to end of Aprilto end of March
AUD/USD 0.481 0.189 0.186
EUR/USD 0.251 0.256 0.255
GBP/USD 0.172 0.257 0.257
USD/CAD 0.459 0.227 0.222
USD/CHF 0.241 0.231 0.229
USD/JPY 0.271 0.214 0.211
AUD/JPY 0.182 0.0858 0.0837
CHF/JPY0.253 0.192 0.187
EUR/AUD 0.250 0.232 0.231
EUR/CHF 0.308 0.196 0.190
EUR/GBP 0.200 0.250 0.249
EUR/JPY 0.304 0.253 0.249
GBP/CHF 0.439 0.216 0.211
GBP/JPY 0.106 0.246 0.246
mean over markets 0.280 0.217 0.215
standard deviation over markets 0.111 0.04470.0453
precision of the mean0.0298 0.0119 0.0126

Table 0.3. Forecasting quality for day low, April 2010.

In all three tables, the precisions of the mean "since inception" improved (uncertainties went down) compared to March. It is remarkable that at the same time, the mean values for low and high went up, while the one for close went down. For day low and high, we again attribute the improvement to the v0.5 upgrade performed in January. A decrease in prediction quality for close is worrisome and some diagnostic activities are underway. However, the figures of merit for the low and high play the role of a canary in a coal mine, ruling out the possibility of some of the less subtle problems. The continued high quality of low and high forecasts indicates that the canary is alive.

Usage strategies

The baseline

During the month of April, the close-to-close strategy remained the baseline. It consists in submitting market orders as soon as possible after the release of the forecast, buying and selling forex pairs in the direction of the forecast day trend for close, provided that the predicted change for the daily high and low would be in the direction of that trend. That is, selling not unless lower low, lower high, lower close are expected; buying not unless higher low, higher high, higher close are expected. Each such market order would be accompanied by a protective stop but no profit target. The stop would be set on the previous day's low and high, depending on the direction of the trade. That is, if the order is a sell, previous day's high would serve as a stop and previous day's low would be the profit target; the roles would change for a buy order.

Effects of trade idea selection

The following 14 subsections are dedicated to the specific currency pairs, useing a particular method of charting to illustrade performance. Two charts will be presented for each. The first chart will show all trade ideas. This corresponds to trading in every pair every day.

The second chart will highlight the days when forecasts for all three components of a day's candlestick were pointing in the same direction. I call this level zero (L0) requirement or L0 trigger.

Table 0.4. Effect of trade idea selection on proportion of wins and losses for 14 popular forex pairs during April 2010. Day scale.


allL0 trigger
wins182 132
losses168 125
wins/losses1.08 1.06

Table 0.4 shows no effect on the quality of trades, as judged by the simple tally of wins and losses, from the L0 and L1 triggers this month. Note that such a simple counting approach ignores the problem of the relative impact of these wins and losses. Therefore it can only serve as an illustration to supplement more quantitative studies. This result is similar to what was seen in March.

The overall impression from reviewing the following charts is that success of the system depends to a considerable extent on presence of sustained trends in the  market -- the condition not found in many currency pairs which seemed to prefer marching on the spot, although quite vigorously, during the month.



Last Updated ( Tuesday, 01 February 2011 14:34 )
 

The charts are courtesy of .