April performance review for Danica-9am algorithmic system |
|
Page 1 of 15 During the month of April, the fourth month of live performance, the system kept running on complete autopilot, with no parameter changes. This document consists of a summary section followed by 14 subsections, dedicated to the individual exchange rates tracked by the system. Those contain color-coded charts of the performance and details pertinent to the specific currency pairs. For comparison with the previous month, you may want to take a look at March review.
Changes in the algorithmNo parameter changes took place during the month. A minor code upgrade of no direct relevance to forecast modeling was performed and announced on April 19. Figures of meritThe figure of merit used, Pearson correlation coefficient between the forecast and real logarithmic returns on a day scale, is a measure of forecasting quality. By construction, the Pearson correlation coefficient is a quantity bounded between -1 (the forecast move and reality are total opposites) and 1 (the forecast is perfect). A success or lack thereof on every trading day makes a contribution to this quantity. In order to make a large positive contribution, one needs a coincidence of a large move in a currency pair with a large forecast move in the same direction. Since a hypothetic rational operator of the system will not pursue small forecast moves, understanding this to be a noisy system, a forecast with large magnitude is more likely to result in a successful trade. By the same property of a product, an impact on the Pearson correlation coefficient of even a large forecast move in a wrong direction can be moderated if the actual price move turned out to be negligible -- again what we want, since in this case the effect of the system's imperfection on the operator's portfolio is likely to be similarly insignificant. Likewise, an impact of a wrong forecast move of negligible magnitude will be negligible both for the Pearson correlation and for the operator's portfolio since in this case, the operator is likely to ignore the trading idea. Finally, the worst case is the one when the system predicts a large movement in the currency pair and a large movement does materialize -- but in the opposite direction. In this case, a large negative contribution to Pearson is recorded. Why use Pearson correlation coefficient instead of running a model portfolio? This independent figure of merit, characterizing the forecasting component regardless of the money management strategy used, allows one to split the complex problem of trading system development into independent tractable pieces, and solve each pieces of the problem separately, eventually combining a winning forecasting system with a winning money management one, having an independent quality assurance process for each. Performance tablesIn the tables, data for the "month" column are taken from the "month" column of the last day's forecast, which reports 24-trading-day running average of the Pearson correlation figure of merit. End of April 2010 data are taken from the April 30 update. End of March 2010 data are taken from the March 31 update.
This month's effect on the performance since inception was, as Table 0.1 indicates, positive only for EUR/USD, USD/CAD, CHF/JPY, and EUR/GBP (4 pairs in total) -- their performance since inception improved. EUR/USD, USD/CAD, USD/CHF, EUR/AUD, EUR/CHF, EUR/GBP, GBP/CHF (7 pairs out of 14) showed positive Pearson correlation coefficients for the month. It must be noted that the "month" column is for rough orientation only as it gives the average over 24 most recent trading days which may not necessarily be the month. In contrast, the conclusions on the basis of the "since inception" columns are strict. Overall, the mean over markets for the Pearson correlation coefficient for the month was negative but consistent with zero, with a negative change to the since-inception figure.
In all three tables, the precisions of the mean "since inception" improved (uncertainties went down) compared to March. It is remarkable that at the same time, the mean values for low and high went up, while the one for close went down. For day low and high, we again attribute the improvement to the v0.5 upgrade performed in January. A decrease in prediction quality for close is worrisome and some diagnostic activities are underway. However, the figures of merit for the low and high play the role of a canary in a coal mine, ruling out the possibility of some of the less subtle problems. The continued high quality of low and high forecasts indicates that the canary is alive. Usage strategiesThe baselineDuring the month of April, the close-to-close strategy remained the baseline. It consists in submitting market orders as soon as possible after the release of the forecast, buying and selling forex pairs in the direction of the forecast day trend for close, provided that the predicted change for the daily high and low would be in the direction of that trend. That is, selling not unless lower low, lower high, lower close are expected; buying not unless higher low, higher high, higher close are expected. Each such market order would be accompanied by a protective stop but no profit target. The stop would be set on the previous day's low and high, depending on the direction of the trade. That is, if the order is a sell, previous day's high would serve as a stop and previous day's low would be the profit target; the roles would change for a buy order. Effects of trade idea selectionThe following 14 subsections are dedicated to the specific currency pairs, useing a particular method of charting to illustrade performance. Two charts will be presented for each. The first chart will show all trade ideas. This corresponds to trading in every pair every day. The second chart will highlight the days when forecasts for all three components of a day's candlestick were pointing in the same direction. I call this level zero (L0) requirement or L0 trigger.
Table 0.4 shows no effect on the quality of trades, as judged by the simple tally of wins and losses, from the L0 and L1 triggers this month. Note that such a simple counting approach ignores the problem of the relative impact of these wins and losses. Therefore it can only serve as an illustration to supplement more quantitative studies. This result is similar to what was seen in March. The overall impression from reviewing the following charts is that success of the system depends to a considerable extent on presence of sustained trends in the market -- the condition not found in many currency pairs which seemed to prefer marching on the spot, although quite vigorously, during the month. |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Last Updated ( Tuesday, 01 February 2011 14:34 ) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||