Who it is for

Before you buy a trading robot, check its backtest

Upload the MetaTrader tester report the vendor shows you and find out whether the curve is evidence or the result of trying hundreds of settings.

The problem

  • The vendor shows an almost straight curve and a high profit factor, and you cannot tell how many settings were tried to find it.
  • Many robots look good in the tester and fail live through costs, slippage or poor data.
  • A Myfxbook history can be inflated by deposits or hide open losses that were never closed.

What you upload

  • The MetaTrader 5 or 4 tester HTML report, exactly as the tester saves it. How to export it
  • If the vendor gives it to you, the optimisation XML: it counts the settings that were tried. How to export it
  • If there is a live or demo account running the robot, its MetaTrader, Myfxbook, FX Blue or MQL5 signal history. How to export it

What Rigor checks

  • Number of trials. The deflated Sharpe discounts the settings tried; with the XML, that number is measured instead of assumed.
  • Isolated peak or plateau? If moving one parameter one step makes the result collapse, the setting was fitted to the noise of the history.
  • What data the test used. The tester's tick model and history quality: a test on open prices does not say the same as one on real ticks.
  • Stress tests. The result without its best trades and months, and what happens at double and triple costs.
  • Backtest against the live account. Whether the vendor's account behaves like thousands of resampled histories of its own backtest.
  • Questions for the vendor. A list of specific questions drawn from what the file does not answer.

What it does not do

  • It does not check the trades with the broker: it audits the file you upload.
  • It does not recommend buying or not buying a robot, and it does not predict results.

Price

Your first full report is free when you create your account. After that the preview is free (3 a month) and needs no card: A to D class, charts, red flags and what each dimension means. The full report is USD 29 (USD 69 for a pack of 3).

Questions

What if the vendor will not give me the report?

Ask for the tester HTML report and, if it was optimised, the optimisation XML. A vendor who cannot show either is already giving you an answer.

Does class A mean the robot will work?

No. The class measures how many statistical questions the file answers. The future depends on the market, real costs and how it is traded.

Other cases