When a trader runs an automated strategy for a few days, loses, and says it does not work, there are several possible explanations. The strategy may be wrong for that market. The settings may be wrong. Or the human around the bot may have changed what it does. Only the first two are about the code, and the third is the easiest to check. Here is how to tell them apart.
Variance looks like failure
Strategies with a real positive expectancy still lose in streaks. As a hypothetical, assume a 60% win rate, independent trades, and a streak of five losses in a row. The chance a given streak start reaches five losses is 0.4 to the fifth power, about 1%. Over 500 trades, the expected number of such runs is roughly 500 x 0.6 x 0.0102, about three. So a five-loss streak is normal inside that model, and it feels like evidence of failure while it is happening. That calculation assumes independent trades and a fixed win rate. Real trades are not so tidy, and nothing here says any particular strategy has such a win rate.
The practical consequence: set the review rule before you start. For example, you might decide to evaluate after a fixed number of trades, with a drawdown limit that stops the bot, and treat anything inside those limits as normal. Switching it off after three bad days is a decision made by emotion, not by data.
The ways people change what the bot does
Your next step
Review the setup before you automate it.
Read the NinjaTrader setup and strategy limits, then test in SIM. YMI bot access belongs to Pro. Check your broker or prop firm's rules before enabling automation.
Overriding signals
The bot enters, you dislike the look of the chart and close it early. Or you skip a signal because the market feels wrong. The system then trades a different set of trades from the one you set up, and any result no longer describes the strategy. If you want to filter signals, write the filter as a rule, test it, and change the settings, not the trade.
Size creep after a loss
Doubling size to get back to even raises the dollar damage of the next loss. A fixed quantity and a daily loss limit set in advance remove the temptation. Note that stop orders can slip, so the realized loss can exceed the planned loss in a fast market.
Adding manual trades
With a bot taking two or three trades a day, hours of watching a screen produce urges to add something. Keep a separate log for trades the bot did not generate. Compare the two results after a month.
Running the wrong conditions or settings
A bot built for the regular session can behave differently on a holiday, an early close, a news day or a thin overnight market. Read the documentation for session times, instrument, contract month and settings, and check that your configuration matches. YMI's bot behavior and current variants are described on the Marty Bot specs and KPL Bot specs pages. Those pages, not an article, are the source for logic and settings.
A checklist before blaming the strategy
- Did the account take every signal the strategy generated, with the planned quantity?
- Did every exit follow the rules, with no early closes?
- Were there trades the bot did not generate?
- Do the live fills, commissions and slippage match what you assumed?
- Were connection drops, platform restarts or settings changes logged?
- Is the sample large enough to say anything? Thirty trades is not a statistically proven edge, and 50 simulated trades is not live proof.
If the answer to any of the first three is no, you have found the problem, and it is not the strategy.
Using simulation without fooling yourself
A simulated account can show that the automation places and manages orders as designed and lets you watch the strategy behave without risking money. In NinjaTrader 8 the simulated account selection and a Playback connection are separate things, so confirm which one you are on. Simulated fills do not show queue position or real slippage, and simulation does not reproduce the pressure of live money, so treat it as a mechanics check, not proof of results.
Check the rules where you trade
Automation is not allowed everywhere. Apex, for example, prohibits automated or preset bots that place, modify or cancel trades without personal real-time review, per its prohibited activities page. No YMI bot should be described as compatible with Apex or as a way to pass an evaluation. TopstepX API access is currently limited to simulation rather than live accounts and prohibits order transmission from a VPS, VPN or remote server, per Topstep's API access article. Read the current rules for your firm and account type before running anything automated.
What to do this week
Write the rules you will follow, including quantity, daily loss limit and the number of trades after which you will review. Keep a column for human changes in your log. If watching the screen makes you interfere, step away and review at the end of the session. The strategy deserves a fair test, and a test only counts if the system you tested is the system that ran.
Related Reading
- Trading Psychology Guide covers sticking to rules under pressure.
- SIM Trading Guide covers what simulation can and cannot show.
Bot access is part of YMI Pro, a paid membership at $795 per month with no trial. Intro and VIP do not include bots. See YMI Pro for details.
About the Author
Founder, Young Money Investments · Quant Trader
Cameron trades ES, NQ, and futures across multiple market cycles. He founded Young Money Investments to teach systematic, data-driven trading and manages Magnum Opus Capital. His work emphasizes documented rules, risk controls, and review over outcome promises.
Free, No Credit Card
Get the Free Room Preview
See how the room works before choosing a membership. Follow a setup in SIM and review what happened.
Risk Disclosure & Disclaimer
Educational Purposes Only: The content provided in this blog is for educational and informational purposes only. It does not constitute financial, investment, or trading advice. Young Money Investments is not a registered investment advisor, broker-dealer, or financial analyst.
Risk Warning: Trading futures, forex, stocks, and cryptocurrencies involves a substantial risk of loss and is not suitable for every investor. The valuation of futures, stocks, and options may fluctuate, and as a result, clients may lose more than their original investment.
CFTC Rule 4.41 - Hypothetical or Simulated Performance Results: Certain results (including backtests mentioned in these articles) are hypothetical. Hypothetical performance results have many inherent limitations. No representation is being made that any account will or is likely to achieve profits or losses similar to those shown. In fact, there are frequently sharp differences between hypothetical performance results and the actual results subsequently achieved by any particular trading program.
Testimonials: Testimonials appearing on this website may not be representative of other clients or customers and is not a guarantee of future performance or success.
