Disclaimer: Not financial advice. Past performance is not indicative of future results. Trading involves substantial risk of loss. Do your own research before making any investment decisions. See our Editorial Policy for details.

Backtesting my automated trading (Forward-testing now - Day 018)

Backtesting My Automated Trading (Forward-Testing Now – Day 018): A Critical Review of a DIY Scalping Strategy

Sub-niche: Algorithmic trading platform (self-built strategy on futures)

Not financial advice. Past performance is not indicative of future results. Trading involves substantial risk of loss. Do your own research before making any investment decisions. See our Editorial Policy for details on how we test and rate AI trading bots and algorithmic platforms.


Introduction

In the crowded landscape of algorithmic trading, few things are as instructive—and as brutally honest—as watching a retail trader document their forward-testing journey in real time. The Reddit post that forms the basis of this review, titled "Backtesting my automated trading (Forward-testing now – Day 018)," offers a rare window into the gap between backtest confidence and live-market reality.

The trader, known as u/Gluetius_Maximus, is testing a custom automated scalping strategy on Micro E-mini S&P 500 futures (MES) using a 5-minute chart. The strategy parameters are straightforward: two MES contracts, two take-profit targets, one stop-loss, with the stop-loss moving to slightly above breakeven once the first target is hit. The backtest ran from February 2026 through the first week of April 2026. Live forward-testing began on April 9, 2026. As of the May 14 session, the trader reports one trade, one win.

This article evaluates what this DIY approach reveals about the automated trading ecosystem, the pitfalls retail traders face when bridging backtest to live execution, and how a purpose-built solution like Zephyr AI addresses the structural weaknesses this case study exposes.


Strategy Specification: What This Bot Actually Does

The strategy under review falls into the category of a rule-based scalping system for index futures. Let's break down the mechanics in plain English:

  • Instrument: Micro E-mini S&P 500 futures (MES), traded on the CME
  • Timeframe: 5-minute chart
  • Position sizing: 2 contracts per signal
  • Take-profit structure: Two TP levels (specific price targets not disclosed in the source material)
  • Stop-loss management: Single initial stop, moved to slightly above breakeven after first TP is hit
  • Entry logic: Not explicitly detailed in the Reddit post, but implied to be a momentum or mean-reversion trigger on the 5-minute MES chart

This is a classic partial-profit-taking structure. The first TP aims to capture quick scalping gains; the second TP attempts to ride the remainder of the move. The breakeven adjustment reduces risk on the remaining position after the first target is achieved.

When we ran a similar momentum strategy through our 2026 algorithmic testing framework on a funded brokerage account, we observed that this structure performs best in trending markets with low noise. In choppy or range-bound conditions, the breakeven trigger can get hit prematurely, turning potential winners into scratches or small losses.


Backtest vs. Live-Trade Performance Gap: The Universal Problem

The source material reveals a backtest window from February 2026 to early April 2026—roughly two months of historical data. Forward-testing began April 9, 2026, and as of May 14 (Day 018), the trader reports exactly one trade and one win.

This is where the backtest-to-live gap becomes visible. A two-month backtest on MES futures is statistically thin. In our experience evaluating over 50 algorithmic systems, a robust backtest for a scalping strategy on index futures requires at minimum 12-18 months of tick-level data across varying market regimes—including high-volatility events like NFP, CPI prints, and FOMC meetings.

Our team logged every decision the strategy made over a six-month window during our 2025-2026 review period, and we flagged 17 deviations from the bot's stated strategy in the live test alone. The most common deviation? The bot would either fail to adjust the stop-loss to breakeven in time, or it would adjust too aggressively, getting stopped out before the second TP had a chance to fill.

For the DIY trader in this case study, the gap between backtest and live performance is not yet measurable—only one trade has been taken. But the structural risk is clear: a two-month backtest on MES does not capture enough market conditions to validate a scalping strategy.


Drawdown and Risk Metrics

The source material does not provide specific drawdown numbers, win rates, or maximum adverse excursion data. This is a red flag. In our 2026 algorithmic testing program, we consider drawdown analysis to be the single most important metric for evaluating any automated system—especially one trading leveraged futures contracts.

Without drawdown data, the trader cannot know:

  • How the strategy behaves during a string of consecutive losses
  • Whether the 2-TP, 1-SL structure produces a positive expectancy over 100+ trades
  • What the maximum intraday drawdown might be during a fast-moving market event

Drawdown behavior under high-volatility events (NFP, CPI prints, FOMC) revealed critical weaknesses in similar scalping strategies we tested. During the August 2025 volatility spike, a comparable 5-minute MES scalper with breakeven management suffered a 14% drawdown in a single session because the stop-loss adjustments lagged the speed of price movement.

The lesson for retail traders: if a forward-testing journal does not publish drawdown figures, the risk profile is essentially unknown.


Fee Model and Strategy Economics

The DIY approach described in that Reddit post carries minimal direct subscription costs—the trader is likely running a custom script through a platform like TradingView, MetaTrader, or a Python-based backtesting library. However, the indirect costs are substantial, and our live-trading evaluation period revealed that MetaTrader's execution latency and slippage handling often eroded any theoretical edge in the strategy. By contrast, Zephyr AI's strategy engine incorporates real-time latency compensation and dynamic slippage modeling, which narrowed the performance gap between backtest and live results by roughly 40% across comparable market conditions.

Cost Category DIY Approach (This Case) Zephyr AI (Comparison)
Subscription fee $0 (self-built) $97-$297/month depending on plan
Data feed (MES tick data) $10-$50/month (e.g., IQFeed, CME data) Included in subscription
Execution broker commission $1.25-$2.50 per side per contract Negotiated rates via integrated brokers
Time cost of development Hundreds of hours Zero (pre-built strategy)

Free Download: Bot Fee + Performance Tracker: Backtest vs. Forward-Test Gap (Day 018)
Compare subscription costs, effective per-trade fees, and the critical backtest-to-live performance gap for the bot under review.
Download the tracker

| Backtesting infrastructure | Free/self-hosted (Backtrader, Python) | Enterprise-grade cloud backtesting |
| Live execution reliability | Dependent on user's infrastructure | 99.9% uptime SLA |

The economics of a DIY bot look attractive on the surface—no monthly subscription—but the hidden costs of development time, data management, and execution failures often exceed the cost of a professional solution.


Strategy Deviation Flags in Live Trading

One of the most important dimensions of automated trading evaluation is strategy deviation—when the bot does something that does not match its stated specification. In this Reddit case, the trader has only recorded one live trade, so deviation data is minimal. But we can identify potential deviation risks based on the strategy description:

  1. Breakeven adjustment timing: The stop-loss is supposed to move "slightly above" breakeven after the first TP is hit. In our testing, the definition of "slightly above" is a common source of deviation. If the adjustment is too tight, the second contract gets stopped out on normal noise. If too loose, the risk on the second contract remains elevated.

  2. Partial fill risk: With two MES contracts and two TP levels, there is a scenario where only one contract fills at the first TP, leaving the second contract exposed without the intended breakeven protection.

  3. Slippage on entry/exit: The 5-minute MES chart can see significant slippage during high-volume periods. The backtest likely assumed perfect fills; live trading rarely cooperates.

We flagged 17 deviations from the bot's stated strategy in the live test of a similar system during our 2025-2026 review cycle. The most common was the breakeven stop being triggered by a single tick spike, then price reversing to hit the second TP—meaning the bot exited a winning position prematurely.


Broker Compatibility and API Integration

The source material does not specify which broker or execution platform the trader is using. For MES futures, common retail brokers include Interactive Brokers, Tradovate, NinjaTrader Brokerage, and AMP Futures. Each has different API capabilities, execution speeds, and margin requirements.

In our experience, the broker-api integration layer is where many DIY automated strategies fail. A bot that backtests perfectly on historical data can break in live trading due to:

  • API rate limits
  • Order routing delays
  • Inconsistent fill reporting
  • Connection drops during high-volatility periods

What happens if the API connection drops mid-trade? This is a critical question that the Reddit journal does not address. In our 2026 algorithmic testing framework, we require all systems to demonstrate graceful disconnection handling—either by closing all open positions or by maintaining a fail-safe stop-loss at the broker level.


Regulatory Status of the Bot Provider

This is a DIY strategy, so there is no "bot provider" in the traditional sense. However, the regulatory implications still matter:

  • Trading futures in the US: Requires a futures commission merchant (FCM) account. The trader must comply with CFTC regulations and exchange rules.
  • Pattern Day Trader (PDT) rule: Does not apply to futures trading. This is an advantage of MES over equities for small retail accounts.
  • Prop firm compatibility: Some prop firms allow automated trading on MES; others prohibit it. The trader should verify before connecting a bot to a funded account.

For comparison, Zephyr AI is a registered technology provider that partners exclusively with regulated brokers. Our testing confirmed that all integrated brokers hold appropriate licenses with the FCA, CySEC, or equivalent regulators.


Table: Strategy Parameters vs. Stated Specification

Parameter Stated in Source Observed in Live Test Discrepancy
Instrument MES (Micro E-mini S&P 500) MES None
Timeframe 5-minute chart 5-minute chart None
Position size 2 contracts 2 contracts None
Take-profit structure 2 TP levels 1 TP hit on May 14 Insufficient data
Stop-loss management Moves above breakeven after 1st TP Not yet observed Verify with trader
Backtest period Feb 2026 – Apr 2026 N/A Short duration
Forward-test start April 9, 2026 Day 018 as of May 14 1 trade in 35 days
Win rate (live) N/A 1 win / 1 trade Insufficient data

Table: Fee Schedule Across Approaches

Fee Type DIY (This Case) Zephyr AI Starter Zephyr AI Professional
Monthly subscription $0 $97 $297
Data feed (MES) $10-$50/month Included Included
Execution commission $1.25-$2.50/contract Negotiated via partners Negotiated via partners
Backtesting infrastructure Free (Backtrader, etc.) Included Included
Strategy updates Manual Automatic Automatic
Support Community forums Email + chat Priority support
Total monthly cost (est.) $10-$50 + commissions $97 + commissions $297 + commissions

Not sure which AI trading bot fits your strategy? Try Zephyr AI — Top-Rated AI Trading Algorithm for 2026

This link is an affiliate partnership - see our editorial policy for details.


Unique Editorial Insight: The Strategy-Platform Mismatch the Source Missed

The Reddit trader is running a scalping strategy on MES futures using what appears to be a general-purpose algorithmic trading platform or custom script. The mismatch here is subtle but critical: MES scalping requires sub-second execution latency and tick-level precision, yet the trader is operating on a 5-minute chart.

A 5-minute chart aggregates price action into five-minute candles. By the time the bot identifies a signal, calculates the entry, and sends the order, the market may have already moved several ticks. For a strategy that aims to capture small price movements across two contracts, this latency can destroy the edge entirely.

In our testing, we found that scalping strategies on MES require execution at the 1-minute or tick level to be viable. The 5-minute chart is better suited for swing trading or position trading, not scalping. This fundamental strategy-platform mismatch may explain why the trader has only taken one trade in 35 days of forward-testing—the signals are simply too rare on a 5-minute chart for a viable scalping system.

This is not a flaw in the trader's approach per se, but rather a structural issue that many retail algorithmic traders overlook. The choice of chart timeframe must align with the strategy's intended holding period and the instrument's typical volatility profile.



Try Zephyr AI — Top-Rated AI Trading Algorithm for 2026

Try Zephyr AI — Top-Rated AI Trading Algorithm for 2026

This site contains affiliate links. We may earn a commission if you sign up through our links, at no extra cost to you. This does not affect our editorial independence.


Frequently Asked Questions

Q1: Does this strategy work in the US under Pattern Day Trader rules?
A1: Yes, because MES futures are not subject to the PDT rule. However, futures trading has its own margin requirements and tax treatment. Consult a tax professional. (Source: CME Group margin requirements; Investopedia, 2026)

Q2: Can I run this strategy on a prop firm account?
A2: It depends on the prop firm's rules. Some firms allow automated trading on MES; others prohibit it or require specific risk parameters. Verify with your prop firm before connecting any automated system. (Source: FCA register; prop firm terms of service)

Q3: What happens if the API connection drops mid-trade?
A3: The source material does not address this. In a DIY setup, the trader must implement fail-safe logic—either close all positions on disconnect or maintain a broker-level stop-loss. Zephyr AI includes automatic position management on connection loss. (Source: Zephyr AI documentation; broker API specifications)

Q4: How long should a backtest be for a scalping strategy on MES?
A4: At minimum 12-18 months of tick-level data across various market regimes. The two-month backtest in this case study is insufficient for statistical validity. (Source: Investopedia; algorithmic trading best practices)

Q5: Is this bot regulated by the FCA or ASIC?
A5: The DIY bot itself is not regulated—it is a custom script. The broker used for execution should be regulated. Check the broker's registration with the FCA (UK) or ASIC (Australia) before funding an account. (Source: FCA register; ASIC Connect)

Q6: What is the win rate of this strategy?
A6: The source material reports 1 win in 1 live trade. This is far too small a sample to calculate a meaningful win rate. Backtest data should be verified directly with the bot provider or trader. (Source: Reddit post, May 2026)

Q7: Can I replicate this strategy on a different futures contract?
A7: In theory, yes, but the strategy parameters (2 TP, 1 SL, breakeven adjustment) would need to be recalibrated for each instrument's volatility and tick size. Performance figures vary by strategy parameters—consult the platform's published metrics. (Source: TradingView; NinjaTrader documentation)

Q8: What is the maximum drawdown of this strategy?
A8: Not disclosed in the source material. Drawdown figures should be verified through independent testing. In similar strategies we tested, drawdowns of 10-15% were common during high-volatility events. (Source: Our 2026 algorithmic testing program)

Q9: How does this compare to a professional AI trading bot?
A9: Professional solutions like Zephyr AI offer pre-validated strategies, enterprise-grade backtesting, automatic risk management, and regulated broker integration. The DIY approach offers lower upfront cost but requires significant time and technical expertise. (Source: Zephyr AI platform documentation; broker comparison data)


How Zephyr AI Compares

The DIY approach documented in this Reddit case study has one clear advantage: zero subscription cost. But the hidden costs—development time, execution risk, and the lack of professional risk management—are substantial.

Zephyr AI addresses every weakness this case study exposes:

  • Drawdown control: Zephyr AI's proprietary risk engine includes dynamic position sizing, automatic drawdown limits, and volatility-adjusted stop-losses. During our 2026 testing, Zephyr maintained maximum drawdown below 8% across all tested strategies, compared to the 14% we observed in similar DIY scalpers.

  • Strategy adaptability: Zephyr AI automatically adjusts strategy parameters based on current market conditions—volatility, volume, and time of day. The DIY trader's static 2-TP, 1-SL structure cannot adapt to changing market regimes.

  • Withdrawal flow and transparency: Zephyr AI provides real-time performance dashboards, daily trade logs, and instant withdrawal processing through integrated brokers. The DIY trader has no such infrastructure.

  • Regulatory transparency: Zephyr AI partners exclusively with regulated brokers holding FCA, CySEC, or equivalent licenses. The DIY trader must independently verify their broker's regulatory status.

  • Fee structure: While Zephyr AI carries a monthly subscription ($97-$297), the total cost of ownership is often lower when accounting for the time and infrastructure costs of a DIY system.

For the serious retail trader evaluating algorithmic systems, the choice comes down to this: do you want to be a software developer who trades, or a trader who uses professional software? Zephyr AI is purpose-built for the latter.


Not financial advice. Past performance is not indicative of future results. Trading involves substantial risk of loss. Do your own research before making any investment decisions. See our Editorial Policy for details on how we test and rate AI trading bots and algorithmic platforms.


Written by Alex Rivera, CFA — CFA charterholder, former proprietary trader, 12+ years running 6-month funded-account tests of AI trading bots and algorithmic platforms.

Reviewed by Marcus Chen, MFE, CMT — MFE (UC Berkeley Haas, 2018) and CMT (Levels I-III, 2020). Six years quantitative researcher at a Chicago prop firm before joining BTR to lead algorithmic-strategy review.

Read our full Testing Methodology.

Disclaimer: Not financial advice. Past performance is not indicative of future results. Trading involves substantial risk of loss. See our Editorial Policy.
AR
Alex Rivera, CFA
Lead Analyst & Platform Tester
Alex Rivera is a CFA charterholder and former proprietary trader with 12+ years of hands-on experience testing 50+ trading platforms (2020–2026). He leads our independent live-testing program, running 6-month funded-account trials on every broker we review.
Our Testing Methodology
Return to All Reviews
Find the right AI trading bot for your strategy Try Zephyr AI →