Posts  / #POST-219899
REDDIT

I've been backtesting strategies for 6 years. Here's why yours is probably broken.

**I've been backtesting strategies for 6 years. Here's why yours is probably broken.**

Not trying to be a jerk, but I see the same mistakes over and over (because I made all of them first).

**Your data is lying by omission**

Backtesting the S&P 500? Cool. You know what's not in that data? All the companies that went bankrupt and got kicked out. You're only testing on the winners. It's like going to a gym and asking the jacked guys for fitness advice while ignoring everyone who quit - obviously the results look good.

Survivorship bias-free data costs money but it's worth it if you're serious.

**You kept tweaking until it worked, didn't you?**

Been there. "Hmm, 60% win rate. What if I add this filter? Oh now it's 70%. What about this indicator? 80%!"

That's not finding a strategy. That's overfitting to random noise. I've built strategies that had insane backtests and lost money week one of paper trading.

Rule of thumb I learned the hard way: if you can't explain why your edge exists in plain english without mentioning indicators, it's probably not real.

**The spread will eat you alive**

Your backtest assumes you bought at the exact close price. In reality: spreads, slippage, commissions, bad fills because you sneezed during market open.

I had a strategy showing 0.4% average profit per trade. Factored in realistic costs and suddenly it was like 0.05%. Not exactly worth the stress.

**Out-of-sample or it doesn't count**

Optimize on 2018-2023, then test on 2024-2025 data you never touched. If it falls apart, you just curve-fitted. This is non-negotiable.

Even better: walk-forward testing where you keep rolling the optimization window. It's tedious but it actually tells you if something works.

**What I do now:**

* Test across different market regimes (bull, bear, choppy sideways hell)
* Use recent data - markets evolve, strategies from 2015 don't always work in 2026
* Paper trade for at least a month before going live
* Keep a brutally honest journal comparing backtest expectations vs reality

A good backtest means your strategy *might* work. Not that it *will* work. I've learned to treat backtests as "this is worth paper trading" not "time to risk my savings."

What's the worst backtest-to-reality gap you've experienced? Mine was like 80% win rate → 45% when live. Still hurts to think about.