19 Backtesting Mistakes Beginners Make

<p>Backtesting is extremely valuable because it allows you to see if a trading strategy has an edge, before you risk real money.</p>
<p><strong>But there are many ways that you can make mistakes when backtesting. If you make any of the mistakes listed below, you won’t have accurate data. </strong></p>
<p>When you have faulty data, that can cause you to start trading a strategy that doesn’t actually have an edge. This usually leads to frustration, losses and believing that backtesting doesn’t work.</p>
<p>Avoid that headache by learning how to backtest properly. This video will show you how to avoid the 19 most common mistakes.</p>
<p><iframe title="YouTube video player" src="https://www.youtube.com/embed/4opqvUAeLYg" width="840" height="450" frameborder="0" allowfullscreen="allowfullscreen"><span data-mce-type="bookmark">?</span></iframe></p>
<h2>The Most Common Backtesting Mistakes</h2>
<h3>1. Not Having a Written Plan</h3>
<p><strong>A written plan is essential to backtesting success.</strong></p>
<p>There will be times when you get caught up in backtesting and forget the rules of the strategy. This is especially true if the strategy you’re testing has a lot of moving parts.</p>
<p>So write EVERYTHING down. Here are a few things that you should define:</p>
<ul>
<li>Entry signal rules</li>
<li>Percent risk per trade</li>
<li>Where to place the stop loss</li>
<li>Profit target</li>
<li>How to manage the trade</li>
<li>Indicators used and settings</li>
</ul>
<p>But there can be several other things to define, depending on the strategy you’re testing. Take some time to figure out every single parameter that you would have to define to do an accurate backtest.</p>
<p>You can get my <a href="https://www.tradingheroes.com/forex-trading-plan-guide/" target="_blank" rel="noopener">free trading plan worksheet here</a>.</p>
<p>…or make your own. It doesn’t matter which worksheet you use.</p>
<p><strong>Just write down a detailed plan and follow it.</strong></p>
<h3>2. Altering Backtesting Trades to be Correct 90%+ of the Time</h3>
<p><img class="aligncenter size-full wp-image-1021102" src="https://www.tradingheroes.com/wp-content/uploads/trader-computer.jpg" alt="Trader at computer" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/trader-computer.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/trader-computer-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p>This is an interesting one.</p>
<p><em>Some traders want to have a really high win rate and will everything they can to get it.</em></p>
<p>So they fudge trades in backtesting to make themselves feel better. They roll back the chart and take trades on future knowledge of what will happen on the chart.</p>
<p>In reality, most trading strategies aren’t going to have a really high win rate and you won’t be able to catch an ideal entry all of the time.</p>
<p><strong>The best strategies are robust. They make money consistently over long periods of time. </strong></p>
<p>So trying to be a high win rate trader in backtesting doesn’t help you develop a robust trading strategy.</p>
<p>You’re just fooling yourself into thinking that the system is better than it really is.</p>
<p>Stick to the testing plan and get an honest result.</p>
<p><strong>The more your backtesting simulates live trading, the better your chances of success. </strong></p>
<h3>3. Not Taking Enough Trades in Testing</h3>
<p>I’ve seen several traders backtest 6 months worth of daily chart data and declare that a system has an edge.</p>
<p><em>Yeah, it has an edge in those 6 months, but what about the rest of the time?</em></p>
<p>Test your strategy with as much historical data as possible, and take as many trades as possible. Your goal is to have a robust trading strategy that will make money in different market conditions.</p>
<p><strong>Optimizing a strategy to a specific time period is called curve fitting and will set you up for disaster. </strong></p>
<h3>4. Not Accounting for Your Emotional State</h3>
<p>Everyone has a bad day here and there. At the very least, we have days when we are really tired.</p>
<p><img class="aligncenter size-full wp-image-1021100" src="https://www.tradingheroes.com/wp-content/uploads/tired-trader.jpg" alt="Tired trader" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/tired-trader.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/tired-trader-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p><strong>Just like in live trading, your mood and your emotional state will affect your backtesting.</strong></p>
<p>You’ll miss trades and you just won’t be very sharp.</p>
<p>Account for your emotional state when backtesting and don’t test if you aren’t feeling up to it.</p>
<p>Also test a system a few times on different days, to account for potential distractions or off days.</p>
<h3>5. Quitting When the Results Aren’t Immediately Spectacular</h3>
<p>Some traders quit a backtest if it isn’t profitable within the first few trades.</p>
<p><strong>This doesn’t make sense because the beginning of a test could just be period where the system has a normal drawdown.</strong></p>
<p>So stick with a test until you hit a catastrophic drawdown that would not be acceptable in live trading.</p>
<p>A series of 7 losses in a row and a 7% loss is not catastrophic. It doesn’t feel good, but any good trading system can overcome that level of drawdown.</p>
<h3>6. Changing the System in the Middle of a Test</h3>
<p><img class="aligncenter size-full wp-image-1021103" src="https://www.tradingheroes.com/wp-content/uploads/change-trade.jpg" alt="Changing a backtest " width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/change-trade.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/change-trade-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p>This one is <em>very</em> common…</p>
<p>“I’ll just make one little tweak here.”</p>
<p>“Oh this might work better.”</p>
<p><strong>When you change a system in the middle of testing, you have contaminated data.</strong></p>
<p>It’s like if someone mixed apple juice and orange juice together, then gave it to you to drink, and asked you which one tastes better.</p>
<p>Obviously, it would be impossible to tell because you’re tasting both of them at the same time.</p>
<p>Likewise, when you change the rules of a trading system, you don’t know how your new rules would have performed in the past and you don’t know how your original rules would have performed after the change.</p>
<p><strong>Test each system separately and evaluate each one with complete data. </strong></p>
<h3>7. Not Following the System</h3>
<p>Some traders write down a trading system, then they don’t follow it…at all.</p>
<p>I’m not sure why that happens. They might have a problem with authority or something.</p>
<p>But this almost goes without saying…almost.</p>
<p><strong>Write down the rules, then test the rules as they are written.</strong></p>
<p>Most traders can do this. But if you have a tendency to stray from the rules, find a way to remind yourself to stay on track.</p>
<h3>8. Not Doing Enough Analysis After Testing and Not Having a Good Reporting System</h3>
<p><strong>Knowing the win rate and return of a trading system is not enough.</strong></p>
<p>You have to know things like:</p>
<ul>
<li>Maximum drawdown</li>
<li>Highest number of consecutive losing trades</li>
<li><a href="https://www.tradingheroes.com/mfe-mae-explained/" target="_blank" rel="noopener">MAE and MFE</a></li>
<li>Yearly return</li>
<li>Monte Carlo simulation results</li>
<li>And more!</li>
</ul>
<p>You can get this information by using backtesting software that provides this information, or you can import your backtesting results into Excel or Google Sheets.</p>
<p><em>These additional stats will show you how to improve your system and what to expect in live trading.</em></p>
<h3>9. Thinking That Live Results Will be Exactly the Same as Backtesting</h3>
<p><strong>Successful trading requires that we think in probabilities, not certainties. </strong></p>
<p>A trading system that looks good in backtesting may not perform exactly as we expect in live trading. There can be a few reasons for this.</p>
<p>For starters, you may be getting nervous when there’s real money on the line and you could be doing things that you didn’t do in backtesting. You might be moving your stop loss, or you may cut your winners short.</p>
<p>Some traders hit a drawdown when they first start trading a system live and they think that the system is broken. But in reality, if they reviewed their backtesting, they might realize that it was a normal drawdown.</p>
<p>Third, there might be a variable that you aren’t accounting for in your backtesting. That could be the spread, trading at the wrong time of day, or something else.</p>
<p>Finally, there might be something about the markets that’s different from when you backtested. There might be unusual news events or the markets may have fundamentally changed.</p>
<p><strong>Your live trading results should be similar, but not exactly the same as your backtesting. Use your backtesting as a guide, but understand that you also have to account for a certain degree of random market fluctuations. </strong></p>
<h3>10. Not Considering Portfolio and Correlation Risk</h3>
<p>Strategies cannot be traded in a vacuum.</p>
<p>Even if a strategy works well on 2 Forex pairs separately, trading the strategy on both pairs at the same time might not be a good idea.</p>
<p>You may have to reduce your risk on each trade, or decide to only take the signals that look the best.</p>
<p>Trading multiple markets with the same trading strategy can dramatically amplify your drawdowns, so be sure to factor that into your backtesting.</p>
<p>An easy way to do this is to merge the results of both tests into one spreadsheet and analyze the results together.</p>
<h3>11. Only Testing on 1 FX Pair/Stock/Commodity and Assuming it Will Work in All Markets</h3>
<p><em>I blame this one mostly on trading educators. </em></p>
<p>There are quite a few educators that will tell you that their trading system will work in any market.</p>
<p>Maybe. But I haven’t found a case where that is true yet.</p>
<p>Each market and each individual stock, currency pair or futures contract has its own personality. They are influenced by different fundamental factors and market dynamics.</p>
<p><strong>Therefore, thinking that you can test a strategy in one market and apply it to all the markets in the world is simply being lazy. </strong></p>
<p>Test each market before you risk real money.</p>
<h3>12. Being Distracted and Missing Trades</h3>
<p><img class="aligncenter size-full wp-image-1021104" src="https://www.tradingheroes.com/wp-content/uploads/distracted-trader.jpg" alt="Distracted trader" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/distracted-trader.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/distracted-trader-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p>Yeah, I get it.</p>
<p>Backtesting can be tedious at times.</p>
<p>I used to play movies in the background, or listen to music while backtesting. Now I’m more conscious of what I’m doing when I backtest.</p>
<p><strong>Watching movies is just a bad idea and you should be aware of the type of music you’re listening to. Turn off your phone and eliminate as many potential distractions as possible. </strong></p>
<p>If you want to listen to music, understand how it affects your concentration and mood. You might like to listen to Metallica in your car, but that type of music probably isn’t the best when you want to focus.</p>
<p>…or maybe it is.</p>
<p>Do you.</p>
<p><strong>Awareness is always the key to improvement. Be aware of how different stimuli impact your mental state and eliminate the ones that don’t help you.</strong></p>
<p>At the same time, think about how to add things that do help. Maybe open a window to get some fresh air, add some decorations in your room, or listen to uplifting music.</p>
<h3>13. Entering/Exiting Trades Optimally and Not Honestly</h3>
<p>This one can actually go both ways.</p>
<p>There is something to be said for testing a system with an optimal entry.</p>
<p>What I mean by that is entering a trade at the point where it would make the most money and follows your plan, versus where you probably would have entered it in live market conditions.</p>
<p><em>Entering a trade according to your plan may seem black and white. But when you’re testing a discretionary system, there can be big gray areas.</em></p>
<p>Many traders set the backtest speed to full-speed playback to get through as much data as possible.</p>
<p>Then they overrun the entry point and make trading decisions based on the data that they already saw.</p>
<p><strong>You won’t have the benefit of future information in live trading, so don’t use it in your backtesting.</strong></p>
<p>The only way that backing up and entering at the optimal point helps, is if you have very precise, mechanical entry rules.</p>
<p>If there is any discretion involved in your entry, like looking for a support/resistance level, then there’s the temptation to scroll the chart back to the ideal entry.</p>
<p><strong>To prevent this, look for backtesting software that only allows you to move forward on the charts. This will keep you honest. </strong></p>
<p><img class="aligncenter size-full wp-image-1021098" src="https://www.tradingheroes.com/wp-content/uploads/forward-test.jpg" alt="Forward test mode in backtesting" width="445" height="357" /></p>
<h3>14. Only Following Other People’s Rules and Not Experimenting for Yourself</h3>
<p><strong>Predefined trading systems usually only work well for one trader.</strong></p>
<p>…and that’s not you.</p>
<p>Every single successful trader I’ve talked to or heard about has had to customize their strategies to fit their personality. Myself included.</p>
<p>So learn trading systems from successful traders. But consider those systems as a jumping off point.</p>
<p>When you find a system you like, be willing to customize it fits your personality and lifestyle. Play with different ideas and have fun with the process.</p>
<p><strong>Your chances of success will increase dramatically when you start thinking for yourself.</strong></p>
<h3>15. Throwing Out a System Because it Doesn’t Make X% Per Month</h3>
<p><img class="aligncenter size-full wp-image-1021105" src="https://www.tradingheroes.com/wp-content/uploads/trash.jpg" alt="Trashing a trading system" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/trash.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/trash-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p>A monthly return goal is an expectation that may or may not be achievable by your trading system.</p>
<p>It can be possible to have monthly goals for <strong>day trading</strong> strategies. But for timeframes higher than that, it’s almost impossible.</p>
<p>I think that it’s much better to have a yearly goal because that gives your trading strategy room to go through a few winning and losing streaks.</p>
<p><strong>So don’t try to cram every trading strategy into your expectations. Your expectations are an arbitrary number anyway. </strong></p>
<p>First find out if a strategy is profitable, per your plan.</p>
<p>If it passes that first test, then you can experiment with versions of the entry and exit to try to increase the return.</p>
<p>Also remember that you can potentially use that strategy on other timeframes and in other markets to increase the return even more.</p>
<p><em>Just be sure to backtest it first. </em></p>
<h3>16. Trying to Over Optimize by Adding More Indicators/Conditions</h3>
<p>This is a very common issue.</p>
<p>Humans are naturally built to want to make better versions of whatever they create.</p>
<p>So in search of perfection, we try to improve the win rate of trading strategies by adding more rules to a trading system, in the hope of filtering out losing trades.</p>
<p><strong>Adding more indicators or conditions usually makes a trading system worse.</strong></p>
<p>Your goal when developing a trading system is to find something that is as simple as possible, and is profitable over a long period of time.</p>
<p>Because you’ll never develop something that’s perfect.</p>
<h3>17. Trying to be an Automated Trader When You Should be a Manual Trader and Vice Versa</h3>
<p><img class="aligncenter size-full wp-image-1021106" src="https://www.tradingheroes.com/wp-content/uploads/coder.jpg" alt="Programmer in trading" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/coder.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/coder-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p>Some people are better manual traders. Others are better at coding and are more likely to be successful trading automated programs.</p>
<p><strong>Consider your skills and strengths. </strong></p>
<p>I would say that most people are better off as discretionary traders. When they find a system that is profitable, then they can do <a href="https://www.tradingheroes.com/how-to-get-started-with-incremental-automation-in-forex-trading/" target="_blank" rel="noopener">Incremental Automation</a> and hire a programmer to automate all or parts of their strategy.</p>
<p>However, if you’re a programmer or engineer personality type, then fully automated trading could be for you. These types of people thrive on structure and can translate trading ideas into code.</p>
<h3>18. Not Studying the Rules of a System That You’re Testing (if learned from others)</h3>
<p>This is one that’s often overlooked.</p>
<p>I’ve caught myself a few times, where I was too eager to backtest a system and jumped into testing, without studying the rules of the system closely.</p>
<p>Upon further review, I discovered that I had missed a few key points that could have made the strategy profitable in my backtests.</p>
<p><strong>So take your time when you’re learning a trading strategy. Go over the material several times to be sure you haven’t missed any details. </strong></p>
<p><em>Then</em> start testing.</p>
<h3>19. Preset Bias to Prove or Disprove the System</h3>
<p>Finally, some traders have a preconcieved notion about a trading system before they even start testing it.</p>
<p>For example, a trader might believe that most breakouts are destined to fail. So if they are testing a breakout system, they might cut the winners short because they want to capture profits as soon as possible.</p>
<p><img class="aligncenter size-full wp-image-1021099" src="https://www.tradingheroes.com/wp-content/uploads/door.jpg" alt="Door" width="1200" height="600" srcset="https://www.tradingheroes.com/wp-content/uploads/door.jpg 1200w, https://www.tradingheroes.com/wp-content/uploads/door-768×384.jpg 768w" sizes="(max-width: 1200px) 100vw, 1200px" /></p>
<p><strong>The bottom line is to leave your biases at the door.</strong></p>
<p>Follow the plan exactly and don’t think that you know better.</p>
<h2>Final Thoughts on Backtesting Mistakes</h2>
<p>Even experienced traders can sometimes make these mistakes, so always be aware while you’re testing and try to be as scientific as possible during the process.</p>
<p>If you follow these guidelines, you’ll be rewarded with quality data that will help you improve your trading performance.</p>
<p>Break the rules and you could be spinning your wheels on the <a href="https://www.tradingheroes.com/trading-silodrome/">Trading Silodrome</a> for years.</p>
<p>It’s your choice.</p>
<p>The post <a rel="nofollow" href="https://www.tradingheroes.com/19-backtesting-mistakes/">19 Backtesting Mistakes Beginners Make</a> appeared first on <a rel="nofollow" href="https://www.tradingheroes.com">Trading Heroes</a>.</p>