--- title: "What are overfitting, look ahead bias and survivorship bias?" description: "Overfitting means a rule has been tuned to the noise in one sample, so it looks strong there and fails on new data." source_url: "https://www.rupeecase.com/learn/questions/overfitting-and-biases" --- A backtest is only honest when the rule is fixed before the held back data is opened The order of a test that can be checked. A map of method, not a result. Source: RupeeCase method map; cost rules from NSE and SEBI. As of 16 Oct 2026. A backtest is a question asked of past data. Overfitting happens when the answer is shaped by the question, through trying many rules, parameters or periods until one looks good. Each extra choice is another chance for a lucky result to pass as skill. Look ahead bias is information used before it existed: a close price used to fill an order at that same close, a constituent list taken from today, or a revised number used as if it had been known on the day. Survivorship bias keeps only the stocks or contracts that lasted, so the losers that left the sample are missing from the test. Data snooping is the quiet cousin. Test forty ideas and a couple will look significant by chance alone. The honest fix is to count every idea tested, not only the one that worked, and to hold back a period that no test has touched. The flow below is the order of a test that can be checked. Each stage answers one question before the next one starts, and any change made after the held back period is a new test, not a revision of the old one. Costs matter for the same reason. A rule that works before brokerage, STT, fees and slippage can fail once they are charged, and a backtest that leaves them out has not tested the strategy that would be traded. **Before you trade.** Derivatives trading carries a high risk of loss. SEBI's study "Profitability of Individual Traders in the Equity Derivatives Segment (FY25 to FY26)" (August 2026) found that 87.7% of individual traders in equity F&O made net losses in FY26, with aggregate net losses of Rs 91,685 crore. [Read the SEBI study](https://www.sebi.gov.in/reports-and-statistics/research/aug-2026/study-profitability-of-individual-traders-in-the-equity-derivatives-segment-fy25-fy26-_103835.html) What are overfitting, look ahead bias and survivorship bias?Overfitting means a rule has been tuned to the noise in one sample, so it looks strong there and fails on new data. Look ahead bias and survivorship bias flatter a backtest in two other ways, by using information that was not yet known or by testing only the contracts and stocks that lasted. LGo deeper ## Where Learn teaches this. [Go deeperWhat a backtest is, and five biases that ruin it9 min, Intermediate](/learn/path-19/module-19-1-backtest-biases)[Go deeperWalk forward and out of sample testing10 min, Advanced](/learn/path-19/module-19-7-walk-forward-testing) SSources ## Go to the source. 4 sources, SEBI the most cited The publisher of each source listed below. Source: Module undefined source list. 1. [SEBI, safer participation of retail investors in algorithmic trading (circular, 4 Feb 2025)](https://www.sebi.gov.in/legal/circulars/feb-2025/safer-participation-of-retail-investors-in-algorithmic-trading_91614.html) SEBI 2. [SEBI, study on F&O profit and loss of individual traders (Aug 2026)](https://www.sebi.gov.in/sebi_data/attachdocs/aug-2026/1787233506209.pdf) SEBI 3. [NSE, equity derivatives contract specifications (lots, expiries and settlement used in the examples)](https://www.nseindia.com/static/products-services/equity-derivatives-contract-specifications) NSE 4. [Harvey, Liu and Zhu (2016), ... and the Cross-Section of Expected Returns, Review of Financial Studies (multiple testing)](https://doi.org/10.1093/rfs/hhv059) Paper ?Questions people ask ## Related questions. [QuestionDoes machine learning work for trading?Advanced, trap check](/learn/questions/does-machine-learning-work-for-trading)[QuestionHow do I backtest an option strategy in India, or in Python?Intermediate](/learn/questions/backtest-option-strategy)[QuestionMust a backtest include STT and costs?Intermediate](/learn/questions/backtest-include-stt)[QuestionSharpe, max drawdown, Kelly, position sizing and risk of ruin: how do they fit?Intermediate](/learn/questions/sharpe-drawdown-kelly-sizing)[QuestionHow do people build an algo with Python and broker APIs?Intermediate](/learn/questions/build-an-algo-with-python) [All 130 questions](/learn/questions/) Explore next ## Go deeper on this question. * [QuestionWhat is walk forward testing?A short answer with a dated chart](/learn/questions/what-is-walk-forward-testing) * [ToolOption payoff builderLegs on a dated Nifty chain, breakevens and charges](/learn/tools/payoff-builder) * [GlossaryInvesting glossary, 230 termsPlain word definitions, and the app’s own](/learn/glossary) Community ## Join my WhatsApp group. Scan the code, fillFill one short form, and join my WhatsApp group. Slides, sources, factsheets and the rebalance logs live there, and members join a daily Google Meet with me. New to RupeeCase? [Getting started](/getting-started) [See the terminal](/terminal) [Sign up for RupeeCase](https://invest.rupeecase.com/signup) [Join the WhatsApp group](https://forms.gle/C6HMtM1Z2GfeocQV7) [One form, one group](https://forms.gle/C6HMtM1Z2GfeocQV7)Scan with your phone camera Education only, not investment advice, a research report or a recommendation to buy, sell or hold any security. RupeeCase (QC Alpha Technologies Pvt Ltd) is not registered with SEBI as an investment adviser or research analyst. Contracts and prices shown are for illustration only, come from NSE end of day files at least 30 days old, and are not recommendatory. Derivatives trading carries a high risk of loss.