Automated System Over-Optimization

19
The Inherent Problems with Automated System Over-Optimization A complimentary publication provided by: www.AutoSystemTrader.com

description

This report explains the inherent problems with automated system over-optimization.

Transcript of Automated System Over-Optimization

Page 1: Automated System Over-Optimization

The Inherent Problemswith Automated System

Over-Optimization

A complimentary publication provided by:

www.AutoSystemTrader.com

Page 2: Automated System Over-Optimization

C F T C R I S K D I S C L A I M E R

U . S . G O V E R N M E N T R E Q U I R E D D I S C L A I M E R - C O M M O D I T Y F U T U R E S T R A D I N G C O M M I S S I O N F U T U R E S A N D O P T I O N S T R A D I N G H A S L A R G E P O T E N T I A L

R E W A R D S , B U T A L S O L A R G E P O T E N T I A L R I S K . Y O U M U S T B E A W A R E O F T H E R I S K S A N D B E W I L L I N G T O A C C E P T T H E M I N O R D E R T O I N V E S T I N T H E

F U T U R E S A N D O P T I O N S M A R K E T S . D O N ' T T R A D E W I T H M O N E Y Y O U C A N ' T A F F O R D T O L O S E . T H I S I S N E I T H E R A S O L I C I T A T I O N N O R A N O F F E R T O

B U Y / S E L L F U T U R E S , S T O C K S O R O P T I O N S O N T H E S A M E . N O R E P R E S E N T A T I O N I S B E I N G M A D E T H A T A N Y A C C O U N T W I L L O R I S L I K E L Y T O A C H I E V E

P R O F I T S O R L O S S E S S I M I L A R T O T H O S E D I S C U S S E D I N T H I S R E P O R T . T H E P A S T P E R F O R M A N C E O F A N Y T R A D I N G S Y S T E M O R M E T H O D O L O G Y I S N O T

N E C E S S A R I L Y I N D I C A T I V E O F F U T U R E R E S U L T S .

C F T C R U L E 4 . 4 1 - H Y P O T H E T I C A L O R S I M U L A T E D P E R F O R M A N C E R E S U L T S H A V E C E R T A I N L I M I T A T I O N S . U N L I K E A N A C T U A L P E R F O R M A N C E R E C O R D ,

S I M U L A T E D R E S U L T S D O N O T R E P R E S E N T A C T U A L T R A D I N G . A L S O , S I N C E T H E T R A D E S H A V E N O T B E E N E X E C U T E D , T H E R E S U L T S M A Y H A V E U N D E R -

O R - O V E R C O M P E N S A T E D F O R T H E I M P A C T , I F A N Y , O F C E R T A I N M A R K E T F A C T O R S , S U C H A S L A C K O F L I Q U I D I T Y . S I M U L A T E D T R A D I N G P R O G R A M S I N

G E N E R A L A R E A L S O S U B J E C T T O T H E F A C T T H A T T H E Y A R E D E S I G N E D W I T H T H E B E N E F I T O F H I N D S I G H T . N O R E P R E S E N T A T I O N I S B E I N G M A D E T H A T

A N Y A C C O U N T W I L L O R I S L I K E L Y T O A C H I E V E P R O F I T O R L O S S E S S I M I L A R T O T H O S E S H O W N W I T H I N T H I S R E P O R T , S U P P O R T A N D T E X T S . O U R

C O U R S E ( S ) , P R O D U C T S A N D S E R V I C E S S H O U L D B E U S E D A S L E A R N I N G A I D S O N L Y A N D S H O U L D N O T B E U S E D T O I N V E S T R E A L M O N E Y . I F Y O U

D E C I D E T O I N V E S T R E A L M O N E Y , A L L T R A D I N G D E C I S I O N S S H O U L D B E Y O U R O W N .

T H I S S I T E I S P R O V I D E D B Y “ A U T O M A T E D S Y S T E M T R A D E R ” ( A S T ) . P L E A S E B E A D V I S E D T H A T A S T I S N O T A R E G I S T E R E D B R O K E R , F I N A N C I A L A D V I S O R ,

N O R I S R E G I S T E R E D I N A N Y W A Y W I T H A N Y G O V E R N M E N T R E G U L A T O R A G E N C Y . A S T M A K E S T H I S I N F O R M A T I O N , I T S P R O D U C T S A N D S E R V I C E S

A V A I L A B L E T H R O U G H T H I S W E B S I T E U N D E R T H E F I R S T A M E N D M E N T O F T H E U N I T E S S T A T E S C O N S T I T U T I O N . A S T H A S M A D E G R E A T E F F O R T T O L I S T

A L L I N F O R M A T I O N T O B E V E R Y A C C U R A T E . A L L D A T A I N C L U D E D I N T H I S W E B S I T E I S C O N S I D E R E D H Y P O T H E T I C A L .

F U T U R E S , F O R E X , O P T I O N ’ S A N D A N Y T R A D I N G O R I N V E S T I N G C O N T A I N S R I S K . E S P E C I A L L Y T R A D I N G I N L E V E R A G E D V E H I C L E S S U C H A S F U T U R E S ,

F O R E X O R R E L A T E D M A R K E T S . A S T P R O D U C T S A N D S E R V I C E S M A Y N O T B E S U I T A B L E F O R E V E R Y O N E . T R A D I N G S H O U L D O N L Y B E D O N E W I T H T R U E

R I S K C A P I T A L . P A S T P E R F O R M A N C E I S N O T I N D I C A T I V E O F F U T U R E P E R F O R M A N C E .

Page 3: Automated System Over-Optimization

What is optimization and how does it affect automated trading strategies?

Optimization refers to taking an automated system trading program and using a computer to backtest know market data (price action) of a period of time in the past to create the most profitable returns. The problems with computer backtesting or optimization is that when you look forward to trade the system in real time, it may not perform the same as it has in the past because the price action has not been tested.

The following pages show automated trading systems that were developed by professional system developers that were over-optimized to create equity curves that did not hold up in real time markets.

This publication is designed to demonstrate that the more complex a trading system becomes, the more likely that it can be curve fit. In terms of trading, we believe that automated systems with less input variables are more sustainable in real time trading.

Most of the systems that we provide are simple enough to have performed well in out of sample testing and real time trading. All systems that AutoSystemTrader.com provideshave gone through no less than 3 months of live trading to ensure that over-optimization has not occurred.

AutoSystemTrader.com offers hypothetical trade data for backtested/optimized data, walk-forward/out of sample data and real time trade data from the automated strategy signals before slippage and commissions. We provide this only as an indication of how systems have performed. Of course, past performance can never guarantee future results.

Page 4: Automated System Over-Optimization

The following pages will contain automated trading systems and their respective equity curves that we have tested and are offered to show how over-optimization can and does occur. It is our intention that this information will help the consumer to make a more informed decision before purchasing or trading an automated trading system.

First, the backtested equity curve will be presented. This is what the system developer uses to optimize the variables of his or her strategy to produce the highest profit, lowest drawdown, or whatever other parameters that the developer may be trying to identify.

Next, when the page is turned, you will see an image that contains the same data along with trades that have occurred after system optimization.

On the next page, you will see only the real time trade data for those systems that have been over-optimized.

AutoSystemTrader.com offers systems tries to find automated trading systems that have withstood real time trading without breaking down. For this reason, if you see systems on the site that say “Available Soon” it is because we are currently testing these systems to see if they hold up in real time. Typically, we optimize our strategies with at least six months of untested data. We then open the system up to incorporate the most recent six months of untested data. After that has been done, we post the systems up on our site and monitor them for a period of six months before making them available for subscription. We do this only in an attempt to reduce risk of trading an automated system too soon.

For more information, please visit us online at http://www.AutoSystemTrader.com

Page 5: Automated System Over-Optimization

System ABacktest Period - Where Optimization is Performed

Page 6: Automated System Over-Optimization

System ABacktested Optimization Period with Real Time Data

Page 7: Automated System Over-Optimization

System AReal Time Trade Data - After Optimization Period

Page 8: Automated System Over-Optimization

www.AutoSystemTrader.com

Page 9: Automated System Over-Optimization

System BBacktest Period - Where Optimization is Performed

Page 10: Automated System Over-Optimization

System BBacktested Optimization Period with Real Time Data

Page 11: Automated System Over-Optimization

System BReal Time Trade Data - After Optimization Period

Page 12: Automated System Over-Optimization

www.AutoSystemTrader.com

Page 13: Automated System Over-Optimization

System CBacktest Period - Where Optimization is Performed

Page 14: Automated System Over-Optimization

System CBacktested Optimization Period with Real Time Data

Page 15: Automated System Over-Optimization

System CReal Time Trade Data - After Optimization Period

Page 16: Automated System Over-Optimization

www.AutoSystemTrader.com

Page 17: Automated System Over-Optimization

System DBacktest Period - Where Optimization is Performed

Page 18: Automated System Over-Optimization

System DBacktested Optimization Period with Real Time Data

Page 19: Automated System Over-Optimization

Real Time Trade Data - After Optimization Period

System D