1. #1
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    Testing this model for MLB 2011

    So a team and I have been working on a model for MLB 2011. We've scrapped all our data and finished the model. We have also backtested it on previous seasons. It is showing profit for the 2009 season and similar profit for the 2010 season.

    So my question is, what are the chances this model will show profit in 2011?
    Nomination(s):
    This post was nominated 1 time . To view the nominated thread please click here. People who nominated: ztay22

  2. #2
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    You did not build the model using the 2009 or 2010 data did you?

  3. #3
    ljump12
    ljump12's Avatar Become A Pro!
    Join Date: 12-08-09
    Posts: 108
    Betpoints: 258

    Quote Originally Posted by Maverick22 View Post
    You did not build the model using the 2009 or 2010 data did you?
    This.

  4. #4
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    What do you mean?

  5. #5
    josie88
    josie88's Avatar Become A Pro!
    Join Date: 02-12-09
    Posts: 48
    Betpoints: 2188

    Sharp Sports Betting by Stanford Wong chapter 7 - testing W/L records for significance

  6. #6
    lovesbaseball1
    lovesbaseball1's Avatar Become A Pro!
    Join Date: 12-07-10
    Posts: 18
    Betpoints: 246

    why did you scrap all the data before you made the model?

  7. #7
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    how was he supposed to make the model with no data?

  8. #8
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    The same data that you used to make the model. (Unless you simply pulled this model out of your ass/backside.) Should not be used to "test" it.

    There should be two sets of data. One for construction of your model. One for testing.

    For example, NBA. You might build your model using the 2000-2005 Seasons. And you might validate/test it using the 2006-2009 and 1995-1999 seasons.

    The book mentioned above will explain why, but I just gave you the readers digest version.

  9. #9
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    Ok I think I see what you mean. When we tested it on the 2009 season no data from 2009 or 2010 was used. When we tested on 2010, we did add the 2009 data back in. And then for 2011 we plan on adding 2010 data in.

    Is this what you mean?

  10. #10
    blackbart
    blackbart's Avatar SBR PRO
    Join Date: 12-04-07
    Posts: 3,782
    Betpoints: 20685

    how may degrees of freedom?

  11. #11
    LLXC
    LLXC's Avatar SBR PRO
    Join Date: 12-10-06
    Posts: 8,969
    Betpoints: 10451

    Cross-validation

  12. #12
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    We are new to this what does degrees of freedom mean and what does cross validation mean?

    Thanks.

  13. #13
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    How many years of MLB data do you have?

    If you only have 2009 & 2010. "They" will tell you, that you need more data than this...

  14. #14
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    We have used many more seasons then just 2009 and 2010 lol.

  15. #15
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    bummpp

  16. #16
    DirkDiggs
    Clippers ML!
    DirkDiggs's Avatar Become A Pro!
    Join Date: 12-07-10
    Posts: 484
    Betpoints: 12

    Take 2009 and 2010 out of the model.

    Use one set of data to build the model and use a different set to validate the model. So, for example use 2000-2008 to build the model. Then test what you have come up with on the 2009 and 2010 seasons to see if it holds true.

  17. #17
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    That is what we did...we took the seasons we used before 09 and tested on 09, then we added 09 to test on 10, and then we are going to add 10, to use on 11.

    Are you saying do not add 09 and 10 data for 2011? And just stick to the data from seasons before that?

  18. #18
    bztips
    bztips's Avatar Become A Pro!
    Join Date: 06-03-10
    Posts: 283

    Quote Originally Posted by OMGRandyJackson View Post
    That is what we did...we took the seasons we used before 09 and tested on 09, then we added 09 to test on 10, and then we are going to add 10, to use on 11.

    Are you saying do not add 09 and 10 data for 2011? And just stick to the data from seasons before that?
    You could add in the 09 and 10 data, then test for whether those added years are statistically different from the prior years, using a Chow test (a form of an F test). If they are different, then that's an indication that something structural/fundamental has changed and your model based on pre-09 data may no longer be valid/relevant.
    Last edited by bztips; 02-01-11 at 03:28 PM.

  19. #19
    OMGRandyJackson
    OMGRandyJackson's Avatar Become A Pro!
    Join Date: 02-07-10
    Posts: 1,680
    Betpoints: 4054

    Ok this is what we've done so far. We created a model using seasons 05-08, we tested this on 09, and it showed profit. We then added 09, and tested on 10 and it showed similar profit. So for 2011 we want to add 2010 to it and use it in 2011.

  20. #20
    batigol
    batigol's Avatar Become A Pro!
    Join Date: 12-29-10
    Posts: 171

    good idea !

  21. #21
    dwaechte
    dwaechte's Avatar Become A Pro!
    Join Date: 08-27-07
    Posts: 5,481
    Betpoints: 235

    Quote Originally Posted by batigol View Post
    good idea !
    gpia

Top