1. #1
    CTA Gitz
    CTA Gitz's Avatar Become A Pro!
    Join Date: 12-03-10
    Posts: 7

    Organizing Statistics and Building Databases

    Hello all, first time post. I am in the preliminary stages of building a model for the nfl and I am having trouble getting the stats I need. I would like to build a program that goes through play by play data and separates it in excel into various categories. The play by play is on the website or each game is downloadable in pdf form. Do you think this is doable? I dont know any code how can I go about this? Any advice would be appreciated.

    Thank you all very much

  2. #2
    Justin7
    Justin7's Avatar Become A Pro!
    Join Date: 07-31-06
    Posts: 8,577
    Betpoints: 1506

    It is certainly doable, but you may have to hire a programmer.

    Getting play-by-play data opens up a lot of opportunities. If you can get it, it has lots of uses... from improved modeling to attacking props.

  3. #3
    GoIrish682
    GoIrish682's Avatar Become A Pro!
    Join Date: 11-05-10
    Posts: 246

    Hey Justim,
    i've been enjoyin gyour posts, and have discovered you on youtube...you are very smart, i have an important question..reading your posts, i get the strong feeling you are a big 'prop' guy and not so much game sides or totals...what can you reccommend to really find out what props to got after?
    thanks

  4. #4
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    Get the relational database, mysql. Learn SQL.

    You will thank me in the end

  5. #5
    Justin7
    Justin7's Avatar Become A Pro!
    Join Date: 07-31-06
    Posts: 8,577
    Betpoints: 1506

    Quote Originally Posted by GoIrish682 View Post
    Hey Justim,
    i've been enjoyin gyour posts, and have discovered you on youtube...you are very smart, i have an important question..reading your posts, i get the strong feeling you are a big 'prop' guy and not so much game sides or totals...what can you reccommend to really find out what props to got after?
    thanks
    I actually bet more sides and totals than props.

    Look at every single prop you can find anywhere. Price it. Go after them all at first. You'll find certain ones frequently offer value.

  6. #6
    CTA Gitz
    CTA Gitz's Avatar Become A Pro!
    Join Date: 12-03-10
    Posts: 7

    If I am unable to learn how to write this code in a timely fashion is there anywhere I can find this kind of data on the internet, even if I pay for it?

  7. #7
    Indecent
    Indecent's Avatar Become A Pro!
    Join Date: 09-08-09
    Posts: 758
    Betpoints: 1156

    Do it the hard way. You will learn a lot writing the scraper, and what you learn will help you in building the model.

  8. #8
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    Quote Originally Posted by Indecent View Post
    Do it the hard way. You will learn a lot writing the scraper, and what you learn will help you in building the model.
    I would have to disagree.

    Unless the model is pretty basic. Or the scraper is pretty exotic. Not sure how what you learn from the scraper helps you with the model.

  9. #9
    Indecent
    Indecent's Avatar Become A Pro!
    Join Date: 09-08-09
    Posts: 758
    Betpoints: 1156

    Quote Originally Posted by Maverick22 View Post
    I would have to disagree.

    Unless the model is pretty basic. Or the scraper is pretty exotic. Not sure how what you learn from the scraper helps you with the model.
    Well, I'm assuming he knows very little to start with. If you don't already know how to program, programming anything is better than not, and anything you learn will make the next task easier.

    Maybe it's interpreting a compiler error message you've never seen before, solving a dependency problem, working with an external class/API for the first time, etc. There are lots of little things can come up, the more you program the more you encounter them and the easier the solution/fix can be in the future.

  10. #10
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 807
    Betpoints: 58

    Quote Originally Posted by Indecent View Post
    Well, I'm assuming he knows very little to start with. If you don't already know how to program, programming anything is better than not, and anything you learn will make the next task easier.

    Maybe it's interpreting a compiler error message you've never seen before, solving a dependency problem, working with an external class/API for the first time, etc. There are lots of little things can come up, the more you program the more you encounter them and the easier the solution/fix can be in the future.
    touche

  11. #11
    Flight
    Update your status
    Flight's Avatar Become A Pro!
    Join Date: 01-27-09
    Posts: 1,979

    Quote Originally Posted by Maverick22 View Post
    Get the relational database, mysql. Learn SQL.

    You will thank me in the end

    +1

    Don't use Excel for data storage. Use SQL. You can then build custom queries at any time to give yourself powerful views of your data.

  12. #12
    subs
    subs's Avatar Become A Pro!
    Join Date: 04-30-10
    Posts: 1,412
    Betpoints: 969

    hi could u please explain that a little. i am using excel and find it easy and intuitive. what am i missing out on. my time is def finite so....

  13. #13
    boondoggle
    99.82% of forum posters are idiots
    boondoggle's Avatar Become A Pro!
    Join Date: 09-29-10
    Posts: 3,014
    Betpoints: 61

    What the guys are suggesting is that you utilize a relational database for your data warehousing instead of a spreadsheet. This has many advantanges over excel.

    1. create normalized database

    2. now you can actually obtain your data via queries that can be ran on the fly to dig the results you want out of your model.

    An example of SQL query for SQ SERVER 2005/8, "select * from table patterns where pattern = 'won_5_of_last_7'"

    You can download SQL SERVER EXPRESS 2008 for free from microsoft. It scales and performs much better than excel and gives incredible flexibility for viewing data based on how you want to view it.

    The only downside is that if you can do all of the above than you could probably make more money programming SQL than you will gambling
    Points Awarded:

    subs gave boondoggle 10 SBR Point(s) for this post.


  14. #14
    subs
    subs's Avatar Become A Pro!
    Join Date: 04-30-10
    Posts: 1,412
    Betpoints: 969

    thanks

    i'm gonna look at a tutorial and if my head doesn't hurt too much after a few hours maybe get stuck in proppa.

    BTW can't i do this via lookup tables? i mean ok it takes a bit longer to sort it all out but then so does learning something completely new?

  15. #15
    Borat38
    Borat38's Avatar Become A Pro!
    Join Date: 10-15-10
    Posts: 177
    Betpoints: 132

    Quote Originally Posted by boondoggle View Post
    What the guys are suggesting is that you utilize a relational database for your data warehousing instead of a spreadsheet. This has many advantanges over excel.

    1. create normalized database

    2. now you can actually obtain your data via queries that can be ran on the fly to dig the results you want out of your model.

    An example of SQL query for SQ SERVER 2005/8, "select * from table patterns where pattern = 'won_5_of_last_7'"

    You can download SQL SERVER EXPRESS 2008 for free from microsoft. It scales and performs much better than excel and gives incredible flexibility for viewing data based on how you want to view it.

    The only downside is that if you can do all of the above than you could probably make more money programming SQL than you will gambling
    Excellent advice!

  16. #16
    CTA Gitz
    CTA Gitz's Avatar Become A Pro!
    Join Date: 12-03-10
    Posts: 7

    Alright thanks for all of the help everybody. I have since found ten years of data to use. 2000-2009 on armchairanalysis.com. I would like to learn all that is mentioned but in the meanwhile I am teaching myself vba so I can splice my excel data however Id like. I would like a macro that sorts each team's games into their own sheet. I did this, which did not work. The teams are in Column F for now.
    Sub Team_Sort()
    Dim This_Team, Next_Team As String
    Dim i, j As Long
    Dim Sheet_Num As Integer
    i = 2
    This_Team = Cells([i], 6).Value
    Next_Team = Cells([i+1], 6).Value
    Sheet_Num = 2
    j = 2
    For i = 2 To 2565 'This is the total # of rows'
    If This_Team = Next_Team Then
    i = 1 + i
    End If
    If This_Team <> Next_Team Then
    Rows("j:i").Select
    Selection.Copy
    Sheets("Sheet_Num").Select
    ActiveSheet.Paste
    j = i
    Sheets(Sheet1).Select
    Sheet_Num=Sheet_Num+1
    End If

    Next

    End Sub
    Any suggestions on making this work?
    Last edited by CTA Gitz; 01-17-11 at 07:15 PM.

  17. #17
    CFA
    CFA's Avatar Become A Pro!
    Join Date: 12-14-09
    Posts: 44
    Betpoints: 618

    Quote Originally Posted by CTA Gitz View Post
    If I am unable to learn how to write this code in a timely fashion is there anywhere I can find this kind of data on the internet, even if I pay for it?
    Tell me how to send you an excel spreadsheet, and I will send it to you.
    Points Awarded:

    subs gave CFA 200 SBR Point(s) for this post.


Top