1. #36
    Poogs
    Poogs's Avatar Become A Pro!
    Join Date: 04-05-10
    Posts: 111
    Betpoints: 630

    ladies ladies, youre killing an otherwise great thread.
    Points Awarded:

    Timetobet34 gave Poogs 1 SBR Point(s) for this post.


  2. #37
    MonkeyF0cker
    MonkeyF0cker's Avatar Become A Pro!
    Join Date: 06-12-07
    Posts: 12,125
    Betpoints: 859

    I really don't think the discussion we had is too far off topic. The thread is about programmatically scraping data. There really needs to be some concern by those who wish to pursue that venture on how that data is stored, organized, and accessed. CSV's simply aren't practical for most profitable modeling applications.
    Last edited by MonkeyF0cker; 04-17-10 at 09:22 PM.

  3. #38
    sharpcat
    sharpcat's Avatar Become A Pro!
    Join Date: 12-19-09
    Posts: 4,516

    Ijump12,

    Please continue with your thread and do not let Monkey destroy it, which has clearly been his intention since day 1

    This is a great thread for those of us interested in the subject and your thread has inspired me to purchase a few books to help make this a little more understanding for me. The subject has tweaked my interest for a while now and your thread has helped to point me in the right direction to get started, I also have interest in programming outside of gambling but this is a great starting point to give me the motivation to learn.

  4. #39
    LT Profits
    LT Profits's Avatar VIP Moderator
    Join Date: 10-27-06
    Posts: 65,908
    Betpoints: 95911

    Thread is also cleaned up now, so carry on Ijump.

    BTP
    Week 8
    5-0-0 461 pts


  5. #40
    Daniel
    Daniel's Avatar Become A Pro!
    Join Date: 03-30-10
    Posts: 22

    How many of you analytical minds use historical (i.e. last year's) data? I'm guessing you're aware of the Lahman-database @ http://www.baseball1.com/?

    There is similar data available for hockey in case people are interested.
    Points Awarded:

    Meestermike gave Daniel 5 SBR Point(s) for this post.


  6. #41
    hockeyman30304
    hockeyman30304's Avatar Become A Pro!
    Join Date: 11-25-08
    Posts: 634


  7. #42
    frankzig
    frankzig's Avatar SBR PRO
    Join Date: 10-26-09
    Posts: 2,038
    Betpoints: 32

    anybody up and running?

    BTP
    Week 11
    3-1-1 383 pts

    BTP
    Week 9
    3-1-1 270 pts


  8. #43
    Meestermike
    Meestermike's Avatar Become A Pro!
    Join Date: 11-21-06
    Posts: 333
    Betpoints: 2600

    Quote Originally Posted by Daniel View Post
    How many of you analytical minds use historical (i.e. last year's) data? I'm guessing you're aware of the Lahman-database @ http://www.baseball1.com/?

    There is similar data available for hockey in case people are interested.
    Thanks Daniel. Any idea on the hockey DB addy?

  9. #44
    Daniel
    Daniel's Avatar Become A Pro!
    Join Date: 03-30-10
    Posts: 22

    Quote Originally Posted by Meestermike View Post
    Thanks Daniel. Any idea on the hockey DB addy?
    The hockey stats are only available if you're a member of a yahoo group (free). The data is also CSV-only and updated after each season, but contains just about every NHL-season's worth of individual and team stats.

    It's managed by a single guy, but he appreciates comments and discussion on the yahoo-group's mailing list.

    http://sports.groups.yahoo.com/group/hockey-databank/

  10. #45
    Meestermike
    Meestermike's Avatar Become A Pro!
    Join Date: 11-21-06
    Posts: 333
    Betpoints: 2600

    Quote Originally Posted by Daniel View Post
    The hockey stats are only available if you're a member of a yahoo group (free). The data is also CSV-only and updated after each season, but contains just about every NHL-season's worth of individual and team stats.

    It's managed by a single guy, but he appreciates comments and discussion on the yahoo-group's mailing list.

    http://sports.groups.yahoo.com/group/hockey-databank/
    Thanks Daniel. Much appreciated

  11. #46
    Nuggz
    Nuggz's Avatar Become A Pro!
    Join Date: 04-28-10
    Posts: 366
    Betpoints: 42

    Wow I've been learning Python recently and didn't really consider it as a tool for investing in sports. Very cool..

  12. #47
    dinaro7
    super player
    dinaro7's Avatar Become A Pro!
    Join Date: 12-06-09
    Posts: 889

    i agree

  13. #48
    kisado
    kisado's Avatar Become A Pro!
    Join Date: 09-09-08
    Posts: 519
    Betpoints: 36

    Awesome thread, I think! I'm not computer program savvy enough to fully comprehend what you have posted, but I can tell it's prolly some good shiit. I'm more of a 'feel' bettor if there's such a thing. I do handicap, but I use that data combined with my knowledge of the particular sport and other factors like motivation, past results, etc.

  14. #49
    jbrent95
    jbrent95's Avatar Become A Pro!
    Join Date: 12-07-09
    Posts: 1,218
    Betpoints: 934

    Thanks for the introduction to Python.

  15. #50
    Reno Gambler
    Reno Gambler's Avatar Become A Pro!
    Join Date: 03-24-09
    Posts: 174
    Betpoints: 244

    This is great stuff for us beginners!!

  16. #51
    frankzig
    frankzig's Avatar SBR PRO
    Join Date: 10-26-09
    Posts: 2,038
    Betpoints: 32

    very intresting

    BTP
    Week 11
    3-1-1 383 pts

    BTP
    Week 9
    3-1-1 270 pts


  17. #52
    CaptainPrice
    CaptainPrice's Avatar Become A Pro!
    Join Date: 10-29-09
    Posts: 1,064

    importing odds sounds like a pain still

  18. #53
    Wrecktangle
    Wrecktangle's Avatar Become A Pro!
    Join Date: 03-01-09
    Posts: 1,524
    Betpoints: 1222

    Quote Originally Posted by CaptainPrice View Post
    importing odds sounds like a pain still
    if it were easy, we'd all be swilling Mai-tais with the sports groupies in the Bellagio penthouse like Monkey. Instead we seek a zen-like oneness with our data bases ignoring all the worldly pleasures.

  19. #54
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 798
    Betpoints: 42

    I have a WELL tested Java Application/Scraper that gets the odds from SBROdds. If someone wants to propose a trade of something worth having...I'd be willing to barter it off...

    If anyone is interested, PM me...

  20. #55
    sharpcat
    sharpcat's Avatar Become A Pro!
    Join Date: 12-19-09
    Posts: 4,516

    Quote Originally Posted by greeksportspicks View Post
    Greek Sports Picks is now 28-5 in their "MLB Lock of the Day." Today, their pick was the Over of 9 1/2 in the Rockies and Brewers game. It easily covered with 15 runs scored combined between the 2 teams. Try their free pick for tomorrow by dialing their toll free number: 1 - 888 - 608 - 7487. Their free picks record is 14-5. TRY IT NOW! BREAK THE BOOKIES!!! ITS EASY MONEY!
    Handicappers digest says these guys are on a 1- 20 run

  21. #56
    yanky yank
    yanky yank's Avatar Become A Pro!
    Join Date: 06-28-10
    Posts: 21

    Brazil kicking some chilean butt

  22. #57
    pats3peat
    LETS GO PATS
    pats3peat's Avatar Become A Pro!
    Join Date: 10-23-05
    Posts: 1,163

    Quote Originally Posted by Wrecktangle View Post
    I'm always struck by how hard it can be to express yourself in print, and the fact that we all use differing terms to label the same items. I'm not a data base guy but data dictionary "thingies" are important even in my simplistic world. I would like to see us stay away from the Players Talk way of solving differences of opinion here in the Tank, however.

    I keep saying this to no observable progress: I'd like to see a group form where the interest is sharing checked out data sets. I spend way too much time cross checking data and way too little time on model building and analysis; especially the analysis.
    yea i think pretty much everyone wastes way too much time instead of just getting started on a model andend up not even trying. not saying research is a waste of time though

    What do you mean, cross-checking each others data sets... to speed up the process? What do you use, mostly just excel?

    SBR Founder Join Date: 10/23/2005


  23. #58
    Wrecktangle
    Wrecktangle's Avatar Become A Pro!
    Join Date: 03-01-09
    Posts: 1,524
    Betpoints: 1222

    Quote Originally Posted by pats3peat View Post
    yea i think pretty much everyone wastes way too much time instead of just getting started on a model andend up not even trying. not saying research is a waste of time though

    What do you mean, cross-checking each others data sets... to speed up the process? What do you use, mostly just excel?
    Building fully checked out dbs with all the conditionals (everything that is knowable about a game/team) is damn difficult. Once you have that, model building is relatively easy, and certainly more fun.

  24. #59
    bztips
    bztips's Avatar Become A Pro!
    Join Date: 06-03-10
    Posts: 283

    These "how-to" posts by lj are by far the most useful things I've seen on this entire site (admittedly I'm relative newbie who has been scouring around for just a little while).

    Following his examples, I am now up and running automated daily scrapes of MLB data from covers, baseballprospectus and statcorner. For my purposes, the csv exports are perfect because they can be appended automatically into my databases.

    Now I just have to be patient, wait for my sample sizes to grow -- and then it's off to modeling!

  25. #60
    RaginCajun
    RaginCajun's Avatar Become A Pro!
    Join Date: 06-28-10
    Posts: 87

    i really just got started in handicapping and never thought to do any of this. are u guys making your dbs by using these programs that u made? and what kind of data are you taking from each sport? its ok if u cant reveal this information

  26. #61
    Wrecktangle
    Wrecktangle's Avatar Become A Pro!
    Join Date: 03-01-09
    Posts: 1,524
    Betpoints: 1222

    Quote Originally Posted by RaginCajun View Post
    i really just got started in handicapping and never thought to do any of this. are u guys making your dbs by using these programs that u made? and what kind of data are you taking from each sport? its ok if u cant reveal this information
    Everything you think might be relevant and maybe even some that might not. Then test them against the lines you scrape. These things can get very large. No one said this is easy.

  27. #62
    Indecent
    Indecent's Avatar Become A Pro!
    Join Date: 09-08-09
    Posts: 757
    Betpoints: 1143

    Python programmers might want to look into Scrapy. Never used it, but seems like it would be useful for betting purposes.

    Upon further reflection.. From the perspective of teaching new programmers, it might be too big of a stretch to teach Python and XPath (and maybe html) all at once. This could be useful for more experienced users, but maybe not quite appropriate for this type of tutorial/userbase.
    Last edited by Indecent; 07-12-10 at 01:14 PM.

  28. #63
    Maverick22
    Maverick22's Avatar Become A Pro!
    Join Date: 04-10-10
    Posts: 798
    Betpoints: 42

    Quote Originally Posted by RaginCajun View Post
    i really just got started in handicapping and never thought to do any of this. are u guys making your dbs by using these programs that u made? and what kind of data are you taking from each sport? its ok if u cant reveal this information
    Not sure how everyone else does, so i speak for myself.

    I have a program that will go out to the internet stat websites ie CBS Sports. This program gets all the game data available. I take EVERYTHING i can find. And then i take this data and load it into a database. Later, once i have all the data, I figure out what i actually need to use...

    PS. Getting ONLY the data you need is a bad practice and will hurt you in the future. And it's lazy. Don't listen to anyone that says "your database should only contain data you plan to use". This is bad when over time your approach changes and you need more (and increasingly specific) data.

  29. #64
    roasthawg
    roasthawg's Avatar Become A Pro!
    Join Date: 11-09-07
    Posts: 2,990

    I've been using PHP with xpath to scrape lately... there's a bunch of different ways though and not all of them involve programming. The hard part is finding that data... not scraping it.

  30. #65
    RaginCajun
    RaginCajun's Avatar Become A Pro!
    Join Date: 06-28-10
    Posts: 87

    i tried to use the elif function in the second "tutorial" and it said there is a syntax error. i checked and i have everything exactly how it is posted. please help

  31. #66
    CrimsonQueen
    CrimsonQueen's Avatar SBR PRO
    Join Date: 08-12-09
    Posts: 1,068
    Betpoints: 12

    Ijump, this is the best thread ever. Please continue it!!

    BTP
    Week 9
    3-1-1 285 pts


  32. #67
    eldoctord
    eldoctord's Avatar Become A Pro!
    Join Date: 06-12-10
    Posts: 265
    Betpoints: 12

    Excellent information. I wonder how many people put this much thought and energy into their decisions. Most of us are impulsive, gut bettors. More power to those who can come up with an edge and consistently win money.

  33. #68
    CrimsonQueen
    CrimsonQueen's Avatar SBR PRO
    Join Date: 08-12-09
    Posts: 1,068
    Betpoints: 12

    Quote Originally Posted by sharpcat View Post
    your thread has inspired me to purchase a few books to help make this a little more understanding for me.
    sharpcat or anyone else: what books are you reading that are about this? that specifically talks about programming databases and modeling for sportsbetting?

    I've always had some basic knowledge of programming from various programs, but this has very much grabbed my attention and I would love to delve fully into the world of programming and databases.

    BTP
    Week 9
    3-1-1 285 pts


  34. #69

  35. #70
    CrimsonQueen
    CrimsonQueen's Avatar SBR PRO
    Join Date: 08-12-09
    Posts: 1,068
    Betpoints: 12

    Thanks maverick22, but that's only about baseball. If the book is sport specific, I'd want it about NCAAB.

    BTP
    Week 9
    3-1-1 285 pts


First 12345 ... Last
Top