Getting CBB play-by-play data

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Justin7
    SBR Hall of Famer
    • 07-31-06
    • 8577

    #1
    Getting CBB play-by-play data
    I've tried scraping a few sites, but my IP eventually gets blocked. Statsheet and ESPN don't want you downloading 5k sets of play-x-play per season.

    Statsheet mentioned that their data provider doesn't allow scraping, or for them to sell it. They won't identify the data provider.

    If you wanted to buy this from a primary source, who has it?
  • wantitall4moi
    SBR MVP
    • 04-17-10
    • 3063

    #2
    Tried CBS sports? NCAA website itself?
    Comment
    • Chi_archie
      SBR Aristocracy
      • 07-22-08
      • 63165

      #3
      I do

      I'm not sure if it is anything before 2010 and its just power conferences

      I can't post it.

      the Mods might give me an infraction
      Comment
      • muldoon
        SBR MVP
        • 01-04-10
        • 4397

        #4
        XMLTeam.com
        Comment
        • wantitall4moi
          SBR MVP
          • 04-17-10
          • 3063

          #5
          Originally posted by muldoon
          XMLTeam.com
          have to pay for that one AFAIK

          EDIT: NVM he said he would buy it.
          Comment
          • muldoon
            SBR MVP
            • 01-04-10
            • 4397

            #6
            Originally posted by wantitall4moi
            have to pay for that one AFAIK
            OP said "If you wanted to buy this from a primary source, who has it?"

            Hard to find anything real time that's decent without paying something for it.
            Comment
            • wantitall4moi
              SBR MVP
              • 04-17-10
              • 3063

              #7
              Originally posted by muldoon
              OP said "If you wanted to buy this from a primary source, who has it?"

              Hard to find anything real time that's decent without paying something for it.
              yeah i edited it after i read the last line.

              I am sure CBSsports would work for awhile. I dont do full play by play scrapes ( no wonder he gets blocked) but 'normal' stuff n problems.
              Comment
              • MonkeyF0cker
                SBR Posting Legend
                • 06-12-07
                • 12144

                #8
                I do.

                $12k.
                Comment
                • rm18
                  SBR Posting Legend
                  • 09-20-05
                  • 22291

                  #9
                  you can get a vpn with like 100 ips might be cheaper
                  Comment
                  • MonkeyF0cker
                    SBR Posting Legend
                    • 06-12-07
                    • 12144

                    #10
                    I've been scraping from ESPN for years and I've never been IP restricted...
                    Comment
                    • Ace_of_Spades
                      SBR Posting Legend
                      • 10-14-09
                      • 13518

                      #11
                      Originally posted by Chi_archie
                      I do

                      I'm not sure if it is anything before 2010 and its just power conferences

                      I can't post it.

                      the Mods might give me an infraction
                      You are a joke.
                      Comment
                      • jjgold
                        SBR Aristocracy
                        • 07-20-05
                        • 388179

                        #12
                        It will cost you about $800 a month through stats.com or even maybe sportsnetwork
                        Comment
                        • jjgold
                          SBR Aristocracy
                          • 07-20-05
                          • 388179

                          #13
                          http://www.stats.com/


                          Comment
                          • Emily_Haines
                            SBR Posting Legend
                            • 04-14-09
                            • 15917

                            #14
                            Each university has their own site.



                            You can easily scrap a seasons worth of games and probably much more before getting blocked. Once your done just move onto the next one. Lot's of them use the same format, so it should not be that bad of a programming nightmare.
                            Comment
                            • jjgold
                              SBR Aristocracy
                              • 07-20-05
                              • 388179

                              #15
                              Pro Players Pay for it

                              Reliable and in programming format
                              Comment
                              • rsigley
                                SBR Sharp
                                • 02-23-08
                                • 304

                                #16
                                since i have it set up to parse data all day fro m espn.com i took an old box i never used and for a test i just parsed every pbp on espn for cbb no ip ban

                                so i deleted the db and did it again no ip ban

                                so i deleted the db and did it again no ip ban

                                then i gave up. so for 4 non stop hours i pulled data from espn.com hundreds of thousands of pbp/box score and no ip ban
                                Comment
                                • jjgold
                                  SBR Aristocracy
                                  • 07-20-05
                                  • 388179

                                  #17
                                  depends what frequency rate is

                                  Every few minutes and you might be ok

                                  every second and could have problems
                                  Comment
                                  • MonkeyF0cker
                                    SBR Posting Legend
                                    • 06-12-07
                                    • 12144

                                    #18
                                    Originally posted by rsigley
                                    since i have it set up to parse data all day fro m espn.com i took an old box i never used and for a test i just parsed every pbp on espn for cbb no ip ban

                                    so i deleted the db and did it again no ip ban

                                    so i deleted the db and did it again no ip ban

                                    then i gave up. so for 4 non stop hours i pulled data from espn.com hundreds of thousands of pbp/box score and no ip ban
                                    LOL. Yup. I just did the same.

                                    Only once though.

                                    Never been IP restricted from there.
                                    Comment
                                    • Maverick22
                                      SBR Wise Guy
                                      • 04-10-10
                                      • 807

                                      #19
                                      Amazon cloud computing. You are welcome.
                                      Comment
                                      • Justin3587
                                        SBR MVP
                                        • 08-29-12
                                        • 2566

                                        #20
                                        What is scraping?
                                        Comment
                                        • Maverick22
                                          SBR Wise Guy
                                          • 04-10-10
                                          • 807

                                          #21
                                          Originally posted by Justin3587
                                          What is scraping?
                                          To take the data from a website and store it off somewhere else. Without actually having direct access to the websites data
                                          Comment
                                          • Justin3587
                                            SBR MVP
                                            • 08-29-12
                                            • 2566

                                            #22
                                            Originally posted by Maverick22
                                            To take the data from a website and store it off somewhere else. Without actually having direct access to the websites data
                                            I see, this may be a dumb question, but what is the point if you can log onto the sites and just view it whenever?
                                            Comment
                                            • jgilmartin
                                              SBR MVP
                                              • 03-31-09
                                              • 1119

                                              #23
                                              Originally posted by Justin3587
                                              I see, this may be a dumb question, but what is the point if you can log onto the sites and just view it whenever?
                                              You can make your own database and run your own analysis on it that wouldn't be possible via simply viewing it on the site.
                                              Comment
                                              • rsigley
                                                SBR Sharp
                                                • 02-23-08
                                                • 304

                                                #24
                                                Originally posted by jjgold
                                                depends what frequency rate is

                                                Every few minutes and you might be ok

                                                every second and could have problems
                                                no pause
                                                Comment
                                                • muldoon
                                                  SBR MVP
                                                  • 01-04-10
                                                  • 4397

                                                  #25
                                                  Originally posted by Justin3587
                                                  I see, this may be a dumb question, but what is the point if you can log onto the sites and just view it whenever?
                                                  Some may want to store the data to use later (or to analyse in real time)

                                                  Some may want to relay that info to their own site or app.
                                                  Comment
                                                  • 339955
                                                    Restricted User
                                                    • 07-20-12
                                                    • 198

                                                    #26
                                                    rsigley how many bets do you make a day how do you have time to make them all? what sites do you et on?
                                                    Comment
                                                    • Miz
                                                      SBR Wise Guy
                                                      • 08-30-09
                                                      • 695

                                                      #27
                                                      You can use python to change what type of browser the site thinks you're using, space out your queries, goof w IPs, etc.

                                                      We've had good luck doing that.
                                                      Comment
                                                      • Justin7
                                                        SBR Hall of Famer
                                                        • 07-31-06
                                                        • 8577

                                                        #28
                                                        Thanks, I got what I needed by rotating through proxies.
                                                        Comment
                                                        • MonkeyF0cker
                                                          SBR Posting Legend
                                                          • 06-12-07
                                                          • 12144

                                                          #29
                                                          Originally posted by Justin7
                                                          Thanks, I got what I needed by rotating through proxies.
                                                          Comment
                                                          • FreeFall
                                                            SBR MVP
                                                            • 02-20-08
                                                            • 3365

                                                            #30
                                                            Originally posted by MonkeyF0cker
                                                            HEY Your're a fvckng liar and a monkey rooster_eater. YOU NEED TO ROTATE THOSE PROXISSES BRO! SEPN bans every user from viewing their site b/c it helps them with ad revenue. God do you not read the thread?
                                                            Comment
                                                            • roasthawg
                                                              SBR MVP
                                                              • 11-09-07
                                                              • 2990

                                                              #31
                                                              Use a proxy.
                                                              Comment
                                                              • tony_come
                                                                SBR Posting Legend
                                                                • 03-31-10
                                                                • 21695

                                                                #32
                                                                use excel sheets
                                                                Comment
                                                                SBR Contests
                                                                Collapse
                                                                Top-Rated US Sportsbooks
                                                                Collapse
                                                                Working...