So who can I hire for scraping sites.

[Bluehorseshoe]

Hit me up in a pm.

[shadymcgrady]

Just download and customize a webscraper

[oilcountry99]

Where from?

[Waterstpub87]

What are you looking to scrape?

[oilcountry99]

daily odds nhl mlb, used to use VI site with excel

[Waterstpub87]

daily odds nhl mlb, used to use VI site with excel

if i just use get data from web this loads pretty cleanly. Is it that you don't know turn that into a macro?

[oilcountry99]

They no longer show the sportsbooks I need, i need a new source to pull into excel.

[Waterstpub87]

They no longer show the sportsbooks I need, i need a new source to pull into excel.

If you find a source, post and we can see how easy it is to scrape. I've started to try to do sbrodds with python, but it also seems like it might just be easier with excel.

[oilcountry99]

I would like to use SBRodds as well, I haven't had success scraping it with excel, but I"m far from an expert in excel. I don't know how to use python, I've dabbled with it but that's about it.

how about c o v e r s??

[turtledoves]

what's a working odds scraper program like this worth to you hypothetically?

you can look on freelance programming websites to hire someone with test automation/selenium skills. testers with these skills should probably able to scrape most sites. coding to verify a website and collect data from a website can be very similar, that's why you might be able to hire a tester cheaper than a software developer.

code quality can be shitty though and you might a get a mess that is harder to maintain.

if the data source/site changes, you might have to hire again for touchups/fixing. you should probably have multiple data sources in case one goes down/changes.

i bet plenty of gamblers here have working scrapers of what you need. you can probably make an offer if you find the right person...

[Waterstpub87]

http://www.donbest.com/mlb/odds/

is this good?

[oilcountry99]

Waterstpub87......I've used that site in the past and didn't really care for it. I'd need something comparable to vi. i like the sbr format. Appreciate your help.

[oilcountry99]

https://www.oddsshark.com/mlb/odds

https://www.oddsmarket.com/baseball/

I would use python if I had the code and it output to .csv, not ideal but it would work. I prefer to keep things in excel if possible.

[oilcountry99]

I'm also not looking for historical odds, just the current day, including the opener. Does that make things easier.

Sorry for hijacking the OP's thread, but its on topic so figured it was ok to post here

SBR should just add an export to .csv button on the odds page. I'm going to go suggest that right now

[Waterstpub87]

I'm also not looking for historical odds, just the current day, including the opener. Does that make things easier.

Sorry for hijacking the OP's thread, but its on topic so figured it was ok to post here

SBR should just add an export to .csv button on the odds page. I'm going to go suggest that right now

Yes, but not by much. I also might keep it in excel. I am trying to scrape historical college basketball lines at the moment. Let you know if I get something working.

[oilcountry99]

Yes, but not by much. I also might keep it in excel. I am trying to scrape historical college basketball lines at the moment. Let you know if I get something working.

I hope you can come up with something, good luck!

[Gaze73]

My brother can do that sort of thing, he made me a scraper.

[Bsims]

Look at https://www.sportsbookreviewsonline....dsarchives.htm

[Waterstpub87]

Look at https://www.sportsbookreviewsonline....dsarchives.htm

Appreciate the link. I found it, there was some error with it that I found, I forget what it was. Unfortunately, Oilcountry seems to be looking more for a day to day click a button get todays lines in a spreadsheet, rather than an odds archive.

Too much programming and shit to do for sports betting. August - April the busiest time. So much in the backlog.

[Bsims]

Appreciate the link. I found it, there was some error with it that I found, I forget what it was.

There are errors in the archive data. It also isn't easy to use. I wrote a program to edit these lines and drop the bad ones .

[Bsims]

Unfortunately, Oilcountry seems to be looking more for a day to day click a button get todays lines in a spreadsheet, rather than an odds archive.

Too much programming and shit to do for sports betting. August - April the busiest time. So much in the backlog.

I don't directly scrape web pages, the language I use doesn't really have the tools necessary. I save the web pages I want. I then have code that can read this file and create a comma delimited file in spreadsheet format. Figuring out where the actual data is in the web page is difficult but necessary. Periodically a site will make changes to there web pages thus requiring an effort to modify the code.

You're right about the work involved.

[Waterstpub87]

I don't directly scrape web pages, the language I use doesn't really have the tools necessary. I save the web pages I want. I then have code that can read this file and create a comma delimited file in spreadsheet format. Figuring out where the actual data is in the web page is difficult but necessary. Periodically a site will make changes to there web pages thus requiring an effort to modify the code.

You're right about the work involved.

What language are you using?

[Bsims]

What language are you using?

I write in Basic. Almost all my code is in Power Basic. It is a compiler/interpreter. I cannot download any complex web pages in it. So I use the Liberty Basic compiler to download most web pages I want. I use data files to request the pages I want and the Liberty Basic code fetches them and saves them. Then the Power Basic code processes the saved pages.

I'd really like to learn Python and be able to combine the web fetching and data processing in one place. Then I could write some API's to really automate some processing. Unfortunately my priority now is bitcoin analysis looking for buy and sell price points.

[Nappyx]

Message me about what you want and I may be able to help. VB.Net coder that has scraped many sites.

[sonnyboy]

download the SBR daily web page/table to excel

Can the SBR daily web page/table be downloaded.
I made a macro with the macro recorder to do that with the DonBest site , but no matter what i try i cant download the SBR site into excel.
An earlier poster said that he was going to suggest that they put a link to download it into excel. I wonder if that has been asked.
sonnyboy

[oilcountry99]

Can the SBR daily web page/table be downloaded.
I made a macro with the macro recorder to do that with the DonBest site , but no matter what i try i cant download the SBR site into excel.
An earlier poster said that he was going to suggest that they put a link to download it into excel. I wonder if that has been asked.
sonnyboy

I asked ... and of course not got a response.

[turbobets]

An earlier poster said that he was going to suggest that they put a link to download it into excel. I wonder if that has been asked.
sonnyboy

They could use it as an incentive to get posters to sign up for a pro membership and it would be worth it.

[wadesi]

I know this is a old thread but has anyone come up with a way to scrape the sbrodds site into excel or csv? I would def pay for a pro membership if this functionality existed....

[oilcountry99]

check out octoparse....works well

[Waterstpub87]

Sub scrapegames()
Range("A").ClearContents
Dim Day As String

Day = Range("K1").Value

Application.CutCopyMode = False
With ActiveSheet.QueryTables.Add(Connection:= _
"URL;https://classic.sportsbookreview.com/betting-odds/nba-basketball/?date=" + Day _
, Destination:=Range("$A$1"))

.Name = "?date=20181003"
.FieldNames = True
.RowNumbers = False
.FillAdjacentFormulas = False
.PreserveFormatting = True
.RefreshOnFileOpen = False
.BackgroundQuery = True
.RefreshStyle = xlOverwriteCells
.SavePassword = False
.SaveData = True
.AdjustColumnWidth = True
.RefreshPeriod = 0
.WebSelectionType = xlEntirePage
.WebFormatting = xlWebFormattingNone
.WebPreFormattedTextToColumns = True
.WebConsecutiveDelimitersAsOne = True
.WebSingleBlockTextImport = False
.WebDisableDateRecognition = False
.WebDisableRedirections = False
.Refresh BackgroundQuery:=False
End With
Range("D1").Select
Application.CutCopyMode = False
With ActiveSheet.QueryTables.Add(Connection:= _
"URL;https://classic.sportsbookreview.com/betting-odds/nba-basketball/totals/?date=" + Day _
, Destination:=Range("$C$1"))

.Name = "?date=20181003_1"
.FieldNames = True
.RowNumbers = False
.FillAdjacentFormulas = False
.PreserveFormatting = True
.RefreshOnFileOpen = False
.BackgroundQuery = True
.RefreshStyle = xlOverwriteCells
.SavePassword = False
.SaveData = True
.AdjustColumnWidth = True
.RefreshPeriod = 0
.WebSelectionType = xlEntirePage
.WebFormatting = xlWebFormattingNone
.WebPreFormattedTextToColumns = True
.WebConsecutiveDelimitersAsOne = True
.WebSingleBlockTextImport = False
.WebDisableDateRecognition = False
.WebDisableRedirections = False
.Refresh BackgroundQuery:=False
End With
Columns("A:F").Select
Selection.Replace What:="top", Replacement:="", LookAt:=xlPart, _
SearchOrder:=xlByRows, MatchCase:=False, SearchFormat:=False, _
ReplaceFormat:=False
Selection.Replace What:="Help", Replacement:="", LookAt:=xlPart, _
SearchOrder:=xlByRows, MatchCase:=False, SearchFormat:=False, _
ReplaceFormat:=False
Columns("A:C").Select
Selection.Replace What:="=", Replacement:="", LookAt:=xlPart, _
SearchOrder:=xlByRows, MatchCase:=False, SearchFormat:=False, _
ReplaceFormat:=False


End Sub

[Waterstpub87]

the smiley face is A : D

[Waterstpub87]

you then have to match formulas to put it into a table form.

This will put spreads in "A" and totals in "C"

[Waterstpub87]

You have to put a date in "k1", like "3/11/2021"