"
collecting data automatically from webpage
Collapse
X
-
/\oxSBR Rookie
- 03-05-12
- 47
#1collecting data automatically from webpageTags: None -
mark49SBR Rookie
- 03-03-08
- 42
#2I couldnt manage it with vegasinsider but i could with
covers.com/pageLoader/pageLoader.aspx?page=/data/nba/teams/pastresults/2011-2012/team404169.html
using a bit of code to download it that refreshes each time you open the workbook.
Once you have the data in excel it is very easy to change it to how you want it.
Does that site have what you need?Comment -
/\oxSBR Rookie
- 03-05-12
- 47
#3yep, Covers is nice too. Actually I think it's more of a case of data arranging in Excel, because it's easier to just copy table from website and paste it directly into Excel but I'm novice in this fieldgotta learn then!
ty mark49!Last edited by /\ox; 03-07-12, 05:01 AM.Comment -
mark49SBR Rookie
- 03-03-08
- 42
#4the easiest way would be to record a macro while you arrange the table to how you like it (delete unneeded columns etc) and then run that macro whenever you update your table.
If you need to extract parts of the data (for instance the game total) then a couple of simple formulas will do it, perhaps on the next sheet so that the table appears in the way you want it.
If you are new to Excel then learing LEN, LEFT, RIGHT, FIND, TRIM etc will help.
For example if the cell A1 had the game total as O 188.5
the formula =RIGHT(A1,LEN(A1)-2) in cell A2 will return 188.5
and it would now be a number that can be used in calculations rather than text.
Hope that helps, good luck.Comment -
/\oxSBR Rookie
- 03-05-12
- 47
#5I cannot get this formula work, can anyone tell me what's wrong with it?
=COUNTIFS(A2:A7, ">" & B6,A2:A7,"<" & B7)
Can cell B4's result come from formula?Comment -
thom321SBR High Roller
- 06-17-11
- 112
#6The formula the way you have entered it "works", meaning that it returns the number of time the data in cells A2:A7 is greater than the value in B6 AND smaller than the value in B7.
So if you have the following values in A2:A7
2
3
4
5
3
7
and cell B6 has the value 2 and B7 has the value 4, the function as you entered it will return 2. The only value that meets the criteria is 3, and the number 3 occurs 2 times in the list of values in cells A2:A7.
Where did B4 come into this? If you mean B6 or B7, either of them can be a formula rather than a number that has been manually entered.Comment -
thom321SBR High Roller
- 06-17-11
- 112
#8If I take your formula, as you entered it in your previous post, and copy it to the formula bar in Excel, it works fine. The only thing that comes to mind is if the regional settings on your computer uses comma as a decimal separator i.e. 12 dollars and 25 cents would be written as $12,25 rather than $12.25. That could happen if your computers regional setting is not set to United States. The link below explains it in more detail.
If that is the case, Excel could be set to use ";" rather than "," to separate arguments in a function. That would cause the error you show above.Comment -
/\oxSBR Rookie
- 03-05-12
- 47
#9Ok, will try out those regional settings, thank you very much thom321!Comment -
Sportsguy_USASBR Hustler
- 09-29-10
- 59
#10Simple. Build a scraper (or hire a guy to do it) that pings the site every X frequency (daily, hourly, weekly, etc). This will grab and pull the data to your database, which you can then have some front end interface built too to query the data as you like.
Caution - hitting the site with a high frequency they may block your IP. If thisis the requirement, get a IP randomizer.
Just saying...not that I've had this done before ;-)Comment -
RufusSBR High Roller
- 03-28-08
- 107
#11Learn to program. Write a scraper. Any reasonably intelligent person should be able to learn a language like Perl (I had no programming experience and taught myself).Comment -
evo34SBR MVP
- 11-09-08
- 1032
#12Simple. Build a scraper (or hire a guy to do it) that pings the site every X frequency (daily, hourly, weekly, etc). This will grab and pull the data to your database, which you can then have some front end interface built too to query the data as you like.
Caution - hitting the site with a high frequency they may block your IP. If thisis the requirement, get a IP randomizer.
Just saying...not that I've had this done before ;-)
I agree. You can get pretty high quality work done for cheap at sites like freelancer.com. I had a fairly complex financial site scraping job completed within a week with no problems. Well worth the money in my opinion.Comment
SBR Contests
Collapse
Top-Rated US Sportsbooks
Collapse
#1 BetMGM
4.8/5 BetMGM Bonus Code
#2 FanDuel
4.8/5 FanDuel Promo Code
#3 Caesars
4.8/5 Caesars Promo Code
#4 DraftKings
4.7/5 DraftKings Promo Code
#5 Fanatics
#6 bet365
4.7/5 bet365 Bonus Code
#7 Hard Rock
4.1/5 Hard Rock Bet Promo Code
#8 BetRivers
4.1/5 BetRivers Bonus Code