1. #1
    oilcountry99
    oilcountry99's Avatar SBR PRO
    Join Date: 08-29-10
    Posts: 258
    Betpoints: 2733

    Anyone web scrape with R? Looking for good resources

    Anyone have any good web scrape resources, tutorials, examples for a total illiterate R newbie? Sports related material would be preferred.

    What are your thoughts on web scraping with R?

  2. #2
    Waterstpub87
    Life-Style Arbitrage
    Waterstpub87's Avatar SBR PRO
    Join Date: 09-09-09
    Posts: 2,694
    Betpoints: 1206

    I've never thought of R as being particularly good for webscraping. I see more stuff referencing python.
    175 pts

    3-QUESTION
    SBR TRIVIA WINNER 09/21/2017

    175 pts

    3-QUESTION
    SBR TRIVIA WINNER 09/18/2017

    BTP
    Week 1
    3-1-1 184 pts


  3. #3
    A4K
    A4K's Avatar SBR PRO
    Join Date: 10-08-12
    Posts: 2,476
    Betpoints: 42

    Just a word of advice.....

    Pay someone on Fiverr.com or post an ad on CraigsList to do the scraping and sorting for you. I did it this way and it cost me $50. The results were far better than I could have managed on my own.
    Nomination(s):
    This post was nominated 1 time . To view the nominated thread please click here. People who nominated: KVB
    175 pts

    3-QUESTION
    SBR TRIVIA WINNER 09/25/2017


  4. #4
    jtoler
    Update your status
    jtoler's Avatar Become A Pro!
    Join Date: 12-17-13
    Posts: 17,525
    Betpoints: 114

    R as opposed to S and T? Definitely R.

  5. #5
    xbalto
    xbalto's Avatar Become A Pro!
    Join Date: 10-14-10
    Posts: 105
    Betpoints: 616

    R sucks for this, use Beautiful Soup in python and dump to a csv for R

  6. #6
    HeeeHAWWWW
    HeeeHAWWWW's Avatar Become A Pro!
    Join Date: 06-13-08
    Posts: 5,012
    Betpoints: 245

    Quote Originally Posted by A4K View Post
    Pay someone on Fiverr.com or post an ad on CraigsList to do the scraping and sorting for you. I did it this way and it cost me $50. The results were far better than I could have managed on my own.
    That's probably a really good suggestion. Scraping is a massive pita - get some Indian phd to do it for peanuts.

  7. #7
    matthewmsturgeon
    matthewmsturgeon's Avatar Become A Pro!
    Join Date: 08-24-17
    Posts: 11
    Betpoints: 102

    Quote Originally Posted by A4K View Post
    Just a word of advice.....

    Pay someone on Fiverr.com or post an ad on CraigsList to do the scraping and sorting for you. I did it this way and it cost me $50. The results were far better than I could have managed on my own.

    This is intriguing to me. How would you go about finding someone to do this and to describing what you are after. I looked briefly on fiverr, but I didn't want to create an account. Do you just post as request for what you are after and wait for someone to respond. Do you describe the site you want to scrape and indicate that you want it dumped at some interval (or run manually) into a spreadsheet or My SQL DB or something like that? I'm not trying to get you to explain everything that you did, I just feel like this is a concept worthy of more discussion if you have the time. Thanks.

Top