Here the database scrape for the Newcastle game , goal scord at 36mins
Results from 1-0 first goal between 30 and 45 minutes
Newcastle 1 - 0 Away Team
30 games. 70% won. 23% drawn 7% lost.
Home Team 1 - 0 West Ham
24 games. 8% won. 12% drawn 79% lost.
Odds are pretty much in line 1.4, 4.8 ,12.5
Palace vs Swansea, Swansea score 44
Results from 0-1 first goal between 30 and 45 minutes, first goal time in brackets
Crystal Palace 0 - 1 Away Team
13 games. 0% won. 15% drawn 85% lost.
Home Team 0 - 1 Swansea
8 games. 38% won. 38% drawn 25% lost.
odds 7.4, 3.45 , 1.73
If we look at data from 4o minutes onwards it seems Palace don't have a good record of coming back to win and Swansea haven't lost either
Results from 0-1 first goal between 40 and 90 minutes, first goal time in brackets
Crystal Palace 0 - 1 Away Team
Crystal Palace 1 - 1 Newcastle (42)
Crystal Palace 1 - 2 Swansea (42)
Crystal Palace 0 - 1 Chelsea (43)
Crystal Palace 1 - 2 Manchester Utd (45)
Crystal Palace 0 - 2 Arsenal (47)
Crystal Palace 2 - 1 Tottenham (49)
Crystal Palace 0 - 1 Tottenham (50)
Crystal Palace 0 - 2 Hull City (51)
Crystal Palace 1 - 2 Manchester City (55)
Crystal Palace 0 - 2 Manchester Utd (62)
Crystal Palace 1 - 1 Arsenal (63)
Crystal Palace 0 - 1 Portsmouth (69)
Crystal Palace 0 - 1 West Bromwich (74)
Crystal Palace 0 - 1 Tottenham (78)
Crystal Palace 0 - 2 Newcastle (79)
Crystal Palace 0 - 1 Sunderland (80)
Crystal Palace 0 - 1 Everton (87)
Crystal Palace 0 - 1 Manchester City (90)
Crystal Palace 0 - 1 Charlton (90)
19 games. 5% won. 11% drawn 84% lost.
Home Team 0 - 1 Swansea
Everton 1 - 1 Swansea (41)
Crystal Palace 1 - 2 Swansea (42)
Wigan 0 - 2 Swansea (45)
Sunderland 1 - 1 Swansea (45)
Liverpool 2 - 3 Swansea (48)
Fulham 1 - 2 Swansea (56)
Newcastle 1 - 2 Swansea (58)
Burnley 0 - 1 Swansea (64)
West Bromwich 1 - 1 Swansea (64)
Burnley 0 - 1 Swansea (82)
Southampton 0 - 1 Swansea (83)
Arsenal 0 - 1 Swansea (85)
Aston Villa 0 - 1 Swansea (87)
Arsenal 0 - 2 Swansea (88)
14 games. 79% won. 21% drawn 0% lost.
Football Data (CSV, JSON) - UPDATED 16/08/17
-
- Posts: 3140
- Joined: Sun Jan 31, 2010 8:06 pm
Last edited by spreadbetting on Sat Aug 26, 2017 4:02 pm, edited 3 times in total.
I agree, we have given plenty of slack and asked kindly. It's not too hard to get on with others. If you have something that works, that's great but constantly drowning out threads endlessly is killing genuine discussion.
-
- Posts: 165
- Joined: Wed Mar 01, 2017 2:06 pm
I'm working on this at the moment. Not been able to find a reliable source for yellow card timings though.
At the moment i'm using the csv's from football-data.co.uk. Which has shots, shots on target, yellows, fowls, reds, goals, result (all for HT and FT) as well as odds for 1x2, o2.5,u2.5 from Pinnacle and an average from a selection of oter bookies. Theres no timings though, just totals for HT/FT. But it'll do for now.
welshboy06 wrote: ↑Wed Aug 30, 2017 8:35 pmI'm working on this at the moment. Not been able to find a reliable source for yellow card timings though.
At the moment i'm using the csv's from football-data.co.uk. Which has shots, shots on target, yellows, fowls, reds, goals, result (all for HT and FT) as well as odds for 1x2, o2.5,u2.5 from Pinnacle and an average from a selection of oter bookies. Theres no timings though, just totals for HT/FT. But it'll do for now.
Have a look at https://www.fctables.com/
Oodles of data... Tooltip pop-ups with reds/yellows and goals.
-
- Posts: 165
- Joined: Wed Mar 01, 2017 2:06 pm
Thanks for this. I've taken a quick look and it doesn't seem to be designed in a webscraper friendly way. Seems awkward to drill down in to stats and as yet I'm not able to find an easy to use underlying data source/api. Will check again tomorrow though.knome wrote: ↑Wed Aug 30, 2017 9:33 pmwelshboy06 wrote: ↑Wed Aug 30, 2017 8:35 pmI'm working on this at the moment. Not been able to find a reliable source for yellow card timings though.
At the moment i'm using the csv's from football-data.co.uk. Which has shots, shots on target, yellows, fowls, reds, goals, result (all for HT and FT) as well as odds for 1x2, o2.5,u2.5 from Pinnacle and an average from a selection of oter bookies. Theres no timings though, just totals for HT/FT. But it'll do for now.
Have a look at https://www.fctables.com/
Oodles of data... Tooltip pop-ups with reds/yellows and goals.
Ah! From the awesome work you've done with the HKJC data I just assumed you'd got a good handle on this web scraping malarkey.welshboy06 wrote: ↑Wed Aug 30, 2017 9:59 pmThanks for this. I've taken a quick look and it doesn't seem to be designed in a webscraper friendly way. Seems awkward to drill down in to stats and as yet I'm not able to find an easy to use underlying data source/api. Will check again tomorrow though.knome wrote: ↑Wed Aug 30, 2017 9:33 pmwelshboy06 wrote: ↑Wed Aug 30, 2017 8:35 pmI'm working on this at the moment. Not been able to find a reliable source for yellow card timings though.
At the moment i'm using the csv's from football-data.co.uk. Which has shots, shots on target, yellows, fowls, reds, goals, result (all for HT and FT) as well as odds for 1x2, o2.5,u2.5 from Pinnacle and an average from a selection of oter bookies. Theres no timings though, just totals for HT/FT. But it'll do for now.
Have a look at https://www.fctables.com/
Oodles of data... Tooltip pop-ups with reds/yellows and goals.
I've had a quick play with python/BeautifulSoup and some chrome extensions but I've concluded web scraping is a young man's game.
... or woman's...
-
- Posts: 165
- Joined: Wed Mar 01, 2017 2:06 pm
Yeah I've scraped a good few websites. But in my past experiences, working with awkward sites involves a lot of spaghetti code, and then they end up getting updated by the developer.knome wrote: ↑Wed Aug 30, 2017 10:07 pmAh! From the awesome work you've done with the HKJC data I just assumed you'd got a good handle on this web scraping malarkey.welshboy06 wrote: ↑Wed Aug 30, 2017 9:59 pmThanks for this. I've taken a quick look and it doesn't seem to be designed in a webscraper friendly way. Seems awkward to drill down in to stats and as yet I'm not able to find an easy to use underlying data source/api. Will check again tomorrow though.knome wrote: ↑Wed Aug 30, 2017 9:33 pm
Have a look at https://www.fctables.com/
Oodles of data... Tooltip pop-ups with reds/yellows and goals.
I've had a quick play with python/BeautifulSoup and some chrome extensions but I've concluded web scraping is a young man's game.
... or woman's...
It's always easier to try and find the data source they're using, rather than scrape the full page.
Hkjc was an exception because it was a quick fix and the site was actually pretty easy. Football-data provides up to date CSV files, which can be easily manipulated.
I'll take another look at the above site tomorrow though:)