theazureguy

7 ms·

1.
by theazureguy 4mo ago
petrolprices.com is still going strong. nice to meet one of the OGs.
2.
by theazureguy 4mo ago
shell's logo does have a lot of yellow but morrisons has already claimed yellow on the chart.
3.
by theazureguy 4mo ago
data goes back to january but coverage is patchy early on as we were doing full fetches rather than continuous polling. march onwards is complete.
4.
by theazureguy 5mo ago
Ahhh thanks for that. I have deployed a change to fix this ASAP.
5.
by theazureguy 5mo ago
Absolutely, feel free to reach out. contact details are on the site. would love to see how I can help!
6.
by theazureguy 5mo ago
bespoke design but used tailwind for styling. charts are recharts. no dashboard lib.
7.
by theazureguy 5mo ago
really appreciate the feedback, that's a valid point. I will review and make it more accessible.
8.
by theazureguy 5mo ago
really appreciate you taking the time to check it properly. I will get them both fixed some time this week!
9.
by theazureguy 5mo ago
that 5 minute reporting requirement is way stricter than the uk.
10.
by theazureguy 5mo ago
Might have a play with that thank you.
11.
by theazureguy 5mo ago
yeah that's as far back as my data goes, started ingesting in march. no history existed before that
12.
by theazureguy 5mo ago
I would love too. But I have not found an API that surfaces this data. This data is only public as the CMA determined the market was fundamentally broken.
13.
by theazureguy 5mo ago
some of my replies yeah, been a bit busy keeping the site up while the thread was live. helps with the typos too.
14.
by theazureguy 5mo ago
Yeah aware of some data quality issues in the feed, bad coordinates, missing brands, occasional obviously wrong prices. I filter out anything outside 100-300p and exclude stations flagged as closed but there's definitely still noise in
15.
by theazureguy 5mo ago
checked the db, tesco e5 is 163.8p average across 292 stations in the last 21 days. Worth spot checking a few specific stations if it still looks off to you.
16.
by theazureguy 5mo ago
yeah that's fair, without wholesale rack prices as a baseline you can't really isolate station behaviour from what's happening upstream.
17.
by theazureguy 5mo ago
fair point on scraper, it's more of an ingest pipeline really. the 90k is total price records across 7,700 stations since january, stations update a few times a week on average. the 10 min polling catches every move when it happens. th
18.
by theazureguy 5mo ago
Update for anyone who hit a slow site earlier: b1ms postgres wasn't having a great time with 140 concurrent users. scaled the db up, bumped the instance, and shipped in-memory output caching while the thread was live so repeated reques
19.
by theazureguy 5mo ago
already on it, just shipped in-memory output caching while the thread was live. next step redis if it needs it
20.
by theazureguy 5mo ago
yeah scaling it up now, was hoping to keep costs down but HN had other ideas
21.
by theazureguy 5mo ago
haha not quite, db was struggling under the load for a few minutes. b1ms postgres doesn't love 6k requests in 30 mins.
22.
by theazureguy 5mo ago
Good shout. DESNZ publishes weekly wholesale rack prices and they are OGL, so there is no barrier there. The interesting bit isn't just showing the gap; it's the propagation lag. Wholesale spikes and pump prices follow within days
23.
by theazureguy 5mo ago
Yeah Asda is in there. I match on brand name directly rather than the API's is_supermarket flag because that flag is all over the place (loads of Asda stations don't have it set). So it explicitly checks for Asda, Tesco, Morrisons
24.
UK Fuel Price Intelligence – Market analytics from reporting stations(fuelinsight.co.uk)
195 points by theazureguy 5mo ago|100 comments
25.
by theazureguy 5mo ago
I got frustrated that every fuel price app just shows you what's cheap nearby. I wanted to know how stations actually behave: do prices go up faster than they come down, do supermarkets really save you much, how bad are motorway prices