Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
meteo-jeff
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
5 ms
·
1.
▲
by
meteo-jeff
3y ago
I would like to see an independent forecast comparison tool similar to Forecast Advisor, which evaluates numerical weather models. However, getting reliable ground truth data on a global scale can be a challenge. Since Open-Meteo continuous
2.
▲
by
meteo-jeff
3y ago
Traditional database systems struggle to handle gridded data efficiently. Using PG with time-based indices is memory and storage extensive. It works well for a limited number of locations, but global weather models at 9-12 km resolution hav
3.
▲
by
meteo-jeff
3y ago
Not yet, but I am working towards it: https://github.com/open-meteo/open-meteo/issues/206
4.
▲
by
meteo-jeff
3y ago
Both APIs use weather models from NOAA GFS and HRRR, providing accurate forecasts in North America. HRRR updates every hour, capturing recent showers and storms in the upcoming hours. PirateWeather gained popularity last year as a replaceme
5.
▲
by
meteo-jeff
3y ago
Sorry, decades. KML files for storm tracks are still the best way to go. You could calculate storm tracks yourself for other weather models like DWD ICON, ECMWF IFS or MeteoFrance ARPEGE, but storm tracks based on GFS ensembles are easy to
6.
▲
by
meteo-jeff
3y ago
Extreme weather is predicted by numerical weather models. Correctly representing hurricanes has driven development on the NOAA GFS model for centuries. Open-Meteo focuses on providing access to weather data for single locations or small are
7.
▲
by
meteo-jeff
3y ago
In case someone is looking for historical weather data for ML training and prediction, I created an open-source weather API which continuously archives weather data. Using past and forecast data from multiple numerical weather models can be
8.
▲
by
meteo-jeff
3y ago
I have heard the same regarding 5xx errors in the past couple of months. I am also working on open-source weather API https://open-meteo.com/ . It covers most of WeatherKit features and offers more flexibility. You can eithe
9.
▲
by
meteo-jeff
3y ago
You can try my API: https://open-meteo.com/en/docs/historical-weather-api
10.
▲
by
meteo-jeff
4y ago
That’s exactly what I want to change with my open source weather api https://open-meteo.com It collects raw weather mode data and redistributes weather forecasts with simple APIs Briefsky is also using it :)
11.
▲
by
meteo-jeff
4y ago
Snowfall is already available in the historical weather API. Because the resolution is fairly limited for long term weather reanalysis data, snow analysis for single mountains slopes/peaks may not be that accurate. If you only want to
12.
▲
by
meteo-jeff
4y ago
Hi, creator of open-meteo.com here! I am using a more wide range of weather models to better cover Europe, Northern Africa and Asia. North America is covered as well with GFS+HRRR and even weather models from the Canadian weather service. I
13.
▲
by
meteo-jeff
4y ago
I am working on an open source weather api: https://open-meteo.com If you are looking for raw weather forecast data, it could be a good start
14.
▲
Show HN: 60 years historical weather API, free for non-commercial use
(open-meteo.com)
2 points
by
meteo-jeff
4y ago
|
0 comments
15.
▲
by
meteo-jeff
4y ago
Thanks for the info. Snowfall was recently added. I am afraid there could be a bug with that particular variable. Temperature, clouds, etc, seem fine EDIT: Issue identified and will be fixed in the next days! Thanks!
16.
▲
by
meteo-jeff
4y ago
I have not. It looks promising as it seems to offer multi dimensional data storage and some compression aspects. I must also admit, that I like my simple approach of just keeping data in compressed local files. With fast SSDs it is super ea
17.
▲
by
meteo-jeff
4y ago
`300 GB` to `10 GB` was bit over optimistic ;-) 300 GB already included 3 weeks of data. `100 GB` to `10 GB` is a more realistic number. Many weather variables like precipitation or pressure are very easy to compress. Variables like solar r
18.
▲
by
meteo-jeff
4y ago
Sure. What do you think about "&start_date=20220701" and "&end_date=20220714"? If end_date is not specified, it would return start_date with 7 days forecast
19.
▲
by
meteo-jeff
4y ago
Yes, it is a combination of delta coding, zigzag, bitpacking and outliner detection. It only works well for integer compression. For text-based data, results are not use-full. SIMD and decompression speed is an important aspect. All forecas
20.
▲
by
meteo-jeff
4y ago
Sure. I bundle a small rectangle of neighbouring locations like 5x5 (= 25 locations). The actual weather model may have a grid like 2878x1441 cells (4 million). Inside the 5x5 chunk, I subtract all grid-cells from the center grid-cell. The
21.
▲
by
meteo-jeff
4y ago
Some technical background: Open-Meteo offers free weather APIs for a while now. Archiving data was not an option, because forecast data alone required 300 GB storage. In the past couple of weeks, I started to look for fast and efficient com
22.
▲
by
meteo-jeff
4y ago
Actually, they are historical weather forecasts , but assembled to a continuous time-series. Storing each weather forecast individually to a performance evaluation for "how good a forecast in 5 days is", would require a lot of st
23.
▲
by
meteo-jeff
4y ago
Hi farmin, so far I do not offer commercial options, just to keep me out of any potential legal issues. In the next weeks I will review everything, make sure attributions and licenses are correct, and remove the non-commercial limitation. A
24.
▲
by
meteo-jeff
4y ago
Hi bernulli, 1) Data are coming from multiple weather models. Primary data source is the German Weather service DWD with the ICON weather model. In my past experiences, the DWD ICON model performs best for many regions. DWD ICON has a globa
25.
▲
Historical weather data API for machine learning, free for non-commercial
(openmeteo.substack.com)
196 points
by
meteo-jeff
4y ago
|
45 comments
26.
▲
The German weather service stopped using airplane data for weather forecasts
(openmeteo.substack.com)
4 points
by
meteo-jeff
5y ago
|
1 comments
27.
▲
How to store weather forecast data for fast time-series APIs
(openmeteo.substack.com)
3 points
by
meteo-jeff
5y ago
|
1 comments
28.
▲
by
meteo-jeff
5y ago
Thanks for posting! This is a good reference to correctly implement and document APIs for Open-Meteo [0]. I soon want to integrate CAMS data from the Copernicus Project to offer Air Quality APIs for non-commercial use applications. [0] htt
29.
▲
by
meteo-jeff
5y ago
Hi balloob! I was showing my non-commercial weather API project [0] to HN 2 days ago. Another HN member was already pointing out your project. If you are interested, we could have a look at integrating weather data without the need of your
30.
▲
by
meteo-jeff
5y ago
Great thanks! Let me know if you are missing something to integrate it. My goal is to keep Open-Meteo free for non-commercial use and not start introducing API keys with different tiers of payments! The uptake in the recent days is great an
More ›