rpedela

11 ms·

1.
by rpedela 5y ago
GCP is pretty pleasant overall. The API, command line, and UI are all pretty good. Vast majority of functionality is supported in all three places too. Like all providers, they have a few services that suck but overall Google has done a gre
2.
by rpedela 5y ago
There are several use cases where ML can help even if it isn't perfect or even just better than random. Here is one example in NLP/search. Let's say you have a product search engine and you analyzed the logged queries. What y
3.
by rpedela 5y ago
If you can write a SQL query or a set of SQL queries to do your transformation, then you can use DBT. DBT doesn't do transformation itself rather it helps you manage all the dependencies between your SQL models. Whether you can use SQL
4.
by rpedela 5y ago
DBT has two main innovations. First, everything is a SELECT statement and DBT handles all the DDL for you. You can handle DDL yourself if you have a special case too. Second, the ref/source macros build a DAG of all your models so you
5.
by rpedela 5y ago
I think using a data warehouse as your data lake or lake house is optimal. Even for data that isn't relational. Storage is so cheap now and is decoupled from compute costs for several providers that I don't even give it a thought.
6.
by rpedela 5y ago
For my search use case, documents are mostly single topic and less than 10 pages. However I have found embeddings still work surprisingly well for longer documents with a few topics in them. But yes, multi-topic documents can certainly be a
7.
by rpedela 5y ago
Google has a distributed embedding matching service in preview: https://cloud.google.com/vertex-ai/docs/matching-engine/over... I guess it depends on what you mean by "simple". The algorithms are co
8.
by rpedela 5y ago
Yes I know for sure. Postgres search is essentially an easier to use regex engine. If you have a recall-only use case and/or a small dataset, then that works great. As soon as you need multiple languages, advanced autocomplete, misspel
9.
by rpedela 6y ago
I disagree based on the trends, especially in the US where few, if any, new coal plants are being built and most existing ones are scheduled to be converted to natural gas or shut down. But let's assume that a significant amount of coa
10.
by rpedela 6y ago
Coal is on its way out. We don't have to wait for the perfect energy solution before we can improve agriculture.
11.
by rpedela 6y ago
If you are going to put creds in git, at least use sops. https://github.com/mozilla/sops
12.
by rpedela 6y ago
I grew up in Cincinnati. You are correct, however traffic is bad enough now that a subway or light rail would make a big difference. Unfortunately it is unlikely the voters would approve a tax increase to support that.
13.
by rpedela 6y ago
I personally try to make decisions using probability. I understand where you are coming from but there is one factor missing in your analysis: this situation is literally life and death. That changes the math a bit to something more akin to
14.
by rpedela 6y ago
We have no data for mRNA vaccines except those trials. We don't know if the historical data on traditional vaccines are applicable here. As such, it is also possible that a single dose isn't good enough or a single dose is good en
15.
by rpedela 6y ago
Yeah I agree, I would like to see some percentage be lottery based. I think you should still need to write a proposal, but if the proposal isn't selected then it goes in the lottery pool. There are two reasons to still write the propos
16.
by rpedela 6y ago
Where do you think those calories come from?
17.
by rpedela 6y ago
> no dietary need for sugar Can I assume you mean simple sugars that are added for taste? If you literally meant what you said, well you will die without carbohydrates (sugar).
18.
by rpedela 6y ago
I think a better analogy would be living near an airport like I do. Depending on the day and weather, even my small airport is quite loud and annoying. My neighbor's motorcycle is also louder than the planes, except the occasional mili
19.
by rpedela 6y ago
I think Citus can be used effectively for that scenario now. https://www.citusdata.com/
20.
by rpedela 6y ago
The post makes it sound like it is cheap to get started, but 32 ETH is currently ~$20K. If you already have the necessary ethereum then it is cheap.
21.
by rpedela 6y ago
In practice, it rarely turns out that way. I have to deal with large, mature Java codebases for some of my work. The good thing is that the code does just about everything well and rarely breaks. The downside is that when something does bre
22.
by rpedela 6y ago
"Here is why the consensus is _______" is not argument by authority, correct. "The ________ theory/hypothesis is fringe, the consensus is ________" is argument by authority. See the difference? Phrasing matters in t
23.
by rpedela 6y ago
Most people on HN are aware that the consensus, a form of argument by authority, is dark matter. It is also known that the dark matter consensus has problems despite billions spent on research over decades. When there is an experimental res
24.
by rpedela 6y ago
Argument by authority is bad science too.
25.
by rpedela 6y ago
You have all that DIY too, except maybe shock bills, but it's your problem to fix. Like with everything, extremes are bad and all managed or all unmanaged are both bad. My personal guideline is use off-the-shelf services if they are ch
26.
by rpedela 6y ago
McKesson is handling distribution for Moderna, and one of the main goals of Operation Warp Speed was to ramp up production using companies who are good at it so the vaccine developers wouldn't necessarily have to do large scale manufac
27.
by rpedela 6y ago
Word bigrams without stopword removal on the title would help in this case as well.
28.
by rpedela 6y ago
Usually managed systems cost less if you factor in salaries. Like everything, it depends on the specifics though.
29.
by rpedela 6y ago
> One dose of MMR vaccine is 93% effective against measles, 78% effective against mumps, and 97% effective against rubella. Two doses of MMR vaccine are 97% effective against measles and 88% effective against mumps. MMR is an attenuated
30.
by rpedela 6y ago
Yeah. What I do is create a view that does all the joins then the middleware just needs to do "SELECT * FROM my_view". If the DB has good JSON support, I will also convert the data into an ES index request with SQL so the middlewa

More ›