wsh91

5 ms·

1.
by wsh91 8y ago
Hi there! One thing you might consider is using a function to replicate your Firestore data to BigQuery, depending on the value the latter would add. (Very fast OLAP; I'm a big fan.) (Cloud Firestore eng. here.)
2.
by wsh91 8y ago
Hi there. :) I'm an engineer on the Cloud Firestore team. I can't speak to if or when we'll be able to remove this restriction, but please know that the folks working on this (like me) are very aware of what a pain in the but
3.
by wsh91 8y ago
Cloud Spanner is also relational. :) (Fellow GCPer.)
4.
by wsh91 8y ago
An export is one component of a backup solution. :) Scheduling is another ( https://firebase.google.com/docs/firestore/solutions/schedul... ). (Checking restores is critical, too; that's also feasible [man
5.
by wsh91 8y ago
Is there anything we could be doing to serve you better?
6.
by wsh91 8y ago
a) Cloud Firestore supports transactions across the entire database. You can learn more about them here: https://cloud.google.com/firestore/docs/manage-data/transact... . b) Given that the primary use case for
7.
by wsh91 8y ago
Cloud Firestore (the next generation of Cloud Datastore) removes those limitations. https://cloud.google.com/firestore/docs/manage-data/transact... It also supports the Cloud Datastore API. (I work on it!)
8.
by wsh91 8y ago
Hey there--I'm an engineer on the Cloud Datastore team. I'd love to know more about what your needs are if you're willing to share.
9.
by wsh91 9y ago
This (fantastic) paper is cited in the Google Megastore paper [1] and we actually use the term "entity group" in our product [2] indirectly because of it. Pat Helland is always worth reading; thanks to the submitter for the remind
10.
by wsh91 9y ago
Have a look at https://cloud.google.com/compute/docs/load-balancing/ipv6 . (Disclaimer: I work on GCP, albeit not on networking stuff.)
11.
by wsh91 9y ago
Only because this question has been asked multiple times at TGIF (regular all-hands meeting).
12.
by wsh91 9y ago
That's not true. Anyone has access to 20% time, the question is just whether or not it makes sense for individual people. Source: I work here and take advantage of 20% time.
13.
by wsh91 10y ago
Heh. :) One technicality: DynamoDB's pricing is based on throughput, as you know, but it's provisioned throughput. (You manage your capacity unit allocations yourself, at least that was the case a little while ago.) You're
14.
by wsh91 10y ago
I can't speak to the SDK parts, but take a look at Firebase's suite more broadly. :) Viz a viz Cognito, check out Authentication and the Realtime Database in particular.
15.
by wsh91 10y ago
Firebase's Realtime Database does this, too. https://firebase.google.com/pricing/ (Disclosure: I work on Cloud Datastore, which is another Google Cloud product; it, too, does pricing based on ops and storage rathe
16.
by wsh91 10y ago
As you noted earlier, Megastore has a schema and we don't, so we have our own index implementation, yes. :)
17.
by wsh91 10y ago
Perhaps I've misunderstood you, but I'm pretty sure cross-partition (I assume you mean cross-entity-group in our terms) transactions are in fact consistent (not totally sure what you mean by transactions being consistent, per se;
18.
by wsh91 10y ago
Again, neat stuff, but that's not what this link claims: * The first serverless database * The first active-active multi-cloud database * The first strongly-consistent multi-region database available to the public None of th
19.
by wsh91 10y ago
I'm familiar with both; what disappoints me is the claim of novelty here with respect to autoscaling. That's just not true. To quote you: "A serverless system must scale dynamically per request. Current popular cloud database
20.
by wsh91 10y ago
:) Here's a paper with which you might already be familiar, but it's one of the citations for the Megastore paper: http://adrianmarriott.net/logosroot/papers/LifeBeyondTxns.pd... . You'll probably en
21.
by wsh91 10y ago
We also have transactions [1], compound indexes [2] and multi-region replication [3]. I'm not sure what defines a "full-blown" database, but that much is true. [1] https://cloud.google.com/datastore/docs&
22.
by wsh91 10y ago
Datastore runs on top of Megastore [1]. You can find out more about our data model here [2], but it's definitely not limited to key-value data. Our end users don't have to think much about our storage system, though, if we're
23.
by wsh91 10y ago
(Disclosure: I work on Google's Cloud Datastore.) This looks super neat, and I can't wait to learn more about it, but just for the record: I'm pretty sure this isn't the first serverless cloud database. Both Firebase&#x2
24.
by wsh91 10y ago
GAE gives at least a year after deprecation before turning off a feature. https://cloud.google.com/appengine/docs/deprecations/ (I work on Google Cloud and on Datastore, which is built into App Engine. We ben
25.
by wsh91 10y ago
Google Cloud Storage (as mentioned) for storage, Google App Engine for PaaS. :) (I work on Cloud, specifically Datastore.)
26.
by wsh91 10y ago
The question didn't even mention GPUs, and there's no reason that what you mention can't change in the future. It was a pointer.
27.
by wsh91 10y ago
There are discounts if your instances can be pre-empted: https://cloud.google.com/preemptible-vms/ . The pricing isn't variable like EC2 spot instances, however.
28.
by wsh91 10y ago
Cloud Datastore has a perpetual free tier, too: https://cloud.google.com/datastore/ :) (I work on it.)
29.
by wsh91 10y ago
Really sorry to see this; your candor is refreshing, and I've been interested in the optimization work you've been doing for some time. Best of luck with what comes next.
30.
by wsh91 10y ago
Spanner's p90s are, for at least one user, consistently lower than 50 ms. https://quizlet.com/blog/quizlet-cloud-spanner (Disclaimer: I work on Google's cloud.)

More ›