natekupp

5 ms·

1.
by natekupp 6y ago
hey bserial, I'm part of the team working on Dagster. While there are many things we're working on, there are 3 goals that got me excited about working on this system: 1. Local development: most modern workflow orchestration syste
2.
by natekupp 7y ago
We use Pulumi to manage both our GCP and AWS resources, and we really like it. You might consider using Terraform directly if you want something more mature.
3.
Why Scala?(medium.com)
2 points by natekupp 9y ago|0 comments
4.
by natekupp 9y ago
Thumbtack | Software Engineer, SRE, many others | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a friendly, ambitiou
5.
Moving Thumbtack’s Data Infrastructure to Google Cloud Platform(cloud.google.com)
4 points by natekupp 9y ago|0 comments
6.
by natekupp 9y ago
We use DynamoDB quite a bit at Thumbtack. Our biggest issue is backups - just wrote a short note about our experiences with DynamoDB here: https://medium.com/@natekupp/dynamodb-and-backups-16dba0dbcd...
7.
Getting started: the 3 stages of data infrastructure(medium.com)
6 points by natekupp 9y ago|0 comments
8.
by natekupp 9y ago
The original Science paper is here: http://science.sciencemag.org/content/356/6342/1046.full The section "Relativistic deflections by foreground stars" walks through the math which enables this, whi
9.
by natekupp 9y ago
Have you considered just applying through the jobs pages of the larger tech companies? Apple, Google, Facebook, LinkedIn are all on the peninsula and more accessible than startups in SF.
10.
by natekupp 9y ago
We're also doing this at Thumbtack. We run all of our Spark jobs in job-scoped Cloud Dataproc clusters. We wrote a custom Airflow operator which launches a cluster, schedules a job on that cluster, and shuts down the cluster upon job c
11.
by natekupp 9y ago
Thumbtack | Software Engineer, SRE, Data Scientist, many others | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a fr
12.
by natekupp 9y ago
I'm constantly surprised by how much work Amazon expects its customers to do themselves. The work that Segment has done here should be a service provided by AWS directly, continuously updating cost data in a Redshift database without a
13.
by natekupp 9y ago
Thumbtack | Software Engineer, SRE, Data Scientist, many others | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a fr
14.
by natekupp 9y ago
Thumbtack | Software Engineer, SRE, Data Scientist, many others | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a fr
15.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a friendly, ambitious
16.
by natekupp 10y ago
Sure, please reach out to jessica [at] thumbtack.com!
17.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a friendly, ambitious
18.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a friendly, ambitious
19.
Migrating our Scala codebase to Spark 2(thumbtack.com)
3 points by natekupp 10y ago|0 comments
20.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Thumbtack is a local services marketplace that connects millions of customers with the right professionals for anything they need done. We are a friendly, ambitious
21.
Welcome to Thumbtack, Noam Lovinsky(thumbtack.com)
9 points by natekupp 10y ago|0 comments
22.
by natekupp 10y ago
Thumbtack | San Francisco, CA | Full-Time | Onsite Our mission is to help people accomplish personal projects by matching their needs to the best service professionals in their area. From wedding photographers and DJs to home contractors or
23.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Our mission is to help people accomplish personal projects by matching their needs to the best service professionals in their area. From wedding photographers and DJ
24.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Our mission is to help people accomplish personal projects by matching their needs to the best service professionals in their area. From wedding photographers and DJ
25.
by natekupp 10y ago
thanks for flagging, I'll look into it!
26.
by natekupp 10y ago
hey all, feel free to reach out to me either on this thread, or directly at nate[at]thumbtack.com if I can answer any questions!
27.
by natekupp 10y ago
+1 to this, we kick off our Sqoop jobs using Airflow - http://airbnb.io/projects/airflow/ Airflow is very similar to Luigi; we've been using in in production to schedule all of our workflows for ~4 months now
28.
How we run Spark and Sqoop in production(thumbtack.com)
58 points by natekupp 10y ago|18 comments
29.
by natekupp 10y ago
Thumbtack | https://thumbtack.com | San Francisco, CA | ONSITE Our mission is to help people accomplish personal projects by matching their needs to the best service professionals in their area. From wedding photographers and DJ
30.
Building Thumbtack’s Data Infrastructure(thumbtack.com)
17 points by natekupp 10y ago|0 comments

More ›