nathanwallace

6 ms·

1.
by nathanwallace 11mo ago
A similar site I've enjoyed for >15 years (!!) is https://techmeme.com/ I also use it's sister aggregator site for political news every day - https://www.memeorandum.com/
2.
by nathanwallace 1y ago
Readers may also enjoy Steampipe [1], an open source tool to live query 140+ services with SQL (e.g. AWS, GitHub, CSV, Kubernetes, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc with other tables. (Discla
3.
by nathanwallace 2y ago
Steampipe project lead here - thanks for the shout out & feedback multani! I agree with your comment about JSON columns being more difficult to work with at times. On balance, we've found that approach more robust than creating new
4.
by nathanwallace 2y ago
Beyond the Steampipe CLI (which has an embedded Postgres), you can use the steampipe plugins as native Postgres FDWs [1], SQLite extensions [2] or command line export tools [3]. We're definitely interested in bringing the plugins to du
5.
by nathanwallace 2y ago
Fair point. I guess that I'm disclosing that I lead the project and disclaiming the self-interest in posting? :)
6.
by nathanwallace 2y ago
Steampipe is most commonly used for DevSecOps. It works with any BI tool for dashboards (it's just Postgres), but is really great when paired with Powerpipe [1] for security benchmarks, visualizing infrastructure and much more [2]. It
7.
by nathanwallace 2y ago
Thanks for leaning into Steampipe!
8.
by nathanwallace 2y ago
thank you! We believe that SQL makes the simple stuff easy and the hard stuff doable :). Hopefully our repos & hubs have good enough examples to get you started most of the time!
9.
by nathanwallace 2y ago
doh! thanks for the heads up :-(. Fixed to be https://hub.steampipe.io/plugins
10.
by nathanwallace 2y ago
Readers may also enjoy Steampipe [1], an open source tool to live query 140+ services with SQL (e.g. AWS, GitHub, CSV, Kubernetes, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc with other tables. (Discla
11.
by nathanwallace 2y ago
Readers may also enjoy Steampipe [1], an open source tool to live query 140+ services with SQL (e.g. AWS, GitHub, CSV, Kubernetes, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc with other tables. (Discla
12.
by nathanwallace 2y ago
For runtime cost analysis, you could try Steampipe [1] with it's Powerpipe "thrifty" [2] mods. They run dozens of automatic checks across cloud providers for waste and cost saving opportunities. If you want to automatically m
13.
by nathanwallace 2y ago
In addition to Postgres FDWs, Steampipe plugins are also available as a SQLite extension [1] or a CLI export tool [2] for lighter weight use cases. (Although a local Postgres has a surprisingly small footprint!) Building plugins as DuckDB e
14.
by nathanwallace 2y ago
Readers may also enjoy Steampipe [1], an open source tool to live query 140+ services with SQL (e.g. AWS, GitHub, CSV, Kubernetes, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc with other tables. (Discla
15.
by nathanwallace 3y ago
Steampipe does live queries against the API endpoint and stores results in an in-memory cache. You can modify the cache expiration to adjust that behavior across queries [1]. If you want to do change data capture to act on results then chec
16.
by nathanwallace 3y ago
Readers may also enjoy Steampipe [1], an open source CLI to live query Google Sheets [2] and 140+ other services with SQL (e.g. AWS, GitHub, etc). It uses Postgres Foreign Data Wrappers under the hood and supports joins etc across the servi
17.
by nathanwallace 3y ago
Readers may also enjoy Flowpipe [1], a cloud scripting engine to build workflow pipelines using HCL (like Terraform). It's as-code, self-hosted and open source. Our design choices were a bit different - focus on DevSecOps, composable O
18.
by nathanwallace 3y ago
Perhaps give Flowpipe [1] a try? It provides "Pipelines for DevOps", including a library of AWS actions [2], that can be run on a schedule (e.g. daily) or a trigger (e.g. instance start) to do things like turn off, update or delet
19.
by nathanwallace 3y ago
Readers may find Steampipe's [1] AWS Thrifty Mod [2] useful. It will automatically scan multiple accounts and regions for 50 cost saving opportunities - many of which are looking for over-provisioned or unused resources. For example, i
20.
Zero-ETL for Postgres: Live-query cloud APIs with 100 open source FDWs(steampipe.io)
13 points by nathanwallace 3y ago|2 comments
21.
by nathanwallace 3y ago
Steampipe [1] is an open source project [2] that includes an embedded Postgres to instantly query cloud, code & more with SQL. This release expands our plugin ecosystem [3] to be a full Zero-ETL platform. Steampipe plugins can now run n
22.
by nathanwallace 3y ago
Thanks for your kind words - so great to hear that :-). We're really excited about Flowpipe and think it makes "cloud scripting" really fun & easy through pipelines - please let us know how you go and what we can improve!
23.
by nathanwallace 3y ago
Readers may enjoy Flowpipe [1], an open source cloud scripting engine we launched this week. It allows creation of pipelines in HCL to connect HTTP queries, run containers, execute lambda-compatible functions, query databases, etc all from
24.
Show HN: Flowpipe – cloud scripting using HCL(github.com)
10 points by nathanwallace 3y ago|0 comments
25.
by nathanwallace 3y ago
Most of our team just use their text editor to do formatter via plugins. I also find this online SQL formatter to be useful - https://extendsclass.com/sql-formatter.html
26.
by nathanwallace 3y ago
We use our open source project Steampipe [1] to query data using the GitHub plugin [2] and mods [3]. We have also opened up the custom mod we built for the specific charts & reports [4]. I hope they help - let us know if you give them a
27.
by nathanwallace 3y ago
Fair point! Rapid response is definitely valuable for thoughtful issues or PRs. For "questions" we try to just ask for more clarifying details or do a brief pointer to documentation. I find it can also be useful to deliberately sl
28.
by nathanwallace 3y ago
If the projects were my own, I'd consider a monorepo. We use this approach for Steampipe samples - https://github.com/turbot/steampipe-samples If it's a collection of changes, small improvements, etc to exist
29.
by nathanwallace 3y ago
Keeping docs with the code is definitely helpful, we've found that works well for our plugins and mods. All pull requests are then reviewed for consistency and documentation at the same time [1] - e.g. does this new table have good col
30.
by nathanwallace 3y ago
Monorepos have advantages and we considered that approach - easier mgmt, linear change timeline, consolidation of GitHub stars, etc. But on balance we felt our plugin and mod model benefited more from the separation - specific audience, cle

More ›