joelschw

7 ms·

1.
by joelschw 3mo ago
No this is a composability surface, Flyte is their workflow engine for durable execution etc
2.
by joelschw 6mo ago
PhysicsX | Principal AI Engineer | London / NY / Remote | Full time | physicsx.ai We're building an AI-native platform that turns physics simulations from days-long jobs into millisecond inference. Think: training deep learni
3.
by joelschw 7mo ago
You could also use braintrust here https://github.com/braintrustdata/braintrust-claude-plugin
4.
by joelschw 10mo ago
January 6th was so egregious, I'm really not sure why they felt the need to exaggerate it.
5.
by joelschw 2y ago
Huge fan of Ibis, the value isn't that you can now use DuckDB... it's that your syntax will work when the next cool thing arrives too
6.
by joelschw 2y ago
Or you use Ibis and switch between the two at will!
7.
by joelschw 3y ago
I'd put this in the readme!
8.
by joelschw 3y ago
Big fan of evidence, really elegant design. There is also space for both declarative and imperative approaches when it comes to dashboarding / reporting etc.
9.
Vizro – toolkit for creating modular data visualization applications(github.com)
133 points by joelschw 3y ago|21 comments
10.
by joelschw 3y ago
The native GitHub feature in preview will make this a lot better for those able to use it https://github.blog/changelog/2023-03-01-feature-preview-ric...
11.
by joelschw 4y ago
Whilst I hate it - Jinja is so much more accessible for SQL coders.
12.
by joelschw 4y ago
I'm not sure it's framed like that, it's specifically talking about production patterns
13.
by joelschw 5y ago
If git did it...
14.
by joelschw 5y ago
Some similar concepts, but Kedro is specialised on the ML engineering workflow and team collaboration
15.
by joelschw 5y ago
Here you go - https://kedro.readthedocs.io/en/0.17.6/09_development/03_com...
16.
by joelschw 5y ago
Will point to some experiences open source users have had on this journey https://medium.com/hacking-talent/production-code-for-data-s... https://medium.com/google-cloud/migrate-kedro-pipeline-on-v
17.
by joelschw 5y ago
Some users have reported the Targets library is similar for that ecosystem
18.
by joelschw 5y ago
Kedro sort of fits into a niche where it just overlaps somewhat with 'orchestrators' like Prefect, Metaflow, Dagster, Airflow and others. What makes it slightly different is that it it is focused on the rapid development journey t
19.
by joelschw 5y ago
I should clarify by short term - the foreseeable future is a more appropriate description
20.
by joelschw 5y ago
Hello maintainer here - hopefully some of our open source users chime in, but my favourite will always be NASA: https://github.com/nasa/ML-airport-configuration Donation is the normal term for proejcts joining the fou
21.
Kedro joins the Linux Foundation(lfaidata.foundation)
6 points by joelschw 5y ago|1 comments
22.
by joelschw 5y ago
Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code. It borrows concepts from software engineering best-practice and applies them to machine-learning code; applied concepts include
23.
by joelschw 5y ago
It's for interactive sessions not background ones
24.
by joelschw 5y ago
Are there any frameworks for avoiding premature optimisation? I'm looking for some content to share with some new teams.
25.
by joelschw 5y ago
How do you compare yourselves to Monte Carlo Data?
26.
by joelschw 5y ago
I'd take a lazy, typed data manipulation language over pandas all day
27.
by joelschw 5y ago
This example doesn't demonstrate any of the power of Cypher, the whole point is matching a pattern than corresponds to a traversal, which as it happens is much much more elegant than recursive SQL
28.
by joelschw 5y ago
The national football team also did really well in the Euro competition - this forced a lot of drunk people indoors and onto public transport.
29.
by joelschw 5y ago
It's a platform play where pipelines would be built and maintained
30.
by joelschw 5y ago
Kedro, Quantumblack Labs | Python Software Engineer | London | REMOTE currently, ONSITE ? | Full-time Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code. It borrows concepts from s

More ›