7 ms·
Looks great ! I don't know If you use Apache Airflow in ML or ETL pipelines but I wonder if one could use nbdev to generate Airflow Dags/Operator. There's alrea
by thesorrow 7y ago
Looks great ! I don't know If you use Apache Airflow in ML or ETL pipelines but I wonder if one could use nbdev to generate Airflow Dags/Operator. There's already some work done to execute Notebooks[0] but would be cool to convert them to Python code!
[0] https://airflow.apache.org/docs/stable/howto/operator/papermill.html https://airflow.apache.org/docs/stable/howto/operator/paperm...
- jph00 7y agoOh interesting idea - not something I'd thought of. (We don't use Airflow at fast.ai so this will likely require a PR.)