This would require custom operators that interact with a database at the beginning of a DAG, sensors to check state, and at the end of a DAG, operator to set state. I would explore a microservice architecture that records and returns DAG states.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |