Workflow Orchestration with Prefect and Coiled - Shared screen with speaker view
Who can see your viewing activity?
Hi I am Julius Busecke. I am an associate research scientist at Columia University currently in my home office in Brooklyn (trying to escape the heat).
Welcome everyone! Thanks for joining - Let us know where you’re tuning in from and we’ll get started in a few minutes :)
I am Luca Cinquini - working at data processing for the NASA Jet Propulsion Laboratory
Robin joining from Paris, working for ACCURE Battery Intelligence, a young startup from the heart of Europe :)
Hi! I'm Nick Byrne, currently a research scientist at Reading University, UK. Tuning in from Ireland :)
Hi, I am Marko Herkaliuk, Data Engineer at appflame from Ukraine
Welcome everyone, thanks for joining us!
Hello! I’m Allen with Postscript.io joining from Oregon
Vinay Kumar M N
Hello good evening to all
Prefect documentation is a nice starting point :)
We can collect any questions here and address them after the demo!
I guess we need to say “This Prefect demo does not represent financial advice” 😂
Technical question:In kv-coiled.py - any difference in having import statements inside a task vs. outside, at the top of the py file?
Careers page: https://www.prefect.io/about/company#careers
Slack channel: https://www.prefect.io/slack/ Github: https://github.com/PrefectHQ/prefect Coiled + Prefect: https://docs.coiled.io/user_guide/examples/prefect.html KV Store Blog: https://www.prefect.io/blog/introducing-the-prefect-kv-store/
Do you support provenance - i.e. the ability to completely rerun a flow perhaps in a different deployment, to reproduce exactly the same results?
Thanks everyone for the informative talk. Gotta run to another meeting.
So Airflow can also submit tasks to a Task cluster as well as a Kubernetes cluster. Are you saying that Prefect can overcome some Airflow scalability problems even if they can have the same backend?
Task —> dask
Great answer, thanks
Thanks for this talk, the first scenario presented for the KV store was something that always raised questions for me. It's a "simple" but really effective solution for plenty of use cases.Congratz to the whole team. I'm proud to be part of the community.
Thanks a lot guys! Great job, keep on doing it
Yes - great job and great product. Thanks.
Thanks guys, you are the best