Feature suggestion - rsync equivilant

[hoiting]

Hi team,

Please consider adding a new that's similar to rsync. That is, to sync all files under two paths.

Sometime, I need to copy all files from another system into unity catalog using databricks fs cp local_path uc_path --recursive. Occasionally, the connection would be interrupted for reasons I do not fully understand. It's a pain to figure out what have been copied and what have not.

[hoiting]

I did not realize there is a databricks sync functionality. I look forward to trying it!

[hoiting]

hmmm no. databricks sync only works for workspace folder. If copying to volume in UC, for example, it does not work.