Sync DataSource

Mentioning Issue with adding Datasource here since it’s about problems creating a datasource from a folder already containing files unknown (yet) to Cells.

Although the cells-ctl hint is very useful, I also think that “quick / immediate / inotify-based” sync out-of-the-box would be a very important feature. It’s the only alternative when the web-importer is not practical (and there could be a variety of reasons):

  • too many / too big files
  • files no present locally / files already on the servers
  • files must not be imported but only discovered to avoid duplication
  • backend is slow (S3 / Swift) and upload has been done via a side-channel

For all these cases a good sync’ is a strongly needed fallback (if not a first-class feature).