How to configure a Pandas/filesystem Datasource

This article is for comments to:

Please comment +1 if this How to is important to you.


Is there an example showing how to achieve something similar to SubdirReaderBatchKwargsGenerator? Should I use ConfiguredAssetFilesystemDataConnector or Inferred one? I have different files in one directory, there is not much pattern, each file itself is a data asset and their have their own format (csv/pickle). Is regex now the only way to configure data assets?


Can someone please help with this use case?

1 Like

Additionally, where can I adjust/insert the kwargs for file types and formats.
e.g.: pipe delimiters.