Message ID | 20220406075612.60298-1-jefflexu@linux.alibaba.com (mailing list archive) |
---|---|
Headers | show |
Series | fscache,erofs: fscache-based on-demand read semantics | expand |
On Wed, Apr 06, 2022 at 03:55:52PM +0800, Jeffle Xu wrote: > changes since v7: > - rebased to 5.18-rc1 > - include "cachefiles: unmark inode in use in error path" patch into > this patchset to avoid warning from test robot (patch 1) > - cachefiles: rename [cookie|volume]_key_len field of struct > cachefiles_open to [cookie|volume]_key_size to avoid potential > misunderstanding. Also add more documentation to > include/uapi/linux/cachefiles.h. (patch 3) > - cachefiles: valid check for error code returned from user daemon > (patch 3) > - cachefiles: change WARN_ON_ONCE() to pr_info_once() when user daemon > closes anon_fd prematurely (patch 4/5) > - ready for complete review > > > Kernel Patchset > --------------- > Git tree: > > https://github.com/lostjeffle/linux.git jingbo/dev-erofs-fscache-v8 > > Gitweb: > > https://github.com/lostjeffle/linux/commits/jingbo/dev-erofs-fscache-v8 > > > User Daemon for Quick Test > -------------------------- > Git tree: > > https://github.com/lostjeffle/demand-read-cachefilesd.git main > > Gitweb: > > https://github.com/lostjeffle/demand-read-cachefilesd > Btw, we've also finished a preliminary end-to-end on-demand download daemon in order to test the fscache on-demand kernel code as a real end-to-end workload for container use cases: User guide: https://github.com/dragonflyoss/image-service/blob/fscache/docs/nydus-fscache.md Video: https://youtu.be/F4IF2_DENXo Thanks, Gao Xiang
Btw, do you want to add a tracepoint or two to cachefiles to log requests? David
On 4/11/22 9:43 PM, David Howells wrote: > Btw, do you want to add a tracepoint or two to cachefiles to log requests? > Good idea. Tracepoints will help a lot when debugging.
> 2022年4月10日 下午8:51,Gao Xiang <hsiangkao@linux.alibaba.com> 写道: > > On Wed, Apr 06, 2022 at 03:55:52PM +0800, Jeffle Xu wrote: >> changes since v7: >> - rebased to 5.18-rc1 >> - include "cachefiles: unmark inode in use in error path" patch into >> this patchset to avoid warning from test robot (patch 1) >> - cachefiles: rename [cookie|volume]_key_len field of struct >> cachefiles_open to [cookie|volume]_key_size to avoid potential >> misunderstanding. Also add more documentation to >> include/uapi/linux/cachefiles.h. (patch 3) >> - cachefiles: valid check for error code returned from user daemon >> (patch 3) >> - cachefiles: change WARN_ON_ONCE() to pr_info_once() when user daemon >> closes anon_fd prematurely (patch 4/5) >> - ready for complete review >> >> >> Kernel Patchset >> --------------- >> Git tree: >> >> https://github.com/lostjeffle/linux.git jingbo/dev-erofs-fscache-v8 >> >> Gitweb: >> >> https://github.com/lostjeffle/linux/commits/jingbo/dev-erofs-fscache-v8 >> >> >> User Daemon for Quick Test >> -------------------------- >> Git tree: >> >> https://github.com/lostjeffle/demand-read-cachefilesd.git main >> >> Gitweb: >> >> https://github.com/lostjeffle/demand-read-cachefilesd >> > > Btw, we've also finished a preliminary end-to-end on-demand download > daemon in order to test the fscache on-demand kernel code as a real > end-to-end workload for container use cases: > > User guide: https://github.com/dragonflyoss/image-service/blob/fscache/docs/nydus-fscache.md > Video: https://youtu.be/F4IF2_DENXo Tested-by: Zichen Tian <tianzichen@kuaishou.com> > Thanks, > Gao Xiang >
On Sun, Apr 10, 2022 at 8:52 PM Gao Xiang <hsiangkao@linux.alibaba.com> wrote: > > On Wed, Apr 06, 2022 at 03:55:52PM +0800, Jeffle Xu wrote: > > changes since v7: > > - rebased to 5.18-rc1 > > - include "cachefiles: unmark inode in use in error path" patch into > > this patchset to avoid warning from test robot (patch 1) > > - cachefiles: rename [cookie|volume]_key_len field of struct > > cachefiles_open to [cookie|volume]_key_size to avoid potential > > misunderstanding. Also add more documentation to > > include/uapi/linux/cachefiles.h. (patch 3) > > - cachefiles: valid check for error code returned from user daemon > > (patch 3) > > - cachefiles: change WARN_ON_ONCE() to pr_info_once() when user daemon > > closes anon_fd prematurely (patch 4/5) > > - ready for complete review > > > > > > Kernel Patchset > > --------------- > > Git tree: > > > > https://github.com/lostjeffle/linux.git jingbo/dev-erofs-fscache-v8 > > > > Gitweb: > > > > https://github.com/lostjeffle/linux/commits/jingbo/dev-erofs-fscache-v8 > > > > > > User Daemon for Quick Test > > -------------------------- > > Git tree: > > > > https://github.com/lostjeffle/demand-read-cachefilesd.git main > > > > Gitweb: > > > > https://github.com/lostjeffle/demand-read-cachefilesd > > > > Btw, we've also finished a preliminary end-to-end on-demand download > daemon in order to test the fscache on-demand kernel code as a real > end-to-end workload for container use cases: > > User guide: https://github.com/dragonflyoss/image-service/blob/fscache/docs/nydus-fscache.md > Video: https://youtu.be/F4IF2_DENXo > > Thanks, > Gao Xiang Hi Xiang, I think this feature is interesting and promising. So I have performed some tests according to the user guide. Hope it can be an upstream feature. Thanks, Jiachen
Hi Jiachen, On Thu, Apr 14, 2022 at 04:10:10PM +0800, Jiachen Zhang wrote: > On Sun, Apr 10, 2022 at 8:52 PM Gao Xiang <hsiangkao@linux.alibaba.com> wrote: > > > > On Wed, Apr 06, 2022 at 03:55:52PM +0800, Jeffle Xu wrote: > > > changes since v7: > > > - rebased to 5.18-rc1 > > > - include "cachefiles: unmark inode in use in error path" patch into > > > this patchset to avoid warning from test robot (patch 1) > > > - cachefiles: rename [cookie|volume]_key_len field of struct > > > cachefiles_open to [cookie|volume]_key_size to avoid potential > > > misunderstanding. Also add more documentation to > > > include/uapi/linux/cachefiles.h. (patch 3) > > > - cachefiles: valid check for error code returned from user daemon > > > (patch 3) > > > - cachefiles: change WARN_ON_ONCE() to pr_info_once() when user daemon > > > closes anon_fd prematurely (patch 4/5) > > > - ready for complete review > > > > > > > > > Kernel Patchset > > > --------------- > > > Git tree: > > > > > > https://github.com/lostjeffle/linux.git jingbo/dev-erofs-fscache-v8 > > > > > > Gitweb: > > > > > > https://github.com/lostjeffle/linux/commits/jingbo/dev-erofs-fscache-v8 > > > > > > > > > User Daemon for Quick Test > > > -------------------------- > > > Git tree: > > > > > > https://github.com/lostjeffle/demand-read-cachefilesd.git main > > > > > > Gitweb: > > > > > > https://github.com/lostjeffle/demand-read-cachefilesd > > > > > > > Btw, we've also finished a preliminary end-to-end on-demand download > > daemon in order to test the fscache on-demand kernel code as a real > > end-to-end workload for container use cases: > > > > User guide: https://github.com/dragonflyoss/image-service/blob/fscache/docs/nydus-fscache.md > > Video: https://youtu.be/F4IF2_DENXo > > > > Thanks, > > Gao Xiang > > Hi Xiang, > > I think this feature is interesting and promising. So I have performed > some tests according to the user guide. Hope it can be an upstream > feature. Many thanks for the feedback. We're doing our best to form/stablize it now. Still struggle with some specific cases. Thanks, Gao Xiang > > Thanks, > Jiachen