[GIT PULL] afs: Filesystem driver overhaul
David Howells
dhowells at redhat.com
Mon Nov 13 08:31:52 PST 2017
[This time with the correct afs mailing list address cc'd]
Hi Linus,
Could you pull my kAFS filesystem driver overhaul please?
Note that it is based on net-next/master and tip/timers/core and will need
pulling after both of those. There's a merge at the base of the branch
that effects this.
The major points of the overhaul are:
(1) Preliminary groundwork is laid for supporting network-namespacing of
kAFS. The remainder of the namespacing work requires some way to pass
namespace information to submounts triggered by an automount. This
requires something like the mount overhaul that's in progress.
(2) sockaddr_rxrpc is used in preference to in_addr for holding addresses
internally and add support for talking to the YFS VL server. With
this, kAFS can do everything over IPv6 as well as IPv4 if it's talking
to servers that support it.
(3) Callback handling is overhauled to be generally passive rather than
active. 'Callbacks' are promises by the server to tell us about data
and metadata changes. Callbacks are now checked when we next touch an
inode rather than actively going and looking for it where possible.
(4) File access permit caching is overhauled to store the caching
information per-inode rather than per-directory, shared over
subordinate files. Whilst older AFS servers only allow ACLs on
directories (shared to the files in that directory), newer AFS servers
break that restriction.
To improve memory usage and to make it easier to do mass-key removal,
permit combinations are cached and shared.
(5) Cell database management is overhauled to allow lighter locks to be
used and to make cell records autonomous state machines that look
after getting their own DNS records and cleaning themselves up, in
particular preventing races in acquiring and relinquishing the fscache
token for the cell.
(6) Volume caching is overhauled. The afs_vlocation record is got rid of
to simplify things and the superblock is now keyed on the cell and the
numeric volume ID only. The volume record is tied to a superblock and
normal superblock management is used to mediate the lifetime of the
volume fscache token.
(7) File server record caching is overhauled to make server records
independent of cells and volumes. A server can be in multiple cells
(in such a case, the administrator must make sure that the VL services
for all cells correctly reflect the volumes shared between those
cells).
Server records are now indexed using the UUID of the server rather
than the address since a server can have multiple addresses.
(8) File server rotation is overhauled to handle VMOVED, VBUSY (and
similar), VOFFLINE and VNOVOL indications and to handle rotation both
of servers and addresses of those servers. The rotation will also
wait and retry if the server says it is busy.
(9) Data writeback is overhauled. Each inode no longer stores a list of
modified sections tagged with the key that authorised it in favour of
noting the modified region of a page in page->private and storing a
list of keys that made modifications in the inode.
This simplifies things and allows other keys to be used to actually
write to the server if a key that made a modification becomes useless.
(10) Writable mmap() is implemented. This allows a kernel to be build
entirely on AFS.
Note that Pre AFS-3.4 servers are no longer supported, though this can be
added back if necessary (AFS-3.4 was released in 1998).
David
---
The following changes since commit 81445e63e67a1e98b1c2575fa2b406d4289d2754:
Merge remote-tracking branch 'tip/timers/core' into afs-next (2017-11-13 15:36:33 +0000)
are available in the git repository at:
git://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs.git tags/afs-next-20171113
for you to fetch changes up to 98bf40cd99fcfed0705812b6cbdbb3b441a42970:
afs: Protect call->state changes against signals (2017-11-13 15:38:21 +0000)
----------------------------------------------------------------
AFS development
----------------------------------------------------------------
David Howells (34):
Pass mode to wait_on_atomic_t() action funcs and provide default actions
afs: Lay the groundwork for supporting network namespaces
afs: Close the rxrpc socket only after purging the servers
afs: Fix server reaping
afs: Note the cell in the superblock info also
afs: Push the net ns pointer to more places
afs: Add some protocol defs
afs: Update the cache index structure
afs: Keep and pass sockaddr_rxrpc addresses rather than in_addr
afs: Allow IPv6 address specification of VL servers
afs: Consolidate abort_to_error translators
afs: Condense afs_call's reply{,2,3,4} into an array
afs: Potentially return call->reply[0] from afs_make_call()
afs: Connect up the CB.ProbeUuid
afs: Fix the afs_uuid struct to make the char-sized fields signed
afs: Rename struct afs_call server member to cm_server
afs: Overhaul the callback handling
afs: Overhaul permit caching
afs: Overhaul cell database management
afs: Add an address list concept
afs: Move server rotation code into its own file
afs: Overhaul volume and server record caching and fileserver rotation
afs: Make use of the YFS service upgrade to fully support IPv6
afs: Only progress call state at end of Tx phase from rxrpc callback
afs: Fix total-length calculation for multiple-page send
afs: Fix documentation on # vs % prefix in mount source specification
afs: Trace the initiation and completion of client calls
afs: Trace the sending of pages
afs: Fix directory read/modify race
afs: Introduce a file-private data record
afs: Get rid of the afs_writeback record
afs: Implement shared-writeable mmap
afs: Trace page dirty/clean
afs: Protect call->state changes against signals
Marc Dionne (1):
afs: Use a dynamic port if 7001 is in use
Documentation/filesystems/afs.txt | 4 +-
arch/mips/kernel/traps.c | 14 +-
drivers/gpu/drm/drm_dp_aux_dev.c | 8 +-
drivers/gpu/drm/i915/selftests/intel_breadcrumbs.c | 10 +-
drivers/media/platform/qcom/venus/hfi.c | 8 +-
fs/afs/Makefile | 5 +-
fs/afs/addr_list.c | 381 ++++++++
fs/afs/afs.h | 35 +-
fs/afs/afs_fs.h | 6 +
fs/afs/afs_vl.h | 73 +-
fs/afs/cache.c | 239 +----
fs/afs/callback.c | 504 +++-------
fs/afs/cell.c | 887 +++++++++++------
fs/afs/cmservice.c | 77 +-
fs/afs/dir.c | 461 +++++----
fs/afs/file.c | 194 +++-
fs/afs/flock.c | 159 ++-
fs/afs/fsclient.c | 830 +++++++++-------
fs/afs/inode.c | 177 ++--
fs/afs/internal.h | 905 ++++++++++-------
fs/afs/main.c | 145 ++-
fs/afs/misc.c | 38 +-
fs/afs/proc.c | 247 +++--
fs/afs/rotate.c | 715 ++++++++++++++
fs/afs/rxrpc.c | 335 ++++---
fs/afs/security.c | 378 +++++---
fs/afs/server.c | 782 +++++++++++----
fs/afs/server_list.c | 153 +++
fs/afs/super.c | 190 ++--
fs/afs/vlclient.c | 682 ++++++++++---
fs/afs/vlocation.c | 720 --------------
fs/afs/vnode.c | 1025 --------------------
fs/afs/volume.c | 611 ++++++------
fs/afs/write.c | 709 ++++++++------
fs/afs/xattr.c | 4 +-
fs/btrfs/extent-tree.c | 27 +-
fs/fscache/cookie.c | 2 +-
fs/fscache/internal.h | 2 -
fs/fscache/main.c | 9 -
fs/nfs/inode.c | 4 +-
fs/nfs/internal.h | 2 +-
fs/ocfs2/filecheck.c | 8 +-
include/linux/wait_bit.h | 15 +-
include/trace/events/afs.h | 293 ++++++
include/uapi/linux/magic.h | 1 +
kernel/sched/wait_bit.c | 18 +-
mm/filemap.c | 1 +
47 files changed, 6769 insertions(+), 5324 deletions(-)
create mode 100644 fs/afs/addr_list.c
create mode 100644 fs/afs/rotate.c
create mode 100644 fs/afs/server_list.c
delete mode 100644 fs/afs/vlocation.c
delete mode 100644 fs/afs/vnode.c
More information about the linux-afs
mailing list