Re: GlusterFS

[Dima Veselov <kab00m%lich.phys.spbu.ru@localhost>]

On 22.09.2020 16:22, Greg Troxel wrote:
> > Maybe it would be useful to know that gluster client is
> > very dependent on glusterfs version on servers (bricks).
> > Recent pkgsrc version (8.0) seem not to work with glusterfs
> > bricks < 8.0. I've tried 3.15, 5 and 7 (on Linux).
> > Not tried NetBSD as bricks though.
> >
> > Also I was not able to get NetBSD client 3.12 working with
> > any version on Linux bricks.
>
> Thanks for the report.  glusterfs is on my eventual TODO list so this is
> interesting.
>
> I am curious if this version-matching requirement (equivalently,
> "upstream does not have a stable wire protocol and has protocol breaks")
> is known and documented upstream?  As an example unison is like this.
> This seems like a property of glusterfs, not about NetBSD and not about
> pkgsrc.

Gluster have special treatment for versions inter-operation
and it stated that clients always work with lowest possible
version of protocol. Not sure what was the problem of my
setup - it always failed to save xattrs on file or find
xattr configuration with any options set.

So, I am not sure if this is NetBSD-related, but I can say that
5.x linux client work with 5.x cluster when NetBSD 3.12 or 8.x
clients do not.

And avoid using 3.12 NetBSD client - it seem to be very unstable.
Self-unmounting volumes after problems, crashing with cores
of several gigabytes, etc.

Also, it appeared to be quite hard finding Linux distribution
with glusterfs 8 - only Archlinux have it in stock. Fedora and
Debian have 8.x in future releases only.

--
Sincerely yours,
Dima Veselov
Physics R&D Establishment of Saint-Petersburg University