[4174] in arla-drinkers

home help back first fref pref prev next nref lref last post

Re: Arla on FreeBSD

daemon@ATHENA.MIT.EDU (Tomas Olsson)
Thu Feb 15 10:43:14 2007

From arla-drinkers-bounces@stacken.kth.se Thu Feb 15 15:43:14 2007
Return-Path: <arla-drinkers-bounces@stacken.kth.se>
Delivered-To: arla-drinkers-mtg@bloom-picayune.mit.edu
Received: (qmail 10272 invoked from network); 15 Feb 2007 15:43:14 -0000
Received: from mx1.kth.se (130.237.32.140)
  by charon.mit.edu with SMTP; 15 Feb 2007 15:43:14 -0000
Received: from localhost (localhost.localdomain [127.0.0.1])
	by mx1.kth.se (Postfix) with ESMTP id 605E31407A4;
	Thu, 15 Feb 2007 16:43:12 +0100 (CET)
Received: from mx1.kth.se ([127.0.0.1])
 by localhost (mx1.kth.se [127.0.0.1]) (amavisd-new, port 10024) with LMTP
 id 10030-02-32; Thu, 15 Feb 2007 16:43:06 +0100 (CET)
Received: from tapas.stacken.kth.se (tapas.stacken.kth.se [130.237.234.140])
	by mx1.kth.se (Postfix) with ESMTP id 860B9140763;
	Thu, 15 Feb 2007 16:43:03 +0100 (CET)
Received: from tapas.stacken.kth.se (localhost [127.0.0.1])
	by tapas.stacken.kth.se (Postfix) with ESMTP id 1ABCC5350F;
	Thu, 15 Feb 2007 16:43:03 +0100 (CET)
X-Original-To: arla-drinkers@tapas.stacken.kth.se
Delivered-To: arla-drinkers@tapas.stacken.kth.se
Received: from brev.stacken.kth.se (brev.stacken.kth.se [130.237.234.84])
	by tapas.stacken.kth.se (Postfix) with ESMTP id 224265350F
	for <arla-drinkers@tapas.stacken.kth.se>;
	Thu, 15 Feb 2007 16:43:01 +0100 (CET)
Received: from mx1.kth.se (mx1.kth.se [130.237.32.140])
	by brev.stacken.kth.se (8.12.10/8.12.10) with ESMTP id l1FFh0OA007656
	for <arla-drinkers@stacken.kth.se>;
	Thu, 15 Feb 2007 16:43:00 +0100 (MET)
Received: from localhost (localhost.localdomain [127.0.0.1])
	by mx1.kth.se (Postfix) with ESMTP id AB9B5140761
	for <arla-drinkers@stacken.kth.se>;
	Thu, 15 Feb 2007 16:43:00 +0100 (CET)
Received: from mx1.kth.se ([127.0.0.1])
	by localhost (mx1.kth.se [127.0.0.1]) (amavisd-new,
	port 10024) with LMTP
	id 10619-01-15; Thu, 15 Feb 2007 16:42:48 +0100 (CET)
Received: from kashyyyk.ite.kth.se (kashyyyk.ite.kth.se [130.237.31.35])
	by mx1.kth.se (Postfix) with ESMTP id 33875140763;
	Thu, 15 Feb 2007 16:42:48 +0100 (CET)
Received: by kashyyyk.ite.kth.se (Postfix, from userid 18404)
	id 2789389CA62; Thu, 15 Feb 2007 16:42:48 +0100 (CET)
From: Tomas Olsson <tol@it.su.se>
To: Robert Watson <rwatson@FreeBSD.org>
Subject: Re: Arla on FreeBSD
References: <20070214162938.GA96725@keira.kiwi-computer.com>
	<20070214173211.L1054@chrishome.localnet>
	<20070214170808.GC96725@keira.kiwi-computer.com>
	<lsrvei45pq1.fsf@kashyyyk.ite.kth.se>
	<20070215044707.GA39168@deviant.kiev.zoral.com.ua>
	<lsrmz3f680v.fsf_-_@kashyyyk.ite.kth.se>
	<20070215104537.GC39168@deviant.kiev.zoral.com.ua>
	<lsrhctn6393.fsf@kashyyyk.ite.kth.se>
	<20070215120855.GE39168@deviant.kiev.zoral.com.ua>
	<lsrd54b603c.fsf@kashyyyk.ite.kth.se>
	<20070215134608.GG39168@deviant.kiev.zoral.com.ua>
	<lsr8xez5v15.fsf@kashyyyk.ite.kth.se>
	<20070215150015.O90799@fledge.watson.org>
Date: 15 Feb 2007 16:42:48 +0100
In-Reply-To: <20070215150015.O90799@fledge.watson.org>
Message-ID: <lsr4ppn5sw7.fsf@kashyyyk.ite.kth.se>
Lines: 49
User-Agent: Gnus/5.09 (Gnus v5.9.0) Emacs/21.3
MIME-Version: 1.0
X-Virus-Scanned: by amavisd-new at kth.se
X-Spam-Status: No, hits=-4.9 tagged_above=-200.0 required=5.0 tests=BAYES_00
X-Spam-Level: 
Cc: Kostik Belousov <kostikbel@gmail.com>, freebsd-fs@FreeBSD.org,
	arla-drinkers@stacken.kth.se
X-BeenThere: arla-drinkers@stacken.kth.se
X-Mailman-Version: 2.1.6
Precedence: list
List-Id: Arla discussions <arla-drinkers.stacken.kth.se>
List-Unsubscribe: <https://lists.stacken.kth.se/mailman/listinfo/arla-drinkers>, 
	<mailto:arla-drinkers-request@stacken.kth.se?subject=unsubscribe>
List-Archive: <http://lists.stacken.kth.se/pipermail/arla-drinkers>
List-Post: <mailto:arla-drinkers@stacken.kth.se>
List-Help: <mailto:arla-drinkers-request@stacken.kth.se?subject=help>
List-Subscribe: <https://lists.stacken.kth.se/mailman/listinfo/arla-drinkers>, 
	<mailto:arla-drinkers-request@stacken.kth.se?subject=subscribe>
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Sender: arla-drinkers-bounces@stacken.kth.se
Errors-To: arla-drinkers-bounces@stacken.kth.se
X-Virus-Scanned: by amavisd-new at kth.se

Robert Watson <rwatson@FreeBSD.org> writes:
> On Thu, 15 Feb 2007, Tomas Olsson wrote:
> >> Also, you could look at file handle API, that would save you of path 
> >> lookups after the vnode is looked up first time (look around for vfs_vptofh 
> >> and vfs_fhtovp ops). This API is used by NFS server, so it shall work :).
> >>
> > That's an idea. We used that before in another context, but then we ran into 
> > trouble with too many OSes so we dropped it.  Depends on how much code one 
> > can share.
> 
> It has been ages since I looked at the xfs/nnpfs internals, but I thought it 
> already used file handles to identify cache files to the kernel?  I seem to 
> recall several of our fh*() system calls were added by Assar specifically in 
> support of Arla work.
> 
Sounds likely. I first saw it from arlad's side, so I've always thought of
it as an optimization to avoid lookups in that end without pondering it all
that much.

> Is it the case that one file visible in /afs may now be backed by pages 
> coming from different cache files?
>
Yup. There ware requests for low latency fetching of ID3 tags etc, and
working with files larger than the cache.

> How does this interact with the vnode pager?  I assume you actually end
> up with two pagers -- one for the file as visible in /afs, and then
> satisfy the pager's VOP requests by forwarding them to the right one of
> the cache vnodes?
>
Exactly. As always, just more fine grained.

> I trust you don't mmap the cache vnode, which would lead to cache
> consistency issues between any mappings of the /afs vnode vs the cache
> vnode?
>
Me too :-)

But this is still a suboptimal world where we end up with double pager
layers, and consistency can still be a problem.  In the long term it would
be nice to have arlad open it's cache nodes through nnpfs, be it small
files or just one large VM space.

> Any chance we could attract you to BSDCan to meet in person to discuss this? 
>
Chance, not probable; May is beyond my horizon. And I do expect to have the
arla working properly on fbsd well before that.

/t
_______________________________________________
Arla-drinkers mailing list
Arla-drinkers@stacken.kth.se
https://lists.stacken.kth.se/mailman/listinfo/arla-drinkers

home help back first fref pref prev next nref lref last post