Discussion:
Why I helped to create this group
(too old to reply)
David C. DiNucci
2004-07-17 11:12:08 UTC
Permalink
I have intermittently posted an "Almost FAQ" here, adapted from the
original charter, to help guide the discussion on this group. It
apparently hasn't been very helpful, perhaps in part due to its
generality and/or political correctness. I'll be a bit more
focused/blunt here, so this should be taken as my personal, totally
unofficial statement.

Over the years, distributed computing, distributed systems, distributed
collectives, etc., have had many different flavors, have gone through
many hype cycles, and have encountered barriers on many fronts (e.g.
technical, political, economical, practical). At about the time that
this group was created, two "technologies" encountering these issues
were P2P and Grids. At least two groups had been formed to address
these issues: The Peer-to-peer working group (P2PWG), an industrial
group formed initially by Intel and other companies; and the Grid Forum,
formed initially by academic and government sources, notably sources
tied closely to the Globus project.

I attended meetings of both of these groups from time to time, including
some of the very first of each, as I had been working with "grid"
development at NASA since '96 or '97, and much longer in parallel and
distributed systems. Eventually, the Grid Forum swallowed up the P2PWG
as well as other distributed efforts (e.g. the New Productivity
Initiative), and the Grid Forum ultimately became the Global Grid Forum
(GGF), which continues to this day. Last I checked, hundreds of
representatives from government agencies and industry were flying all
over the world and paying sizeable registration fees every few months to
meet, and to talk about...well, largely Globus.

That, in itself, is not necessarily bad. What *is* bad is when people
are actively discouraged from discussing anything *but* Globus. I was,
at least twice, quite actively and rudely discouraged from using Grid
Forum mailing lists for un-Globus-ish discussions by the moderators of
those lists. These were not anti-Globus discussions, but just
suggestions by me that there might be more productive ways to handle
certain problems than the way Globus was handling them, or suggestions
that perhaps we should occasionally start with tabula rasa, rather than
with Globus, when determining solutions to certain issues. (I do believe
that the "power structure" of the GGF has changed markedly since that time.)

Feeling that the potential of these distributed systems was too great to
be left primarily in the hands of the GGF, my intent for this newsgroup
was to help foster a purer meritocracy when finding solutions to
distributed systems issues than I was (and am) seeing elsewhere. Raj
Buyya and I intentionally tried to use terms other than just P2P and
Grid to describe the scope of this newsgroup, in part because of the
ties these terms had to projects like Napster and Globus. The terms
Distributed (or Networked) Resource Collectives (or Cooperatives) were
some of our choices, but such terms can only enter the vernacular with
help from others.

So why is this group not thriving? Perhaps my experiences were very
different than others. Perhaps other forums (forii) and open source
projects more than adequately provide for everyone's needs in this
field. Maybe, even if they don't, the costs of appearing to publically
buck the system are too great. Maybe distributed technologies have lost
their luster, contrary to what the press is saying. And maybe, even if
they're still hot, people believe that their ideas are too valuable to
share here for free. Maybe the creation of this newsgroup was
wrong-headed from the beginning. (Based on the vote discussion from the
formation of this group, I'm guessing that some would find great
satisfaction if I was to concede such--and I'm not.)

Some of us have now had 8 years or so of exposure to "Grids", maybe 5 to
"P2P", and who knows how many to other forms of distributed resource
collectives. After that, aren't there some novel big picture ideas,
productive criticisms, etc., that can be shared on this group? As many
know, I've been working in one direction with Software Cabling, PICA
(People, Instruments, Computers, and Archives), and CDS (Cooperative
Data Sharing) for some time now, and I've shared many of my design
criteria, etc., on this group already. I'd be happy to continue, if
prompted, but even better would be to hear some comparisons, contrasts,
criticisms, etc., between different projects and approaches, including
new ideas.

-- Dave
-----------------------------------------------------------------
David C. DiNucci Elepar Tools for portable grid,
***@elepar.com http://www.elepar.com parallel, distributed, &
503-439-9431 Beaverton, OR 97006 peer-to-peer computing
Edward A. Feustel
2004-07-18 10:10:30 UTC
Permalink
I think the group could be quite important for the discussion of systems of
autonomous communicating processes at work "somewhere" on the network.

I am particularily interested in the security aspects of such networks of
processes
including the infrastructure supporting these applications as well as the
applications
themselves. So far it seems to me that PKI and SAML and XACML could be major
pieces in such a system.

Edward Feustel
Teresa Conant
2005-05-17 14:01:30 UTC
Permalink
I just joined the group this weekend. And participating in exchanges
list those outlined below is the main reason I wanted to join!

Teresa
Post by David C. DiNucci
What *is* bad is when people
are actively discouraged from
discussing anything *but* Globus.
Feeling that the potential of these distributed systems was too great to
be left primarily in the hands of the GGF, my intent for this newsgroup
was to help foster a purer meritocracy when finding solutions to
distributed systems issues than I was (and am) seeing elsewhere.
I've been working in one direction with Software Cabling, PICA
(People, Instruments, Computers, and Archives), and CDS (Cooperative
Data Sharing) for some time now, and I've shared many of my design
criteria, etc., on this group already. I'd be happy to continue, if
prompted, but even better would be to hear some comparisons, contrasts,
criticisms, etc., between different projects and approaches, including
new ideas.
-- Dave
-----------------------------------------------------------------
David C. DiNucci Elepar Tools for portable grid,
503-439-9431 Beaverton, OR 97006 peer-to-peer computing
c***@yahoo.com
2005-05-18 20:02:08 UTC
Permalink
I just joined the group this weekend. And participating in exchanges list
those outlined below is the main reason I wanted to join!
Looks like you'll have to start one. What aspects of distributed computing
are you insterested in/do you work on? (noting that non-lurkers still do
google searchs so you might bring some traffic here)
Post by David C. DiNucci
What *is* bad is when people
are actively discouraged from
discussing anything *but* Globus.
So, reading your (David's) post it is not clear. Is this a place for
discussion of things like Plan 9 and those in Tanenbaum's book?
Periodically there are questions about amoeba in the minix group. Should
they come here?

3ch
David C. DiNucci
2005-05-19 18:50:18 UTC
Permalink
Post by c***@yahoo.com
Post by David C. DiNucci
What *is* bad is when people
are actively discouraged from
discussing anything *but* Globus.
So, reading your (David's) post it is not clear. Is this a place for
discussion of things like Plan 9 and those in Tanenbaum's book?
Periodically there are questions about amoeba in the minix group. Should
they come here?
(Gee, I posted that in July '04!) I think this would be a fine place
for such issues. Just for the record, I'll go ahead and post the
"almost FAQ" again, but as a source of topic ideas rather than a
document limiting what's on/off limits. Simply put, this group was
created as an open forum for discussing distributed systems, grids, P2P,
etc., whether theoretical or practical. I sense that open-ended
questions, discussions, and reviews are more likely to pay off here than
specific how-to questions about a particular tool or application, but
times change.

-Dave
c***@yahoo.com
2005-05-20 06:04:23 UTC
Permalink
Post by David C. DiNucci
(Gee, I posted that in July '04!)
Yeah, I'd noticed it was a reply to an old post, so I didn't know if you'd
still be around, Good you are.

I was just lurking trying to get the buzz prior to leaping into the
subject and groups w/ k's of messages intimidate me.

So maybe if Teresa Conant will come back I'll have some dialog to read
other than the FAQ 'n' manual I see in the next two posts.

3ch
David C. DiNucci
2005-05-31 08:07:47 UTC
Permalink
Post by c***@yahoo.com
I was just lurking trying to get the buzz prior to leaping into the
subject and groups w/ k's of messages intimidate me.
Finally, someone who sees the dearth of messages here as an advantage!
Post by c***@yahoo.com
So maybe if Teresa Conant will come back I'll have some dialog to read
other than the FAQ 'n' manual I see in the next two posts.
Some of us here a long time ago discussed putting together a real FAQ.
I don't think there were enough frequently asked questions yet.

One question that did come up somewhere regards the difference between
the terms "parallel" and "concurrent". My view is/was that "parallel"
describes things that happen, or are intended to happen, at the same
time, as might be depicted by parallel (and adjacent) segments in a
space-time graph, and "distributed" is an orthogonal term describing
coordinated actions occurring in different places. Though "concurrent"
technically means happening at the same time, I usually use it to
describe actions (especially potentially distributed ones) that might or
might not occur at the same time, and deciding whether they do or do not
could be difficult, impossible, or just a waste of time due (in part) to
potential relativistic effects and different frames of reference. In
that context, one reasons about concurrent actions in terms of partial
orders imposed by cause and effect (e.g. Lamport's logical clocks), and
that reasoning remains valid regardless of whether the actions overlap
in time (in some given frame of reference), and regardless of the
relative placement/distribution, speeds, latencies, loading, etc.,
associated with the resources ultimately used to host those actions. In
a sense, it is good concurrent design that makes the terms "parallel"
and "distributed" orthogonal. Is there a word other than "concurrent"
that others use for this "partially ordered" or "potentially parallel"
notion?

The "almost FAQ" just posted mentioned some of the issues that arise in
distributed environments, many of which relate to the greater likelihood
of heterogeneity and faults in the platform when it is distributed.
These issues often arise in grid environments, for some definitions of
that term. Some people advocate "grid-aware programming", in which the
application is aware of these issues and responsible for mitigating them
head-on. I argue that that conflicts with good concurrent design. It
blurs the distinction between the application and the platform. If the
platform is not responsible for at least allocating and managing shared
resources, or for hiding applications from one another (at some level of
abstraction), then what is it responsible for?

-Dave
c***@yahoo.com
2005-05-31 19:11:34 UTC
Permalink
Post by David C. DiNucci
Finally, someone who sees the dearth of messages here as an advantage!
Well, maybe there are too few here...
Martin 53N 1W
2005-06-05 00:01:29 UTC
Permalink
Post by c***@yahoo.com
Post by David C. DiNucci
Finally, someone who sees the dearth of messages here as an advantage!
Well, maybe there are too few here...
Kirk seems to have been absent for a while with his DC projects updates
reminders...

Cheers,
Martin
--
---------- OS? What's that?! (Martin_285 on Mandriva)
- Martin - To most people, "Operating System" is unknown & strange.
- 53N 1W - Mandriva 10LE GNU Linux - An OS for Supercomputers & PCs
---------- http://www1.mandrivalinux.com/en/concept.php3
David C. DiNucci
2005-06-06 15:35:52 UTC
Permalink
Post by Martin 53N 1W
Post by c***@yahoo.com
Post by David C. DiNucci
Finally, someone who sees the dearth of messages here as an advantage!
Well, maybe there are too few here...
Kirk seems to have been absent for a while with his DC projects updates
reminders...
It's hard to get much of a blaze going with just a few regularly spaced
matches...regardless of how good those matches are.

Anybody got some kindling?

-Dave
Kirk Pearson
2005-07-03 16:23:35 UTC
Permalink
Post by David C. DiNucci
Post by Martin 53N 1W
Post by c***@yahoo.com
Post by David C. DiNucci
Finally, someone who sees the dearth of messages here as an advantage!
Well, maybe there are too few here...
Kirk seems to have been absent for a while with his DC projects updates
reminders...
It's hard to get much of a blaze going with just a few regularly spaced
matches...regardless of how good those matches are.
Anybody got some kindling?
-Dave
Sorry I haven't been able to post updates lately. Sun laid me off at
the end of March, and I have been looking for a new job since then. I
have one now (ironically a contract back at Sun), and I should have more
time for posting updates again. I have just posted all of my recent
updates.

Kirk
--
Kirk Pearson, editor of http://distributedcomputing.info (news and
information about public distributed computing projects)
"Time sneaks up on you like a windshield on a bug." -- John Lithgow
Martin 53N 1W
2005-07-16 21:57:34 UTC
Permalink
Kirk Pearson wrote:
[...]
Post by Kirk Pearson
Sorry I haven't been able to post updates lately. Sun laid me off at
the end of March, and I have been looking for a new job since then. I
have one now (ironically a contract back at Sun), and I should have more
time for posting updates again. I have just posted all of my recent
updates.
Hopefully a good and more lucrative change...

Thanks for the updates,

Regards,
Martin
--
---------- OS? What's that?! (Martin_285 on Mandriva)
- Martin - To most people, "Operating System" is unknown & strange.
- 53N 1W - Mandriva 10LE GNU Linux - An OS for Supercomputers & PCs
---------- http://www1.mandrivalinux.com/en/concept.php3
David C. DiNucci
2005-05-31 15:09:59 UTC
Permalink
[My previous post, hopefully w/better line wrapping.]
Post by c***@yahoo.com
I was just lurking trying to get the buzz prior to leaping into the
subject and groups w/ k's of messages intimidate me.
Finally, someone who sees the dearth of messages here as an advantage!
Post by c***@yahoo.com
So maybe if Teresa Conant will come back I'll have some dialog to read
other than the FAQ 'n' manual I see in the next two posts.
Some of us here a long time ago discussed putting together a real FAQ.
I don't think there were enough frequently asked questions yet.

One question that did come up somewhere regards the difference between
the terms "parallel" and "concurrent". My view is/was that "parallel"
describes things that happen, or are intended to happen, at the same
time, as might be depicted by parallel (and adjacent) segments in a
space-time graph, and "distributed" is an orthogonal term describing
coordinated actions occurring in different places. Though "concurrent"
technically means happening at the same time, I usually use it to
describe actions (especially potentially distributed ones) that might or
might not occur at the same time, and deciding whether they do or do not
could be difficult, impossible, or just a waste of time due (in part) to
potential relativistic effects and different frames of reference. In
that context, one reasons about concurrent actions in terms of partial
orders imposed by cause and effect (e.g. Lamport's logical clocks), and
that reasoning remains valid regardless of whether the actions overlap
in time (in some given frame of reference), and regardless of the
relative placement/distribution, speeds, latencies, loading, etc.,
associated with the resources ultimately used to host those actions. In
a sense, it is good concurrent design that makes the terms "parallel"
and "distributed" orthogonal. Is there a word other than "concurrent"
that others use for this "partially ordered" or "potentially parallel"
notion?

The "almost FAQ" just posted mentioned some of the issues that arise in
distributed environments, many of which relate to the greater likelihood
of heterogeneity and faults in the platform when it is distributed.
These issues often arise in grid environments, for some definitions of
that term. Some people advocate "grid-aware programming", in which the
application is aware of these issues and responsible for mitigating them
head-on. I argue that that conflicts with good concurrent design. It
blurs the distinction between the application and the platform. If the
platform is not responsible for at least allocating and managing shared
resources, or for hiding applications from one another (at some level of
abstraction), then what is it responsible for?

-Dave
Loading...