Bryan Carpenter

... Support of Differentiated Services, Francois Le Faucheur, Liwen Wu, Bruce Davie, Shahram Davari, Pasi Vaananen, Ram Krishnan, Pierrick Cheval, Juha ... USA EMail: [email protected] Francois Le Faucheur Cisco Systems Petra B - Les Lucioles 291, rue Albert Caquot 06560 ...

. This paper introduces a new portable communication librarycalled ARMCI. ARMCI provides one-sided communication capabilitiesfor distributed array libraries and compiler run-time systems. It supportsremote memory copy, accumulate, and synchronization operationsoptimized for non-contiguous data transfers including strided and generalizedUNIX I/O vector interfaces. The library has been employed in theGlobal Arrays shared memory programming toolkit and Adlib, a ParallelCompiler Run-time...

MPJ Express is our implementation of MPI-like bindings for Java. In this paper we discuss our intermediate buffering layer that makes use of the so-called direct byte buffers introduced in the Java New I/O package. The purpose of this layer is to support the implementation of derived datatypes. MPJ Express is the first Java messaging library that implements this feature using pure Java. In addition, this buffering layer allows efficient implementation of communication devicesbased on proprietary networks such as Myrinet. In this paper we evaluate the performance of our buffering layer and demonstrate the usefulness of direct byte buffers. Also, we evaluate the performance of MPJ Express against other messaging systems using Myrinet and show that our buffering layer has made it possible to avoid the overheads suffered by other Java systems such as mpiJava that relies on the Java Native Interface.

MPJ Express is a thread-safe Java messaging library that provides a full implementation of the mpiJava 1.2 API specification. This specification defines a MPI-like bindings for the Java language. We have implemented two communication devices as part of our library, the first, called niodev is based on the Java New I/O package and the second, called mxdev is based on the Myrinet eXpress library. MPJ Express comes with an experimental runtime, which allows portable bootstrapping of Java Virtual Machines across a cluster or network of computers. In this paper we describe the implementation of MPJ Express. Also, we present a qualitative and quantitative comparison against various other C and Java messaging systems. A beta version of MPJ Express was released in September 2005. I.

ABSTRACT Many organizations—including academic, research, commercial institutions—have invested heavily in setting up High Performance Computing (HPC) facilities for running computational science applications. On the other hand, the Apache Hadoop software—after emerging in 2005— has become a popular, reliable, and scalable open-source framework for processing large-scale data (Big Data). Realizing the importance and significance of Big Data, an increasing number of organizations are investing in relatively cheaper Hadoop clusters for executing their mission critical data processing applications. An issue here is that system administrators at these sites might have to maintain two parallel facilities for running HPC and Hadoop computations. This, of course, is not ideal due to redundant maintenance work and poor economics. This paper attempts to bridge this gap by allowing HPC and Hadoop jobs to co-exist on a single hardware facility. We achieve this goal by exploiting YARN—Hadoop v2.0—that de-couples the computational and resource scheduling part of the Hadoop framework from HDFS. In this context, we have developed a YARN-based reference runtime system for the MPJ Express software that allows executing parallel MPI-like Java applications on Hadoop clusters. The main contribution of this paper is provide Big Data community access to MPI-like programming using MPJ Express. As an aside, this work allows parallel Java applications to perform computations on data stored in Hadoop Distributed File System (HDFS).

With the transition to multicore processors almost complete, the parallel processing community is seeking efficient ways to port legacy message passing applications on shared memory and multicore processors. MPJ Express is our reference implementation of Message Passing Interface (MPI)-like bindings for the Java language. Starting with the current release, the MPJ Express software can be configured in two modes: the multicore and the cluster mode. In the multicore mode, parallel Java applications execute on shared memory or multicore processors. In the cluster mode, Java applications parallelized using MPJ Express can be executed on distributed memory platforms like compute clusters and clouds. The multicore device has been implemented using Java threads in order to satisfy two main design goals of portability and performance. We also discuss the challenges of integrating the multicore device in the MPJ Express software. This turned out to be a challenging task because the parallel ...

Rfc, 2732. Title, Format for Literal IPv6 Addresses in URL's. Author, R. Hinden, B. Carpenter, L. Masinter. Date, December 1999. ... All Rights Reserved. Abstract This document defines the format for literal IPv6 Addresses in URL's for implementation in World Wide Web browsers. ...

Page 1. 1 7/18/2002 IPv6 Flow Label Specification IPv6 Flow Label Specification draft-ietf-ipv6-flow-label-02.txt Jarno Rajahalme Alex Conta ... Difficult to pick up one-size-fits-all value • Also the minimum interval by which IPv6 nodes storing flow state must check flows ...

... Support of Differentiated Services, Francois Le Faucheur, Liwen Wu, Bruce Davie, Shahram Davari, Pasi Vaananen, Ram Krishnan, Pierrick Cheval, Juha ... USA EMail: [email protected] Francois Le Faucheur Cisco Systems Petra B - Les Lucioles 291, rue Albert Caquot 06560 ...

We describe two applications of our HPJava language for parallel computing. The flrst is a multigrid solver for a Poisson equation, and the second is a CFD application that solves the Euler equations for inviscid ∞ow. We illustrate how the features of the HPJava language allow these algorithms to be expressed in a straightforward and convenient way. Performance results on

HPJava is an environment for scientific and parallel program- ming using Java. It is based on an extended version of the Java language. One feature that HPJava adds to Java is a multi-dimensional array, or multiarray, with properties similar to the arrays of Fortran. We are us- ing Adlib as our high-level collective communication library. Adlib was originally developed using

We review the authors' HPJava programming en- vironment 1, and compare and contrast with systems like HPF. Because the underlying programming lan- guage is Java, and because the HPJava programming model relies centrally on object-oriented run-time de- scriptors for distributed arrays, the achievable perfor- mance has been somewhat uncertain. In the latest pub- lication (15), we have proved that HPJava

Two characteristic run-time communication libraries of HPJava are developed as an application level library and device level library. A high-level communication API, Adlib, is developed as an application level communication library. This communication library supports collective operations on distributed arrays. The mpjdev API is a device level underlying communication library for HPJava. This library is developed to perform actual communication

The article describes the current status of the authors’ HPJava programming environment. HPJava is a parallel dialect of Java that imports Fortran-like arrays—in particular the distributed arrays of High Performance Fortran—as new data structures. The article discusses the translation scheme adopted in a recently developed translator for the HPJava language. It also gives an overview of the language.

The HPspmd programming language model is a exible hybrid of HPF-like data- parallel language features and the popular, library-oriented, SPMD style, omitting some basic assumptions of the HPF model. Here, we will discuss a Java-based HPspmd language, called HPJava. HPJava extends the Java language with some additional syntax and pre-dened classes for handling distributed arrays, and a few new control

Our system aims to support a programming model that is a exible hybrid of the data-parallel, language-oriented, HPF style, and the established and popular, library-oriented, SPMD style. We refer to this model as HPspmd. Primary goals of the current project include ... 1. Providing a small set of syntax extensions to various base languages (including Java, Fortran, and C++). These syntax extensions add distributed arrays as language primitives, and introduce a few new control constructs, such as the distributed loop. ... 2. Providing bindings from ...