Main Page

From UC Grid Wiki
Jump to: navigation, search

UGP (UCLA Grid Portal Software) and the UC Grid


Introduction

A Grid is a collection of independently owned and administered resources which have been joined together by a software and hardware infrastructure that interacts with the resources and the users of the resources to provide coordinated dynamic resource sharing in a dependable and consistent way according to policies that have been agreed to by all parties. Because of the large number of resources available on a Grid at any given time, an individual researcher can always be provided with the best resources available at that point of time for his/her needs, and overall, resource utilization can be distributed for maximum efficiency.

The UCLA Grid Portal Software (UGP) and the UCLA Grid Architecture bring computational clusters together into a Grid. The hardware resources making up the Grid consist entirely of computational clusters each of which consists of a head node, compute nodes, storage nodes, network resources, software, and data resources. Individual computational clusters can be quite large, containing hundreds of nodes.

By incorporating the concepts of pooled resources and Pool Users, UGP facilitates the sharing of resources among users. Administrative overhead is reduced because there is no longer a need to add individual user login ids on multiple clusters. UGP is a software product that provides a web-based Grid Portal. It allows users to interact with distributed computing clusters at the campus or institution level and the grids it works with can be hierarchical in that a higher level Grid Portal can also be created. For example, at the University of California, we deploy a University of California (UC) Grid Portal which interacts with the Grids and Grid Portals at the ten University of California campuses to allow users to access resources across campuses.

At the same time as the UGP architecture presents a uniform appearance to users, it provides for a Grid made up of diverse computing environments (hardware, operating systems, job schedulers) and autonomous administrative domains. Local organizations own and maintain control of the resources involved, and local administrative procedures and security solutions take precedence.

UGP makes use entirely of open source software: Globus ToolKit, Tomcat, Java, Gridsphere and MySQL. UGP itself is also open source.

Single Campus and Hierarchical Architectures

In the UCLA Grid Architecture clusters are connected to the Grid Portal by the addition of a Grid Appliance to each cluster.

Single_Grid_Architecture
Clusters at an institution are connected into a Grid and have a single Grid Portal
Hierarchical_Architecture
Each institution creates a Grid and runs a Grid Portal. A parent institution runs a Grid Portal that can access all the computational resources of the member grids. For example, from the Universtity of California grid portal, one can access clusters from the 10 campus grids.

UGP implemented two WSRF web services to achieve the above: Register Service, Sync Service.

Services Provided by UGP

Services provided by UGP.

The Grid at UCLA

At UCLA, the UCLA Grid is maintained by, and the UCLA Grid Portal is run by Academic Tecnology Services (ATS). ATS is the UCLA Grid Administrator for UCLA.

If you administer a cluster at UCLA, you can join your cluster to the UCLA Grid by getting a Grid Appliance from ATS and attaching it to your cluster. The Grid Appliance comes to you fully installed and configured by ATS. As a Cluster Administrator you have control over which users of your cluster can access your cluster via the UCLA Grid Portal. Users apply to use the Grid directly via the Grid Portal. You will recieve an email whenever a user of your cluster asks to be Grid enabled. A web-based administration tool is available for you to either approve or deny. Additional web-based administration tools allow you to manipulate the database, add trusted clusters, list and add users and groups.


Setting up a Grid using UGP at your own Institution

If you are not at UCLA you can download the UCLA Grid software and use it to set up a Grid at your own organization complete with Grid Portal. The software is in the public domain and is distributed under the Apache Public License.

Setting up a grid at your own institution.

Feature Highlights

Resource Discovery
see Resources Demo
AJAX Data Manager
see AJAX Data Manager Demo
  • File transfer (GUI FTP client) among the clusters
  • Online Visualization tools -- see Visualization Demo
Job Services
see Job Services Demo;
  • Pool resources
  • Pool Job submission with metascheduling
  • appForm -- application forms create application program input
Interactive GUI applications run on the compute nodes and manipulated from the browser
see How to setup Interactive Applications and Interactive Application Demo
Grid Development Environment
see AJAX Grid Development Environment Demo
Access to TeraGrid and other outside grid resources if applicable
see Access TeraGrid Demo
Automatic user application workflow process
Real time synchronization between the institution Grid Portal and a higher level Grid Portal

See UCLA Grid Portal Demo

UC Grid Desktop (beta)

Watch demo UC Grid Desktop demo 1

UC Grid Security Guide

System Security Guide

UC Grid Roadmap

  • Migrate services from Globus Toolkit 4.0 to Globus Toolkit 4.2 (2009)
  • UC Grid Broker Web Service
  • Integrate Cloud Computing as a service in UGP by the end of 2009
  • Integrate a scientific workflow engine to UGP (TBD)


Contact Us

The UCLA Grid Team

UCLA Grid Team
UCLA Academic Technology Services
University of California, Los Angeles
5308 Math Sciences Box 951557
Los Angeles, CA. 90095-1557