ECE 432 / CS 442 : Introduction to Parallel Processing

Textbooks:

• K. Hwang and Z. Xu, Scalable Parallel Computing: Technology, Architecture, Programming, McGraw-Hill, 1998.
• P. Pacheco, Parallel Programming with MPI, Morgan Kaufmann, 1997.

Please get an account on the

For User Support on the AHPCC machines, call Brian Baltz at 277-8420 or email help@arc.unm.edu

Course Materials:

• Syllabus
• Homework 1
• Independent Project Assignments
• Homework 2
• Homework 3
• Homework 4
• Midterm Exam Posted: March 22 ---- Due: March 31
• Clarification #1 on the Midterm
• Clarification #2 on the Midterm
• Final Project -- Due: May 10

Related Links:

• Journal of Parallel and Distributed Computing
• IEEE Transactions on Parallel and Distributed Systems
• IEEE Computer Society: ParaScope
• MPI: The Complete Reference
• MPI Forum
• MPI Information
• MPICH Portable Implementation of MPI
• High Performance Cluster Computing: Architectures and Systems, from Prentice-Hall
• Albuquerque High Performance Computing Center
• Maui High Performance Computing Center
• Computational Sciences, Computer Sciences, and Mathematics Center, Sandia National Laboratories
• Advanced Computing Laboratory, Los Alamos National Laboratories
• ASCI at Sandia National Laboratories
• ASCI at Los Alamos National Laboratory
• ASCI at Lawrence Livermore National Laboratory

Special Topics:

1. Architecture
   • Hewlett-Packard Exemplar
   • IBM SP-2 with SMP nodes
   • SGI/Cray Origin 2000
   • Sun HPC 10000 (Starfire)
   • Tera Computer Company: Multithreaded Architecture (MTA)
2. Benchmarks
   • ASCI Benchmarks
   • NAS Parallel Benchmarks
   • ParkBench
3. Programming Paradigms
   • Bulk-Synchronous Parallel (BSP)
   • The Cilk Project
   • Coherent Virtual Machine (CVM)
   • KeLP
   • OpenMP
   • High Performance Fortran (HPF)
4. Programs
   • Accelerated Strategic Computing Initiative (ASCI)
   • Peta(fl)ops Initiative
   • National Science Foundation PACI Program
5. High Performance Distributed Computing
   • Condor
   • Globus
   • Computational Grids
   • Legion
6. Job Scheduling
   • Application-Level Scheduling (AppLeS)
   • Maui-Scheduler
   • Portable Batch System (PBS)
7. Input/Output
   • MPI-IO (ROMIO Implementation)
   • High Performance Storage System (HPSS)