Notes ordonnanceur cluster grid batch scheduler

Voir :

• http://calcul.math.cnrs.fr/Documents/Ecoles/LEM2I/Mod1/architectureBench.pdf

batchScheduler / cluster-computing framework :

• Apache Spark
• Moab (Cluster Resources)
• GE
• Sun Grid Engine (SGE)
• SLURM
• PBS Pro
• MAUI/Torque
• MOCK
• Loadleveler
• OAR (LIG/INRIA)
  • http://calcul.math.cnrs.fr/Documents/Ecoles/2009/gestionnaire-de-batch.pdf
  • http://rioc.readthedocs.org/en/latest/oar.html
  • https://www.grid5000.fr/school2010/slides/oar_virtu.pdf
  • https://tel.archives-ouvertes.fr/tel-00357473/file/Cudennec-Soutenance-These.pdf
• LSF (Platform)
• Condor
• BQS (CC-IN2P3), Lava, CCS
• DrQueue
  • https://thanosk.net/content/setting-drqueue-render-farm-blender
• Python celery

http://en.wikipedia.org/wiki/Job_scheduler https://en.wikipedia.org/wiki/Comparison_of_cluster_software

Basic Linear Algebra Subroutines (BLAS)

• https://sites.google.com/a/case.edu/hpc-upgraded-cluster/blas

LAPACK — Linear Algebra PACKage

• http://www.netlib.org/lapack/

MPI / PVM

• mpirun
  • mpirun -np 4 /usr/bin/john -test
• https://support.rackspace.com/how-to/high-performance-computing-cluster-in-a-cloud-environment/
• http://www.linux-mag.com/id/5759/
• https://fr.wikipedia.org/wiki/Parallel_Virtual_Machine

Distro pour HTC

• http://www.paratools.com/HPCLinux/
• http://pareto.uab.es/mcreel/PelicanHPC/

Environment Modules

• http://www.admin-magazine.com/HPC/Articles/Environment-Modules

Slurm Jupyter/ IPython

• http://twiecki.github.io/blog/2014/02/24/ipython-nb-cluster/
• http://k-d-w.org/node/96
• https://github.com/roryk/ipython-cluster-helper
• https://rcc.fsu.edu/docs/parallel-ipython-programming-hpc-and-spear