Notes ordonnanceur cluster grid batch scheduler

Voir :

http://calcul.math.cnrs.fr/Documents/Ecoles/LEM2I/Mod1/architectureBench.pdf

batchScheduler / cluster-computing framework :

Apache Spark

Moab (Cluster Resources)

GE

Sun Grid Engine (SGE)

SLURM

PBS Pro

MAUI/Torque

MOCK

Loadleveler FIXME2

OAR (LIG/INRIA)

http://calcul.math.cnrs.fr/Documents/Ecoles/2009/gestionnaire-de-batch.pdf

http://rioc.readthedocs.org/en/latest/oar.html

https://www.grid5000.fr/school2010/slides/oar_virtu.pdf

https://tel.archives-ouvertes.fr/tel-00357473/file/Cudennec-Soutenance-These.pdf

LSF (Platform)

Condor

BQS (CC-IN2P3), Lava, CCS

DrQueue

https://thanosk.net/content/setting-drqueue-render-farm-blender

Python celery

http://en.wikipedia.org/wiki/Job_scheduler https://en.wikipedia.org/wiki/Comparison_of_cluster_software

HPC

Basic Linear Algebra Subroutines (BLAS)

https://sites.google.com/a/case.edu/hpc-upgraded-cluster/blas LAPACK — Linear Algebra PACKage

http://www.netlib.org/lapack/

MPI / PVM

mpirun

mpirun -np 4 /usr/bin/john -test

https://support.rackspace.com/how-to/high-performance-computing-cluster-in-a-cloud-environment/

http://www.linux-mag.com/id/5759/

https://fr.wikipedia.org/wiki/Parallel_Virtual_Machine

Distro pour HTC

http://www.paratools.com/HPCLinux/

http://pareto.uab.es/mcreel/PelicanHPC/

Environment Modules

http://www.admin-magazine.com/HPC/Articles/Environment-Modules

Slurm Jupyter/ IPython

http://twiecki.github.io/blog/2014/02/24/ipython-nb-cluster/

http://k-d-w.org/node/96

https://github.com/roryk/ipython-cluster-helper

https://rcc.fsu.edu/docs/parallel-ipython-programming-hpc-and-spear