Powerpoint Presentation Sample - Lanzhou Universityitslab.lzu.edu.cn/download/20191028203007.pdf ·...
Transcript of Powerpoint Presentation Sample - Lanzhou Universityitslab.lzu.edu.cn/download/20191028203007.pdf ·...
容器、高性能计算、云
联科集团(中国)有限公司
Agenda⚫ Virtualize & Containerize⚫ Docker & Singularity⚫ Capsule & Cloudified HPC
Virtualize & Containerize
虚拟化
虚拟化与容器化
虚拟化 容器化
主机操作系统
应用
库
应用
库
应用
库
应用
库
应用
库
主机操作系统
虚拟化软件
应用
操作系统
虚拟硬件
硬件驱动
库
应用
操作系统
虚拟硬件
硬件驱动
库
虚拟化与容器化
虚拟化 容器化
模拟出一套完整的硬件 操作系统级别的隔离
强隔离,安全性高 名字空间隔离,安全性较弱
重量级,虚机内运行完整操作系统 轻量级,容器内运行进程
支持不同种类操作系统 与主机共用同一内核
启动慢 实时启动
性能开销较大,尤其是读写密集型 几乎没有性能损失
虚拟化与容器化
⚫虚拟化引擎⚫ Vmware⚫ Parallels⚫ Hyper-V⚫ VirtualBox⚫ Qemu/KVM
⚫容器化引擎⚫Docker⚫Singularity⚫runc⚫CRI-O⚫Capsule
Docker & Singularity
Docker & Singularity
⚫Docker⚫ Rapid application deployment⚫ Portability across machines⚫ Version control and component reuse⚫ Sharing⚫ Lightweight footprint and minimal overhead ⚫ Simplified maintenance
⚫Singularity⚫ Encapsulation of the environment⚫ Containers are image based⚫ No user contextual changes or root escalation allowed⚫ No root owned daemon processes
Docker: Architecture
Docker: Images
Docker: Principles
• a series of image layers• ephemeral micro service• one process per container
Singularity
⚫Lawrence Berkeley National Lab⚫Containers for Science, Reproducibility and Mobility
⚫ singularity shell /home/public/alpine.sif⚫ singularity exec /home/public/alpine.sif pwd⚫ singularity exec /home/public/alpine.sif whoami⚫ singularity --debug exec /home/public/alpine.sif true⚫ singularity exec -p /home/public/alpine.sif ps au⚫ singularity exec /home/public/alpine.sif env
Singularity: MPI support
mpirun -n NP singularity exec /path/to/image /mpi/program
Capsule & Cloudified HPC
Capsule: Architecture
⚫Container over HPC
Slurm
OS OS OS OS OS OS OS
mpirun
sing
ula
rity
sing
ula
rity
sing
ula
rity
APP2
APP2 APP2
APP1
AP
P4
AP
P5
⚫HPC over Container
Cloud
OS OS OS OS OS OS OS
CAP CAP CAP CAP VM
Slurm
mpirun
APP2 APP2
APP1
CAP CAP
Troque
APP1
VM
VM
APP2
Capsule: Container + HPC + Cloud
Performance
Mobility Elasticity
Singularity Rescale
K8S
HPC
Container Cloud
Capsule: https://capsule.sh
⚫ capsule images⚫ amd64 + arm64⚫ ( time + space ) capsule⚫ code + data + config⚫ systemd-nspawn compatible
DEMO:
⚫平台登陆⚫应用商店⚫虚拟集群⚫作业提交⚫文件传输⚫交互操作