1. Results of measuring performance of Mesos Marathon

Abstract

This document includes performance test results for Mesos as a container platform for Docker with Marathon. All tests have been performed regarding Measuring performance of container cluster systems

1.1. Environment description

1.1.1. Cluster description

  • 3 master nodes with Mesos, Marathon and Zookeeper

  • 189 mesos slaves nodes

1.1.2. Software versions

  • Mesos - 0.27.0

  • Marathon - 0.15.2

  • Zookeeper - 3.4.5

  • Docker - 1.10.2

1.1.3. Running options

  • Marathon extra options are “-Xmx2048m –max_tasks_per_offer 20”

1.1.4. Hardware configuration of each server

Description of servers hardware

server

vendor,model

HP,DL380 Gen9

operating_system

3.13.0-76-generic
Ubuntu-trusty
x86_64

CPU

vendor,model

Intel,E5-2680 v3

processor_count

2

core_count

12

frequency_MHz

2500

RAM

vendor,model

HP,752369-081

amount_MB

262144

NETWORK

interface_name

p1p1

vendor,model

Intel,X710 Dual Port

bandwidth

10G

STORAGE

dev_name

/dev/sda

vendor,model

raid10 - HP P840
12 disks EH0600JEDHE

SSD/HDD

HDD

size

3,6TB

1.1.5. Network scheme and part of configuration of hardware network switches

Network scheme of the environment:

Network Scheme of the environment

Here is the part of switch configuration for each switch port which connected to p1p1.603 interface of a server:

switchport mode trunk
switchport trunk native vlan 600
switchport trunk allowed vlan 600-602,630-649
spanning-tree port type edge trunk
spanning-tree bpduguard enable
no snmp trap link-status

1.2. Results

1.2.1. Test create

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

6.15

6.15

6.15

6.15

1

100

6.09

6.09

6.09

6.09

1

500

14.18

14.18

14.18

14.18

2

50

6.08

6.1

6.09

6.09

2

100

6.09

6.12

6.11

6.105

2

500

20.3

22.27

21.29

21.285

4

50

6.15

16.2

11.66

12.155

4

100

6.24

16.19

10.24

9.26

4

500

28.39

38.42

33.13

32.86

8

50

8.11

12.24

10.16

10.16

8

100

6.46

16.25

12.08

13.185

8

500

29.12

83.03

58.19

58.06

16

50

8.12

20.36

12.88

13.22

16

100

9.02

26.39

19.3

20.28

16

500

130.43

453.85

296.59

320.07

Graph for test create, concurrency 1

Graph for test create, concurrency 1

Graph for test create, concurrency 2

Graph for test create, concurrency 2

Graph for test create, concurrency 4

Graph for test create, concurrency 4

Graph for test create, concurrency 8

Graph for test create, concurrency 8

Graph for test create, concurrency 16

Graph for test create, concurrency 16

1.2.2. Test delete

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

0.01

0.01

0.01

0.01

1

100

0.01

0.01

0.01

0.01

1

500

0.01

0.01

0.01

0.01

2

50

0.01

0.02

0.01

0.01

2

100

0.02

0.02

0.02

0.02

2

500

0.01

0.02

0.01

0.01

4

50

0.02

0.03

0.03

0.03

4

100

0.02

0.03

0.03

0.03

4

500

0.02

0.04

0.03

0.04

8

50

0.04

0.05

0.04

0.04

8

100

0.04

0.05

0.05

0.05

8

500

0.05

0.07

0.06

0.07

16

50

0.12

0.13

0.12

0.12

16

100

0.09

0.11

0.1

0.1

16

500

0.13

0.15

0.14

0.14

Graph for test delete, concurrency 1

Graph for test delete, concurrency 1

Graph for test delete, concurrency 2

Graph for test delete, concurrency 2

Graph for test delete, concurrency 4

Graph for test delete, concurrency 4

Graph for test delete, concurrency 8

Graph for test delete, concurrency 8

Graph for test delete, concurrency 16

Graph for test delete, concurrency 16

1.2.3. Test restart

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

500

28.63

28.63

28.63

28.63

2

50

8.51

8.53

8.52

8.52

2

100

14.47

16.59

15.53

15.53

2

500

28.81

30.83

29.82

29.82

4

50

10.56

12.53

11.07

10.59

4

100

12.74

28.65

18.19

15.69

4

500

63.31

75.2

68.69

68.12

8

50

12.75

22.68

17.18

16.64

8

100

26.73

38.87

31.54

30.755

8

500

433.62

441.69

439.17

439.505

16

50

19.36

30.86

23.32

22.73

16

100

45.8

63.07

51.96

51.35

16

500

605.63

1204.02

709.46

646.73

Graph for test restart, concurrency 2

Graph for test restart, concurrency 2

Graph for test restart, concurrency 4

Graph for test restart, concurrency 4

Graph for test restart, concurrency 8

Graph for test restart, concurrency 8

Graph for test restart, concurrency 16

Graph for test restart, concurrency 16

1.2.4. Test update_cpu

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

12.51

12.51

12.51

12.51

1

100

12.56

12.56

12.56

12.56

1

500

22.63

22.63

22.63

22.63

2

50

6.51

8.49

7.5

7.5

2

100

14.53

16.58

15.55

15.555

2

500

20.73

26.72

23.73

23.725

4

50

8.52

14.56

11.52

11.5

4

100

14.6

71.14

30.77

18.67

4

500

47.03

55.09

50.56

50.06

8

50

8.56

26.71

16.61

16.59

8

100

18.65

32.73

24.67

24.655

8

500

219.0

249.28

239.4

243.815

16

50

16.63

32.78

22.68

22.68

16

100

37.56

44.87

41.58

40.95

16

500

610.82

1205.25

883.32

736.29

Graph for test update_cpu, concurrency 1

Graph for test update_cpu, concurrency 1

Graph for test update_cpu, concurrency 2

Graph for test update_cpu, concurrency 2

Graph for test update_cpu, concurrency 4

Graph for test update_cpu, concurrency 4

Graph for test update_cpu, concurrency 8

Graph for test update_cpu, concurrency 8

Graph for test update_cpu, concurrency 16

Graph for test update_cpu, concurrency 16

1.2.5. Test update_disk

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

10.48

10.48

10.48

10.48

1

100

16.59

16.59

16.59

16.59

1

500

26.65

26.65

26.65

26.65

2

50

8.52

12.56

10.54

10.54

2

100

14.56

26.61

20.59

20.585

2

500

26.67

28.68

27.68

27.675

4

50

10.56

20.55

14.05

12.555

4

100

12.59

20.63

17.6

18.59

4

500

53.01

55.1

53.58

53.1

8

50

10.67

26.75

19.66

19.635

8

100

15.18

20.68

17.99

17.705

8

500

395.82

441.34

415.5

402.97

16

50

15.0

32.79

24.62

24.705

16

100

44.19

50.94

47.14

46.995

16

500

426.87

1204.53

731.92

610.83

Graph for test update_disk, concurrency 1

Graph for test update_disk, concurrency 1

Graph for test update_disk, concurrency 2

Graph for test update_disk, concurrency 2

Graph for test update_disk, concurrency 4

Graph for test update_disk, concurrency 4

Graph for test update_disk, concurrency 8

Graph for test update_disk, concurrency 8

Graph for test update_disk, concurrency 16

Graph for test update_disk, concurrency 16

1.2.6. Test update_instances

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

600.05

600.05

600.05

600.05

1

100

16.17

16.17

16.17

16.17

1

500

600.31

600.31

600.31

600.31

2

50

10.12

600.11

305.12

305.115

2

100

14.16

600.19

307.18

307.175

2

500

600.72

601.09

600.9

600.905

4

50

10.13

600.17

452.65

600.155

4

100

14.18

600.36

308.75

310.225

4

500

39.4

602.01

461.02

601.33

8

50

20.24

600.4

323.46

336.595

8

100

18.23

600.79

169.8

28.68

8

500

150.94

603.91

546.72

603.255

16

50

14.25

600.72

276.17

32.375

16

100

24.24

601.53

351.71

601.0

16

500

603.1

1206.38

1016.9

1203.81

Graph for test update_instances, concurrency 1

Graph for test update_instances, concurrency 1

Graph for test update_instances, concurrency 2

Graph for test update_instances, concurrency 2

Graph for test update_instances, concurrency 4

Graph for test update_instances, concurrency 4

Graph for test update_instances, concurrency 8

Graph for test update_instances, concurrency 8

Graph for test update_instances, concurrency 16

Graph for test update_instances, concurrency 16

1.2.7. Test update_mem

CONCURRENCY

NODES_NUMBER_PER_APPLICATION

APPLICATION_OPERATION (sec)

minimum

maximum

average

median

1

50

8.58

8.58

8.58

8.58

1

100

10.55

10.55

10.55

10.55

1

500

22.68

22.68

22.68

22.68

2

50

10.46

10.48

10.47

10.47

2

100

10.54

14.5

12.52

12.52

2

500

26.6

26.76

26.68

26.68

4

50

10.51

10.55

10.54

10.54

4

100

10.57

18.65

16.59

18.575

4

500

56.96

69.29

63.66

64.2

8

50

18.61

22.74

21.16

20.695

8

100

15.1

26.77

21.26

20.7

8

500

294.84

304.16

300.42

300.86

16

50

13.92

24.67

19.78

21.645

16

100

39.57

49.03

41.95

41.24

16

500

498.57

1204.44

666.49

624.195

Graph for test update_mem, concurrency 1

Graph for test update_mem, concurrency 1

Graph for test update_mem, concurrency 2

Graph for test update_mem, concurrency 2

Graph for test update_mem, concurrency 4

Graph for test update_mem, concurrency 4

Graph for test update_mem, concurrency 8

Graph for test update_mem, concurrency 8

Graph for test update_mem, concurrency 16

Graph for test update_mem, concurrency 16

1.2.8. Test health check

CONTAINERS_COUNT

HEALTH_CHECK_INTERVAL_DEVIATION (sec)

minimum

maximum

average

95%

2500

0.00

0.12

0.02

0.04