●

●

●

●

●

●

●

●

Rally

Shaker

PerfKitBenchmarker

pBench

Graphite

Ansible

Connmon Kibana

Grafana

Elasticsearch

Collectd

●●

●

●

●

●

●

●

●

●

●

●

●○○○

●○○○○

●○○

Setup$ git clone https://github.com/openstack/browbeat.git$ cd browbeat/ansible$ ./generate_tripleo_hostfile.sh <undercloud-ip>$ vi install/group_vars/all.yml $ ansible-playbook -i hosts install/browbeat.ymlMonitoring$ ansible-playbook -i hosts install/collectd-openstack.yml$ ansible-playbook -i hosts install/dashboards-openstack.ymlPerformance Testing$ . browbeat-venv/bin/activate(browbeat-venv)$ cd browbeat/(browbeat-venv)$ vi browbeat-config.yaml(browbeat-venv)$ ./browbeat.py <workload>

Stress Test Analyze Check Tune

Repeat

●

●

●●●

browbeat ── ansible ── install ├── group_vars/all.yml └── roles

●●

# ansible-playbook -i hosts install/elk.yml# ansible-playbook -i hosts install/elk-openstack-client.yml --extra-vars 'elk_server=X.X.X.X'

●●

○○

●○

●●●

○●

●

●

# ansible-playbook -i hosts install/graphite.yml# ansible-playbook -i hosts install/grafana.yml

# ansible-playbook -i hosts install/graphite-docker.yml# ansible-playbook -i hosts install/grafana-docker.yml

●●

○○

●●

●●

●●●

●●●●

●●●

●●

●●●●●

● Collect and store cloud performance results data perpetually

● Easily search and retrieve results data

● Aggregate and Summarize data

● Statistical analysis of results data

● Visualize collected results data

● Make run to run, cloud to cloud and build to build performance comparisons

● Historical data and trends

● Get more value from data

● Ansible○ IT Automation○ Configuration Management

● Elasticsearch○ Distributed, open source search and analytics engine○ Real-time search and analytics capabilities○ Document-Oriented

● Kibana○ Open source data visualization platform○ Real-time summary and charting of streaming data○ Give shape to your data○ Seamless integration with Elasticsearch○ Sophisticated Analytics- slice and dice data

● Why is metadata important?○ Adds value to result data○ Captures configuration details, so you don’t have to take

notes on environment setup○ Captures test setup too along with results○ Validate your tunings

VS

And the best part….ansible-playbook -i hosts install/kibana-visual.yml

VS

96

Browbeat Rally Plugin to boot a server, attach FIP and ping it

Scenario: Create and list routers 1500 times

●●●

(browbeat-venv) [stack@gprfc007 browbeat]$ ./browbeat.py rally

●●●

(browbeat-venv) [stack@gprfc007 browbeat]$ ./browbeat.py -s conf/telemetry-nova-persist-instances.yaml rally

●

●

●

●

●

●