Skip to content

Commit bb6ca1e

Browse files
committed
Kakfa & Elastic Deployement Added
1 parent af44753 commit bb6ca1e

File tree

30 files changed

+404
-1
lines changed

30 files changed

+404
-1
lines changed

README.md

Lines changed: 33 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,4 +2,36 @@
22
Big Data Decisional Benchmark
33

44

5-
![alt text](./doc/img/benchmark.png)
5+
![alt text](./doc/img/benchmark.png)
6+
7+
## BDBench Installation
8+
9+
### Requirements
10+
11+
- Java 1.8
12+
13+
14+
### Steps
15+
16+
17+
1. Install **Ansible** :
18+
19+
http://docs.ansible.com/ansible/latest/installation_guide/intro_installation.html
20+
21+
2. Active the Remove Session in your Mac Configuration
22+
23+
`Préférences Système > Partage > Coche "Session à distance"`
24+
25+
3. create your ssh public key :
26+
27+
`ssh-keygen`
28+
29+
4. add your public Key to your Host
30+
31+
`ssh-copy-id localhost`
32+
33+
5. test Ansible Installation
34+
35+
`ansible localhost -m ping`
36+
37+

benchmark-installation/ansible.cfg

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
[defaults]
2+
3+
inventory = ./inventory
4+
roles_path = ./roles
5+
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
kafka_install_parent_dir: /Users/mehdi/kafka/
2+
elasticsearch_install_parent_dir: /Users/mehdi/elasticsearch/
3+
logstash_install_parent_dir: /Users/mehdi/logstash/
4+
kibana_install_parent_dir: /Users/mehdi/kibana/
5+

benchmark-installation/inventory

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
node1 ansible_ssh_host=localhost
2+
3+
4+
[elasticsearch-nodes]
5+
node1
6+
7+
[logstash-nodes]
8+
node1
9+
10+
[kibana-nodes]
11+
node1
12+
13+
[kakfa-nodes]
14+
node1
15+

benchmark-installation/main.yml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
- hosts: kakfa-nodes
2+
roles:
3+
- { role: kafka.install}
4+
5+
- hosts: elasticsearch-nodes
6+
roles:
7+
- { role: elasticsearch.install}
8+
9+
- hosts: logstash-nodes
10+
roles:
11+
- { role: logstash.install}
12+
13+
- hosts: kibana-nodes
14+
roles:
15+
- { role: kibana.install}
Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
Command to generate this Ansible Role
2+
=========
3+
4+
ansible-galaxy init bdbench-install
5+
6+
Role Name
7+
=========
8+
9+
A brief description of the role goes here.
10+
11+
Requirements
12+
------------
13+
14+
Any pre-requisites that may not be covered by Ansible itself or the role should be mentioned here. For instance, if the role uses the EC2 module, it may be a good idea to mention in this section that the boto package is required.
15+
16+
Role Variables
17+
--------------
18+
19+
A description of the settable variables for this role should go here, including any variables that are in defaults/main.yml, vars/main.yml, and any variables that can/should be set via parameters to the role. Any variables that are read from other roles and/or the global scope (ie. hostvars, group vars, etc.) should be mentioned here as well.
20+
21+
Dependencies
22+
------------
23+
24+
A list of other roles hosted on Galaxy should go here, plus any details in regards to parameters that may need to be set for other roles, or variables that are used from other roles.
25+
26+
Example Playbook
27+
----------------
28+
29+
Including an example of how to use your role (for instance, with variables passed in as parameters) is always nice for users too:
30+
31+
- hosts: servers
32+
roles:
33+
- { role: username.rolename, x: 42 }
34+
35+
License
36+
-------
37+
38+
BSD
39+
40+
Author Information
41+
------------------
42+
43+
An optional section for the role authors to include contact information, or a website (HTML is not allowed).
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
---
2+
# defaults file for bdbench-install
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
---
2+
# handlers file for bdbench-install
Lines changed: 57 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,57 @@
1+
galaxy_info:
2+
author: your name
3+
description: your description
4+
company: your company (optional)
5+
6+
# If the issue tracker for your role is not on github, uncomment the
7+
# next line and provide a value
8+
# issue_tracker_url: http://example.com/issue/tracker
9+
10+
# Some suggested licenses:
11+
# - BSD (default)
12+
# - MIT
13+
# - GPLv2
14+
# - GPLv3
15+
# - Apache
16+
# - CC-BY
17+
license: license (GPLv2, CC-BY, etc)
18+
19+
min_ansible_version: 1.2
20+
21+
# If this a Container Enabled role, provide the minimum Ansible Container version.
22+
# min_ansible_container_version:
23+
24+
# Optionally specify the branch Galaxy will use when accessing the GitHub
25+
# repo for this role. During role install, if no tags are available,
26+
# Galaxy will use this branch. During import Galaxy will access files on
27+
# this branch. If Travis integration is configured, only notifications for this
28+
# branch will be accepted. Otherwise, in all cases, the repo's default branch
29+
# (usually master) will be used.
30+
#github_branch:
31+
32+
#
33+
# platforms is a list of platforms, and each platform has a name and a list of versions.
34+
#
35+
# platforms:
36+
# - name: Fedora
37+
# versions:
38+
# - all
39+
# - 25
40+
# - name: SomePlatform
41+
# versions:
42+
# - all
43+
# - 1.0
44+
# - 7
45+
# - 99.99
46+
47+
galaxy_tags: []
48+
# List tags for your role here, one per line. A tag is a keyword that describes
49+
# and categorizes the role. Users find roles by searching for tags. Be sure to
50+
# remove the '[]' above, if you add tags to this list.
51+
#
52+
# NOTE: A tag is limited to a single word comprised of alphanumeric characters.
53+
# Maximum 20 tags per role.
54+
55+
dependencies: []
56+
# List your role dependencies here, one per line. Be sure to remove the '[]' above,
57+
# if you add dependencies to this list.
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
---
2+
# tasks file for bdbench-install
3+
4+
- name: Create the hosts file for all machines
5+
debug:
6+
msg: "System : {{ inventory_hostname }} "

0 commit comments

Comments
 (0)