13763 Commits

Author SHA1 Message Date
James E. Blair
a491f80f6f run-base: exclude __pycache__ from logs
We don't need to copy this back over.

Change-Id: I419c9c80526953177f808ad7b180deba9bf0434e
2018-08-30 11:05:49 -07:00
James E. Blair
6dab882147 Refactor run-base jobs
Create a parent run job and inherit from it.  This reduces duplicate
'run' parameters, and corrects the omission of run-post from the
eavesdrop job.

Change-Id: Ib2a21b7190bf3611972097d6db545989cd54b3d4
2018-08-30 10:48:58 -07:00
James E. Blair
09b1ff4bc3 Add system-config-run-eavesdrop
Add a job which runs testinfra for the eavesdrop server.  When we
have a per-hostgroup playbook, we will add it to this job too.

The puppet group is removed from the run-base job because the
groups.yaml file is now used to construct groups (as it does
in production) and will construct the group correctly.

The testinfra iptables module may throw an error if it's run
multiple times simultaneously on the same host.  To avoid this,
stop using parallel execution.

Change-Id: I1a7bab5c14b0da22393ab568000d0921c28675aa
2018-08-30 10:25:23 -07:00
James E. Blair
6de5aee53b run-base: collect ansible configuration
This is helpful for debugging.

Change-Id: I0423dcede48c98379e58edd245842afe3292c0b1
2018-08-30 10:25:19 -07:00
Paul Belanger
20286235b6 Generate junit.xml file for testinfra
And collect it on post, it is helpful to see the results.

Change-Id: I0dbecf57bf9182168eb6f99cdf88329fcdeb1bdc
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-29 12:00:43 -04:00
Zuul
9958b253f3 Merge "Don't git clone system-config in puppet-install" 2018-08-29 00:20:53 +00:00
Paul Belanger
17a8a70643 Don't git clone system-config in puppet-install
Talking to clarkb, it was decided we can remove this logic in favor of
having ansible-role-puppet push system-config and modules to the remote
nodes.

Change-Id: I59b8a713cdf2b4c1fede44e977c49be5e8cc08fa
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-28 19:28:48 -04:00
Paul Belanger
ad0e8bd241 Add profile_tasks and timer callbacks for ansible
These add extra datetime information to tasks, in an effort to help
profile ansible. More info at:

  https://docs.ansible.com/ansible/2.5/plugins/callback/profile_tasks.html
  https://docs.ansible.com/ansible/2.5/plugins/callback/timer.html

Change-Id: Iebd40bfe06484ec1c6f938570eb6cb60e532fb9f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-08-28 18:30:31 -04:00
Zuul
62a74b0630 Merge "Test puppet is installed on base" 2018-08-28 22:21:13 +00:00
Zuul
65f96790cb Merge "Add install-puppet to base playbook" 2018-08-28 22:18:45 +00:00
Zuul
ca5f61ecb5 Merge "allow cr repo mirror for early testing" 2018-08-28 22:10:33 +00:00
Clark Boylan
60d31fc636 Test puppet is installed on base
We need to be able to install puppet in our base ansible as part of the
transition from puppet to other management. Test using testinfra that
our base ansible playbook does install puppet.

Change-Id: I3a080a0717483a0885fefb329a168dd438eb9854
2018-08-28 14:21:08 -07:00
Zuul
70730c0fe3 Merge "Create ansible roles to install puppet" 2018-08-28 20:26:57 +00:00
Zuul
f430b70fd1 Merge "Correct inventory pattern for planet.openstack.org" 2018-08-28 19:48:40 +00:00
Zuul
c6e73b8cb6 Merge "Enable unattended upgrades" 2018-08-28 19:33:11 +00:00
Jeremy Stanley
f119cc5aab Correct inventory pattern for planet.openstack.org
The planet.openstack.org service is currently provided by the
planet01.openstack.org server, so correct the inventory pattern for
the webservers group accordingly. This was spotted as the firewall
rules for planet ceased allowing HTTP/HTTPS connections.

Change-Id: I4e3353e8f1a73db13c54dfe93a6a26fc618d2aa4
2018-08-28 19:01:19 +00:00
Zuul
c5c32ed8f4 Merge "Only run role integration tests on role changes" 2018-08-28 17:16:54 +00:00
Zuul
ea6a11d424 Merge "Add role integration jobs" 2018-08-28 17:08:11 +00:00
David Shrewsbury
6a8707a02d Enable unattended upgrades
Debian gets this from 'unattended-upgrades' and Red Hat family
gets it from yum-cron.

Change-Id: Ie00f6073ad1127b11a89e69816baf47011480dbf
2018-08-28 12:05:15 -04:00
James E. Blair
e37ad40de1 Correct iptables var names
This variable name was translated incorrectly during the transition
from puppet to ansible for iptables.

Change-Id: I865ba7122b215a7f653aa5ed5770a05edbd655a0
2018-08-28 08:45:58 -07:00
Ian Wienand
7bd8117e2a Add install-puppet to base playbook
This role manages puppet on the host and should be applied to all
puppet hosts.

The dependent change is required to get the "puppet" group into the
generated inventory for the system-config-run-base test.

Change-Id: I0e18c53836baca743d32abf1bb4b7a3f63c025bb
Depends-On: https://review.openstack.org/596994
2018-08-28 17:54:09 +10:00
Ian Wienand
ee7faefe08 Create ansible roles to install puppet
Currently our puppet-requiring hosts (all !bridge) do not manage their
puppet installs.  This is OK for existing servers, but new servers
come up without puppet installed.

This is playbooks to manage puppet installs on hosts.  It is mostly a
port of the relevant parts of ./install_puppet.sh for our various
control-plane platforms.

Basic testing with zuul-integration jobs is added.  Using this in the
control-plane base.yaml playbooks will be a follow-on.

Change-Id: Id5b2f5eb0f1ade198acf53a7c886dd5b3ab79816
2018-08-28 16:42:45 +10:00
Ian Wienand
d049cf45fb Only run role integration tests on role changes
Change-Id: I531dd10da459b36e3f2f02d65e8f3baa961aade2
2018-08-28 11:28:42 +10:00
Ian Wienand
7bfb0db43f Add role integration jobs
The top-level roles in roles/* should be usable as roles under Zuul
and as generic Ansible roles (for control plane).

Add an integration job to ensure this.  Start with the kerberos and
afs roles.

Change-Id: I9f5d572d5f69ca4b58e6e62b06fc873fe7a1e2f0
2018-08-28 11:28:42 +10:00
James E. Blair
055f29d8ab Use python2 on centos/trusty in system-config-run-base
This mirrors the group var we set for hosts which run on centos
and trusty.

Change-Id: I5f0f9eee04e45c35566bd4f4990ee527184f4d90
2018-08-27 15:39:16 -07:00
James E. Blair
3d166f99f6 Add unbound role
Add it to the base playbook and add a testinfra test for it.

Change-Id: Id5098f33aac213e6add6f061684d0214dc99ab5b
2018-08-27 13:29:18 -07:00
Zuul
4dfd604936 Merge "Add volume-size flag to launch-node" 2018-08-27 19:17:44 +00:00
Zuul
58b96d6703 Merge "Add VEXXHOST to Ansible cloud layouts" 2018-08-27 16:38:36 +00:00
Zuul
74895df154 Merge "Adding SJC1 for VEXXHOST" 2018-08-27 16:22:48 +00:00
Zuul
973b624427 Merge "Add testinfra test for timezone" 2018-08-27 16:19:24 +00:00
Zuul
52f847013b Merge "Add snmpd role and add it to base" 2018-08-27 16:19:22 +00:00
Zuul
73d61df06d Merge "Add testinfra test for ntp" 2018-08-27 16:19:21 +00:00
Zuul
27b2c7e10b Merge "Add timezone role" 2018-08-27 16:19:19 +00:00
Zuul
ba263fa07e Merge "Add NTP service to base-server" 2018-08-27 16:19:18 +00:00
Zuul
53b308b786 Merge "Add iptables role" 2018-08-27 16:19:16 +00:00
Mohammed Naser
0bb20fc5bf Add VEXXHOST to Ansible cloud layouts
Change-Id: I055df4aa90428db73db9808435bc5a4adc8ad204
2018-08-27 11:50:04 -04:00
Mohammed Naser
1534c42409 Adding SJC1 for VEXXHOST
Change-Id: Ia4bf3fcd576d415418f756cb07609b817d035534
2018-08-27 11:34:53 -04:00
Wes Hayutin
69b78eea04 allow cr repo mirror for early testing
The continuous release centos repo allows
for early testing against pre-released rpms
and updates to minor releases. This is
quite handy when trying to prevent jobs from
going down when CentOS is updated.

https://wiki.centos.org/AdditionalResources/Repositories/CR

Related-Bug: #1788675
Closes-Bug: #1789218
Change-Id: I56e346376976f890899de0cfb47b0612fa5fbb84
2018-08-27 11:25:17 -04:00
David Shrewsbury
faec087e20 Add testinfra test for timezone
Change-Id: Ib02d54eb5b188928906670607d4d2bff80a384f2
2018-08-27 11:21:03 -04:00
Zuul
4bd5095f37 Merge "Scope exim service name variable" 2018-08-27 14:53:04 +00:00
James E. Blair
dceb09d886 Add snmpd role and add it to base
Change-Id: I00bf872e8504efb26d20832f1da82da8cfe87258
2018-08-27 07:34:36 -07:00
James E. Blair
6ec51b4d00 Add testinfra test for ntp
Change-Id: If7b5215edea93d272dc1d0344839756d9f43b2ac
2018-08-27 07:34:30 -07:00
David Shrewsbury
b3b698c6ff Add timezone role
Contains a handler to restart crond when tz is changed. Cron service
name differs across distros.

Removes the puppet-timezone usage.

Change-Id: I4e45d0e0ed37214ac491f373ff2d37750e720718
2018-08-27 07:34:28 -07:00
David Shrewsbury
360e0107a7 Add NTP service to base-server
Removes puppet-side ntp setup.

Change-Id: I75a87ca55fd4b75c5715cc3fd2b708e0b0ae2c20
2018-08-27 07:34:25 -07:00
Monty Taylor
15663daaf7 Add iptables role
Co-Authored-By: James E. Blair <corvus@inaugust.com>
Change-Id: Id8b347483affd710759f9b225bfadb3ce851333c
Depends-On: https://review.openstack.org/596503
2018-08-27 14:33:32 +00:00
Zuul
6c71d80d87 Merge "Add openafs-client role" 2018-08-27 01:39:46 +00:00
Zuul
f52774cc20 Merge "Add kerberos-client role" 2018-08-27 01:39:44 +00:00
James E. Blair
3bc18bc705 Scope exim service name variable
This is used in a handler which may be run after intervening roles;
ensure it has a unique variable name.

Change-Id: I6a3d856d3252ff62220d9769232e31ea7c4f9080
2018-08-24 17:05:03 -07:00
Andreas Jaeger
1c6b4876eb Cleanup docs formatting
Fix indents of some pages, the wrong indent let to gray bars besides
them.

Also, fix a typo and add some markup.

Change-Id: I6e7126ef7b782b376efcc7c6d69c6de9a504ddb5
2018-08-24 22:13:37 +02:00
Zuul
dde24421d0 Merge "Add system-config-run-base to gate" 2018-08-24 19:57:30 +00:00