14267 Commits

Author SHA1 Message Date
James E. Blair
12709a1c8b Run a docker registry for CI
Change-Id: If9669bb3286e25bb16ab09373e823b914b645f26
2019-02-01 10:12:51 -08:00
James E. Blair
8062f4c1ec Grab container logs at the end of run-base
So that we automatically get container logs for future jobs
which use containers.

Change-Id: I329c67eefb8c6a2ff9a8ce8ef69cc844cef6012a
2019-02-01 10:12:39 -08:00
James E. Blair
22ad414a86 Use stage-output role in system-config-run
This simplifies log collection.

Change-Id: I754637115f8c7469efbc1856e88bbcb6fb83b4ce
Depends-On: https://review.openstack.org/634293
2019-01-31 11:03:25 -08:00
Clark Boylan
df6edc372a Add http vhosts for zuul.o.o
We missed this when adding zuul.opendev.org. The old setup added vhosts
for port 80 and 443. Explicitly add these back in here.

Change-Id: I945d1d82da297a4fb643afc2513928268578a4f4
2019-01-29 15:20:00 -08:00
Clark Boylan
a902797fc9 Add zuul.opendev.org webserver
This adds a toplevel zuul webserver for all opendev tenants. This
leverages new work in puppet-zuul (the depends on below) to configure
multiple vhosts.

This will enable us to add new zuul tenants without needing to
reconfigure webservers after this top level web server is added.

Change-Id: Idca6ade4e9f939486cc06f30ded40894e35da505
Depends-On: https://review.openstack.org/#/c/633586
2019-01-29 09:45:20 -08:00
Zuul
3f9df89e74 Merge "Switch to zuul-jobs docker build jobs" 2019-01-24 02:21:00 +00:00
Zuul
5d9f619b1e Merge "Flexible instance naming for openstackid-dev" 2019-01-23 21:57:00 +00:00
James E. Blair
d145e86f71 Switch to zuul-jobs docker build jobs
There are upstream jobs in zuul-jobs with the docker build playbooks,
so use them.  The system-config jobs are kept so that we don't have
to duplicate the secret stanza.

Change-Id: Iceee55a3d0e8b243549fa988f134b1ea9bb6dac5
2019-01-23 13:44:04 -08:00
Zuul
08a4a0c22a Merge "Prepare for storyboard server replacement" 2019-01-23 18:58:38 +00:00
Jeremy Stanley
5a75bc9c96 Flexible instance naming for openstackid-dev
Use group variables and a node name pattern to divorce the
openstackid-dev service from the instance name of the server which
provides it. Also update the inventory matches to be consistent with
the pattern in the global site manifest.

Change-Id: I335f7ebaa5a446a83a4725bbcc0240f91cd14341
2019-01-23 18:40:32 +00:00
Zuul
51c6427da7 Merge "Correct typo in zuul restart playbook" 2019-01-23 18:27:23 +00:00
James E. Blair
f99b72fd0c Correct typo in zuul restart playbook
This is very confusing when watching the output.

Change-Id: I555f8ac1689192f40af509db1a85890250fda027
2019-01-23 08:53:42 -08:00
Monty Taylor
b78d2f8ed6
Reorder the copy in the python-builder builder image
It really doesn't actually matter, but if we do the apt-get install
before the COPY, it can increase the caching efficiency by a billionth
of a percent.

Depends-On: https://review.openstack.org/632528
Change-Id: I875812c956af1c4739e0986d267a47652bb5e6f3
2019-01-22 19:14:04 +00:00
Zuul
f731bac396 Merge "Install python requirements directly" 2019-01-22 18:20:58 +00:00
Zuul
545921ba7b Merge "Add python-builder docker image" 2019-01-22 18:19:04 +00:00
James E. Blair
208c9dbde7 Update dockerhub credential
We've made separate dockerhub users so we don't have to share
credentials across trust boundaries, nor do we need to define the
jobs which use them centrally.

There is a new opendevzuul user which has access to opendevorg,
use that.

Change-Id: Ia22188255f6e5b0f2ba0cefe20694bdec38c1444
2019-01-21 14:55:32 -08:00
Monty Taylor
d3c6bbc7af
Install python requirements directly
There are cases when an issue has been fixed upstream in a
dependency but not yet released and it is desirable to install
that version in a built image. pbr does not support such urls
in requirements files because releasing software that depends
on unreleased software is quite dangerous.

Update assemble and install-from-bindep to install -r requirements.txt
before installing the actual software so that image builds with
such requirements lines will work.

Change-Id: Ie17a66bdc4ea0609ce4e66051f659cbd829fdd5d
2019-01-21 20:50:43 +00:00
Monty Taylor
0e1cd6ee85
Add python-builder docker image
This is a builder image intended to make it easy to build
images for projects that use pbr and bindep.

Also, build a python-base image for use with python-builder

pbrx installed dumb-init in a base image and used it as an
entrypoint for the image. This is a good pattern that we should
continue. Make a python-base image that can be used in the FROM
line of consuming final images.

Change-Id: I8da39e680e9c5ca0d8f603a2645e83fc3be87a8b
2019-01-21 20:06:42 +00:00
Zuul
67193f6b3e Merge "Migrate OpenStackID dev server to php7" 2019-01-21 15:50:37 +00:00
Jeremy Stanley
628b7cce51 Prepare for storyboard server replacement
Like recently done with storyboard-dev, switch storyboard to a host
group and use an explicit vhost name so that the site can be
divorced from the hostname of the instance providing it.

Change-Id: Iacb91cb6f22dee239bd51347d17c10a7bcb01a33
2019-01-20 18:06:21 +00:00
Zuul
71e8d86244 Merge "Switch StoryBoard database backups to local" 2019-01-20 17:31:29 +00:00
Zuul
c4466665bb Merge "Rename docker role vars" 2019-01-18 20:34:41 +00:00
Zuul
3147334c1a Merge "Upgrade review.o.o to gerrit 2.13.12" 2019-01-18 16:29:06 +00:00
Sebastian Marcet
3d12760e4a Migrate OpenStackID dev server to php7
Update scripts to migrate IDP dev server
to xenial and php7

Depends-On: https://review.openstack.org/631655

Change-Id: I0de414b6f6083016250f284203562ebe0e72193a
2019-01-17 18:49:29 -03:00
James E. Blair
624e454c5a Rename docker role vars
The upstream role var names have changed.  For the better.
Depends-On: https://review.openstack.org/631602

Change-Id: I0a338da98dcfb48cd4207f182f88a043b1370ab6
2019-01-17 11:30:08 -08:00
James E. Blair
a81503921d Set allowed-projects on system-config image jobs
Without this, other projects could run this job (or its descendents)
and pass in an images dictionary instructing it to upload something
to one of our repositories.

Change-Id: I2c68d6673217bbc274c1134ee221cd6484abcf16
2019-01-16 16:29:53 -08:00
Zuul
f917e7696f Merge "Add gerrit image jobs" 2019-01-16 23:13:26 +00:00
Zuul
06c8fe8ba8 Merge "Add gitea image jobs" 2019-01-16 23:13:25 +00:00
Zuul
2cca2cb3d3 Merge "Add gitea-init image jobs" 2019-01-16 22:57:57 +00:00
Zuul
ba3aa3fb9a Merge "Correct auth_openid scope in survey vhost" 2019-01-16 22:49:05 +00:00
Zuul
951ad3d40b Merge "Add jinja-init image jobs" 2019-01-16 22:19:43 +00:00
Clark Boylan
d4c1035856 Upgrade review.o.o to gerrit 2.13.12
Note that we will need to manually delete the .bcp*.backup jar files in
/home/gerrit2/review_site/lib before merging this change. If we don't do
that then the gerrit init step will fail.

This has been tested on review-dev.openstack.org. Please kick the tires
on that server prior to ok'ing this change.

Change-Id: Ia404366a3fef919a406c918c36f241ed3f5d5e74
2019-01-16 14:14:39 -08:00
Zuul
0909d31453 Merge "Add docker image building jobs" 2019-01-16 22:07:00 +00:00
Zuul
e8c42df207 Merge "Remove all docker image building jobs" 2019-01-16 22:06:59 +00:00
Jeremy Stanley
ea66db19f1 Correct auth_openid scope in survey vhost
With the move to Puppet 4, vhost config templates fail to find
relative references to class parameters within a vhost resource
scope. Be explicit about the scope for the auth_openid parameter in
the survey class from within its associated vhost config template so
that it will be correctly found.

Change-Id: I7c769849449b304193e3eb41d129364817d7db1f
2019-01-16 21:49:17 +00:00
Zuul
dca94a66c7 Merge "Build a gerrit image" 2019-01-16 20:22:24 +00:00
James E. Blair
c8571eef3c Add gerrit image jobs
Add jobs to build, upload, and promote a gerrit image to
Docker Hub.  This uses alternative tags, build path, and
build args.

Change-Id: Iea7109f9ee0ec18431f298a2ecc611678a868d6d
Co-Authored-By: Monty Taylor <mordred@inaugust.com>
2019-01-16 11:28:18 -08:00
James E. Blair
bfbf0e347b Add gitea image jobs
Add jobs to build, upload, and promote a gitea image to Docker Hub.
This produces two images (gitea and openssh) from a single Dockerfile
via a multi-stage build.

Change-Id: I8e6136787f75cd69b881b7ac715418c86d356872
2019-01-16 11:28:17 -08:00
James E. Blair
de9e62975a Add gitea-init image jobs
Add jobs to build, upload, and promote a gitea-init image to
Docker Hub.

Change-Id: I7f3ed47ec4c58c118dd3b234a4e20ced3a998999
2019-01-16 11:28:16 -08:00
James E. Blair
31de26ff39 Add jinja-init image jobs
Add jobs to build, upload, and promote a jinja-init image to
Docker Hub.

Change-Id: I493846b672f2a77e63eb78e1fb51c8fefb710990
2019-01-16 11:28:15 -08:00
James E. Blair
7a6ae3aadb Add docker image building jobs
This adds the infrastructure for building docker images: the
credential used to upload to Docker Hub as well as the parent jobs
and playbooks to perform the builds.

Change-Id: I7cbbcdd184c4934f1b0ce5905d9760c732b06aa9
Depends-On: https://review.openstack.org/631078
2019-01-16 11:28:14 -08:00
James E. Blair
9e6a4d327e Remove all docker image building jobs
These will be re-added in followup changes based on the new
zuul-jobs roles.

Change-Id: I0c0691afb180903c573cc1a9eb39590fa58e7ca6
2019-01-16 11:28:07 -08:00
Monty Taylor
b1c4a6d36a Build a gerrit image
The gerrit source dir needs three plugins cloned into
the plugins dir and also a few files updated.

Depends-On: https://review.openstack.org/631007
Change-Id: I56037137d43ee1cea0a4c17e48d09102e1599ddc
2019-01-16 11:27:20 -08:00
Zuul
dff34e57a7 Merge "Add support for per-image build-arg settings" 2019-01-16 18:12:19 +00:00
Clark Boylan
f963225dcd Use correct 2.13.12 war on review-dev
This war is based on merged code and is hosted permanently (unlike the
war hosted on our logs server that we were testing with earlier). If
this ends up being a happy war we'll deploy it to production.

Change-Id: I7a0ca93f0cd7a9eed19172d315000c3b7e4464b7
2019-01-15 14:22:05 -08:00
Monty Taylor
d1a2dfa6f5 Add support for per-image build-arg settings
Change-Id: Ia14397389be0c7178c1879844cd675a3d291a3d0
2019-01-15 09:27:16 -08:00
Zuul
b0731b9840 Merge "Remove trailing slash from googlesource url" 2019-01-15 10:52:38 +00:00
Monty Taylor
c1aa5717cc
Remove trailing slash from googlesource url
This causes a massive sad for zuul, resulting in ability to clone
the repos and indefinitely hung job.

Change-Id: I96b2bd883b63079f5032c5715960c25b61940f16
2019-01-15 09:51:29 +00:00
Zuul
8e3961d32f Merge "Delete change tags from docker image repos" 2019-01-15 04:22:25 +00:00
James E. Blair
a546e25e76 Delete change tags from docker image repos
Whenever we promote an image, delete the change tag for that image
in Docker Hub, and also delete any change tags older than 24 hours
in order to keep the Docker Hub image registry tidy.

Change-Id: Id4654c893963bdb0a364b1132793fe4fb152bf27
2019-01-14 16:51:13 -08:00