14826 Commits

Author SHA1 Message Date
James E. Blair
860652fedf Add gitea docs
This is based on the recently removed cgit document, but updated
for gitea.

Change-Id: I4bb1f4b9485d15c412e4882ccc0baf031aeba87b
2019-05-29 08:06:29 -07:00
James E. Blair
a92ac59e15 Fix new mirror system errors
Fix the reported stat name for the mirror playbook.

Run the mirror job in gate.

Set follow=false so that we're telling Ansible to set the perms
on the link rather than the target (which is the default).

Change-Id: Id594cf3f7ab1dacae423cd2b7e158a701d086af6
2019-05-24 09:42:38 -07:00
Zuul
5e908c739b Merge "Move openSUSE Tumbleweed into a caching mirror instead" 2019-05-24 08:01:38 +00:00
Zuul
528a1f7e16 Merge "Cleanup bashate errors to make them easier to understand" 2019-05-24 07:10:12 +00:00
Dirk Mueller
b3ce1c52dc Move openSUSE Tumbleweed into a caching mirror instead
Tumbleweed is only rarely used in the openStack CI, so mirroring it
fully is not worth the time/space overhead. a caching proxy
should be good enough. Add it to the directories to clean up
and remove the older entries because they will no longer be
matching.

Change-Id: I987da098cf4a7330cdec8da9ae3cfbff2f330bf8
2019-05-24 16:19:40 +10:00
Zuul
098425a4a7 Merge "Use --no-cache-dir with pip" 2019-05-23 22:29:00 +00:00
Zuul
406d8fc614 Merge "Clean up apt cache" 2019-05-23 22:09:54 +00:00
Clark Boylan
926ba11184 Cleanup bashate errors to make them easier to understand
We ignore E006 which is line lenght longer than 79 characters. We don't
actually care about that. Fix E042 in run_all.sh this represents a
potential real issue in bash as it will hide errors.

This makes the bashate output much cleaner which should make it easier
for people to understand why it fails when it fails in check.

Change-Id: I2249b76e33003b57a1d2ab5fcdb17eda4e5cd7ad
2019-05-23 14:00:37 -07:00
Zuul
82ae6524ba Merge "Remove the ask.openstack.org inventory entry" 2019-05-23 20:50:35 +00:00
Zuul
058e62a99f Merge "Remove groups configuration" 2019-05-23 20:50:18 +00:00
Clark Boylan
0848e0760b Remove the ask.openstack.org inventory entry
This trusty server has been replaced by xenial ask01.openstack.org.

Change-Id: I33090c9ce45982e19d4ef85c156e76e7583a07af
2019-05-23 12:20:09 -07:00
Clark Boylan
08152aa22f Remove groups configuration
This removes the groups servers from our inventory as well as our
manifests/modules. We don't run the groups service anymore as many
groups migrated to meetup.com independent of us and the others have
transitioned there.

Change-Id: I7cb76611e6d30e7189821923f36a38dec9ea7241
2019-05-23 12:20:04 -07:00
Zuul
509ec18dc9 Merge "Omnibus rename repo playbook fixes" 2019-05-23 18:17:00 +00:00
Zuul
f671c38fa7 Merge "Push all refs to gitea" 2019-05-23 17:07:39 +00:00
Monty Taylor
69f618d36c Disable openid login and signup
This is not a feature we're intending to support at the current
time.

Change-Id: Ie33c266c8ebcaeb471066b52ce37c56c04f93e5d
2019-05-23 10:32:01 -05:00
James E. Blair
03232d51ce Push all refs to gitea
The current version wil now skip performing expensive operations
on unknown refs, so it is safe to push refs/notes and refs/changes
to gitea.

Change-Id: I8f08f3341e0ff603f8579870bd862b5fd6c5a9c1
2019-05-23 07:09:49 -07:00
Zuul
5fca87512e Merge "Properly mirror the lxc container images as well" 2019-05-23 10:13:43 +00:00
Zuul
01dfccbd99 Merge "Drop tools/owners.py" 2019-05-23 07:57:48 +00:00
Zuul
62c06cc3e9 Merge "Remove unused commit-filter script" 2019-05-23 07:55:31 +00:00
Zuul
9e75dbd53b Merge "Switch to upstream and upgrade gitea to current master (pre-1.9.0)" 2019-05-23 01:15:17 +00:00
James E. Blair
ead3f63649 Switch to upstream and upgrade gitea to current master (pre-1.9.0)
The current gitea master has our change to avoid indexing extra
refs, so we can start replicating refs/changes and refs/notes to
it.  It also fixes a bug we observed when viewing the index of
the starlingx/integ repo.

This also switches us back to the upstream repo, though since
we're using an intermediate commit, the version displayed in
the web ui will be "6eb53ac570ab9af51fc9cbd79f1db782edce57e0".

The docker entrypoint script has moved, so the Dockerfile is updated
to reflect that.

Change-Id: I47769fc1ca62a39122d96a1fc0c1bfc2caca6a4f
2019-05-22 15:14:01 -07:00
Zuul
e38c56757f Merge "Update key for SotK" 2019-05-22 21:42:14 +00:00
Zuul
60107e75ed Merge "Update references to OpenDev Zuul" 2019-05-22 19:14:17 +00:00
Adam Coldrick
e9b2ca3774 Update key for SotK
Change-Id: Ic0ca12a5036fb9025f05c2a9c267da84af62dafc
2019-05-22 20:09:08 +01:00
Zuul
0ae85ed7bb Merge "Use local fork of gitea and upgrade to 1.8.0" 2019-05-22 16:58:09 +00:00
Monty Taylor
40e3cf3c5e Update references to OpenDev Zuul
The GitHub app has been updated to be called OpenDev Zuul. Update
the docs accordingly.

Change-Id: I384f84d2d291e82c2062b116c77f1b062a009907
2019-05-22 11:16:23 -05:00
Zuul
2c78db0146 Merge "letsencrypt : use date call for serial number" 2019-05-22 07:44:12 +00:00
Ian Wienand
93bb1d549e letsencrypt : use date call for serial number
Per [1] ansible_date_time is NOT actually the date/time -- it is the
time cached from the facts.  It seems this can not be changed because,
of course, things have started depending on this behaviour.

This is particuarly incorrect if you're using this as a serial number
for DNS and it is not incrementing across runs, and thus bind is
refusing to load the new entries in the acme.opendev.org zone during
letsencrypt runs, and the TXT authentication fails.

Use the suggested work-around in the issue which is an external call
to date.

[1] https://github.com/ansible/ansible/issues/22561

Change-Id: Ic3f12f52e8fbb87a7cd673c37c6c4280c56c2b0f
2019-05-22 16:41:51 +10:00
Zuul
afc8e507af Merge "mirror01.dfw.rax.opendev.org : use python3 for ansible" 2019-05-22 01:26:03 +00:00
Ian Wienand
2e9992af9e mirror01.dfw.rax.opendev.org : use python3 for ansible
This is a bionic host, so requires this to run as it has no
/usr/bin/python.  This is the same as the other bionic hosts, I just
forgot it.

Change-Id: Ifdd1df2fa83dd25dcc20596ce17e2f0c88279c62
2019-05-22 10:03:11 +10:00
Zuul
41c06cdf49 Merge "Bringup mirror01.dfw.rax.opendev.org" 2019-05-21 23:42:57 +00:00
Zuul
066a87441e Merge "Add more /s to puppet:/// url for jetty shim deb" 2019-05-21 23:32:42 +00:00
Zuul
46c09946b4 Merge "Adds new key for diablo_rojo" 2019-05-21 23:01:30 +00:00
Zuul
54c72ab7b9 Merge "Create opendev mirrors" 2019-05-21 23:01:28 +00:00
Clark Boylan
2eefb60457 Add more /s to puppet:/// url for jetty shim deb
We only had two and need three.

Change-Id: If1d952867b7a662278e8a4c900322b9266f4e1c6
2019-05-21 15:03:06 -07:00
Kendall Nelson
ddc677db19 Adds new key for diablo_rojo
Change-Id: I3805ebcf613ba4459efe0bc28f6c4b0283eb12df
2019-05-22 00:01:16 +02:00
Ian Wienand
dabe6e2768 ask.o.o : fix jetty package install
I'm certain I copied this from somewhere out of date; it should be
"ensure" not "state" for puppet4

Change-Id: I18272db219a7d047bc58728b1d09355fd0100881
2019-05-22 06:45:37 +10:00
Zuul
05300b6268 Merge "Update ask.openstack.org to puppet 4" 2019-05-21 19:35:04 +00:00
James E. Blair
70b8118ab0 Use local fork of gitea and upgrade to 1.8.0
This has a few emergency local patches while we wait for them to
appear in an upstream release.

This updates the modified templates to match the changes in 1.8.0
upstream.

This also disables the oauth2 service, which is new in 1.8.0.
Without disabling this, gitea tries to generate a JWT secret and
write it to the file, which in our case is read only. If we want
to enable it, we need to add a new JWT_SECRET setting.

Change-Id: I969682bce6ff25b7614ce9265097307ee9cbc6cb
Co-Authored-By: Monty Taylor <mordred@inaugust.com>
2019-05-21 12:16:21 -05:00
Zuul
bd20f23f0b Merge "Revert "Pin skopeo to unbreak skopeo+bubblewrap"" 2019-05-21 15:53:17 +00:00
Zuul
e740439103 Merge "ask.o.o : workaround old puppet-solr package" 2019-05-21 08:39:30 +00:00
Zuul
82e498fb59 Merge "Remove ask-staging* from disabled list" 2019-05-21 08:39:28 +00:00
Zuul
dd2d9b141e Merge "ask.openstack.org: switch backup user to ask01-bup" 2019-05-21 08:19:23 +00:00
Zuul
41f6aa7275 Merge "Add #starlingx to statusbot channels" 2019-05-21 08:19:21 +00:00
Ian Wienand
3fa721e541 ask.openstack.org: switch backup user to ask01-bup
The new server has new backups

Change-Id: I59ac068e8d049c1293de47979cdbe6f202fad3c6
2019-05-21 17:33:17 +10:00
Zuul
79d473614d Merge "launch.py : fix typo calling legacy dns print function" 2019-05-21 01:38:50 +00:00
Ian Wienand
73bbc6787f Bringup mirror01.dfw.rax.opendev.org
This is an initial host for testing opendev.org mirrors

Change-Id: I26b9ed1e21e2111f48bc7ecc384880c274eed213
Depends-On: https://review.opendev.org/660235
2019-05-21 11:08:30 +10:00
Ian Wienand
670107045a Create opendev mirrors
This impelements mirrors to live in the opendev.org namespace.  The
implementation is Ansible native for deployment on a Bionic node.

The hostname prefix remains the same (mirrorXX.region.provider.) but
the groups.yaml splits the opendev.org mirrors into a separate group.
The matches in the puppet group are also updated so to not run puppet
on the hosts.

The kerberos and openafs client parts do not need any updating and
works on the Bionic host.

The hosts are setup to provision certificates for themselves from
letsencrypt.  Note we've added a new handler for mirror nodes to use
that restarts apache on certificate issue/renewal.

The new "mirror" role is a port of the existing puppet mirror.pp.  It
installs apache, sets up some modules, makes some symlinks, sets up a
cleanup cron job and installs the apache vhost configuration.

The vhost configuration is also ported from the extant puppet.  It is
simplified somewhat; but the biggest change is that we have extracted
the main port 80 configuration into a macro which is applied to both
port 80 and 443; i.e. the host will have SSL support.  The other ports
are left alone for now, but can be updated in due course.

Thus we should be able to CNAME the existing mirrors to new nodes, and
any existing http access can continue.  We can update our mirror setup
scripts to point to https resources as appropriate.

Change-Id: Iec576d631dd5b02f6b9fb445ee600be060f9cf1e
2019-05-21 11:08:25 +10:00
Zuul
60f47bf05e Merge "Add testinfra master to -devel job" 2019-05-20 22:43:56 +00:00
Zuul
695a064036 Merge "Remove grafana01.openstack.org from inventory" 2019-05-20 22:23:33 +00:00