9762 Commits

Author SHA1 Message Date
Anita Kuno
7a41c18798 Add ci-backup-rs-ord.openstack.org to cacti
Currently the server ci-backup-rs-ord.openstack.org is not on
cacti. While there is a slight risk to the server adding cacti,
the port is already open so we are exposed to the risk without
the benefit. This patch adds the benefit.

Change-Id: Ia5823d73b65f120b725f53e5a6f3da9b68882b82
2016-01-13 12:30:02 -05:00
Jenkins
d11bd740f5 Merge "Add Infra Cloud modules to modules.env" 2016-01-11 22:57:01 +00:00
Jenkins
c3aa7860ad Merge "Allow openstack_citest 'grant option' privilege" 2016-01-11 19:03:50 +00:00
Colleen Murphy
c7466dea40 Allow openstack_citest 'grant option' privilege
The old version of the puppet mysql module defined the "all" privilege
as all the columns in the *_priv rows in the "db" table of the "mysql"
database, which included "Grant_priv". The new version simply uses the
normal MySQL API, which defines the "all" privilege as "Grant all
privileges at specified access level except GRANT OPTION".

In order to get back the old behavior of grant permissions on single use
slaves we use the options parameter with ['GRANT'].

Change-Id: I93b9375de916ca701399aee03dfaa9ab4d197319
2016-01-11 10:00:32 -08:00
Monty Taylor
f1b9b864f7 Translate the rest of run_all.sh to ansible
There are a few things that are run as part of run_all.sh that are
not logged into puppet_run_all.log - namely git cloning, module installation
and ansible role installation. Let's go ahead and do those in a playbook
so that we can see their output while we're watching the log file.

Change-Id: I6982452f1e572b7bc5a7b7d167c1ccc159c94e66
2016-01-10 12:38:22 -05:00
Jenkins
e777d234a7 Merge "Add instructions on how to troubleshoot bots" 2016-01-08 19:52:37 +00:00
James E. Blair
6875fac8b3 Revert "Schedule Gerrit's git garbage collection"
This reverts commit 925083544a688f630630bcfa88c6ab451c2c2c00.

Garbage collection in *Git* is not the same thing as garbage
collection in *Java*.  We're seeing gerrit spend a lot of time in
*Java* garbage collection.  We do not need to adjust *Git* garbage
collection for that.

Change-Id: Ica3cc603d9e0ed68efbb1c7606f3e7d67fddac3c
2016-01-08 09:04:27 -08:00
Jenkins
57301f80e7 Merge "Schedule Gerrit's git garbage collection" 2016-01-08 17:01:04 +00:00
Jenkins
a43847a117 Merge "Add accessDatabase and emailReviewers capabilities" 2016-01-07 20:03:58 +00:00
Jenkins
df2fafecd8 Merge "Add use_hostnames to ansible clouds.yaml" 2016-01-07 20:00:36 +00:00
Colleen Murphy
080f1c7f09 Add Infra Cloud modules to modules.env
Add the Puppet OpenStack modules and their dependencies, if not already
installed, to modules.env.

Change-Id: If6247009ffcc478d5fc0b97db423ee5f8836f051
2016-01-07 11:54:28 -08:00
Spencer Krum
ad0454cdc7 Rename puppet-community to voxpupuli
The organization changed name to remove ambiguity with puppetlabs
official community efforts.

https://voxpupuli.org/blog/2016/01/01/voxpupuli/

Change-Id: Ia5b7f6169dd783b9c6d006fd77d9018d98950877
2016-01-07 10:19:20 -08:00
James E. Blair
ce732f492c Add use_hostnames to ansible clouds.yaml
This is the clouds.yaml file that gets used by the ansible openstack
inventory system.  Setting use_hostnames to true indicates that
generally, our hostnames are expected to be unique, so ansible can
add them to the inventory based on their hostnames rather than their
uuids.  In the case that we have more than one host with the same
hostname, ansible will still favor uuids.

This should cause our logs to be more readable as they will include
hostnames for most of the ansible actions.

Change-Id: Ie4c24317429a8f0ac59729a2065dfae7fc6679d9
2016-01-07 08:39:05 -08:00
Jenkins
37e10bd3de Merge "Add script to downgrade gerrit from 2.10" 2016-01-07 16:17:26 +00:00
Jeremy Stanley
5e41893fd5 Add accessDatabase and emailReviewers capabilities
We're specifying the accessDatabase and emailReviewers capabilities
in our Gerrit 2.11 All-Projects configuration "ACL" so document them
in the usual place.

Change-Id: I1235a8a1d9b9b579860f2d96641bacc99df409d8
2016-01-06 21:18:19 +00:00
Jenkins
f0d7c43ed9 Merge "Add requestsexceptions to proposal slave" 2016-01-06 20:13:45 +00:00
James E. Blair
2bca224b7c Redirect puppet cron output to a log file
The _ansible_ output (mostly consisting of puppet output) is now sent
to the puppet_run_all log file, but there is still quite a bit of
output from ancilary parts of the cron job that just gets sent in
email to infra-root every few minutes.  Send it to a log file.

Change-Id: I1f382b2d376cbfc2eff430c897bd3737fd585373
2016-01-06 08:19:12 -08:00
Jenkins
8e21ec389c Merge "Dynamically schedule for updatepuppet master cron job" 2016-01-05 22:37:47 +00:00
Colleen Murphy
9f74110cb6 Upgrade mysql module to 3.6.1
This patch upgrades the mysql module version as well as upgrading the
usage of that module in openstack_project. This includes:

 - upgrading the syntax to set the root password
 - no longer setting bind_address anywhere since it defaults to 127.0.0.1
 - upgrading the syntax to set the default storage engine using the new
   override_options param
 - upgrading the database and database_grant puppet resources to use the
   mysql_database and mysql_grant types. These types were renamed and
   are now more strict about how the title should look and what
   parameters need to be specified rather than inferred from the title.
   There is also no longer any reason to specify the 'mysql' provider
   since they gave up on the generic database provider idea.

Changes to the system that we can expect:

 - /etc/mysql/my.cnf will have its parameters reordered. The key_buffer
   config parameter was renamed to key_buffer_size and the log_error
   parameter was renamed to log-error. Default values haven't changed.
 - The change in /etc/mysql/my.conf will trigger a mysql restart
 - /root/.my.cnf now adds single quotes around the password value. This
   won't change how mysql or the module reads the value, but puppet
   will report the file as having changed.

This patch should not be merged until a downtime is prepared for the
paste and wiki services.

Change-Id: I8072e0aab03606307505e37fe6fb0c8b18eef854
Depends-On: I3ff754b15eef51c3c86c188647353a4a1d3bfea0
2016-01-04 10:51:50 -08:00
Jenkins
558e4b68b4 Merge "Fix stackforge and github links" 2016-01-04 09:21:03 +00:00
Jenkins
d19dc2a484 Merge "Revert "Add a local MySQL database to paste.o.o"" 2016-01-04 05:15:05 +00:00
Andreas Jaeger
af292f040e Fix stackforge and github links
Fix links to stackforge where content has moved to openstack now, adjust
links to use git.openstack.org instead of github.com since
git.openstack.org is our git master.

Fix also repo name, it's app-catalog.

Change-Id: Iec7cbe11bfc4e3536a0fee5fdc1e7d3e0c9cc321
2016-01-01 14:48:21 +01:00
Jenkins
b0e6dc72e7 Merge "Move cacti hosts to hiera" 2015-12-30 23:02:00 +00:00
Jenkins
7133ef7d0c Merge "Update docs for adding channels to meet/statusbots" 2015-12-30 22:59:16 +00:00
Jenkins
ebec311a6f Merge "Set hiera yaml location in puppet.conf" 2015-12-30 22:55:18 +00:00
Spencer Krum
d13bb31303 Move cacti hosts to hiera
Lists of hosts is data, not code

Change-Id: Iee1912d9031d76b06e613b5a4d095b53ca93b46d
2015-12-30 14:44:49 -08:00
Elizabeth K. Joseph
6de660692b Update docs for adding channels to meet/statusbots
We've moved the long list of channels for statusbot and meetbot (logging) into
the hiera/common.yaml file, updating the documentation accordingly.

Change-Id: I2337de6c82a24fabe0d428ba3a7f40c8d41a62c8
2015-12-30 14:44:25 -08:00
Spencer Krum
e432cdf1a1 Use public hiera for meetbot channels list
This list is data, lets put it in yaml

Change-Id: I6e77ae49c3a0f991d011a3e11e4668dbad349b9f
2015-12-30 21:36:00 +00:00
Monty Taylor
d82e5dede5 Set hiera yaml location in puppet.conf
Puppet 4 from puppetlabs changed the default location of hiera.yaml. The
versions we run have the old location patched in, but let's put in the
value just to be complete.

Change-Id: I36ae190fc6758f297f3a48912f79871fd917c2e9
2015-12-30 15:31:56 -06:00
Spencer Krum
691897db6f Use In-Tree Public Hiera data
Also make the apply-test public-hiera aware

Change-Id: I761bf49ed6279a492cabeca878ec5e7c0fac3d0e
2015-12-30 13:31:17 -08:00
Jenkins
a0d21c1952 Merge "Add openstack-meeting-cp to statusbot" 2015-12-30 20:51:08 +00:00
Jenkins
8f7f3670aa Merge "Add #openstack-net-bgpvpn as a logged channel" 2015-12-30 20:46:57 +00:00
Anita Kuno
6ba1d14ee1 Add openstack-meeting-cp to statusbot
Currently openstack-meeting-cp is not in statusbot's reach. The
other meeting channels have access to statusbot's services. This
patch adds openstack-meeting-cp to statusbot's list of channels.

Change-Id: Id4a12de1bea8fd48f3d234f54e95c23697e83c97
2015-12-30 21:34:46 +01:00
Jenkins
7468814ce4 Merge "Added meetbot for openstack-solar channel for logging purposes" 2015-12-30 20:22:39 +00:00
Jenkins
366b036dfe Merge "Revert "MySQL database cleanup for paste.o.o"" 2015-12-30 14:41:25 +00:00
Jenkins
0d6e037143 Merge "Remove pep8/bashate targets" 2015-12-30 12:42:10 +00:00
Isaac Beckman
3ed891c470 Dynamically schedule for updatepuppet master cron job
Add an option to dynamically set the time interval for
"updatepuppetmaster" cron job. This will enable to tune the update
time interval differentially for different puppet masters, in
different environments, rather than setting them all to 15 min
hardcoded.

Change-Id: Ib71bbb2ff6be1576a45d6809beb1164c79328a60
2015-12-30 13:53:32 +02:00
Tomasz 'Zen' Napierala
b77c495122 Added meetbot for openstack-solar channel for logging purposes
Change-Id: Ic192ab03e786aaa3444c121cbe04e19a4d7f380d
2015-12-30 11:36:09 +01:00
Jeremy Stanley
4d0cea3403 Revert "Add a local MySQL database to paste.o.o"
Remove the local database management on paste.openstack.org now that
it's back to running with a remote Trove database again.

This reverts commit b7e352cc86bb850fa1c4d6b74253e5450165afa2.

Change-Id: I7b8513b427395f610b23e3f226109ea954ee210b
2015-12-29 20:46:58 +00:00
Jeremy Stanley
8cf5b6abd5 Revert "MySQL database cleanup for paste.o.o"
Now that we've determined how to adjust Trove configuration
parameters to override extremely short default connection timeouts
imposed by our provider, switch back to using a remote database for
the loggeit installation on paste.openstack.org.

This reverts commit 8cad8d737f3a53650159ab7c00cb8e3b4649e2fb.

Change-Id: I7f172b2b4f09703f1360aff0b1fef902fc935067
2015-12-29 20:41:07 +00:00
Khai Do
925083544a Schedule Gerrit's git garbage collection
We are seeing that Gerrit is spending a lot of time garbage collecting,
possibily because the JVM is starting the garbage collection too late
and thus trying to garbage collect too much.  This change schedules the
garbage collection daily which will allow Gerrit to garbage collect
in smaller chunks.  Hopefully this will help maintain Gerrit performance.

Garbage collection recommendations from Collabnet[1]:
"Running JGIT gc frequently is crucial for good fetch/push performance
as well as smooth source code browsing".

[1] http://tinyurl.com/q2aw6ba

Change-Id: If9f5d5879cffc5c6349166a70b4e00429b59576b
depends-on: I73166de7008ceb42db3db4a8b22fb6e9c94e790d
2015-12-28 22:18:31 -08:00
Jenkins
27b040913a Merge "Allow java to allocate more memory for Gerrit" 2015-12-29 00:57:36 +00:00
Khai Do
e1c7af446f Allow java to allocate more memory for Gerrit
We are seeing Gerrit spending lots of time garbage collecting due
to low memory.  Increase the memory to help avoid this problem.

Memory recommendations from Collabnet[1]:
"You should have at least <#Cores> GB size heap allocated for Gerrit.
The largest repository on disk should fit in 1/4 of your heap.  32 GB
per 1M daily requests is pretty common".

[1] http://tinyurl.com/q2aw6ba

Change-Id: I67adb239bcb689c2b8764047fd1afefe38911c70
2015-12-28 12:22:32 -08:00
Andreas Jaeger
6af9364e68 Remove pep8/bashate targets
These targets are now part of the linters environment, so can be
removed.

Change-Id: I2bfdac672b3d1d375e098e9b38371935a6f208fe
2015-12-28 19:43:23 +01:00
Jenkins
27b0a8800c Merge "Test for sorted modules as part of linting" 2015-12-28 17:30:12 +00:00
Jenkins
50bc7961b2 Merge "Create linters test target" 2015-12-28 17:25:52 +00:00
Yolanda Robla
890a56d1b9 Add instructions on how to troubleshoot bots
Change-Id: I18ed46a1f1a87d6545541502f499eeab5e80c692
2015-12-28 09:41:15 +01:00
Evgeniy L
f1bab0670e Add statusbot/eavesdrop to #openstack-bareon channel
Change-Id: Ifb35e374800b82bcd9daea0255907e109abd95b6
2015-12-24 11:38:22 +03:00
Jenkins
374775e304 Merge "Add statusbot/eavesdrop to #congress channel" 2015-12-23 22:15:30 +00:00
Jenkins
d15d79e822 Merge "Move eavesdrop bot from #akanda->#openstack-astara" 2015-12-23 22:07:39 +00:00