2166 Commits

Author SHA1 Message Date
Matt McEuen
2b429eb810 Add kubectl-wait-cluster-ephemeral phase
This adds a phase to wait for the target cluster to become initialized,
directed at the ephemeral management cluster.  It re-uses the helper script
already used by the `kubectl-wait-cluster-target` phase, adds parameterization
so that it can watch for both controlPlaneInitialized and controlPlaneReady
conditions, and adds the new phase to the phase plan.

Lack of this waiting was causing errors in some environments.

This also adds a kubectl-wait-node-target phase definition,
in case we ever want to make use of it.

Change-Id: Ic18742dd59a7901b0d985b8c11260bc1b3527a30
2021-07-19 19:41:07 -05:00
Matt McEuen
e2e8732fed Bump up timeouts for treasuremap's sake
Treasuremap virtualized testing is failing frequently due to timeouts:
- very frequently for workload deployment
- occasionally for controlplane deployment

This bumps both timeouts to unblock gating.

Change-Id: Ie26438afe65f2a5a123527e8c2a1bdec04cb04fe
2021-07-13 14:15:07 +00:00
Zuul
a152567e2b Merge "Update flux components" 2021-07-13 00:46:38 +00:00
Zuul
5c889d291d Merge "Update virtualized testing env docs" 2021-07-12 21:56:54 +00:00
Zuul
798272c409 Merge "Add helmcharts and helmrepositories to log collection" 2021-07-12 21:56:50 +00:00
bijayasharma
2278f01bf0 Fixed error message and typos in docs file
* This commit will fix capitalization of error message in
  templater.go file
* And will also fix typos in some of the docs file

Signed-off-by: bijayasharma <vetbijaya@gmail.com>
Change-Id: Ic37df3151c33559db971fc85a41c540281828de0
2021-07-12 12:39:06 +00:00
Andrii Ostapenko
42892a035c
Add helmcharts and helmrepositories to log collection
Change-Id: I58c8c3b62191732bc4657e09f8c796f0635b0c0c
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-07-11 15:02:34 -06:00
Zuul
3544c96249 Merge "Remove secret generate cmd and its implementation" 2021-07-10 07:43:58 +00:00
Sean Eagan
7c4e6c3036 Update flux components
helm-controller: v0.11.1
source-controller: v0.15.3

This brings in an increase in the default leader election
deadlines, in order to hopefully reduce the impact of any
cluster instability during reconciliations, particularly
with helm releases getting stuck in pending state:

[0]: https://github.com/fluxcd/pkg/issues/94
[1]: https://github.com/fluxcd/helm-controller/issues/149

Signed-off-by: Sean Eagan <seaneagan1@gmail.com>
Change-Id: I8e989aead88ffde7812a19e66ee039326d7c3fee
2021-07-09 15:08:49 -05:00
Zuul
852a75246e Merge "Zuul gate to check if the cli doc is generated" 2021-07-08 21:14:50 +00:00
Zuul
ec6e22b0af Merge "Add retry on image build" 2021-07-07 20:38:14 +00:00
Drew Walters
f5c3541778 Update virtualized testing env docs
This change updates the airshipctl virtualized testing env documentation
to clarify the differences between airshipctl and treasuremap
environments. It also moves the documentation to its own page, as not
all pre-reqs on the Developer's guide are required for the virtualized
testing environments.

Signed-off-by: Drew Walters <andrew.walters@att.com>
Change-Id: I6c2e8ff0f1bc21622fa38f06cf5af6d6ee01cd72
2021-07-07 16:33:31 +00:00
Andrii Ostapenko
7551c71c2a
Add retry on image build
Change-Id: I2b0b7eb735963102310edcdcced58d182c0c9be3
Signed-off-by: Andrii Ostapenko <andrii.ostapenko@att.com>
2021-07-07 10:17:23 -06:00
Pallav Gupta
ee9747d26f Added customize K8s control plane configuration
Closes: #594

Change-Id: Ie90c58a34c47ad517537f8b6492ff838b1f547fc
2021-07-07 00:59:07 +00:00
bijayasharma
8a15d048cf Flux source-controller Function Proxy Var Replacement
* This commit fixes the bug of flux source-controller proxy var replacement
  to include proxy env settings to match HTTP_PROXY, HTTPS_PROXY and NO_PROXY

Change-Id: Ia6943529abf4e8afa7c5495316b8173e6c89cf9c
Relates-To: #550
Closes: #550
2021-07-06 12:23:45 +00:00
Sirisha Gopigiri
9e8446339c Zuul gate to check if the cli doc is generated
The below code adds check zuul gate to verify
that for every cli added to airshipctl appropriate
documentation is generated.

Closes: #280
Change-Id: Iba0f4393b9785190536aae2a13109ddb75fd0ef8
2021-07-06 04:59:01 +00:00
Zuul
3b49a3af59 Merge "Remove cluster resetsatoken subcommand" 2021-07-02 19:13:23 +00:00
Zuul
63492f7437 Merge "Remove cluster check-expiration subcommand" 2021-07-02 19:13:19 +00:00
Zuul
4cb1d982ce Merge "airshipctl - kustomize updating version to v3.9.4" 2021-07-02 18:06:32 +00:00
Shiba, Sidney
a8a8386906 airshipctl - kustomize updating version to v3.9.4
When using the script 10_build_gate.sh the ansible playbook was
installing an older version of kustomize, i.e., v3.8.5.

If you use the old kustomize version to render
treasuremap/manifests/site/reference-multi-tenant/target/workload it
will fail.

You will need kustomize v3.9.4 to be able to render the folder above.

Change-Id: I42425c32705c0c9dde3881cd890e135897b2ac23
2021-07-01 13:40:06 +00:00
Zuul
935a9da230 Merge "fix developer guide sops commands copy" 2021-06-30 19:15:13 +00:00
Zuul
7d91e48781 Merge "Add gate runner script with bash-based execution" 2021-06-29 19:56:35 +00:00
Zuul
da85ff8845 Merge "Update gcp-test-site for site validation" 2021-06-29 19:07:22 +00:00
Ruslan Aliev
3f23f278a5 Add gate runner script with bash-based execution
Added ability to run deployment scripts directly (not via ansible),
to be able to observe realtime output from commands.

Change-Id: I736b075d6ecf0d7badc1e7703f9238339ab09592
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
2021-06-29 01:42:09 -05:00
Zuul
d844fdceca Merge "Generate additional CRDs from API types" 2021-06-29 00:15:35 +00:00
Ruslan Aliev
f5daa32ef9 Remove secret generate cmd and its implementation
This command is obsolete and can be safely removed. All the secrets
functionality now is part of SOPS krm function and phases.

Change-Id: Ia8244e51aa8c28f1ac07734e4f4afc6ee59e4021
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Relates-To: #588
2021-06-28 17:49:08 -05:00
Ruslan Aliev
ada5d6f131 Remove cluster resetsatoken subcommand
This command is outdated and no longer needed, according to the
design call it should be removed.

Change-Id: I7c96fdd8cbc21c56ad9d0d6291ea9b6c6626735d
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Relates-To: #588
2021-06-28 17:45:30 -05:00
Ruslan Aliev
7a89572149 Remove cluster check-expiration subcommand
This command is outdated and no longer used, according to the design call
it should be removed.

Change-Id: I5953f0c66e9cee40c070afe148aa98c9d07113f7
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
Relates-To: #588
2021-06-28 17:43:27 -05:00
Kostiantyn Kalynovskyi
df55f50cb6 Allow rendering by label for replacement transformer
Change-Id: Ie2d68d735cb2b95987f5c95cbc024d608696f028
2021-06-28 18:42:49 +00:00
Zuul
c696c71dbf Merge "Support for specifying site manifest location in AIAP" 2021-06-28 18:01:37 +00:00
Zuul
9caf5ed4f6 Merge "Allow labelling of BMHs" 2021-06-28 16:34:24 +00:00
Ratnopam Chakrabarti
a6856adca6 Update gcp-test-site for site validation
This PS updates the gcp-test-site to work with phasePlan
kubeval validation configuration.
Includes the gcp-test-site in the site validation.

Relates-To: #528
Change-Id: I0b0d8aafa39730d0cb21e3d0a837a4a4b5909645
2021-06-28 15:10:37 +00:00
Sirisha Gopigiri
4da8a54887 Separate folders-Create airshipctl cli user guide documentation
Current modified go code, generates RsT files for each airshipctl
cmd and places them in a folder specific to the airshipctl subcommand.
It also generates the index.rst file for the specific airshipctl
subcommand folders. These generated rst files are appropriate to sphinx,
so that they can be easliy rendered in docs.airshipit.org

Steps to render the document locally

	* Install sphinx: python3 -m pip install sphinx
        * Clone airshipctl: git clone https://github.com/airshipit/airshipctl.git
        * Download current PS: cd airshipctl; git fetch "https://review.opendev.org/airship/airshipctl" refs/changes/50/789250/2 && git checkout -b change-789250-1 FETCH_HEAD
	* Build sphinx html pages: cd docs/source; sphinx-build -b html . _build
	* Run local server: cd _build; python3 -m http.server
	* Open URL to access the page: http://localhost:8000/ navigate to commands section access the document

Relates-To: #280
Change-Id: Ifa1dafc7b296014cc826072ac2c52f4488421352
2021-06-28 10:20:55 +05:30
Zuul
261a0d4b8a Merge "Add flags to airshipctl get-kubeconfig cmd" 2021-06-25 21:23:51 +00:00
Zuul
be8d06758a Merge "Fix deploying ssh key on worker node" 2021-06-25 21:23:45 +00:00
Matthew Fuller
52c5aedc63 Generate additional CRDs from API types
'make manifests' attempts to generate all airshipctl API types,
but several types throw errors and the resulting CRDs can't be
properly generated. This change:

- updates the controller-gen version to pull in a bug fix for the
  error 'map values must be a named type, not *ast.StarExpr'
- modifies the Templater type's Values member to be of type JSON
  since controller-gen does not support map[string]interface{},
  and unmarshals it separately in the templater itself
- adds 'image_repositories' to the VersionsCatalogueSpec struct
  to ensure it doesn't get deleted from the schema when manifests
  get regenerated
- checks in generated copies of all CRDs from airshipctl's API
  types, not just catalogues, to be used for validation

Closes: #574
Change-Id: I89a12cfd307a08da9aaec9773eac01169ea43ace
2021-06-25 19:10:25 +00:00
ma257n
418c64ba44 Support for specifying site manifest location in AIAP
- Addded new container artifact-setup in lieu of
  airshipctl-builder
- Added/Renamed env MANIFEST_REPO_NAME, MANIFEST_REPO_URL, MANIFEST_REPO_REF
- Added examples for airshipctl/treasuremap as kustomize files.

Relates-To: #477

Closes: #477

Depends-On: I98b605d16940fab2a728e4646e52c7d1ad992c2d

Change-Id: I6759c765c1aa9eaef8a989fcefe300679513a1be
2021-06-25 03:04:04 +00:00
Zuul
3728b6c0ce Merge "Added Image Repositories replacement for KCP" 2021-06-24 22:11:56 +00:00
Pallav Gupta
e6ea8f55b0 fix developer guide sops commands copy
When we copy sops commands from github dev guide, it also
includes '-' which makes commands incorrect when we past in
terminal. So removed it from sops commands.

Change-Id: I7da808606ce4a9196a1ecd6f0dc503c8aced4e76
2021-06-24 08:10:35 +00:00
Zuul
d87c317367 Merge "Add airship container cleanup" 2021-06-23 21:00:43 +00:00
Zuul
c22561bad2 Merge "Pin a stable version of image-builder" 2021-06-23 20:11:19 +00:00
Matt McEuen
a27476580d Allow labelling of BMHs
SIP cluster scheduling relies ultimately on labels on the underlying
BareMetalHosts for rack and server name.

This change allows operators to optionally add labels to BMHs
that are generated by the hostgenerator-m3 function, and gives
an example of how to use it.

Change-Id: Icc35ef81fc3a9fc6e6e89dc7ba58a385469cdf68
2021-06-23 19:14:54 +00:00
Pallav Gupta
30691affe8 Added Image Repositories replacement for KCP
Change-Id: I454f5e9b92290d0c5b24830621a396f07354f90b
2021-06-23 17:48:40 +00:00
Ruslan Aliev
cb6b13a581 Fix deploying ssh key on worker node
Change-Id: Ic5033adfccefb571193e902a06de2ef3cf7ffe56
Signed-off-by: Ruslan Aliev <raliev@mirantis.com>
2021-06-23 11:08:56 -05:00
Zuul
f74f4af7a9 Merge "Revert "Add chrony config"" 2021-06-23 13:59:54 +00:00
bijayasharma
622d45f3bd Add flags to airshipctl get-kubeconfig cmd
* This commits add --file and --merge flags to
  airshipctl get-kubeconfig cmd

Change-Id: I919d4f068d3ef9bcda6b3a7c9aeb0826a4e5c0d4
Signed-off-by: bijayasharma <vetbijaya@gmail.com>
Relates-To: #495
Closes: #495
2021-06-23 13:41:14 +00:00
Sirajudeen
2aafb98cad Pin a stable version of image-builder
* Use a known stable version of image-builder

Change-Id: Id1420d6274985d3c943f335abc830b0749b7ca3c
2021-06-23 12:09:56 +00:00
Jagan Mohan Kavva
d808e37c64 Revert "Add chrony config"
This reverts commit bf7c04d13f3c456c4d7fd29c30e83cfb6d66712a.

Reason for revert: We just realized that passing NTP and chrony.conf both is not needed so reverting this changes.

Change-Id: Ifa3ee40316871addb05cd8196baf9e4daa5eb8a6
2021-06-22 15:11:20 +00:00
Kostiantyn Kalynovskyi
a121a88a97 Add airship container cleanup
Closes: #546

Change-Id: I623694327bd6cc7dea616c109a7dcb7d97420be9
2021-06-22 14:49:53 +00:00
Zuul
8d882fcc85 Merge "Enable tolerance to apply timeout errors" 2021-06-19 03:15:30 +00:00