Compare commits
2 Commits
v2.6.3
...
conform-k8
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
d04b74fd8d | ||
|
|
975132714b |
4
.github/workflows/conformance.yaml
vendored
4
.github/workflows/conformance.yaml
vendored
@@ -19,7 +19,7 @@ jobs:
|
||||
matrix:
|
||||
# Keep this list up-to-date with https://endoflife.date/kubernetes
|
||||
# Build images with https://github.com/fluxcd/flux-benchmark/actions/workflows/build-kind.yaml
|
||||
KUBERNETES_VERSION: [1.30.9, 1.31.5, 1.32.1 ]
|
||||
KUBERNETES_VERSION: [1.30.9, 1.31.5, 1.32.1, 1.33.0]
|
||||
fail-fast: false
|
||||
steps:
|
||||
- name: Checkout
|
||||
@@ -42,7 +42,7 @@ jobs:
|
||||
- name: Setup Kubernetes
|
||||
uses: helm/kind-action@a1b0e391336a6ee6713a0583f8c6240d70863de3 # v1.12.0
|
||||
with:
|
||||
version: v0.22.0
|
||||
version: v0.27.0
|
||||
cluster_name: ${{ steps.prep.outputs.CLUSTER }}
|
||||
node_image: ghcr.io/fluxcd/kindest/node:v${{ matrix.KUBERNETES_VERSION }}-arm64
|
||||
- name: Run e2e tests
|
||||
|
||||
166
rfcs/0000-external-artifact/README.md
Normal file
166
rfcs/0000-external-artifact/README.md
Normal file
@@ -0,0 +1,166 @@
|
||||
# RFC External Artifacts
|
||||
|
||||
**Status:** provisional
|
||||
|
||||
**Creation date:** 2025-04-08
|
||||
|
||||
**Last update:** 2025-04-08
|
||||
|
||||
## Summary
|
||||
|
||||
This RFC proposes the introduction of a new API called `ExternalArtifact` that would allow
|
||||
3rd party controllers to act as a source of truth for the cluster desired state. In effect,
|
||||
the `ExternalArtifact` API acts as an extension of the existing `source.toolkit.fluxcd.io` APIs
|
||||
that enables Flux `kustomize-controller` and `helm-controller` to consume artifacts from external
|
||||
source types that are not natively supported by `source-controller`.
|
||||
|
||||
## Motivation
|
||||
|
||||
Over the years, we've received requests from users to support other source types besides the
|
||||
ones natively supported by `source-controller`. For example, users have asked for support of
|
||||
downloading Kubernetes manifests from GitHub/GitLab releases, Omaha protocol, SFTP protocol,
|
||||
and other remote storage systems.
|
||||
|
||||
Another common request is to run transformations on the artifacts fetched by source-controller.
|
||||
For example, users want to be able to generate YAML manifests from jsonnet, cue, and other
|
||||
templating engines before they are consumed by Flux `kustomize-controller`.
|
||||
|
||||
In order to support these use cases, we need to define a standard API that allows 3rd party
|
||||
controllers to expose artifacts in-cluster (in the same way `source-controller` does)
|
||||
that can be consumed by Flux `kustomize-controller` and `helm-controller`.
|
||||
|
||||
### Goals
|
||||
|
||||
Define a standard API for 3rd party controllers to expose artifacts that can be consumed by
|
||||
Flux controllers in the same way as the existing `source.toolkit.fluxcd.io` APIs.
|
||||
|
||||
Allow Flux users to transition from using `source-controller` to using 3rd party source controllers
|
||||
with minimal changes to their existing `Kustomizations` and `HelmReleases`.
|
||||
|
||||
### Non-Goals
|
||||
|
||||
Allow arbitrary custom resources to be referenced in Flux `Kustomization` and `HelmRelease` as `sourceRef`.
|
||||
|
||||
Extend the Flux controllers permissions to access custom resources that are not part of the
|
||||
`source.toolkit.fluxcd.io` APIs.
|
||||
|
||||
## Proposal
|
||||
|
||||
Assuming we have a custom controller called `release-controller` that is responsible for
|
||||
reconciling `GitHubRelease` custom resources. This controller downloads the Kubernetes
|
||||
deployment YAML manifests from the GitHub API and stores them in a local file system
|
||||
as a `tar.gz` file. The `release-controller` then creates an `ExternalArtifact`
|
||||
custom resource that tells the Flux controllers from where to fetch the artifact.
|
||||
|
||||
Every time the `release-controller` reconciles a `GitHubRelease` custom resource,
|
||||
it updates the `ExternalArtifact` status with the latest artifact information if the
|
||||
upstream release has changed.
|
||||
|
||||
The `release-controller` is responsible for exposing a HTTP endpoint that serves
|
||||
the artifacts from its own storage. The URL of the `tar.gz` artifact is stored in
|
||||
the `ExternalArtifact` status and should be accessible from the Flux controllers
|
||||
running in the cluster.
|
||||
|
||||
Example of a generated `ExternalArtifact` custom resource:
|
||||
|
||||
```yaml
|
||||
apiVersion: source.toolkit.fluxcd.io/v1
|
||||
kind: ExternalArtifact
|
||||
metadata:
|
||||
name: podinfo
|
||||
namespace: apps
|
||||
spec:
|
||||
# SourceRef points to the Kubernetes custom resource for
|
||||
# which the artifact is generated.
|
||||
# +required
|
||||
sourceRef:
|
||||
apiVersion: source.example.com/v1alpha1
|
||||
kind: GitHubRelease
|
||||
name: podinfo
|
||||
namespace: apps
|
||||
status:
|
||||
artifact:
|
||||
# Digest is the digest of the tar.gz file in the form of '<algorithm>:<checksum>'.
|
||||
# The digest is used by the Flux controllers to verify the integrity of the artifact.
|
||||
# +required
|
||||
digest: sha256:35d47c9db0eee6ffe08a404dfb416bee31b2b79eabc3f2eb26749163ce487f52
|
||||
# LastUpdateTime is the timestamp corresponding to the last update of the
|
||||
# Artifact in storage.
|
||||
# +required
|
||||
lastUpdateTime: "2025-03-21T13:37:31Z"
|
||||
# Path is the relative file path of the Artifact. It can be used to locate
|
||||
# the file in the root of the Artifact storage on the local file system of
|
||||
# the controller managing the Source.
|
||||
# +required
|
||||
path: release/apps/podinfo/6.8.0-b3396ad.tar.gz
|
||||
# Revision is a human-readable identifier traceable in the origin source system
|
||||
# in the form of '<human-readable-identifier>@<algorithm>:<checksum>'.
|
||||
# The revision is used by the Flux controllers to determine if the artifact has changed.
|
||||
# +required
|
||||
revision: 6.8.0@sha256:35d47c9db0eee6ffe08a404dfb416bee31b2b79eabc3f2eb26749163ce487f52
|
||||
# Size is the number of bytes of the tar.gz file.
|
||||
# +required
|
||||
size: 20914
|
||||
# URL is the in-cluster HTTP address of the Artifact as exposed by the controller
|
||||
# managing the Source. It can be used to retrieve the Artifact for
|
||||
# consumption, e.g. by kustomize-controller applying the Artifact contents.
|
||||
# +required
|
||||
url: http://release-controller.flux-system.svc.cluster.local./release/apps/podinfo/6.8.0-b3396ad.tar.gz
|
||||
conditions:
|
||||
- lastTransitionTime: "2025-04-08T09:09:49Z"
|
||||
message: stored artifact for release 6.8.0
|
||||
observedGeneration: 1
|
||||
reason: Succeeded
|
||||
status: "True"
|
||||
type: Ready
|
||||
```
|
||||
|
||||
Note that the `.status.artifact` is identical to how `source-controller` exposes the
|
||||
artifact information for `Bucket`, `GitRepository`, and `OCIRepository` custom resources.
|
||||
This allows the Flux controllers to consume external artifacts with minimal changes.
|
||||
|
||||
The `ExternalArtifact` custom resource is referenced by a Flux `Kustomization` as follows:
|
||||
|
||||
```yaml
|
||||
apiVersion: kustomize.toolkit.fluxcd.io/v1
|
||||
kind: Kustomization
|
||||
metadata:
|
||||
name: podinfo
|
||||
namespace: apps
|
||||
spec:
|
||||
interval: 10m
|
||||
sourceRef:
|
||||
kind: ExternalArtifact
|
||||
name: podinfo
|
||||
path: "./"
|
||||
prune: true
|
||||
```
|
||||
|
||||
Flux `kustomize-controller` will then fetch the artifact from the URL specified in the
|
||||
`ExternalArtifact` status, verifies the integrity of the artifact using the digest
|
||||
and applies the contents of the artifact to the cluster.
|
||||
|
||||
Like with the existing `source.toolkit.fluxcd.io` APIs, `kustomize-controller` will
|
||||
watch the `ExternalArtifact` custom resource for changes and will re-apply the
|
||||
contents of the artifact when the `.status.artifact.revision` changes.
|
||||
|
||||
### User Stories
|
||||
|
||||
TODO
|
||||
|
||||
### Alternatives
|
||||
|
||||
TODO
|
||||
|
||||
## Design Details
|
||||
|
||||
TODO
|
||||
|
||||
## Implementation History
|
||||
|
||||
<!--
|
||||
Major milestones in the lifecycle of the RFC such as:
|
||||
- The first Flux release where an initial version of the RFC was available.
|
||||
- The version of Flux where the RFC graduated to general availability.
|
||||
- The version of Flux where the RFC was retired or superseded.
|
||||
-->
|
||||
Reference in New Issue
Block a user