Codefresh platform deployment

Platform deployment options

Codefresh Enterprise provides a comprehensive platform for continuous integration and continuous delivery with Codefresh pipelines, and continuous delivery for Arog CD applications with GitOps, through flexible deployment options: SaaS and on-premises.

• SaaS platform deployment
  The SaaS option leverages the Codefresh Control Plane hosted in the cloud, enabling streamlined operations with minimal infrastructure overhead. Runtimes for GitOps and Runners for CI Pipelines are installed in your environment, ensuring data security and compliance.
  See SaaS platform architecture.

• On-premises platform deployment
  The on-premises option ensures complete control over the infrastructure, hosting the platform components within your private network. It is ideal for organizations with strict compliance or security requirements.
  See On-premises platform architecture.

Both deployments offer:

• Seamless integration of CI and CD with Codefresh pipelines, and CD with GitOps for managing Argo CD applications.
• Modular functionality where pipelines and GitOps can operate independently or together.
• Robust compliance with SOC2 - Type2 standards.

SaaS platform architecture

The diagram shows the high-level architecture of the SaaS platform and its core components.

Control Plane

The Codefresh Control Plane is the SaaS component in the platform. External to the enterprise firewall, the Control Plane does not communicate directly with the Codefresh Runtimes, Codefresh Clients, or the customer’s organizational systems. The Codefresh Runtimes and the Codefresh Clients communicate with the Codefresh Control Plane to retrieve the required information.

GitOps Runtime

The GitOps Runtime is installed on a Kubernetes cluster, and houses the enterprise distribution of the Codefresh Application Proxy and the Argo Project.
The GitOps Runtime is installed in hybrid mode within the customer environment.
Read more in GitOps Runtimes.

Codefresh Runner

The Codefresh Runner, also known as the Agent, is required for Codefresh pipelines, and enables running pipeline builds in the customer’s environment. It provides a way to run pipeline builds, tests, and deployments within your private network or on-premises environment by making API calls to the Codefresh platform.
Read more in Codefresh Runner.

Managed Clusters

Managed clusters are external clusters added to provisioned GitOps Runtimes. You can deploy applications to the clusters without having to install Argo CD on the clusters in order to do so. Read more in Managed clusters in Runtimes.

Codefresh Clients

Codefresh UI

The Codefresh UI provides an intuitive web interface to create, run, and manage CI pipelines and Argo CD applications.

The global (Home) dashboard consolidates unified, enterprise-wide insights into CI pipelines and Argo CD applications.
For in-depth analysis, the UI has several additional dashboards, each dedicated to distinct aspects of pipeline and Argo CD application functionality and performance.
For pipelines, you have Kubernetes and Helm dashboards to monitor releases and deployments.
For GitOps, you have our unique Products and Environments dashboards to track and manage Argo CD application deployments.

Codefresh CLI

The CLI for Codefresh Pipelines can:

• Perform any UI operation
• Create complex automation from your local machine
• Create and run pipelines for complex use cases using the CLI within pipeline steps

For installation instructions and CLI command descriptions, see the CLI documentation.

Codefresh on-premises platform architecture

The diagram shows a high-level view of the Codefresh on-premises deployment, and its core components.

External components

Codefresh Runner

The Codefresh Runner can be installed on the same cluster as the on-premises platform or on a remote cluster. It provides a way to run pipeline builds, tests, and deployments within your private network or on-premises environment by making API calls to the Codefresh platform.

Read more about it in Codefresh Runner architecture, and on how it works in Runner behind firewalls.

GitOps Runtime

The GitOps Runtime, similar to the Codefresh Runner, can be installed on the same cluster as the on-premises platform or on a remote cluster. It includes Codefresh-signed versions of the Argo Project components, Argo CD, Argo Workflows, Argo Rollouts, and Argo Events. The GitOps Runtime reports events in clusters and Git repositories through API calls to the Codefresh platform.

Read more in GitOps Runtime architecture.

Codefresh UI & CLI

Codefresh UI

The Codefresh UI provides an intuitive web interface to create, run, and manage CI pipelines and Argo CD applications.

The global (Home) dashboard displays unified, enterprise-wide insights into CI pipelines and Argo CD applications. For in-depth analysis, the UI has several additional dashboards, each dedicated to distinct aspects of Codefresh pipeline, and Argo CD application functionality and performance. For pipelines, you have Kubernetes and Helm dashboards to monitor releases and deployments. For GitOps, you have our unique Products and Environments dashboards to track and manage Argo CD application deployments.

Codefresh CLI

The CLI for Codefresh Pipelines can:

• Perform any UI operation
• Create complex automation from your local machine
• Create and run pipelines for complex use cases using the CLI within pipeline steps

For installation instructions and CLI command descriptions, see the CLI documentation.

On-premises platform components

Ingress controller

The Codefresh On-Premises platform uses an ingress controller to handle incoming traffic. The NGINX Ingress Controller is deployed within the cluster hosting the Codefresh platform. The ingress controller serves as the entry point for requests originating from Codefresh Runners, GitOps Runtimes, and Clients, and routes them to the appropriate destinations, namely the Pipelines API/UI and the GitOps API/UI.

Pipelines API

The Pipelines API serves as the primary gateway for the Codefresh Pipelines module in the On-Premises platform. It handles a wide range of system functionalities, including authentication, authorization, audit logging, user management, and pipeline builds, among others. The Pipelines API utilizes a REST API interface with OpenAPI (Swagger v3) specifications.

Pipelines UI

The Pipelines UI acts as a static file server that hosts and delivers all the user interface pages for Codefresh Pipelines. It provides visualization of pipelines, builds, third-party integrations and more.

GitOps API

The GitOps API serves as the primary gateway for the Codefresh GitOps module in the On-Premises platform. It interfaces between Codefresh GitOps, Git, and Argo CD, to sync It utilizes a GraphQL interface to provide a user interface

GitOps UI

The GitOps UI provides a unified, enterprise-wide view of deployments, Runtimes, clusters, and applications in the same location.

Pipelines

The Pipelines module comprises a set of microservices for managing Codefresh pipelines in the On-Premises platform. The Codefresh Runner and clients (UI/CLI) forward incoming requests to the Pipelines API, which in turn forwards them to the different Pipeline microservices.

• Broadcaster
  Forwards requests from the Codefresh Runner and client to the Codefresh API when Firebase is not used.

• Runtime Manager
  Manages the runtime environments for the Codefresh Runner in the Codefresh On-Premises platform.

• Context Manager
  Stores information on Pipeline Integrations created in Codefresh.

• Pipeline Manager
  Stores and manages projects and pipeline entities.

• Helm Manager
  Provides an interface for aggregated views of Helm integrations in Codefresh Pipelines.

• GitOps Manager
  Deprecated. Stored information for populating the GitOps Dashboard in Codefresh Pipelines. The dashboard is now populated by Codefresh GitOps.

GitOps

The GitOps module comprises the microservices for Codefresh and Argo users to consume and share Argo Workflow templates.

• Cron executer
  The Cron Executor performs periodic internal tasks required for platform functionality.

• API Events
  Receives events from GitOps Runtimes and publishes them to the Event Bus.

• Event Handler
  The Event Handler subscribes to events originating from the API Events received via the Event Bus, processes, and updates them.

• Audit Manager
  The Audit Manager reports and stores audit logs of API calls to Codefresh GitOps.

• Analytics Reporter
  Reports analytics information to populate deployment, runtime, and cluster data for GitOps in the different dashboards and widgets.

• Argo Hub
  Interfaces with the Argo Hub platform for working with pre-built Argo Workflow templates. Visit ​​https://codefresh.io/argohub/ for more details.

Infrastructure

Codefresh stores entity, configuration, and integration data for Codefresh Pipelines and Codefresh GitOps in different databases. Each microservice within the Codefresh Pipeline and GitOps modules has its own dedicated database, which is independent from the databases used by other microservices. Communication between each microservice and its respective database is exclusive.

• mongoDB
  The main database for entity storage for Pipeline and GitOps microservices.

• Redis
  • Optimizes caching for faster response times to requests and reduce load on the database
  • When Firebase is not used, interacts with the Broadcaster microservice to serve pipeline build logs to the client

• RabbitMQ
  RabbitMQ serves as a message bus to move tasks and information between microservices in the Pipeline and GitOps modules.

• PostgreSQL
  The PostgreSQL database stores:
  • Audit logs of API calls from the Codefresh and GitOps APIs
  • Analytics information

• NATS
  Legacy message bus.

• Consul
  Stores data for legacy builder and Windows nodes.

Related articles

On-premises platform deployment
Codfresh Runner architecture
GitOps Runtime architecture