gcp_kubernetes_engine_node_pool
ancestors
Type: UNORDERED_LIST_STRING
autoscaling
Type: STRUCT
Provider name: autoscaling
Description: Autoscaler configuration for this NodePool. Autoscaler is enabled only if a valid configuration is present.
autoprovisioned
Type: BOOLEAN
Provider name: autoprovisioned
Description: Can this node pool be deleted automatically.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Is autoscaling enabled for this node pool.
location_policy
Type: STRING
Provider name: locationPolicy
Description: Location policy used when scaling up a nodepool.
Possible values:
LOCATION_POLICY_UNSPECIFIED
- Not set.
BALANCED
- BALANCED is a best effort policy that aims to balance the sizes of different zones.
ANY
- ANY policy picks zones that have the highest capacity available.
max_node_count
Type: INT32
Provider name: maxNodeCount
Description: Maximum number of nodes for one location in the NodePool. Must be >= min_node_count. There has to be enough quota to scale up the cluster.
min_node_count
Type: INT32
Provider name: minNodeCount
Description: Minimum number of nodes for one location in the NodePool. Must be >= 1 and <= max_node_count.
total_max_node_count
Type: INT32
Provider name: totalMaxNodeCount
Description: Maximum number of nodes in the node pool. Must be greater than total_min_node_count. There has to be enough quota to scale up the cluster. The total_*_node_count fields are mutually exclusive with the *_node_count fields.
total_min_node_count
Type: INT32
Provider name: totalMinNodeCount
Description: Minimum number of nodes in the node pool. Must be greater than 1 less than total_max_node_count. The total_*_node_count fields are mutually exclusive with the *_node_count fields.
best_effort_provisioning
Type: STRUCT
Provider name: bestEffortProvisioning
Description: Enable best effort provisioning for nodes
enabled
Type: BOOLEAN
Provider name: enabled
Description: When this is enabled, cluster/node pool creations will ignore non-fatal errors like stockout to best provision as many nodes as possible right now and eventually bring up all target number of nodes
min_provision_nodes
Type: INT32
Provider name: minProvisionNodes
Description: Minimum number of nodes to be provisioned to be considered as succeeded, and the rest of nodes will be provisioned gradually and eventually when stockout issue has been resolved.
conditions
Type: UNORDERED_LIST_STRUCT
Provider name: conditions
Description: Which conditions caused the current node pool state.
canonical_code
Type: STRING
Provider name: canonicalCode
Description: Canonical code of the condition.
Possible values:
OK
- Not an error; returned on success. HTTP Mapping: 200 OK
CANCELLED
- The operation was cancelled, typically by the caller. HTTP Mapping: 499 Client Closed Request
UNKNOWN
- Unknown error. For example, this error may be returned when a Status
value received from another address space belongs to an error space that is not known in this address space. Also errors raised by APIs that do not return enough error information may be converted to this error. HTTP Mapping: 500 Internal Server Error
INVALID_ARGUMENT
- The client specified an invalid argument. Note that this differs from FAILED_PRECONDITION
. INVALID_ARGUMENT
indicates arguments that are problematic regardless of the state of the system (e.g., a malformed file name). HTTP Mapping: 400 Bad Request
DEADLINE_EXCEEDED
- The deadline expired before the operation could complete. For operations that change the state of the system, this error may be returned even if the operation has completed successfully. For example, a successful response from a server could have been delayed long enough for the deadline to expire. HTTP Mapping: 504 Gateway Timeout
NOT_FOUND
- Some requested entity (e.g., file or directory) was not found. Note to server developers: if a request is denied for an entire class of users, such as gradual feature rollout or undocumented allowlist, NOT_FOUND
may be used. If a request is denied for some users within a class of users, such as user-based access control, PERMISSION_DENIED
must be used. HTTP Mapping: 404 Not Found
ALREADY_EXISTS
- The entity that a client attempted to create (e.g., file or directory) already exists. HTTP Mapping: 409 Conflict
PERMISSION_DENIED
- The caller does not have permission to execute the specified operation. PERMISSION_DENIED
must not be used for rejections caused by exhausting some resource (use RESOURCE_EXHAUSTED
instead for those errors). PERMISSION_DENIED
must not be used if the caller can not be identified (use UNAUTHENTICATED
instead for those errors). This error code does not imply the request is valid or the requested entity exists or satisfies other pre-conditions. HTTP Mapping: 403 Forbidden
UNAUTHENTICATED
- The request does not have valid authentication credentials for the operation. HTTP Mapping: 401 Unauthorized
RESOURCE_EXHAUSTED
- Some resource has been exhausted, perhaps a per-user quota, or perhaps the entire file system is out of space. HTTP Mapping: 429 Too Many Requests
FAILED_PRECONDITION
- The operation was rejected because the system is not in a state required for the operation's execution. For example, the directory to be deleted is non-empty, an rmdir operation is applied to a non-directory, etc. Service implementors can use the following guidelines to decide between FAILED_PRECONDITION
, ABORTED
, and UNAVAILABLE
: (a) Use UNAVAILABLE
if the client can retry just the failing call. (b) Use ABORTED
if the client should retry at a higher level. For example, when a client-specified test-and-set fails, indicating the client should restart a read-modify-write sequence. (c) Use FAILED_PRECONDITION
if the client should not retry until the system state has been explicitly fixed. For example, if an ‘rmdir’ fails because the directory is non-empty, FAILED_PRECONDITION
should be returned since the client should not retry unless the files are deleted from the directory. HTTP Mapping: 400 Bad Request
ABORTED
- The operation was aborted, typically due to a concurrency issue such as a sequencer check failure or transaction abort. See the guidelines above for deciding between FAILED_PRECONDITION
, ABORTED
, and UNAVAILABLE
. HTTP Mapping: 409 Conflict
OUT_OF_RANGE
- The operation was attempted past the valid range. E.g., seeking or reading past end-of-file. Unlike INVALID_ARGUMENT
, this error indicates a problem that may be fixed if the system state changes. For example, a 32-bit file system will generate INVALID_ARGUMENT
if asked to read at an offset that is not in the range [0,2^32-1], but it will generate OUT_OF_RANGE
if asked to read from an offset past the current file size. There is a fair bit of overlap between FAILED_PRECONDITION
and OUT_OF_RANGE
. We recommend using OUT_OF_RANGE
(the more specific error) when it applies so that callers who are iterating through a space can easily look for an OUT_OF_RANGE
error to detect when they are done. HTTP Mapping: 400 Bad Request
UNIMPLEMENTED
- The operation is not implemented or is not supported/enabled in this service. HTTP Mapping: 501 Not Implemented
INTERNAL
- Internal errors. This means that some invariants expected by the underlying system have been broken. This error code is reserved for serious errors. HTTP Mapping: 500 Internal Server Error
UNAVAILABLE
- The service is currently unavailable. This is most likely a transient condition, which can be corrected by retrying with a backoff. Note that it is not always safe to retry non-idempotent operations. See the guidelines above for deciding between FAILED_PRECONDITION
, ABORTED
, and UNAVAILABLE
. HTTP Mapping: 503 Service Unavailable
DATA_LOSS
- Unrecoverable data loss or corruption. HTTP Mapping: 500 Internal Server Error
code
Type: STRING
Provider name: code
Description: Machine-friendly representation of the condition Deprecated. Use canonical_code instead.
Possible values:
UNKNOWN
- UNKNOWN indicates a generic condition.
GCE_STOCKOUT
- GCE_STOCKOUT indicates that Google Compute Engine resources are temporarily unavailable.
GKE_SERVICE_ACCOUNT_DELETED
- GKE_SERVICE_ACCOUNT_DELETED indicates that the user deleted their robot service account.
GCE_QUOTA_EXCEEDED
- Google Compute Engine quota was exceeded.
SET_BY_OPERATOR
- Cluster state was manually changed by an SRE due to a system logic error.
CLOUD_KMS_KEY_ERROR
- Unable to perform an encrypt operation against the CloudKMS key used for etcd level encryption.
CA_EXPIRING
- Cluster CA is expiring soon. More codes TBA
message
Type: STRING
Provider name: message
Description: Human-friendly representation of the condition
config
Type: STRUCT
Provider name: config
Description: The node configuration of the pool.
accelerators
Type: UNORDERED_LIST_STRUCT
Provider name: accelerators
Description: A list of hardware accelerators to be attached to each node. See https://cloud.google.com/compute/docs/gpus for more information about support for GPUs.
accelerator_count
Type: INT64
Provider name: acceleratorCount
Description: The number of the accelerator cards exposed to an instance.
accelerator_type
Type: STRING
Provider name: acceleratorType
Description: The accelerator type resource name. List of supported accelerators here
gpu_driver_installation_config
Type: STRUCT
Provider name: gpuDriverInstallationConfig
Description: The configuration for auto installation of GPU driver.
gpu_driver_version
Type: STRING
Provider name: gpuDriverVersion
Description: Mode for how the GPU driver is installed.
Possible values:
GPU_DRIVER_VERSION_UNSPECIFIED
- Default value is to not install any GPU driver.
INSTALLATION_DISABLED
- Disable GPU driver auto installation and needs manual installation
DEFAULT
- Default’ GPU driver in COS and Ubuntu.
LATEST
- Latest’ GPU driver in COS.
gpu_partition_size
Type: STRING
Provider name: gpuPartitionSize
Description: Size of partitions to create on the GPU. Valid values are described in the NVIDIA mig user guide.
gpu_sharing_config
Type: STRUCT
Provider name: gpuSharingConfig
Description: The configuration for GPU sharing options.
gpu_sharing_strategy
Type: STRING
Provider name: gpuSharingStrategy
Description: The type of GPU sharing strategy to enable on the GPU node.
Possible values:
GPU_SHARING_STRATEGY_UNSPECIFIED
- Default value.
TIME_SHARING
- GPUs are time-shared between containers.
MPS
- GPUs are shared between containers with NVIDIA MPS.
max_shared_clients_per_gpu
Type: INT64
Provider name: maxSharedClientsPerGpu
Description: The max number of containers that can share a physical GPU.
max_time_shared_clients_per_gpu
Type: INT64
Provider name: maxTimeSharedClientsPerGpu
Description: The number of time-shared GPU resources to expose for each physical GPU.
advanced_machine_features
Type: STRUCT
Provider name: advancedMachineFeatures
Description: Advanced features for the Compute Engine VM.
enable_nested_virtualization
Type: BOOLEAN
Provider name: enableNestedVirtualization
Description: Whether or not to enable nested virtualization (defaults to false).
threads_per_core
Type: INT64
Provider name: threadsPerCore
Description: The number of threads per physical core. To disable simultaneous multithreading (SMT) set this to 1. If unset, the maximum number of threads supported per core by the underlying processor is assumed.
boot_disk_kms_key
Type: STRING
Provider name: bootDiskKmsKey
Description: The Customer Managed Encryption Key used to encrypt the boot disk attached to each node in the node pool. This should be of the form projects/[KEY_PROJECT_ID]/locations/[LOCATION]/keyRings/[RING_NAME]/cryptoKeys/[KEY_NAME]. For more information about protecting resources with Cloud KMS Keys please see: https://cloud.google.com/compute/docs/disks/customer-managed-encryption
confidential_nodes
Type: STRUCT
Provider name: confidentialNodes
Description: Confidential nodes config. All the nodes in the node pool will be Confidential VM once enabled.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Whether Confidential Nodes feature is enabled.
containerd_config
Type: STRUCT
Provider name: containerdConfig
Description: Parameters for containerd customization.
private_registry_access_config
Type: STRUCT
Provider name: privateRegistryAccessConfig
Description: PrivateRegistryAccessConfig is used to configure access configuration for private container registries.
certificate_authority_domain_config
Type: UNORDERED_LIST_STRUCT
Provider name: certificateAuthorityDomainConfig
Description: Private registry access configuration.
fqdns
Type: UNORDERED_LIST_STRING
Provider name: fqdns
Description: List of fully qualified domain names (FQDN). Specifying port is supported. Wilcards are NOT supported. Examples: - my.customdomain.com - 10.0.1.2:5000
gcp_secret_manager_certificate_config
Type: STRUCT
Provider name: gcpSecretManagerCertificateConfig
Description: Google Secret Manager (GCP) certificate configuration.
secret_uri
Type: STRING
Provider name: secretUri
Description: Secret URI, in the form “projects/$PROJECT_ID/secrets/$SECRET_NAME/versions/$VERSION”. Version can be fixed (e.g. “2”) or “latest”
enabled
Type: BOOLEAN
Provider name: enabled
Description: Private registry access is enabled.
disk_size_gb
Type: INT32
Provider name: diskSizeGb
Description: Size of the disk attached to each node, specified in GB. The smallest allowed disk size is 10GB. If unspecified, the default disk size is 100GB.
disk_type
Type: STRING
Provider name: diskType
Description: Type of the disk attached to each node (e.g. ‘pd-standard’, ‘pd-ssd’ or ‘pd-balanced’) If unspecified, the default disk type is ‘pd-standard’
enable_confidential_storage
Type: BOOLEAN
Provider name: enableConfidentialStorage
Description: Optional. Reserved for future use.
ephemeral_storage_config
Type: STRUCT
Provider name: ephemeralStorageConfig
Description: Parameters for the ephemeral storage filesystem. If unspecified, ephemeral storage is backed by the boot disk.
local_ssd_count
Type: INT32
Provider name: localSsdCount
Description: Number of local SSDs to use to back ephemeral storage. Uses NVMe interfaces. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn’t support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info.
ephemeral_storage_local_ssd_config
Type: STRUCT
Provider name: ephemeralStorageLocalSsdConfig
Description: Parameters for the node ephemeral storage using Local SSDs. If unspecified, ephemeral storage is backed by the boot disk. This field is functionally equivalent to the ephemeral_storage_config
local_ssd_count
Type: INT32
Provider name: localSsdCount
Description: Number of local SSDs to use to back ephemeral storage. Uses NVMe interfaces. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn’t support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info.
fast_socket
Type: STRUCT
Provider name: fastSocket
Description: Enable or disable NCCL fast socket for the node pool.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Whether Fast Socket features are enabled in the node pool.
gcfs_config
Type: STRUCT
Provider name: gcfsConfig
Description: GCFS (Google Container File System) configs.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Whether to use GCFS.
gvnic
Type: STRUCT
Provider name: gvnic
Description: Enable or disable gvnic on the node pool.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Whether gVNIC features are enabled in the node pool.
host_maintenance_policy
Type: STRUCT
Provider name: hostMaintenancePolicy
Description: HostMaintenancePolicy contains the desired maintenance policy for the Google Compute Engine hosts.
maintenance_interval
Type: STRING
Provider name: maintenanceInterval
Description: Specifies the frequency of planned maintenance events.
Possible values:
MAINTENANCE_INTERVAL_UNSPECIFIED
- The maintenance interval is not explicitly specified.
AS_NEEDED
- Nodes are eligible to receive infrastructure and hypervisor updates as they become available. This may result in more maintenance operations (live migrations or terminations) for the node than the PERIODIC option.
PERIODIC
- Nodes receive infrastructure and hypervisor updates on a periodic basis, minimizing the number of maintenance operations (live migrations or terminations) on an individual VM. This may mean underlying VMs will take longer to receive an update than if it was configured for AS_NEEDED. Security updates will still be applied as soon as they are available.
opportunistic_maintenance_strategy
Type: STRUCT
Provider name: opportunisticMaintenanceStrategy
Description: Strategy that will trigger maintenance on behalf of the customer.
maintenance_availability_window
Type: STRING
Provider name: maintenanceAvailabilityWindow
Description: The window of time that opportunistic maintenance can run. Example: A setting of 14 days implies that opportunistic maintenance can only be ran in the 2 weeks leading up to the scheduled maintenance date. Setting 28 days allows opportunistic maintenance to run at any time in the scheduled maintenance window (all PERIODIC
maintenance is set 28 days in advance).
min_nodes_per_pool
Type: INT64
Provider name: minNodesPerPool
Description: The minimum nodes required to be available in a pool. Blocks maintenance if it would cause the number of running nodes to dip below this value.
node_idle_time_window
Type: STRING
Provider name: nodeIdleTimeWindow
Description: The amount of time that a node can remain idle (no customer owned workloads running), before triggering maintenance.
image_type
Type: STRING
Provider name: imageType
Description: The image type to use for this node. Note that for a given image type, the latest version of it will be used. Please see https://cloud.google.com/kubernetes-engine/docs/concepts/node-images for available image types.
kubelet_config
Type: STRUCT
Provider name: kubeletConfig
Description: Node kubelet configs.
cpu_cfs_quota
Type: BOOLEAN
Provider name: cpuCfsQuota
Description: Enable CPU CFS quota enforcement for containers that specify CPU limits. This option is enabled by default which makes kubelet use CFS quota (https://www.kernel.org/doc/Documentation/scheduler/sched-bwc.txt) to enforce container CPU limits. Otherwise, CPU limits will not be enforced at all. Disable this option to mitigate CPU throttling problems while still having your pods to be in Guaranteed QoS class by specifying the CPU limits. The default value is ’true’ if unspecified.
cpu_cfs_quota_period
Type: STRING
Provider name: cpuCfsQuotaPeriod
Description: Set the CPU CFS quota period value ‘cpu.cfs_period_us’. The string must be a sequence of decimal numbers, each with optional fraction and a unit suffix, such as “300ms”. Valid time units are “ns”, “us” (or “µs”), “ms”, “s”, “m”, “h”. The value must be a positive duration.
cpu_manager_policy
Type: STRING
Provider name: cpuManagerPolicy
Description: Control the CPU management policy on the node. See https://kubernetes.io/docs/tasks/administer-cluster/cpu-management-policies/ The following values are allowed. * “none”: the default, which represents the existing scheduling behavior. * “static”: allows pods with certain resource characteristics to be granted increased CPU affinity and exclusivity on the node. The default value is ’none’ if unspecified.
insecure_kubelet_readonly_port_enabled
Type: BOOLEAN
Provider name: insecureKubeletReadonlyPortEnabled
Description: Enable or disable Kubelet read only port.
pod_pids_limit
Type: INT64
Provider name: podPidsLimit
Description: Set the Pod PID limits. See https://kubernetes.io/docs/concepts/policy/pid-limiting/#pod-pid-limits Controls the maximum number of processes allowed to run in a pod. The value must be greater than or equal to 1024 and less than 4194304.
linux_node_config
Type: STRUCT
Provider name: linuxNodeConfig
Description: Parameters that can be configured on Linux nodes.
cgroup_mode
Type: STRING
Provider name: cgroupMode
Description: cgroup_mode specifies the cgroup mode to be used on the node.
Possible values:
CGROUP_MODE_UNSPECIFIED
- CGROUP_MODE_UNSPECIFIED is when unspecified cgroup configuration is used. The default for the GKE node OS image will be used.
CGROUP_MODE_V1
- CGROUP_MODE_V1 specifies to use cgroupv1 for the cgroup configuration on the node image.
CGROUP_MODE_V2
- CGROUP_MODE_V2 specifies to use cgroupv2 for the cgroup configuration on the node image.
hugepages
Type: STRUCT
Provider name: hugepages
Description: Optional. Amounts for 2M and 1G hugepages
hugepage_size1g
Type: INT32
Provider name: hugepageSize1g
Description: Optional. Amount of 1G hugepages
hugepage_size2m
Type: INT32
Provider name: hugepageSize2m
Description: Optional. Amount of 2M hugepages
local_nvme_ssd_block_config
Type: STRUCT
Provider name: localNvmeSsdBlockConfig
Description: Parameters for using raw-block Local NVMe SSDs.
local_ssd_count
Type: INT32
Provider name: localSsdCount
Description: Number of local NVMe SSDs to use. The limit for this value is dependent upon the maximum number of disk available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information. A zero (or unset) value has different meanings depending on machine type being used: 1. For pre-Gen3 machines, which support flexible numbers of local ssds, zero (or unset) means to disable using local SSDs as ephemeral storage. 2. For Gen3 machines which dictate a specific number of local ssds, zero (or unset) means to use the default number of local ssds that goes with that machine type. For example, for a c3-standard-8-lssd machine, 2 local ssds would be provisioned. For c3-standard-8 (which doesn’t support local ssds), 0 will be provisioned. See https://cloud.google.com/compute/docs/disks/local-ssd#choose_number_local_ssds for more info.
local_ssd_count
Type: INT32
Provider name: localSsdCount
Description: The number of local SSD disks to be attached to the node. The limit for this value is dependent upon the maximum number of disks available on a machine per zone. See: https://cloud.google.com/compute/docs/disks/local-ssd for more information.
logging_config
Type: STRUCT
Provider name: loggingConfig
Description: Logging configuration.
variant_config
Type: STRUCT
Provider name: variantConfig
Description: Logging variant configuration.
variant
Type: STRING
Provider name: variant
Description: Logging variant deployed on nodes.
Possible values:
VARIANT_UNSPECIFIED
- Default value. This shouldn’t be used.
DEFAULT
- default logging variant.
MAX_THROUGHPUT
- maximum logging throughput variant.
machine_type
Type: STRING
Provider name: machineType
Description: The name of a Google Compute Engine machine type. If unspecified, the default machine type is e2-medium
.
min_cpu_platform
Type: STRING
Provider name: minCpuPlatform
Description: Minimum CPU platform to be used by this instance. The instance may be scheduled on the specified or newer CPU platform. Applicable values are the friendly names of CPU platforms, such as minCpuPlatform: "Intel Haswell"
or minCpuPlatform: "Intel Sandy Bridge"
. For more information, read how to specify min CPU platform.
node_group
Type: STRING
Provider name: nodeGroup
Description: Setting this field will assign instances of this pool to run on the specified node group. This is useful for running workloads on sole tenant nodes.
oauth_scopes
Type: UNORDERED_LIST_STRING
Provider name: oauthScopes
Description: The set of Google API scopes to be made available on all of the node VMs under the “default” service account. The following scopes are recommended, but not required, and by default are not included: * https://www.googleapis.com/auth/compute
is required for mounting persistent storage on your nodes. * https://www.googleapis.com/auth/devstorage.read_only
is required for communicating with gcr.io (the Google Container Registry). If unspecified, no scopes are added, unless Cloud Logging or Cloud Monitoring are enabled, in which case their required scopes will be added.
preemptible
Type: BOOLEAN
Provider name: preemptible
Description: Whether the nodes are created as preemptible VM instances. See: https://cloud.google.com/compute/docs/instances/preemptible for more information about preemptible VM instances.
reservation_affinity
Type: STRUCT
Provider name: reservationAffinity
Description: The optional reservation affinity. Setting this field will apply the specified Zonal Compute Reservation to this node pool.
consume_reservation_type
Type: STRING
Provider name: consumeReservationType
Description: Corresponds to the type of reservation consumption.
Possible values:
UNSPECIFIED
- Default value. This should not be used.
NO_RESERVATION
- Do not consume from any reserved capacity.
ANY_RESERVATION
- Consume any reservation available.
SPECIFIC_RESERVATION
- Must consume from a specific reservation. Must specify key value fields for specifying the reservations.
key
Type: STRING
Provider name: key
Description: Corresponds to the label key of a reservation resource. To target a SPECIFIC_RESERVATION by name, specify “compute.googleapis.com/reservation-name” as the key and specify the name of your reservation as its value.
values
Type: UNORDERED_LIST_STRING
Provider name: values
Description: Corresponds to the label value(s) of reservation resource(s).
resource_manager_tags
Type: STRUCT
Provider name: resourceManagerTags
Description: A map of resource manager tag keys and values to be attached to the nodes.
sandbox_config
Type: STRUCT
Provider name: sandboxConfig
Description: Sandbox configuration for this node.
sandbox_type
Type: STRING
Provider name: sandboxType
Description: Type of the sandbox to use for the node (e.g. ‘gvisor’)
type
Type: STRING
Provider name: type
Description: Type of the sandbox to use for the node.
Possible values:
UNSPECIFIED
- Default value. This should not be used.
GVISOR
- Run sandbox using gvisor.
secondary_boot_disk_update_strategy
Type: STRUCT
Provider name: secondaryBootDiskUpdateStrategy
Description: Secondary boot disk update strategy.
secondary_boot_disks
Type: UNORDERED_LIST_STRUCT
Provider name: secondaryBootDisks
Description: List of secondary boot disks attached to the nodes.
disk_image
Type: STRING
Provider name: diskImage
Description: Fully-qualified resource ID for an existing disk image.
mode
Type: STRING
Provider name: mode
Description: Disk mode (container image cache, etc.)
Possible values:
MODE_UNSPECIFIED
- MODE_UNSPECIFIED is when mode is not set.
CONTAINER_IMAGE_CACHE
- CONTAINER_IMAGE_CACHE is for using the secondary boot disk as a container image cache.
service_account
Type: STRING
Provider name: serviceAccount
Description: The Google Cloud Platform Service Account to be used by the node VMs. Specify the email address of the Service Account; otherwise, if no Service Account is specified, the “default” service account is used.
shielded_instance_config
Type: STRUCT
Provider name: shieldedInstanceConfig
Description: Shielded Instance options.
enable_integrity_monitoring
Type: BOOLEAN
Provider name: enableIntegrityMonitoring
Description: Defines whether the instance has integrity monitoring enabled. Enables monitoring and attestation of the boot integrity of the instance. The attestation is performed against the integrity policy baseline. This baseline is initially derived from the implicitly trusted boot image when the instance is created.
enable_secure_boot
Type: BOOLEAN
Provider name: enableSecureBoot
Description: Defines whether the instance has Secure Boot enabled. Secure Boot helps ensure that the system only runs authentic software by verifying the digital signature of all boot components, and halting the boot process if signature verification fails.
sole_tenant_config
Type: STRUCT
Provider name: soleTenantConfig
Description: Parameters for node pools to be backed by shared sole tenant node groups.
node_affinities
Type: UNORDERED_LIST_STRUCT
Provider name: nodeAffinities
Description: NodeAffinities used to match to a shared sole tenant node group.
key
Type: STRING
Provider name: key
Description: Key for NodeAffinity.
operator
Type: STRING
Provider name: operator
Description: Operator for NodeAffinity.
Possible values:
OPERATOR_UNSPECIFIED
- Invalid or unspecified affinity operator.
IN
- Affinity operator.
NOT_IN
- Anti-affinity operator.
values
Type: UNORDERED_LIST_STRING
Provider name: values
Description: Values for NodeAffinity.
spot
Type: BOOLEAN
Provider name: spot
Description: Spot flag for enabling Spot VM, which is a rebrand of the existing preemptible flag.
taints
Type: UNORDERED_LIST_STRUCT
Provider name: taints
Description: List of kubernetes taints to be applied to each node. For more information, including usage and the valid values, see: https://kubernetes.io/docs/concepts/configuration/taint-and-toleration/
effect
Type: STRING
Provider name: effect
Description: Effect for taint.
Possible values:
EFFECT_UNSPECIFIED
- Not set
NO_SCHEDULE
- NoSchedule
PREFER_NO_SCHEDULE
- PreferNoSchedule
NO_EXECUTE
- NoExecute
key
Type: STRING
Provider name: key
Description: Key for taint.
value
Type: STRING
Provider name: value
Description: Value for taint.
windows_node_config
Type: STRUCT
Provider name: windowsNodeConfig
Description: Parameters that can be configured on Windows nodes.
os_version
Type: STRING
Provider name: osVersion
Description: OSVersion specifies the Windows node config to be used on the node
Possible values:
OS_VERSION_UNSPECIFIED
- When OSVersion is not specified
OS_VERSION_LTSC2019
- LTSC2019 specifies to use LTSC2019 as the Windows Servercore Base Image
OS_VERSION_LTSC2022
- LTSC2022 specifies to use LTSC2022 as the Windows Servercore Base Image
workload_metadata_config
Type: STRUCT
Provider name: workloadMetadataConfig
Description: The workload metadata configuration for this node.
mode
Type: STRING
Provider name: mode
Description: Mode is the configuration for how to expose metadata to workloads running on the node pool.
Possible values:
MODE_UNSPECIFIED
- Not set.
GCE_METADATA
- Expose all Compute Engine metadata to pods.
GKE_METADATA
- Run the GKE Metadata Server on this node. The GKE Metadata Server exposes a metadata API to workloads that is compatible with the V1 Compute Metadata APIs exposed by the Compute Engine and App Engine Metadata Servers. This feature can only be enabled if Workload Identity is enabled at the cluster level.
node_metadata
Type: STRING
Provider name: nodeMetadata
Description: NodeMetadata is the configuration for how to expose metadata to the workloads running on the node.
Possible values:
UNSPECIFIED
- Not set.
SECURE
- Prevent workloads not in hostNetwork from accessing certain VM metadata, specifically kube-env, which contains Kubelet credentials, and the instance identity token. Metadata concealment is a temporary security solution available while the bootstrapping process for cluster nodes is being redesigned with significant security improvements. This feature is scheduled to be deprecated in the future and later removed.
EXPOSE
- Expose all VM metadata to pods.
GKE_METADATA_SERVER
- Run the GKE Metadata Server on this node. The GKE Metadata Server exposes a metadata API to workloads that is compatible with the V1 Compute Metadata APIs exposed by the Compute Engine and App Engine Metadata Servers. This feature can only be enabled if Workload Identity is enabled at the cluster level.
etag
Type: STRING
Provider name: etag
Description: This checksum is computed by the server based on the value of node pool fields, and may be sent on update requests to ensure the client has an up-to-date value before proceeding.
gcp_status
Type: STRING
Provider name: status
Description: Output only. The status of the nodes in this pool instance.
Possible values:
STATUS_UNSPECIFIED
- Not set.
PROVISIONING
- The PROVISIONING state indicates the node pool is being created.
RUNNING
- The RUNNING state indicates the node pool has been created and is fully usable.
RUNNING_WITH_ERROR
- The RUNNING_WITH_ERROR state indicates the node pool has been created and is partially usable. Some error state has occurred and some functionality may be impaired. Customer may need to reissue a request or trigger a new update.
RECONCILING
- The RECONCILING state indicates that some work is actively being done on the node pool, such as upgrading node software. Details can be found in the statusMessage
field.
STOPPING
- The STOPPING state indicates the node pool is being deleted.
ERROR
- The ERROR state indicates the node pool may be unusable. Details can be found in the statusMessage
field.
initial_node_count
Type: INT32
Provider name: initialNodeCount
Description: The initial node count for the pool. You must ensure that your Compute Engine resource quota is sufficient for this number of instances. You must also have available firewall and routes quota.
instance_group_urls
Type: UNORDERED_LIST_STRING
Provider name: instanceGroupUrls
Description: Output only. The resource URLs of the managed instance groups associated with this node pool. During the node pool blue-green upgrade operation, the URLs contain both blue and green resources.
labels
Type: UNORDERED_LIST_STRING
locations
Type: UNORDERED_LIST_STRING
Provider name: locations
Description: The list of Google Compute Engine zones in which the NodePool’s nodes should be located. If this value is unspecified during node pool creation, the Cluster.Locations value will be used, instead. Warning: changing node pool locations will result in nodes being added and/or removed.
management
Type: STRUCT
Provider name: management
Description: NodeManagement configuration for this NodePool.
auto_repair
Type: BOOLEAN
Provider name: autoRepair
Description: Whether the nodes will be automatically repaired.
auto_upgrade
Type: BOOLEAN
Provider name: autoUpgrade
Description: Whether the nodes will be automatically upgraded.
upgrade_options
Type: STRUCT
Provider name: upgradeOptions
Description: Specifies the Auto Upgrade knobs for the node pool.
auto_upgrade_start_time
Type: STRING
Provider name: autoUpgradeStartTime
Description: Output only. This field is set when upgrades are about to commence with the approximate start time for the upgrades, in RFC3339 text format.
description
Type: STRING
Provider name: description
Description: Output only. This field is set when upgrades are about to commence with the description of the upgrade.
max_pods_constraint
Type: STRUCT
Provider name: maxPodsConstraint
Description: The constraint on the maximum number of pods that can be run simultaneously on a node in the node pool.
max_pods_per_node
Type: INT64
Provider name: maxPodsPerNode
Description: Constraint enforced on the max num of pods per node.
name
Type: STRING
Provider name: name
Description: The name of the node pool.
network_config
Type: STRUCT
Provider name: networkConfig
Description: Networking configuration for this NodePool. If specified, it overrides the cluster-level defaults.
additional_node_network_configs
Type: UNORDERED_LIST_STRUCT
Provider name: additionalNodeNetworkConfigs
Description: We specify the additional node networks for this node pool using this list. Each node network corresponds to an additional interface
network
Type: STRING
Provider name: network
Description: Name of the VPC where the additional interface belongs
subnetwork
Type: STRING
Provider name: subnetwork
Description: Name of the subnetwork where the additional interface belongs
additional_pod_network_configs
Type: UNORDERED_LIST_STRUCT
Provider name: additionalPodNetworkConfigs
Description: We specify the additional pod networks for this node pool using this list. Each pod network corresponds to an additional alias IP range for the node
max_pods_per_node
Type: STRUCT
Provider name: maxPodsPerNode
Description: The maximum number of pods per node which use this pod network.
max_pods_per_node
Type: INT64
Provider name: maxPodsPerNode
Description: Constraint enforced on the max num of pods per node.
secondary_pod_range
Type: STRING
Provider name: secondaryPodRange
Description: The name of the secondary range on the subnet which provides IP address for this pod range.
subnetwork
Type: STRING
Provider name: subnetwork
Description: Name of the subnetwork where the additional pod network belongs.
create_pod_range
Type: BOOLEAN
Provider name: createPodRange
Description: Input only. Whether to create a new range for pod IPs in this node pool. Defaults are provided for pod_range
and pod_ipv4_cidr_block
if they are not specified. If neither create_pod_range
or pod_range
are specified, the cluster-level default (ip_allocation_policy.cluster_ipv4_cidr_block
) is used. Only applicable if ip_allocation_policy.use_ip_aliases
is true. This field cannot be changed after the node pool has been created.
enable_private_nodes
Type: BOOLEAN
Provider name: enablePrivateNodes
Description: Whether nodes have internal IP addresses only. If enable_private_nodes is not specified, then the value is derived from cluster.privateClusterConfig.enablePrivateNodes
network_performance_config
Type: STRUCT
Provider name: networkPerformanceConfig
Description: Network bandwidth tier configuration.
external_ip_egress_bandwidth_tier
Type: STRING
Provider name: externalIpEgressBandwidthTier
Description: Specifies the network bandwidth tier for the NodePool for traffic to external/public IP addresses.
Possible values:
TIER_UNSPECIFIED
- Default value
TIER_1
- Higher bandwidth, actual values based on VM size.
total_egress_bandwidth_tier
Type: STRING
Provider name: totalEgressBandwidthTier
Description: Specifies the total network bandwidth tier for the NodePool.
Possible values:
TIER_UNSPECIFIED
- Default value
TIER_1
- Higher bandwidth, actual values based on VM size.
pod_cidr_overprovision_config
Type: STRUCT
Provider name: podCidrOverprovisionConfig
Description: [PRIVATE FIELD] Pod CIDR size overprovisioning config for the nodepool. Pod CIDR size per node depends on max_pods_per_node. By default, the value of max_pods_per_node is rounded off to next power of 2 and we then double that to get the size of pod CIDR block per node. Example: max_pods_per_node of 30 would result in 64 IPs (/26). This config can disable the doubling of IPs (we still round off to next power of 2) Example: max_pods_per_node of 30 will result in 32 IPs (/27) when overprovisioning is disabled.
disable
Type: BOOLEAN
Provider name: disable
Description: Whether Pod CIDR overprovisioning is disabled. Note: Pod CIDR overprovisioning is enabled by default.
pod_ipv4_cidr_block
Type: STRING
Provider name: podIpv4CidrBlock
Description: The IP address range for pod IPs in this node pool. Only applicable if create_pod_range
is true. Set to blank to have a range chosen with the default size. Set to /netmask (e.g. /14
) to have a range chosen with a specific netmask. Set to a CIDR notation (e.g. 10.96.0.0/14
) to pick a specific range to use. Only applicable if ip_allocation_policy.use_ip_aliases
is true. This field cannot be changed after the node pool has been created.
pod_ipv4_range_utilization
Type: DOUBLE
Provider name: podIpv4RangeUtilization
Description: Output only. The utilization of the IPv4 range for the pod. The ratio is Usage/[Total number of IPs in the secondary range], Usage=numNodesnumZonespodIPsPerNode.
pod_range
Type: STRING
Provider name: podRange
Description: The ID of the secondary range for pod IPs. If create_pod_range
is true, this ID is used for the new range. If create_pod_range
is false, uses an existing secondary range with this ID. Only applicable if ip_allocation_policy.use_ip_aliases
is true. This field cannot be changed after the node pool has been created.
organization_id
Type: STRING
parent
Type: STRING
placement_policy
Type: STRUCT
Provider name: placementPolicy
Description: Specifies the node placement policy.
policy_name
Type: STRING
Provider name: policyName
Description: If set, refers to the name of a custom resource policy supplied by the user. The resource policy must be in the same project and region as the node pool. If not found, InvalidArgument error is returned.
tpu_topology
Type: STRING
Provider name: tpuTopology
Description: TPU placement topology for pod slice node pool. https://cloud.google.com/tpu/docs/types-topologies#tpu_topologies
type
Type: STRING
Provider name: type
Description: The type of placement.
Possible values:
TYPE_UNSPECIFIED
- TYPE_UNSPECIFIED specifies no requirements on nodes placement.
COMPACT
- COMPACT specifies node placement in the same availability domain to ensure low communication latency.
pod_ipv4_cidr_size
Type: INT32
Provider name: podIpv4CidrSize
Description: Output only. The pod CIDR block size per node in this node pool.
project_id
Type: STRING
project_number
Type: STRING
queued_provisioning
Type: STRUCT
Provider name: queuedProvisioning
Description: Specifies the configuration of queued provisioning.
enabled
Type: BOOLEAN
Provider name: enabled
Description: Denotes that this nodepool is QRM specific, meaning nodes can be only obtained through queuing via the Cluster Autoscaler ProvisioningRequest API.
resource_name
Type: STRING
self_link
Type: STRING
Provider name: selfLink
Description: Output only. Server-defined URL for the resource.
status_message
Type: STRING
Provider name: statusMessage
Description: Output only. Deprecated. Use conditions instead. Additional information about the current status of this node pool instance, if available.
Type: UNORDERED_LIST_STRING
update_info
Type: STRUCT
Provider name: updateInfo
Description: Output only. Update info contains relevant information during a node pool update.
blue_green_info
Type: STRUCT
Provider name: blueGreenInfo
Description: Information of a blue-green upgrade.
blue_instance_group_urls
Type: UNORDERED_LIST_STRING
Provider name: blueInstanceGroupUrls
Description: The resource URLs of the [managed instance groups] (/compute/docs/instance-groups/creating-groups-of-managed-instances) associated with blue pool.
blue_pool_deletion_start_time
Type: STRING
Provider name: bluePoolDeletionStartTime
Description: Time to start deleting blue pool to complete blue-green upgrade, in RFC3339 text format.
green_instance_group_urls
Type: UNORDERED_LIST_STRING
Provider name: greenInstanceGroupUrls
Description: The resource URLs of the [managed instance groups] (/compute/docs/instance-groups/creating-groups-of-managed-instances) associated with green pool.
green_pool_version
Type: STRING
Provider name: greenPoolVersion
Description: Version of green pool.
phase
Type: STRING
Provider name: phase
Description: Current blue-green upgrade phase.
Possible values:
PHASE_UNSPECIFIED
- Unspecified phase.
UPDATE_STARTED
- blue-green upgrade has been initiated.
CREATING_GREEN_POOL
- Start creating green pool nodes.
CORDONING_BLUE_POOL
- Start cordoning blue pool nodes.
WAITING_TO_DRAIN_BLUE_POOL
- Start waiting after cordoning the blue pool and before draining it.
DRAINING_BLUE_POOL
- Start draining blue pool nodes.
NODE_POOL_SOAKING
- Start soaking time after draining entire blue pool.
DELETING_BLUE_POOL
- Start deleting blue nodes.
ROLLBACK_STARTED
- Rollback has been initiated.
upgrade_settings
Type: STRUCT
Provider name: upgradeSettings
Description: Upgrade settings control disruption and speed of the upgrade.
blue_green_settings
Type: STRUCT
Provider name: blueGreenSettings
Description: Settings for blue-green upgrade strategy.
autoscaled_rollout_policy
Type: STRUCT
Provider name: autoscaledRolloutPolicy
Description: Autoscaled policy for cluster autoscaler enabled blue-green upgrade.
node_pool_soak_duration
Type: STRING
Provider name: nodePoolSoakDuration
Description: Time needed after draining entire blue pool. After this period, blue pool will be cleaned up.
standard_rollout_policy
Type: STRUCT
Provider name: standardRolloutPolicy
Description: Standard policy for the blue-green upgrade.
batch_node_count
Type: INT32
Provider name: batchNodeCount
Description: Number of blue nodes to drain in a batch.
batch_percentage
Type: FLOAT
Provider name: batchPercentage
Description: Percentage of the blue pool nodes to drain in a batch. The range of this field should be (0.0, 1.0].
batch_soak_duration
Type: STRING
Provider name: batchSoakDuration
Description: Soak time after each batch gets drained. Default to zero.
max_surge
Type: INT32
Provider name: maxSurge
Description: The maximum number of nodes that can be created beyond the current size of the node pool during the upgrade process.
max_unavailable
Type: INT32
Provider name: maxUnavailable
Description: The maximum number of nodes that can be simultaneously unavailable during the upgrade process. A node is considered available if its status is Ready.
strategy
Type: STRING
Provider name: strategy
Description: Update strategy of the node pool.
Possible values:
NODE_POOL_UPDATE_STRATEGY_UNSPECIFIED
- Default value if unset. GKE internally defaults the update strategy to SURGE for unspecified strategies.
BLUE_GREEN
- blue-green upgrade.
SURGE
- SURGE is the traditional way of upgrading a node pool. max_surge and max_unavailable determines the level of upgrade parallelism.
version
Type: STRING
Provider name: version
Description: The version of Kubernetes running on this NodePool’s nodes. If unspecified, it defaults as described here.