▸ Agent Skills
45 min read

Nutanix Objects Manual: Monitoring, Alerts, and Event Notifications

MONITORING AND ALERTS IN NUTANIX

OBJECTS

Monitor object store usage, bucket performance, and system alerts in Nutanix Objects, with visibility rules based on user roles in Prism Central.You can monitor the usage and the performance of object stores and buckets, and you can also view system-generated alerts for Nutanix Objects.Non-admin users can view the usage and performance of object stores and buckets, and also view system-generated alerts for objects only if assigned a role with View Object Store permission by the admin user in Prism Central. Admins are Super Admins or Prism Admins in Prism Central; non-admins are Prism Central users without admin privileges.For more information on the built-in roles in Prism Central, see Built-in Role Management in the Security Guide.For the object counts that are shown at the object store instance level, Nutanix Objects counts each upload of a multipart upload as a separate object until the object is finalized. At the bucket level, only finalized objects are counted.For example, if you upload 10 objects with 5 parts each, the object store instance shows a count of 50, while the bucket shows 0 until the uploads are complete.

Viewing Performance of Object Stores

You can view and analyze the performance of an object store by placing the cursor anywhere on the horizontal axis to display the value at that time. You can also select the time interval (last 1 hour, 3 hours, 6 hours, 12 hours, and 24 hours) from the pull-down list above the graphs.

About this taskTo view the performance of an object store, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store to view its performance.

| The | Object Store page appears. Objects | Monitoring and Alerts in Nutanix Objects | | | — | — |

  1. Click Performance.

Figure 37: Object Store Performance Graph

The graph shows the following information:

a.Requests Per Second: Displays the following graphs:
• TheTotal graph displays the total input and output requests in each second in the object store or

bucket.

• ThePuts graph displays the total input in each second
• TheGets graph displays the total output in each second.
b.Throughput (MB per sec): The Throughput graph displays granular read-and-write throughput in

MB in each second.You can see the total in, total out, gets, puts, NFS reads, and NFS writes in a bucket.

c.Time to First Byte (GET Operations): This graph displays the time taken to read the first byte from

the object in milliseconds.

Viewing Performance of Buckets

You can view and analyze the performance of a bucket by placing the cursor anywhere on the horizontal axis to display the value at that time. You can also select the time interval (last 1 hour, 3 hours, 6 hours, 12 hours, and 24 hours) from the pull-down list above the graphs.

About this task

Note: The Throughput chart shows data for each connection. This data is not the cumulative throughput

across all the clients and connections. To view the performance of a bucket, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects. . In the object stores table, click the name of the object store to view its performance.
TheObject Store page appears.

4. Click the Bucket tab, and then click the name of the bucket from the Buckets list table, and then click

Performance.

Figure 38: Bucket Performance Graph

The graph displays the performance of the bucket.

a.Requests Per Second: Displays the following graphs:
• TheTotal graph displays the total input and output requests in each second in the object store or

bucket.

• ThePuts graph displays the total input in each second
• TheGets graph displays the total output in each second.
• TheNFS Reads graph displays the total NFS reads in each second.
• TheNFS Writes graph displays the total NFS writes in each second.
b.Throughput (MB per sec): This graph displays granular read-and-write throughput in MB per

second.You can see the total in, total out, gets, puts, NFS reads, and NFS writes in a bucket.

c.Time to First Byte (GET Operations): This graph displays the time taken to read the first byte from

the object in milliseconds.

Viewing Object Store Usage

The Usage tab displays the physical and logical storage usage. You can view the space used across all buckets in an object store.

About this taskTo view the object store usage, follow these steps:

Procedure

  1. Log on to the Prism Central web console. . In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store to view its usage.
TheObject Store page appears.
  1. Click Usage > Usage Summary.

Figure 39: Object Store Usage

The storage usage section displays the following information:Physical Usage: Displays the physical capacity used by the object store on the cluster.

• You can switch betweenAcross Clusters and Cluster wise for the required view in graph.
  • Total used and total usable storage for the cluster.• Space used across all buckets on the existing cluster displayed in a bar.• Total and free physical capacity of the cluster.• Logical capacity assigned for the object store.Logical Usage: Displays the logical capacity used by the object store on the cluster. As the

Redundancy Factor is 2 (RF-2), the data is stored in two backups.

  • Data stored locally• Data tiered to another S3 endpoint

Assigning Quota Policy to a User

Assigning a quota policy to a user Nutanix Objects to set soft and hard thresholds on storage limits of all buckets owned by the user and number of buckets created by the user within an object store. You can assign quota policy to multiple users at the same time. If a soft threshold is set and if any user exceeds the limit, they can still create buckets and objects, however an alert is raised in the Alerts page. However, if a hard threshold is set, then the user is restricted from exceeding the limit. For example, if a user has 20 TB storage and has six buckets, then storage for all the six buckets will be accounted. If you are an owner of a bucket and have shared your bucket with multiple users, then your storage quota will be used up even if other users use the shared bucket storage. Quota policies will be automatically removed within 24 hours after the user is deleted. If some multi-part operations are pending, those pending parts will count towards the quota. Objects | Monitoring and Alerts in Nutanix Objects |

Before you beginA non-admin user can assign quota policy to a user only after the administrator creates an access control policy on a role in Prism Central for the non-admin user. The specific role must have the following minimum permissions:

  • Create Quota Policy• Delete Quota Policy• View Quota Policy• View Object Store

Note: Administrators and non-admin users are Prism Central users with the following roles:

  • Administrator - A Super Admin or a Prism Admin in Prism Central.• Non-admin user - A Prism Central user without any administrator privileges.For more information on the built-in roles in Prism Central, see

Built-in Role Management in the Security Guide.

About this task

  • You cannot list the buckets only owned by a particular user. So, if you have exceeded your storage

quota and try to delete a bucket shared with you to release the storage space, the quota level remains as is. You have to delete your own bucket to release the storage space.For example, if user A has exceeded the storage quota and tries to list all the buckets, the bucket list will also contain the buckets that were shared with user A by user B. To release the storage space within user A quotas, if user A deletes objects in the buckets shared with user A by user B, the quota level remains as is.You can run get-bucket-acl command on the bucket to list the user owned buckets, and then delete the data from that bucket.

  • Quota policies are enforced for buckets or space usage across all namespaces, federated or non-

federated alike.

  • If federation is enabled, quotas for a particular owner/user are enforced only on the OSS cluster where

the policy was created and not on other OSS clusters which are part of the same federation.

Important:

  • Usage is accounted under the owner of the bucket, and not under the user who uploaded the

objects to the bucket.For example, user A and user B each have a 50 GiB quota. User A creates bucket X and shares it with user B, and both users upload 10 GiB to bucket X. User A’s usage is 20 GiB and user B’s usage is 0 GiB, because all usage is attributed to user A, the owner of bucket X.

  • Admin-created buckets (buckets created from the UI) are not accounted for under any quota.

To assign a quota policy to a user, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects. Objects | Monitoring and Alerts in Nutanix Objects |

3. In the object stores table, click the name of the object store to see the object store usage and to assign

quota policy to the users.

TheObject Store page appears.
  1. Click Usage > Quota Policy.5. Select the user for which you want to create the quota policy. If you are creating quota policy for the first time, skip this step. 6. Click + Create Policy.

Figure 40: Configure Quota

AConfigure Quota window appears.
  1. Select a user or multiple users from the People drop-down. You can create quote policy for multiple users simultaneously, but you cannot assign multiple quotas to the same user. 8. In the Quota Limit section, select either one check box or both check boxes, and enter the limit.
a. (Optional) Click theStorage Limit check box and enter the total storage capacity limit for the user.

Capacity Limit cannot be larger than the current available storage.

b. (Optional) Click theBucket Number Limit check box and enter the number of buckets the user can

create. . In the Quota Limit Enforcement section, select any of the following, and then click Save.

»Hard limit: Once the user reaches the specified quota limits, the request is blocked.
»Soft limit: Once the user has exceeded the specified quota limits, only alerts are raised and the

request is not blocked. You can always update the existing policy.A list of users with the configured storage- and bucket-quota, and the current usage is displayed.When the storage usage or bucket usage reaches 90% of the defined limit, you are notified with an exclamation mark.A background task checks for any violation of quota policies and generates this alert. So, it can take about an hour to generate the alert. On a heavily loaded object store, it can take up to a day to generate an alert. What to do nextYou can view the alerts. For more information, see Viewing Nutanix Objects Alerts on page 172.

Viewing Nutanix Objects Alerts

You can view any informational, warning, and critical alerts in a tabular format. The table presents each alert with the color-coded severity level, a description of the alert, and the time stamp.

About this task

a banner at the top of the page to open the Prism Central alerts page. To view object store alerts, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store.

| The | Object Store page appears. Objects | Monitoring and Alerts in Nutanix Objects | | | — | — |

  1. Click the Alerts tab.

Figure 41: Alerts List in the Nutanix Objects Alerts Page

The alerts table displays the following information:

Table 15: Alerts Table

FieldDescription
NameName of the alert
DescriptionDescription of the alert issue
SeveritySeverity level of the alert:
•Critical: Requires immediate attention
•Warning: Needs attention soon
•Info: Condition to be aware of.
CreatedNumber of days since the alert was created. Hover over the number of days to view the date and time when the alert was created. Objects
FieldDescription
SilencedSuppress an alert.
You can also suppress multiple alerts by usingSilence at the top-left of the screen.

Note:

  • Silencing alerts cannot be done from Prism Central alerts page.• Silencing of alerts is temporary.
You can useFilters at the top-right corner to filter the alerts you want to view. You can filter the alerts by
severity levels (Critical, Warning, and Info) and state (Active and Silenced).
You can also view these alerts from the Prism CentralAlerts page. The following image shows the
list of Nutanix Objects alerts on Prism CentralAlerts page. The Source Entity column for the Nutanix

Objects alerts will be the object store name.

Figure 42: Alerts List in the Prism Central Alerts page

Nutanix Objects Specific Alerts

The following tables describe the Nutanix Objects specific alerts.Apart from the Nutanix Objects specific alerts, alerts that monitor the underlying infrastructure of the Nutanix Objects clusters are also triggered. For more information on these alerts, contact Nutanix Support at https://portal.nutanix.com. For more information on MSP alerts on Nutanix Objects, see MSP Alerts on Nutanix Objects Clusters on page 183.

Table 16: Nutanix Objects Alert - High Time to First Byte

TitleHigh Time to First Byte
NameHighTimeToFirstByte
DescriptionThe HighTimeToFirstByte alert appears when the Time To First Byte (TTFB) for all the HTTP GET operations in the past 10 minutes exceeds 1 second.
Alert MessageGet operations issued to the object store in the past 10minutes have been showing TTFB of msec Objects
CauseHigh network latency, improper sizing, and component crashes may generateHighTimeToFirstByte alert.
ImpactThe response for Object GET requests becomes slow.
ResolutionDo the following: • Check for the networking issues impacting the nodes in the Prism Element cluster. • Check if the GETs in each second and PUTs
in each second shown on thePerformance page of the object store exceeds the estimated workload at the time of deployment. If there is an indication of an overload, consider reducing the workload on the Object Store Service (OSS). • Check for crashing services on the object store.• Check the Prism Element cluster on which you deployed the object store for any alerts that may be relevant to HighTimeToFirstByte alert.

Table 17: Nutanix Objects Alert - High Object Store Usage

TitleHigh Object Store Usage
NameHighObjectStoreUsage
DescriptionThe HighObjectStoreUsage alert appears when the total object store space usage exceeds the estimated capacity specified at the time of deployment.
Alert MessageCurrent object store usage TB exceeds theprovisioned capacity TB
CauseThe following may cause the HighObjectStoreUsage alert to generate. • Missing lifecycle management policies• Performing too many object operations.
ImpactObject store gets overloaded, thus causing slow performance. Objects
ResolutionDo the following: • Delete nonessential objects from the object store to reduce the number of objects in the object store. • If the object store usage is unexpectedly high based on the workload and available resources, check for misconfigured Lifecycle Policies on the buckets in the object that may be retaining objects longer than intended. • If the storage space on the Prism Element cluster outside of the object store is high, consider deleting nonessential VMs, snapshots, data, or adding extra nodes to free the storage space in the Prism Element cluster.

Table 18: Nutanix Objects Alert - High Error Rate

TitleHigh Error Rate
NameHighErrorRate
DescriptionThe HighErrorRate alert appears when the object store returns one or more HTTP 4XX or HTTP 5XX errors in each second for the last 10 minutes.
Alert MessageOperations issued to Nutanix Buckets have been failingwith 5XX/4XX errors with observed error rate /sover the past 10 minutes
CauseImproper credentials and component crashes may generate the HighErrorRate alert.
ImpactThe object store operations fail.
ResolutionDo the following: • Check the client applications for the correct access and secret key combination. • Check for any crashing services on the object store. • Check the Prism Element cluster on which you deployed the object store for any alerts that may be relevant to HighErrorRate alert.

Table 19: Nutanix Objects Alert - Endpoint Unreachable

TitleEndpoint <cluster_name> Unreachable
NameEndpointUnreachable
DescriptionThe EndpointUnreachable alert appears when connectivity to the remote endpoint is down. Objects
Alert MessageConnectivity to the remote endpoint <cluster_name>is down. Identify and fix the connectivity issue.
CauseThe network connectivity to the remote endpoint cluster is lost.
ImpactThis issue can result in object GET or PUT failures.
ResolutionCheck the network connectivity to the remote endpoint cluster and fix the connectivity issue.

Table 20: Nutanix Objects Replication Alert - Replication Pause Time For a Bucket Exceeded by 24

Hours

TitleReplication Pause Time For a Bucket Exceeded by 24 Hours
NamePauseReplicationWarningDurationTimeExceeded
DescriptionThe PauseReplicationWarningDurationTimeExceeded alert appears when the replication rule is paused for more than 24 hours and if at least one object was uploaded during the pause state.
Alert MessagePause replication duration time from source bucket to destination bucket has exceeded warning pause time by duration.
CauseThe replication rule was paused for more than 24 hours and at least one object was uploaded during the pause state.
ImpactIf the replication of a bucket is paused, it can cause potential data loss and bloat the number of objects pending for replication.
ResolutionResume the replication to avoid bloating the number of objects pending for replication.

Table 21: Nutanix Objects Replication Alert - Last replication sync time for a bucket exceeded by 12

hours

TitleLast replication sync time for a bucket exceeded by 12 hours
NameReplicationWarningRPOTimeExceeded
DescriptionThe ReplicationWarningRPOTimeExceeded alert appears when the replication of pending objects does not finish even after 12 hours of RPO.
Alert MessageLast sync time for bucket exceeded RPOtime by <time_period_secs>
CauseThe cause can be a combination of many reasons, such as low network bandwidth, sizing, replication failures, and so on. Objects
ImpactReplication for one bucket has not synced within expected time and can cause potential data loss.
ResolutionDo the following: • Check if any other replication alerts are generated. • Check the connectivity or if the available network bandwidth is sufficient. • Check for any alerts generated due to service crashes.

Table 22: Nutanix Objects Replication Alert - Last replication sync time for a bucket exceeded by 3

days

TitleLast replication sync time for a bucket exceeded by 3 days.
NameReplicationCriticalRPOTimeExceeded
DescriptionThe ReplicationCriticalRPOTimeExceeded alert appears when the replication of pending objects does not finish even after 3 days of RPO.
Alert MessageLast sync time from bucket to destination bucket exceededCritical RPO time by <time_period_secs>.
CauseThe cause can be a combination of many reasons, such as low network bandwidth, sizing, replication failures, and so on.
ImpactReplication of one bucket has not synced within expected time and can cause potential data loss.
ResolutionDo the following: • Check if any other replication alerts are generated. • Check the connectivity or if the available network bandwidth is sufficient. • Check for any alerts generated due to service crashes.

Table 23: Nutanix Objects Replication Alert - Replication Endpoint Storage Full

TitleReplication Endpoint Storage Full
NameReplicationEndpointStorageFull
DescriptionThe ReplicationEndpointStorageFull alert appears when the object store instance where the remote bucket exists runs out of storage space. Objects
Alert MessageStorage full on replication endpoint .
CauseThe remote objects instance storage becomes full.
ImpactReplication to the remote site fails since the destination object store is out of space.
ResolutionAdd capacity to the remote objects PE cluster or delete existing objects to create space.

Table 24: Nutanix Objects Replication Alert - Replication Endpoint Unreachable

TitleReplication Endpoint Unreachable
NameReplicationEndpointUnreachable
DescriptionThe ReplicationEndpointUnreachable alert appears when the object store instance where the remote bucket exists is unreachable for 15 mins.
Alert MessageReplication to endpoint has lostconnectivity for the last 15 minutes
CauseThe following can be the reasons for this alert: • The network connectivity to the remote object store instance is lost. • The remote object store instance is down.
ImpactReplication of bucket to remote site fails since remote site is unreachable.
ResolutionDo the following: • Check the network connectivity to the remote objects instance. • Check if the remote objects instance is up and running.

Table 25: Nutanix Objects Replication Alert - Bucket Sync Completed

TitleBucket Sync Completed
NamekBucketSyncCompleted
DescriptionThe system raises this alert to notify the user upon successful completion of the bucket sync operation.
Alert MessageSync operation has completed for bucket:source_bucket_ name
CauseThe synchronization of bucket replication has been completed, and the status has changed from “Running” to “Completed.”
ImpactAlerts are displayed on both Prism Central and
Nutanix ObjectsAlerts page. Objects
ResolutionNo resolution is required. The alert will automatically resolve itself after 7 days.

Table 26: Nutanix Objects Replication Alert - Few Nonconforming Nutanix Objects Skipped during

Sync

TitleFew nonconforming objects skipped during sync
NamekObjectsSkippedInSync_<bucket_name>
DescriptionThe system raises this alert this alert when the bucket synchronization operation skips certain objects during replication. This usually occurs when the versioning state of the skipped objects does not match the versioning state of the destination bucket
Alert MessageSome objects were skipped due to differing versionstates.: Match the bucket version state and reissue sync toreplicate all objects.
CauseSome objects were skipped because they have different version states.
ImpactAlerts are displayed on both Prism Central and
Nutanix ObjectsAlerts page.
ResolutionMatch the bucket version state and reissue sync to replicate all objects.

Table 27: Nutanix Objects Replication Alert - Replication Sync Operation on Bucket Stalled

TitleReplication Sync operation on bucket stalled

Name kBucketSyncProgressStalled

DescriptionThe system raises this alert when the bucket synchronization operation is stalled for longer than expected, indicating it is unable to make progress.
Alert MessageUnexpected error occurred while syncing bucket. IfReplication Sync does not complete, please contactNutanix support.
CauseAn unexpected error occurred while syncing the bucket.
ImpactAlerts are displayed on both Prism Central and
Nutanix ObjectsAlerts page.
ResolutionIf replication sync does not complete, contact Nutanix Support. Objects

Table 28: Nutanix Objects Replication Alert - Bucket Replication Sync has Pending Replication

Entries

TitleBucket Replication Sync has pending replication entries
NamekBucketSyncPendingEntriesTimeout
DescriptionThe system raises this alert when the bucket synchronization operation has pending replication entries for a long time.
Alert MessageReplication Sync operation is stuck for a while. Pleasecontact Nutanix support.
CauseThe replication synchronization operation has been stuck for a while.
ImpactAlerts are displayed on both Prism Central and
Nutanix ObjectsAlerts page.
ResolutionIf replication sync does not complete, contact Nutanix Support.

Table 29: Nutanix Objects NFS Alert - High NFS Ops Drop Rate

TitleHigh NFS Ops Drop Rate
NameHighNfsOpsDropRate
DescriptionThe HighNfsOpsDropRate alert is triggered when some of the NFS ops are not being executed for past 10 minutes.
Alert MessageDue to high payload, few operations submitted to NFSare not executed for the past 10 minutes. Operationsare dropped when the outstanding NFS operations haveexceeded the threshold value of 1000, or when the QoSqueue has reached its maximum capacity of 128 ops, orwhen the operation wasn’t admitted to the queue within10 seconds.
CauseThe following can be the reasons for this alert: • NFS payload is causing the number of ops to exceed the threshold value of 1000. • Overall high payload is causing QoS queue to reach its maximum capacity.
ImpactNFS ops are being dropped. Latencies may increase due to client retries. Objects
ResolutionDo the following: • Reduce the overall payload on the impacted bucket. • Modify maximum number of concurrent NFS requests.For example, in CentOS, this can be done by changing /proc/sys/sunrpc/tcp_slot_table_entries value to 128.

Table 30: Nutanix Objects Too Many Delete Markers

TitleToo Many Delete Markers
NamekTooManyDeleteMarkers
DescriptionThe kTooManyDeleteMarkers alert is an early warning triggered when the number of objects and delete markers in a bucket exceed safe thresholds.
Alert MessageThe average number of delete markers for each object isgreater than 1 million.
CauseThis typically occurs when a bucket is misconfigured with versioning enabled (instead of disabled), causing applications to leave behind delete markers that are never cleaned up.
ImpactAccumulated delete markers can lead to kTimeouts and other performance issues when serving LIST- class S3 requests.
ResolutionUse life-cycle policies on versioned buckets to define retention and expiry policies on delete- markers.

Table 31: Nutanix Objects Too Many Versions

TitleToo Many Versions
NamekTooManyVersions
DescriptionThe kTooManyVersions alert is an early warning triggered when average number of versions for each unique object name is greater than a set threshold 1000.
Alert MessageThe average number of versions for each object is greaterthan 1000.
CauseThis typically occurs when the average number of versions for each object is high.
ImpactCertain Nutanix Objects version APIs may experience performance degradation. Objects
ResolutionUse life-cycle policies on versioned buckets to define retention and expiry policies on non-current versions of objects.

MSP Alerts on Nutanix Objects Clusters

The following tables describe the MSP alerts on Nutanix Objects clusters. For more information on these alerts, contact Nutanix Support at https://portal.nutanix.com.

Table 32: MSP Alert - Kube Pod Crash Looping

TitleKube Pod Crash Looping
NameKubePodCrashLooping
DescriptionThe KubePodCrashLooping alert appears when a pod in the Nutanix Objects cluster is in a crash loop.
Alert MessagePod namespace/pod container is in waiting state dueto CrashLoopBackOff
CauseThe pod enters a crash loop because the application becomes unresponsive or crashes, leading Kubernetes to attempt automatic restarts.
ImpactService degradation or unavailability
ResolutionDo the following: • Check pod events. $ kubectl -n $NAMESPACE describe pod $POD • Check pod logs. $ kubectl -n $NAMESPACE logs $POD -c $CONTAINER

Table 33: MSP Alert - Kube Persistent Volume Filling Up

TitleKube Persistent Volume Filling Up
NameKubePersistentVolumeFillingUp
DescriptionThe KubePersistentVolumeFillingUp alert appears when a volume used by a stateful pod in the Nutanix Objects cluster is nearing its capacity.
Alert MessageThe PersistentVolume claimed bypersistentvolumeclaim in Namespace namespace is only value free.
CauseThe volume is filling up due to specific reasons related to the application..
ImpactService degradation Objects
ResolutionReview the application configuration. You might need to delete unnecessary data after identifying the cause.

Table 34: MSP Alert - Kube Client Certificate Expiration

TitleKube Client Certificate Expiration
NameKubeClientCertificateExpiration
DescriptionThe KubeClientCertificateExpiration alert appears when a client certificate used for authenticating to the Kubernetes API server is nearing its expiration date.
Alert MessageA client certificate used to authenticate to the apiserver isexpiring in less than 90 days. Please perform certificaterotation to avoid downtime. Check KB 13311.
CauseA client certificate used for authenticating to the Kubernetes API server is nearing its expiration date.
ImpactThe certificate is not automatically rotated and expires on the expiration date.
ResolutionPlan and upgrade MSP prior to the certificate expiration date. The MSP upgrade automatically rotates the certificate.

Table 35: MSP Alert - Kube API Down

TitleKube API Down
NameKubeAPIDown
DescriptionThe KubeAPIDown alert is triggered when the monitoring system cannot reach all Kubernetes API servers for more than 15 minutes.
Alert MessageKubeAPI has disappeared from Prometheus targetdiscovery.
CauseThe Kubernetes API server is not responding.
ImpactThe cluster might be partially or fully non-functional. Applications that do not use the Kubernetes API directly continue to function as expected, while services that use the Kubernetes API directly might exhibit erratic behavior. Objects
ResolutionDo the following: • Check pod events. $ kubectl -n kube-system describe pod -l component=kube-controller-manager One or two pods might be present. • Check the logs of each pod: $ kubectl -n kube-system logs $POD -c kube-apiserver

Table 36: MSP Alert - Kubelet Down

TitleKubelet Down
NameKubeletDown
DescriptionThe KubeletDown alert is triggered when the monitoring system cannot reach Kubelets of any of the cluster for over 15 minutes.
Alert MessageKubelet has disappeared from Prometheus targetdiscovery
CauseThe Kubernetes API server is not responding.
ImpactThis alert signifies a critical threat to the stability of the cluster. If there is no network issue affecting the ability of the monitoring system to collect Kubelet metrics, multiple nodes might be unable to respond to configuration changes for pods and other resources. Also, debugging tools like kubectlexec and kubectl logs might not work.
ResolutionCheck the status of nodes, recent events on node objects, or recent events in general: $ kubectl get nodes $ kubectl describe node $NODE_NAME $ kubectl get events –field-selector ‘involvedObject.kind=Node’ $ kubectl get events With SSH access to the nodes, access the logs for the Kubelet directly: $ sudo journalctl -u kubelet-master / kubelet-worker

For more information on Nutanix Objects specific alerts, see Nutanix Objects Specific Alerts on page 174. Objects | Monitoring and Alerts in Nutanix Objects |

NUTANIX OBJECTS NOTIFICATIONS

Notifications for Nutanix Objects enables you to send the completed events logs to the configured endpoints in your Nutanix Objects instance. This helps you with centralized events log management, thus enabling you to monitor and analyze the logs and identify performance or configuration issues. TCP is the supported protocol for Nutanix Objects notifications.The following endpoints are supported for logging the notification events:

•Syslog - System Logging Protocol is a standard protocol for sending events logs to the Syslog server.

Enter the hostname or host IP address and port number of your Syslog server when configuring the endpoints. The Syslog server should be up and running when performing the endpoint configuration in your Nutanix Objects instance.

•Nats-streaming - A lightweight, reliable streaming platform built on top of the core NATS platform

that provides persistent logs. Enter the hostname or host IP address and port number of your NATS streaming server when configuring the endpoints. NATS streaming server should be up and running when performing the endpoint configuration in your Nutanix Objects instance.

Note: The default topic used to create the NATS queue is OSSEvents. You can use this as the subject

while using the NATS client to connect to the NATS streaming server.

•Apache Kafka - Kafka is a distributed system consisting of servers and clients that communicate

through a high-performance TCP network protocol. It can be deployed on bare-metal hardware, virtual machines, and containers in on-premise as well as cloud environments. Enter the hostname or host IP address and port number of your Kafka server when configuring the endpoints. The Kafka server should be up and running when performing the endpoint configuration in your Nutanix Objects instance.

Notification Types for Nutanix Objects

There are two types of notifications for Nutanix Objects that can be enabled for either successful, or failed, or both successful and failed instance-level and data events.

•Instance-level events - All operations performed on a bucket. For example, create a bucket, update

a bucket, delete a bucket, enable versioning, and so on. The following instance-level events are supported for successful, or failed, or both successful and failed events: Note: All the instance-level events notifications are enabled by default once you configure the endpoints. You cannot enable or disable the notifications for a single instance-level event.

Table 37: S3 APIs for Only Successful Instance-level Events

Supported Instance-level EventsS3 APIs for Only Successful Instance-level Events
Create bucketS3:BucketCreated:Put
Delete bucketS3:BucketRemoved:Delete
Add bucket policyS3:BucketPolicy:Put
Enable static websiteS3:BucketWebsite:Put
Disable static websiteS3:BucketWebsite:Delete
Create bucket CORSS3:BucketCORS:Put Objects
Supported Instance-level EventsS3 APIs for Only Successful Instance-level Events
Delete bucket CORSS3:BucketCORS:Delete
Update bucket lifecycle policyS3:BucketLifecyclePolicy:Update
Delete bucket lifecycle policyS3:BucketLifecyclePolicy:Delete
Enable bucket lock (WORM)S3:BucketLock:Enabled
Disable bucket lock (WORM)S3:BucketLock:Disabled
Add bucket replication ruleS3:BucketReplication:Put
Delete bucket replication ruleS3:BucketReplication:Delete
Enable bucket versioningS3:BucketVersioning:Enabled
Suspend bucket versioningS3:BucketVersioning:Disabled
Enable bucket notificationS3:BucketNotify

Table 38: S3 APIs for Only Failed Instance-level Events

Supported Instance-level EventsS3 APIs for Only Failed Instance-level Events
Create bucketS3:BucketCreatedError:Put
Delete bucketS3:BucketRemovedError:Delete
Add bucket policyS3:BucketPolicyError:Put
Enable static websiteS3:BucketWebsiteError:Put
Disable static websiteS3:BucketWebsiteError:Delete
Create bucket CORSS3:BucketCORSError:Put
Delete bucket CORSS3:BucketCORSError:Delete
Update bucket lifecycle policyS3:BucketLifecyclePolicyError:Update
Delete bucket lifecycle policyS3:BucketLifecyclePolicyError:Delete
Enable bucket lock (WORM)S3:BucketLockError:Enabled
Disable bucket lock (WORM)S3:BucketLockError:Disabled
Add bucket replication ruleS3:BucketReplicationError:Put
Delete bucket replication ruleS3:BucketReplicationError:Delete
Enable bucket versioningS3:BucketVersioningError:Enabled
Suspend bucket versioningS3:BucketVersioningError:Disabled Objects
Supported Instance-level EventsS3 APIs for Only Failed Instance-level Events
Enable bucket notificationS3:BucketNotifyError

Table 39: S3 APIs for Both Successful and Failed Instance-level Events

Supported Instance-level EventsS3 APIs for Both Successful and Failed Instance-level Events
Create bucketS3:BucketCreated:Put and S3:BucketCreatedError:Put
Delete bucketS3:BucketRemoved:Delete and S3:BucketRemovedError:Delete
Add bucket policyS3:BucketPolicy:Put and S3:BucketPolicyError:Put
Enable static websiteS3:BucketWebsite:Put and S3:BucketWebsiteError:Put
Disable static websiteS3:BucketWebsite:Delete and S3:BucketWebsiteError:Delete
Create bucket CORSS3:BucketCORS:Put and S3:BucketCORSError:Put
Delete bucket CORSS3:BucketCORS:Delete and S3:BucketCORSError:Delete
Update bucket lifecycle policyS3:BucketLifecyclePolicy:Update and S3:BucketLifecyclePolicyError:Update
Delete bucket lifecycle policyS3:BucketLifecyclePolicy:Delete and S3:BucketLifecyclePolicyError:Delete
Enable bucket lock (WORM)S3:BucketLock:Enabled and S3:BucketLockError:Enabled
Disable bucket lock (WORM)S3:BucketLock:Disabled and S3:BucketLockError:Disabled
Add bucket replication ruleS3:BucketReplication:Put and S3:BucketReplicationError:Put
Delete bucket replication ruleS3:BucketReplication:Delete and S3:BucketReplicationError:Delete
Enable bucket versioningS3:BucketVersioning:Enabled and S3:BucketVersioningError:Enabled
Suspend bucket versioningS3:BucketVersioning:Disabled and S3:BucketVersioningError:Disabled
Enable bucket notificationS3:BucketNotify and S3:BucketNotifyError

For more information, see

  • Configuring Event Notifications in Nutanix Objects for Syslog on page 191.• Configuring Event Notifications in Nutanix Objects for Kafka on page 197

Objects | Nutanix Objects Notifications |

  • Configuring Event Notifications in Nutanix Objects for NATS on page 194The following is the structure of the notification output for instance-level events that get published to the

endpoints. {“EventType”:“s3:BucketCreated:Put”,“Key”:“first”,“Records”: [{“eventError”:“”,“eventVersion”:“2.0”,“eventSource”:“aws:s3”,“awsRegion”:“us- east-1”,“eventTime”:“2022-02-09T07:40:13Z”,“eventName”:“s3:BucketCreated:Put”,“userIdentity”: {“principalId”:“[email protected]”},“requestParameters”: {“sourceIPAddress”:“10.44.91.64”},“responseElements”: {“x-amz-id-2”:“110000+1229+2129+240”,“x-amz-request- id”:“110000+1229+2129+240”,“x-ntnx-origin-endpoint”:“0.0.0.0”},“s3”: {“s3SchemaVersion”:“1.0”,“configurationId”:“SuccessfulWriteManagementEvent”,“OSSDomain”:“rc4.eng.nutanix.com”,“bucket”: {“name”:“frst”,“ownerIdentity”: {“principalId”:“[email protected]”},“arn”:“arn:aws:s3:::frst”}}}],“level”:“info”,“msg”:“”,“time”:“2022-02-09T07:40:13Z”}

•Data events - Data events are specific to data operations. These events can be enabled for each

bucket. To enable notifications for successful, or failed, or both data events for a bucket, you need to

create notification rules. You can define the scope of a notification rule by selectingAll Objects or

Subset of objects. For more information, see Creating Notification Rules for Data Events in Nutanix

Objects on page 201.The following is the structure of the notification output for data events that get published to the endpoints. {“EventType”:“s3:ObjectCreated:Put”,“Key”:“put”,“Records”: [{“eventError”:“”,“eventVersion”:“2.0”,“eventSource”:“aws:s3”,“awsRegion”:“us- east-1”,“eventTime”:“2022-02-09T08:04:48Z”,“eventName”:“s3:ObjectCreated:Put”,“userIdentity”: {“principalId”:“[email protected]”},“requestParameters”: {“sourceIPAddress”:“10.44.91.64”},“responseElements”: {“x-amz-id-2”:“110000+1229+2791+297”,“x-amz-request- id”:“110000+1229+2791+297”,“x-ntnx-origin-endpoint”:“0.0.0.0”},“s3”: {“s3SchemaVersion”:“1.0”,“configurationId”:“5836c513-51ef-45a9-9c84-6a0c01996e40”,“OSSDomain”:“rc4.eng.nutanix.com”,“bucket”: {“name”:“put”,“ownerIdentity”: {“principalId”:“[email protected]”},“arn”:“arn:aws:s3:::put”},“object”: {“key”:“csv.docx”,“size”:“31”,“eTag”:“c7a74379a77360a6b85926adb8b2aafb”,“versionId”:“1”,“sequencer”:“110000+1229+2791+297”}}}],“level”:“info”,“msg”:“”,“time”:“2022-02-09T08:04:48Z”} The following data events are supported for successful, or failed, or both successful and failed events:

Note: You can enable notifications for all Nutanix Objects Create Events, Nutanix Objects Access Events,

or Nutanix Objects Delete Events, or you can choose to enable notifications for one or more sub-categories of Nutanix Objects Create Events (such as Put, Post, Copy, Multipart Upload Complete), Nutanix Objects Access Events (such as Get, Head), or Nutanix Objects Delete Events (such as Delete, Delete Markers).

Table 40: S3 APIs for Only Successful Data Events

Supported Data EventsS3 APIs for Only Successful Data Events
All Create Eventss3:ObjectCreated:*
Puts3:ObjectCreated:Put
Posts3:ObjectCreated:Post
Copys3:ObjectCreated:Copy
Multipart Uploads3:ObjectCreated:CompleteMultipartUpload
All Access Eventss3:ObjectAccessed:* Objects
Supported Data EventsS3 APIs for Only Successful Data Events
Gets3:ObjectAccessed:Get
Heads3:ObjectAccessed:Head
All Delete Eventss3:ObjectRemoved:*
Deletes3:ObjectRemoved:Delete
Delete Markerss3:ObjectRemoved:DeleteMarkerCreated

Table 41: S3 APIs for Only Failed Data Events

Supported Data EventsS3 APIs for Only Failed Data Events
All Create Eventss3:ObjectCreatedError:*
Puts3:ObjectCreatedError:Put
Posts3:ObjectCreatedError:Post
Copys3:ObjectCreatedError:Copy
Multipart Uploads3:ObjectCreatedError:CompleteMultipartUpload
All Access Eventss3:ObjectAccessedError:*
Gets3:ObjectAccessedError:Get
Heads3:ObjectAccessedError:Head
All Delete Eventss3:ObjectRemovedError:*
Deletes3:ObjectRemovedError:Delete
Delete Markerss3:ObjectRemovedError:DeleteMarkerCreated

Table 42: S3 APIs for Both Successful and Failed Data Events

Supported Data EventsS3 APIs for Both Successful and Failed Data Events
All Create Eventss3:ObjectCreated:* and s3:ObjectCreatedError:*
Puts3:ObjectCreated:Put and s3:ObjectCreatedError:Put
Posts3:ObjectCreated:Post and s3:ObjectCreatedError:Post
Copys3:ObjectCreated:Copy and s3:ObjectCreatedError:Copy
Multipart Uploads3:ObjectCreated:CompleteMultipartUpload and s3:ObjectCreatedError:CompleteMultipartUpload
All Access Eventss3:ObjectAccessed:* and s3:ObjectAccessedError:* Objects
Supported Data EventsS3 APIs for Both Successful and Failed Data Events
Gets3:ObjectAccessed:Get and s3:ObjectAccessedError:Get
Heads3:ObjectAccessed:Head and s3:ObjectAccessedError:Head
All Delete Eventss3:ObjectRemoved:* and s3:ObjectRemovedError:*
Deletes3:ObjectRemoved:Delete and s3:ObjectRemovedError:Delete
Delete Markerss3:ObjectRemoved:DeleteMarkerCreated and s3:ObjectRemovedError:DeleteMarkerCreated

Configuring Event Notifications in Nutanix Objects for Syslog

Specify endpoints when configuring event notifications. By default, only successful events are logged. You can choose success, failure, both, or none. Before you beginYou must set up and maintain your own Syslog, NATS, or Kafka servers.

About this taskNutanix Objects supports event notifications through Syslog, NATS, or Kafka. To log operations, enable

notifications to one of these services. Nutanix does not manage these services.Non-admin users can configure event notifications only if an admin assigns them a role with specific

permissions in Prism Central. Required permissions includeSet Notification Endpoint, View Notification

Endpoint, and View Object store. Admins are Super Admins or Prism Admins in Prism Central;

non-admins are Prism Central users without admin privileges. For more information, see Built-in Role Management in the Nutanix Security Guide.To configure Syslog notifications, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store to view its performance.
TheObject Store page appears.
  1. Click Endpoints > Notification Endpoints.
TheNotification Endpoints page appears to configure the endpoints by entering the endpoint server
details. The available endpoints areSyslog, Nats-streaming, and Kafka. You can enable any one of

these endpoints or all of them.When you add a notification endpoint (Syslog, NATS, or Kafka) with correctly formatted fields, the operation succeeds even if the endpoint is unreachable or invalid. Errors during setup appear on the Object Store list page.

5. Click Actions > Enable

Endpoint is enabled. Objects | Nutanix Objects Notifications |

6. For a syslog endpoint, click Actions > Edit

Edit notification endpoint window appears. . In Syslog tab, specify the server connection details.

Important: Syslog server must be up and running when performing the endpoint configuration in your

Nutanix Objects instance.

Figure 43: Notification Endpoints: Syslog

Objects | Nutanix Objects Notifications |

a. In theServer Address box, enter the host name and port number of your Syslog server in the Host

name:Port format.

b. In theLogged Events section, specify the Topic.
c. In theLogged Events section, select one of the following object store events for which you plan to
enable notifications. By default,Successful only option is selected.
•Successful and Failed: Logs both successful and failed object store events.
•Successful only: Logs only successful object store events.
•Failed only: Logs only failed object store events.
•None: Logs none of the object store events.
You can click theView Events List link to view the list of bucket events that are logged to the

endpoints. 8. Click Save to complete the events notification configuration.

Note: After saving notification endpoints for an object store, the notification status might take one minute

to display correctly. Also, changes to the notification configuration can take up to five minutes to take effect. What to do nextTo configure Kafka and NATS notification, see Configuring Event Notifications in Nutanix Objects for Kafka on page 197, Configuring Event Notifications in Nutanix Objects for NATS on page 194.You can now create notification rules for data events of the bucket, see Creating Notification Rules for Data Events in Nutanix Objects on page 201.

Configuring Event Notifications in Nutanix Objects for NATS

Specify endpoints when configuring event notifications. By default, only successful events are logged. You can choose success, failure, both, or none. Before you beginYou must set up and maintain your own Syslog, NATS, or Kafka servers.

About this taskNutanix Objects supports event notifications through Syslog, NATS, or Kafka. To log operations, enable

notifications to one of these services. Nutanix does not manage these services.Non-admin users can configure event notifications only if an admin assigns them a role with specific

permissions in Prism Central. Required permissions includeSet Notification Endpoint, View Notification

Endpoint, and View Object store. Admins are Super Admins or Prism Admins in Prism Central;

non-admins are Prism Central users without admin privileges. For more information, see Built-in Role Management in the Nutanix Security Guide.To configure events notifications, follow these steps:

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects. . In the object stores table, click the name of the object store to view its performance.
TheObject Store page appears.
  1. Click Endpoints > Notification Endpoints.
TheNotification Endpoints page appears to configure the endpoints by entering the endpoint server
details. The available endpoints areSyslog, Nats-streaming, and Kafka. You can enable any one of

these endpoints or all of them.When you add a notification endpoint (Syslog, NATS, or Kafka) with correctly formatted fields, the operation succeeds even if the endpoint is unreachable or invalid. Errors during setup appear on the Object Store list page.

5. Click Actions > Enable

Endpoint is enabled.

6. For a Nats-streaming endpoint, click Actions > Edit

Edit notification endpoint window appears. . In the Nats-streaming tab, specify the server connection details.

Important: Nats-streaming server must be up and running when performing the endpoint configuration

in your Nutanix Objects instance.

Figure 44: Notification Endpoints: Nats-Streaming

Objects | Nutanix Objects Notifications |

a. In theServer Address box, enter the host name and port number of your NATS server in the Host

name:Port format.

b. In theCluster ID box, enter the cluster ID of the server that you used to start the NATS server.
c. In theLogged Events section, specify the Topic.
d. In theLogged Events section, select one of the following object store events for which you plan to
enable notifications. By default,Successful only option is selected.
•Successful and Failed: Logs both successful and failed object store events.
•Successful only: Logs only successful object store events.
•Failed only: Logs only failed object store events.
•None: Logs none of the object store events.
You can clickView Events List link to view the list of bucket events that are logged to the endpoints.
  1. Click Save to complete the events notification configuration.

Note: After saving notification endpoints for an object store, the notification status might take one minute

to display correctly. Also, changes to the notification configuration can take up to five minutes to take effect. What to do nextTo configure Kafka and syslog notification, see Configuring Event Notifications in Nutanix Objects for Kafka on page 197, Configuring Event Notifications in Nutanix Objects for Syslog on page 191.You can now create notification rules for data events of the bucket, see Creating Notification Rules for Data Events in Nutanix Objects on page 201.

Configuring Event Notifications in Nutanix Objects for Kafka

Specify endpoints when configuring event notifications. By default, only successful events are logged. You can choose success, failure, both, or none. Before you beginYou must set up and maintain your own Syslog, NATS, or Kafka servers.

About this taskNutanix Objects supports event notifications through Syslog, NATS, or Kafka. To log operations, enable

notifications to one of these services. Nutanix does not manage these services.Non-admin users can configure event notifications only if an admin assigns them a role with specific

permissions in Prism Central. Required permissions includeSet Notification Endpoint, View Notification

Endpoint, and View Object store. Admins are Super Admins or Prism Admins in Prism Central;

non-admins are Prism Central users without admin privileges. For more information, see Built-in Role Management in the Nutanix Security Guide.To configure events notifications, follow these steps:

Procedure

  1. Log on to the Prism Central web console. . In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store to view its performance.
TheObject Store page appears.
  1. Click Endpoints > Notification Endpoints.
TheNotification Endpoints page appears to configure the endpoints by entering the endpoint server
details. The available endpoints areSyslog, Nats-streaming, and Kafka. You can enable any one of

these endpoints or all of them.When you add a notification endpoint (Syslog, NATS, or Kafka) with correctly formatted fields, the operation succeeds even if the endpoint is unreachable or invalid. Errors during setup appear on the Object Store list page.

5. Click Actions > Enable

Endpoint is enabled.

6. For a Kafka endpoint, click Actions > Edit

Edit notification endpoint window appears. . In the Kafka tab, specify the server connection and security protocol details. When adding a Kafka endpoint, if the OSSEvents topic does not exist, the system creates it. If it already exists, ensure it matches your Kafka server configuration.

Important: Kafka server must be up and running when performing the endpoint configuration in your

Nutanix Objects instance. Objects | Nutanix Objects Notifications |

Figure 45: Notification Endpoints: Kafka

In the Kafka tab, enter the following details: Objects | Nutanix Objects Notifications |

1. Server Address: Enter the host name and port number of your Kafka server in the hostname:port

format.

2. Security Protocol Configuration: Select one of the following options:

•None: Select this option to use no encryption or authentication.
•TLS: Select this option to encrypt communication using SSL/TLS. Upload the following files:
  • Root certificate• Client certificate• Client key
•mTLS: Select this option to use mutual TLS for encryption and client authentication. Upload the

following files:

  • Root certificate• Client certificate• Client key

3. Topic: Enter the topic name. If the OSSEvents topic does not exist, the system creates it

automatically.

4. Publish Message Key: Select No key for no message key. Select /

for publishing as a key for management level events and / as a key for data level events.

5. Object Store Events: Select one of the following options to determine which events are logged:

•Successful and Failed: Logs both successful and failed object store events.
•Successful only: Logs only successful object store events.
•Failed only: Logs only failed object store events.
•None: Does not log any object store events.
  1. Click Save to complete the events notification configuration.

Note: After saving notification endpoints for an object store, the notification status might take one minute

to display correctly. Also, changes to the notification configuration can take up to five minutes to take effect.

What to do nextTo configure Syslog and NATS notification, see Configuring Event Notifications in Nutanix Objects for

Syslog on page 191, Configuring Event Notifications in Nutanix Objects for NATS on page 194.You can now create notification rules for data events of the bucket, see Creating Notification Rules for Data Events in Nutanix Objects on page 201.

Creating Notification Rules for Data Events in Nutanix Objects

To track successfully completed data events, create notification rules for the buckets in Nutanix Objects.

About this taskNon-admin users can create notification rules for data events only if assigned a role with the following

permissions by the admin user in Prism Central. Objects | Nutanix Objects Notifications |

  • View Notification Endpoint• Edit Buckets

Users with this permission can create notification rules for data events across all buckets in the assigned object stores.

  • View Buckets• View Object StoreAdmins are Super Admins or Prism Admins in Prism Central; non-admins are Prism Central users without

admin privileges. For more information on the built-in roles in Prism Central, see Built-in Role Management in the Security Guide.To create a notification rule for a bucket, follow these steps.

Procedure

  1. Log on to the Prism Central web console.2. In the Application Switcher, click Objects.3. In the object stores table, click the name of the object store to view its performance.
TheObject Store page appears.

4. Click the Buckets tab, and then from the list of buckets, select the bucket for which you plan to create a

notification rule. 5. Click Data Event Notification.

TheData Event Notification page appears.
  1. Click Create Rule to open the Create Rule page. Configuring an endpoint is required to create notification rules. Configure endpoints that can be used to log both bucket events and data events. For more information, see Configuring Event Notifications in Nutanix Objects for Syslog on page 191, Configuring Event Notifications in Nutanix Objects for Kafka on page 197, and Configuring Event Notifications in Nutanix Objects for NATS on page 194. . (Optional) If a rule is already created for the bucket, click + Add Rule.

Figure 46: Create Rule

8. In the Create Rule page, follow these steps:

a. In theEndpoint list, select the endpoint where you plan the data events for this bucket to be logged.

The endpoints configured on the object store are listed in the dropdown here.To configure endpoints for your Nutanix Objects instance, see Configuring Event Notifications in Nutanix Objects for Syslog on page 191, Configuring Event Notifications in Nutanix Objects Objects | Nutanix Objects Notifications |

for Kafka on page 197, and Configuring Event Notifications in Nutanix Objects for NATS on page 194.

b. In theScope list, select All Objects or Subset of objects.
• If you selectAll Objects, the notification rule applies to all the objects.
• SelectSubset of objects to apply the notification rule to specific objects. You can filter Nutanix

Objects by entering a prefix, suffix, or both. Nutanix Objects with the prefix and suffix you specified are filtered and the rule applies to those objects.

Note:

• You cannot proceed without providing a suffix or prefix for the scopeSubset of

objects.

  • You can enter only one prefix and suffix. You can create another rule with a different

suffix and prefix.

c. In theData Events section, click the All Events check box to select all data events, or select a
check box next to the name of the events listed underObjects Create Events, Objects Access

Events, and Objects Delete Events, and choose from the following that you plan to log to the

endpoint.

•Successful and Failed: Logs both successful and failed object store events.
•Successful only: Logs only successful object store events.
•Failed only: Logs only failed object store events.
When you select theAll Events check box, all the Objects Create Events, Objects Access

Events, and Objects Delete Events are selected. 9. Click Save to complete, and then click Done to close the Create Rule page.

The notification rule you created appears in the list of data events notification rules on theData

Event Notification page. You can click All Events or Number Events in the Events column to view

Objects | Nutanix Objects Notifications |

the configured data events for that bucket. For example, click8 Events to view the 8 data events

configured.

Figure 47: Configured Notification Events

Also, you can delete a notification rule. In theData Event Notification page, select a notification rule
from the list, and then clickDelete.
After you create a notification rule for a bucket, the status in theNotifications column changes to

Enabled. Objects | Nutanix Objects Notifications |


Last updated Oct 08, 2026