Follow

What does the "Network Problem Detected" message mean?

Subject:

The QuantaStor system will periodically check the "ifconfig" output for dropped packets and will generate an alert like the one below if any are detected:

"alert_manager:100} Alert 'Network Problem Detected' : 'Dropped packets were detected on network port bond1"

OR

"alert_manager:100} Alert 'Network Problem Detected' :"Overruns were detected on network port eth1"

 

Details:

The QuantaStor system will check for dropped packets every 10 minutes and send an alert if between discovery cycles we see an increase of 5000 dropped packets or more on read or transmit. An alert will then be raised and will not alert again until another 5000 dropped packets are detected.

The alert behavior can be modified by editing the "/etc/quantastor.conf" file and adding the entries below and changing the value of the "dropped_throttling" variable:


[alerts]
dropped_throttling=5000

 

Possible cause:

These errors can be caused by overloading the network with replication jobs and can be resolved by throttling replication rate.

This can be done with the "Replication Rate Limit" throttling mechanism using the steps below:

• The "qs-util rratelimitset NN" command can be used to impose an artificial limit on the replication tasks for the system overall. This is intended to limit disk and network usage to a value below the limit on both the Primary and Secondary(Destination) Replication units.

The default Replication Throttle rate is 30MB/s.

Use the "qs-util rratelimitget" to verify current settings.

• Please note that this value is used for all replication tasks on a system and is taken in real time and divided up by any replication tasks running on the system.

If you have a rate limit of 200 but there are two replication tasks running, each task will be throttled to a maximum of 100MB/s of throughput.

When one of the replication tasks finishes, the remaining replication task will have a maximum throughput limit of 200MB/s. The same is true if more replication tasks are started, if a Replication task is running with a 200MB/s limit, and three other tasks are started, all four tasks will now each have a maximum throughput of 50MB/s.

 

Please review the link below for additional information:

QuantaStor_Admin_Guide#Remote_Replication_Bandwidth_Throttling

 

 

 

 

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk