* Re: [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182)
2019-09-12 12:03 [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182) Rich Brown
@ 2019-09-12 12:09 ` Rich Brown
2019-09-13 16:13 ` Toke Høiland-Jørgensen
` (3 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Rich Brown @ 2019-09-12 12:09 UTC (permalink / raw)
To: tohojo/flent; +Cc: Subscribed
[-- Attachment #1.1: Type: text/plain, Size: 392 bytes --]
Update: dtaht (in https://github.com/tohojo/flent/issues/178#issuecomment-528885331) said of the ping times, "I have seen this statistic be wildly wrong in the summary but correct in the graph."
Related?
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/tohojo/flent/issues/182#issuecomment-530795911
[-- Attachment #1.2: Type: text/html, Size: 2125 bytes --]
[-- Attachment #2: Type: text/plain, Size: 151 bytes --]
_______________________________________________
Flent-users mailing list
Flent-users@flent.org
http://flent.org/mailman/listinfo/flent-users_flent.org
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182)
2019-09-12 12:03 [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182) Rich Brown
2019-09-12 12:09 ` Rich Brown
@ 2019-09-13 16:13 ` Toke Høiland-Jørgensen
2019-09-13 16:13 ` Toke Høiland-Jørgensen
` (2 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Toke Høiland-Jørgensen @ 2019-09-13 16:13 UTC (permalink / raw)
To: tohojo/flent; +Cc: Subscribed
[-- Attachment #1.1: Type: text/plain, Size: 828 bytes --]
Rich Brown <notifications@github.com> writes:
> Update: dtaht (in
> https://github.com/tohojo/flent/issues/178#issuecomment-528885331)
> said of the ping times, "I have seen this statistic be wildly wrong in
> the summary but correct in the graph."
Yes, this can be the case because of the way the summary values are
computed. However, it *should* be the case that what the summary outputs
is computed from the aggregate statistics that netperf outputs at the
end of the test where possible.
However, it seems there was a bug causing all this per-series metadata
to be cleared out before the file was saved. Not good! Will post a fix...
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/tohojo/flent/issues/182#issuecomment-531299423
[-- Attachment #1.2: Type: text/html, Size: 2269 bytes --]
[-- Attachment #2: Type: text/plain, Size: 151 bytes --]
_______________________________________________
Flent-users mailing list
Flent-users@flent.org
http://flent.org/mailman/listinfo/flent-users_flent.org
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182)
2019-09-12 12:03 [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182) Rich Brown
2019-09-12 12:09 ` Rich Brown
2019-09-13 16:13 ` Toke Høiland-Jørgensen
@ 2019-09-13 16:13 ` Toke Høiland-Jørgensen
2019-09-14 1:15 ` Rich Brown
2019-09-14 15:39 ` Toke Høiland-Jørgensen
4 siblings, 0 replies; 6+ messages in thread
From: Toke Høiland-Jørgensen @ 2019-09-13 16:13 UTC (permalink / raw)
To: tohojo/flent; +Cc: Subscribed
[-- Attachment #1.1: Type: text/plain, Size: 239 bytes --]
Closed #182 via ff465203dd7de78d87e0d88717068621b8159c28.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/tohojo/flent/issues/182#event-2632860804
[-- Attachment #1.2: Type: text/html, Size: 2224 bytes --]
[-- Attachment #2: Type: text/plain, Size: 151 bytes --]
_______________________________________________
Flent-users mailing list
Flent-users@flent.org
http://flent.org/mailman/listinfo/flent-users_flent.org
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182)
2019-09-12 12:03 [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182) Rich Brown
` (2 preceding siblings ...)
2019-09-13 16:13 ` Toke Høiland-Jørgensen
@ 2019-09-14 1:15 ` Rich Brown
2019-09-14 15:39 ` Toke Høiland-Jørgensen
4 siblings, 0 replies; 6+ messages in thread
From: Rich Brown @ 2019-09-14 1:15 UTC (permalink / raw)
To: tohojo/flent; +Cc: Subscribed
[-- Attachment #1.1: Type: text/plain, Size: 2803 bytes --]
Sorry to re-open, but the new version (Flent 1.9.9-git-ff46520) seems to fix the upload values for the Average - the individual streams sum to the displayed sum.
But the Median values still don't look right. Here are two runs of the same command:
```
bash-3.2$ flent -x -L -H flent-fremont.bufferbloat.net -t "flent-fremont.bufferbloat.net" --te=upload_streams=4 --te=ping_hosts=1.1.1.1 tcp_nup
Started Flent 1.9.9-git-ff46520 using Python 3.7.4.
Starting tcp_nup test. Expected run time: 70 seconds.
Data file written to ./tcp_nup-2019-09-13T210706.195971.flent-fremont_bufferbloat_net.flent.gz.
Summary of tcp_nup test run from 2019-09-14 01:07:06.195971
Title: 'flent-fremont.bufferbloat.net'
avg median # data pts
Ping (ms) ICMP : 101.23 101.00 ms 347
Ping (ms) ICMP 1.1.1.1 (extra) : 23.39 23.90 ms 347
TCP upload avg : 0.17 0.18 Mbits/s 354
TCP upload sum : 0.69 0.30 Mbits/s 354
TCP upload::1 : 0.16 0.17 Mbits/s 354
TCP upload::2 : 0.15 0.14 Mbits/s 354
TCP upload::3 : 0.19 0.20 Mbits/s 354
TCP upload::4 : 0.19 0.20 Mbits/s 354
```
```
bash-3.2$ flent -x -L -H flent-fremont.bufferbloat.net -t "flent-fremont.bufferbloat.net" --te=upload_streams=4 --te=ping_hosts=1.1.1.1 tcp_nup
Started Flent 1.9.9-git-ff46520 using Python 3.7.4.
Starting tcp_nup test. Expected run time: 70 seconds.
Data file written to ./tcp_nup-2019-09-13T211010.793062.flent-fremont_bufferbloat_net.flent.gz.
Summary of tcp_nup test run from 2019-09-14 01:10:10.793062
Title: 'flent-fremont.bufferbloat.net'
avg median # data pts
Ping (ms) ICMP : 102.19 102.00 ms 347
Ping (ms) ICMP 1.1.1.1 (extra) : 24.91 24.80 ms 341
TCP upload avg : 0.15 0.16 Mbits/s 354
TCP upload sum : 0.62 0.16 Mbits/s 354
TCP upload::1 : 0.12 0.13 Mbits/s 354
TCP upload::2 : 0.18 0.19 Mbits/s 354
TCP upload::3 : 0.18 0.19 Mbits/s 354
TCP upload::4 : 0.14 0.15 Mbits/s 354
bash-3.2$
```
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/tohojo/flent/issues/182#issuecomment-531433159
[-- Attachment #1.2: Type: text/html, Size: 4205 bytes --]
[-- Attachment #2: Type: text/plain, Size: 151 bytes --]
_______________________________________________
Flent-users mailing list
Flent-users@flent.org
http://flent.org/mailman/listinfo/flent-users_flent.org
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182)
2019-09-12 12:03 [Flent-users] [tohojo/flent] Incorrect "TCP upload sum" for tcp_nup, rrul, rrul_be tests (#182) Rich Brown
` (3 preceding siblings ...)
2019-09-14 1:15 ` Rich Brown
@ 2019-09-14 15:39 ` Toke Høiland-Jørgensen
4 siblings, 0 replies; 6+ messages in thread
From: Toke Høiland-Jørgensen @ 2019-09-14 15:39 UTC (permalink / raw)
To: tohojo/flent; +Cc: Subscribed
[-- Attachment #1.1: Type: text/plain, Size: 912 bytes --]
Rich Brown <notifications@github.com> writes:
> Sorry to re-open, but the new version (Flent 1.9.9-git-ff46520) seems
> to fix the upload values for the Average - the individual streams sum
> to the displayed sum.
>
> But the Median values still don't look right. Here are two runs of the
> same command:
Ah, no, the median has the same issue, but there is no per-test output
we can use, so we need to calculate it. And since the summary output
calculates a per-series median, the sum doesn't match up (which is not
too surprising; the median of the total throughput is not necessarily
the sum of the medians of each individual flow).
We could remove the median from the calculated data series if that is
less confusing?
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/tohojo/flent/issues/182#issuecomment-531489398
[-- Attachment #1.2: Type: text/html, Size: 2369 bytes --]
[-- Attachment #2: Type: text/plain, Size: 151 bytes --]
_______________________________________________
Flent-users mailing list
Flent-users@flent.org
http://flent.org/mailman/listinfo/flent-users_flent.org
^ permalink raw reply [flat|nested] 6+ messages in thread