From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail.toke.dk X-Spam-Level: X-Spam-ASN: AS60781 77.235.32.0/19 X-Spam-Status: No, score=-101.9 required=5.0 tests=BAYES_00,SHORTCIRCUIT shortcircuit=ham autolearn=disabled version=3.4.1 Received: from mail.toke.dk by mail.toke.dk with LMTP id eIWDC8ACGVvkfgAAOr1fkg (envelope-from ) for ; Thu, 07 Jun 2018 12:02:40 +0200 Authentication-Results: mail.toke.dk; none (SPF check N/A for local connections - client-ip=77.235.54.103; helo=web6.sd.eurovps.com; envelope-from=flent-users-bounces@flent.org; receiver=) Authentication-Results: mail.toke.dk; dkim=fail reason="key not found in DNS" (0-bit key) header.d=flent.org header.i=@flent.org header.b=CrygvCRI; dkim=fail reason="signature verification failed" (1024-bit key) header.d=github.com header.i=@github.com header.b=hy6Yz2xV Received: from web6.sd.eurovps.com (web6.sd.eurovps.com [77.235.54.103]) by mail.toke.dk (Postfix) with ESMTPS id 0C7663E3BD6 for ; Thu, 7 Jun 2018 12:02:39 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=flent.org; s=default; h=Sender:Content-Type:Cc:Reply-To:List-Subscribe:List-Help: List-Post:List-Archive:List-Unsubscribe:List-Id:Subject:Mime-Version: References:In-Reply-To:Message-ID:To:From:Date:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=a3DAwmA6Kp2JKYkSjuVRRfL3pNXqRIVRK+1+6M/FYPc=; b=CrygvCRImxfk0b9zgkbNzulI2O TarcGILOS1Znrjz20rTrGKyJrKKdGgPsNwMHFBZSVwKmIrzXDnIMv9B6fKz2RN34LzHkvpjG/12aH wsynDXr2j25pDVcojSHIwoiknZCh6D3TnZisKZTtUI5hAS2cT1xz9vsNFO9G4rfcH5amNEMjJrULQ xMCmL0pfZIH2bNeFZd99TC2LeSncDDLoiE0h2FZRG8RnSo5N0DpOiZztMOa3KuN+HsQbn35ebQHvP Bnoocatauh1WchiQU6BxV/dbnCti3c1jtJoidofrGORhRT7KW3uef5GEru3HKu8cVPPkK9rOz0C7F mSrW2x6w==; Received: from [::1] (port=46715 helo=web6.sd.eurovps.com) by web6.sd.eurovps.com with esmtp (Exim 4.91) (envelope-from ) id 1fQrkb-008uV8-S9; Thu, 07 Jun 2018 13:02:37 +0300 Received: from o1.sgmail.github.com ([192.254.114.176]:31162) by web6.sd.eurovps.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.91) (envelope-from ) id 1fQrkW-008uHu-DE for flent-users@flent.org; Thu, 07 Jun 2018 13:02:35 +0300 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com; h=from:reply-to:to:cc:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe; s=s20150108; bh=T/xLsxfuZQHEnsK5MZz5mWEFasE=; b=hy6Yz2xVH2Na/8Cu 865VFC8rJXX7Qve8m63gncy+Do/eCBWjpboJRmtVVgYzmPATaDBsFBZBVBDfwHqk xRHp85+4O1vDvlwWP9fZHkIMgaU1UHWeu965AljYmSSnJmzgbptagmJr5eDKdngd XoAtHmczTLtcyNL0VDC9Xvlb7R8= Received: by filter0179p1iad2.sendgrid.net with SMTP id filter0179p1iad2-18447-5B19028E-1D 2018-06-07 10:01:50.495974687 +0000 UTC Received: from github-lowworker-f6df7df.cp1-iad.github.net (unknown [192.30.252.41]) by ismtpd0007p1iad1.sendgrid.net (SG) with ESMTP id c2Y4i3btRcKkRbN-7b471g for ; Thu, 07 Jun 2018 10:01:50.401 +0000 (UTC) Received: from github.com (localhost [127.0.0.1]) by github-lowworker-f6df7df.cp1-iad.github.net (Postfix) with ESMTP id 5E79A3E034C for ; Thu, 7 Jun 2018 03:01:50 -0700 (PDT) Date: Thu, 07 Jun 2018 10:01:50 +0000 (UTC) From: =?UTF-8?B?VG9rZSBIw7hpbGFuZC1Kw7hyZ2Vuc2Vu?= To: tohojo/flent Message-ID: In-Reply-To: References: Mime-Version: 1.0 Precedence: list X-GitHub-Sender: tohojo X-GitHub-Recipient: flent-users X-GitHub-Reason: subscribed X-Auto-Response-Suppress: All X-GitHub-Recipient-Address: flent-users@flent.org X-SG-EID: IRsowsd9yCOJafMG0EWGsh26xBq50lgDrxWUlCCqUnuWJj1fk7yl0e/4GYgHQPo3u28SpXDIMF54nk KU6c4uZqKs27I2xP5Q9xv+lskTx2KB2fX57dOt4LCAvWXJIqT75s1aqykjZ5fuurHUVOpARhenYmPW npE2+fRqlOaoMB0m1xFW9PFn1CWwfIcuO2kmdg3qwhIg8xBSDu37LaxLCjpezp04/dR3zdqMeOrwj2 h42I39kLEvUpynU1Qf8FVV Subject: Re: [Flent-users] [tohojo/flent] completion delay for an iperf script (#138) X-BeenThere: flent-users@flent.org X-Mailman-Version: 2.1.26 List-Id: Flent discussion list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: tohojo/flent Cc: Subscribed Content-Type: multipart/mixed; boundary="===============7994188559724714489==" Errors-To: flent-users-bounces@flent.org Sender: "Flent-users" X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - web6.sd.eurovps.com X-AntiAbuse: Original Domain - toke.dk X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - flent.org X-Get-Message-Sender-Via: web6.sd.eurovps.com: acl_c_authenticated_local_user: mailman/mailman X-Authenticated-Sender: web6.sd.eurovps.com: mailman@flent.org --===============7994188559724714489== Content-Type: multipart/alternative; boundary="--==_mimepart_5b19028e5bd50_131b2ae1b3e6cf5c85695"; charset=UTF-8 Content-Transfer-Encoding: 7bit ----==_mimepart_5b19028e5bd50_131b2ae1b3e6cf5c85695 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Matthieu Coudron writes: > `You just want to repeat a single download and measure its time,` > Yes that's exactly it. Right. Well, there are basically two ways you can go about this. Either you create a test that runs only a single test, capture the delay as a metadata item, and then the test multiple times to collect multiple data points (which will each go into its own data file), and plot the CDF over all of them (using a cdf_combine type plot). Or you go play with IterationAggregator. The combining of different runners into the toplevel data set is done by aggregators; most of the tests are returning timeseries data, i.e. where each runner is expected to return a timeseries data series. Single data points for a whole test run is stored as metadata (in the series_meta array). However, there's also some old code that does single-data-point-per-run. Before I realised that timeseries data was the most useful for my tests, I actually started out with exactly what you are describing: Using each test as a single data point and plotting those. That code still exists in the form of the IterationAggregator; but you'd have to write a new runner that outputs a single data point instead of the timeseries data, and obviously you wouldn't get the bandwidth output over the duration of the test. I think that the easiest approach is the first one, since the timeseries data is what's used most, and the other code might have bitrotted (not sure). If you don't mind using netperf, it's just a matter of adding ELAPSED_TIME as an output var and storing that in the metadata array. Then we'd need to add support for passing negative durations to netperf (that's how you specify a byte count), which is mostly a question of how to have a good API in Flent. With this, you could use the existing tcp_* tests and just add a plot to those... You could do something similar in the iperf runner as well, of course, it would just take a bit more parsing I think :) -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/tohojo/flent/issues/138#issuecomment-395365247 ----==_mimepart_5b19028e5bd50_131b2ae1b3e6cf5c85695 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Matthieu Coudron <notifications@github.com> writes:

> `You just want to repeat a single download and measure its time,`
> Yes that's exactly it.

Right. Well, there are basically two ways you can go about this. Either
you create a test that runs only a single test, capture the delay as a
metadata item, and then the test multiple times to collect multiple data
points (which will each go into its own data file), and plot the CDF
over all of them (using a cdf_combine type plot). Or you go play with
IterationAggregator.

The combining of different runners into the toplevel data set is done by
aggregators; most of the tests are returning timeseries data, i.e. where
each runner is expected to return a timeseries data series. Single data
points for a whole test run is stored as metadata (in the series_meta
array).

However, there's also some old code that does single-data-point-per-run= .
Before I realised that timeseries data was the most useful for my tests,
I actually started out with exactly what you are describing: Using each
test as a single data point and plotting those. That code still exists
in the form of the IterationAggregator; but you'd have to write a new runner that outputs a single data point instead of the timeseries data,
and obviously you wouldn't get the bandwidth output over the duration o= f
the test.

I think that the easiest approach is the first one, since the timeseries
data is what's used most, and the other code might have bitrotted (not<= br> sure). If you don't mind using netperf, it's just a matter of addin= g
ELAPSED_TIME as an output var and storing that in the metadata array.
Then we'd need to add support for passing negative durations to netperf=
(that's how you specify a byte count), which is mostly a question of ho= w
to have a good API in Flent. With this, you could use the existing tcp_*
tests and just add a plot to those...

You could do something similar in the iperf runner as well, of course,
it would just take a bit more parsing I think :)

&mda= sh;
You are receiving this because you are subscribed to this thread.<= br />Reply to this email directly, view it on GitHub, or mute the thread.3D""

= ----==_mimepart_5b19028e5bd50_131b2ae1b3e6cf5c85695-- --===============7994188559724714489== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Flent-users mailing list Flent-users@flent.org http://flent.org/mailman/listinfo/flent-users_flent.org --===============7994188559724714489==--