From patchwork Wed Nov 27 14:02:29 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264087 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id B48EF14ED for ; Wed, 27 Nov 2019 14:02:55 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 8C85720863 for ; Wed, 27 Nov 2019 14:02:55 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="lIY+TUN4" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726655AbfK0OCy (ORCPT ); Wed, 27 Nov 2019 09:02:54 -0500 Received: from mail-lf1-f68.google.com ([209.85.167.68]:44467 "EHLO mail-lf1-f68.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726664AbfK0OCx (ORCPT ); Wed, 27 Nov 2019 09:02:53 -0500 Received: by mail-lf1-f68.google.com with SMTP id v201so16207862lfa.11 for ; Wed, 27 Nov 2019 06:02:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ZlId46raQm99CyqcEPElFx6Ys5AGmgS/V/H8bCM/z48=; b=lIY+TUN4fqwlMq4rl594dFB4H+1UHwNy7vx9kSSZllgqf6MzN94d14y9D7XmP9maBH 2VWUV5faNUW8ebXXXfUZ+Ml2rPqDk1fM31flzEaZ2RLlN9PlHJ4OX1CayTUJX9CDpsyb PbDMYdERBuv8o6yYJvAvxLvFCvjqH9DiNpd4L3MMSsXNrSc7vYkJc1g6C/ojpLyJE7xM +7yclOj+2DbFQz0XI6BeUKVmPcNnIsozgjIMC5NyVbMz/fdNHeWxuorWOw/OZvxsVee3 mmfDSPrL/ae1gN/6xclblQGJadWBWKzBL/PQuChAWPHtF0lzk+BdABPd0KhIvjLyGz2F 2ZZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ZlId46raQm99CyqcEPElFx6Ys5AGmgS/V/H8bCM/z48=; b=sM1ereanQEpaqj3mXvhGXjbp2vmQWHuze75SG1yT4Pe21YjZcMyQJfylO5EeONTAgp Sm3V7Ict9iOv1XXSXKL1jJAX9wikOW+w6rd0HH722EbIKQAs1FCqg8R4xlVhNzM2Kbeu OHm9rJZCEBi8aBeaWcqEb5zm2YfDGxaIwM8HJ5EQ3YQ2Toxwi9ubaStal04tsIm2HH+e 7QnZlrpzhnPx0c8Tpt/xm5YBOd/+MU8IMS0bKLo87t+uv5Y5c5j7IGZqMJSq0oB6uzD4 oVkAZpmDBGWGVZDD06qYdJnIPD7XxoOVakW2sTlre5NxPT03L5+GSmYkmPSKFPgUlzT/ Yx5w== X-Gm-Message-State: APjAAAXqFOM4vhJQZhICEwHhVMLpve7tZk3/8+dH0gbPOj7RNNOwerDg k1941m2jdPkJ0uhExVenRsh9p3gJz+k= X-Google-Smtp-Source: APXvYqyfbVNkEp9ptutcT/HIk23YGDMu0z7cpjJumcXMtjv2ff2Py1UygXpNirH0xkzUCQRU0hyehw== X-Received: by 2002:ac2:5b0f:: with SMTP id v15mr17717594lfn.99.1574863370840; Wed, 27 Nov 2019 06:02:50 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:50 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 01/19] trace-cmd: Implement new lib API: tracecmd_local_events_system() Date: Wed, 27 Nov 2019 16:02:29 +0200 Message-Id: <20191127140247.258766-2-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov The new tracecmd lib API tracecmd_local_events_system() creates a tep handler and initializes it with the events of the specified subsystems. Signed-off-by: Tzvetomir Stoyanov --- include/trace-cmd/trace-cmd.h | 4 +- lib/trace-cmd/trace-util.c | 102 +++++++++++++++++++++++----------- 2 files changed, 72 insertions(+), 34 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 13afce7..9363a26 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -27,8 +27,10 @@ extern int tracecmd_disable_plugins; char **tracecmd_event_systems(const char *tracing_dir); char **tracecmd_system_events(const char *tracing_dir, const char *system); struct tep_handle *tracecmd_local_events(const char *tracing_dir); +struct tep_handle *tracecmd_local_events_system(const char *tracing_dir, + const char * const *sys_names); int tracecmd_fill_local_events(const char *tracing_dir, - struct tep_handle *pevent, int *parsing_failures); + struct tep_handle *tep, int *parsing_failures); char **tracecmd_local_plugins(const char *tracing_dir); char **tracecmd_add_list(char **list, const char *name, int len); diff --git a/lib/trace-cmd/trace-util.c b/lib/trace-cmd/trace-util.c index 8aa3b6c..311f183 100644 --- a/lib/trace-cmd/trace-util.c +++ b/lib/trace-cmd/trace-util.c @@ -613,39 +613,20 @@ static int read_header(struct tep_handle *pevent, const char *events_dir) return ret; } -/** - * tracecmd_local_events - create a pevent from the events on system - * @tracing_dir: The directory that contains the events. - * - * Returns a pevent structure that contains the pevents local to - * the system. - */ -struct tep_handle *tracecmd_local_events(const char *tracing_dir) +static bool contains(const char *name, const char * const *names) { - struct tep_handle *pevent = NULL; - - pevent = tep_alloc(); - if (!pevent) - return NULL; - - if (tracecmd_fill_local_events(tracing_dir, pevent, NULL)) { - tep_free(pevent); - pevent = NULL; - } - - return pevent; + if (!names) + return false; + for (; *names; names++) + if (strcmp(name, *names) == 0) + return true; + return false; } -/** - * tracecmd_fill_local_events - Fill a pevent with the events on system - * @tracing_dir: The directory that contains the events. - * @pevent: Allocated pevent which will be filled - * @parsing_failures: return number of failures while parsing the event files - * - * Returns whether the operation succeeded - */ -int tracecmd_fill_local_events(const char *tracing_dir, - struct tep_handle *pevent, int *parsing_failures) +static int tracecmd_fill_local_events_system(const char *tracing_dir, + struct tep_handle *tep, + const char * const *sys_names, + int *parsing_failures) { struct dirent *dent; char *events_dir; @@ -674,7 +655,7 @@ int tracecmd_fill_local_events(const char *tracing_dir, goto out_free; } - ret = read_header(pevent, events_dir); + ret = read_header(tep, events_dir); if (ret < 0) { ret = -1; goto out_free; @@ -687,7 +668,8 @@ int tracecmd_fill_local_events(const char *tracing_dir, if (strcmp(name, ".") == 0 || strcmp(name, "..") == 0) continue; - + if (sys_names && !contains(name, sys_names)) + continue; sys = append_file(events_dir, name); ret = stat(sys, &st); if (ret < 0 || !S_ISDIR(st.st_mode)) { @@ -695,7 +677,7 @@ int tracecmd_fill_local_events(const char *tracing_dir, continue; } - ret = load_events(pevent, name, sys); + ret = load_events(tep, name, sys); free(sys); @@ -713,6 +695,60 @@ int tracecmd_fill_local_events(const char *tracing_dir, return ret; } +/** + * tracecmd_local_events_system - create a tep from the events of the specified subsystem. + * + * @tracing_dir: The directory that contains the events. + * @sys_name: Array of system names, to load the events from. + * The last element from the array must be NULL + * + * Returns a tep structure that contains the tep local to + * the system. + */ +struct tep_handle *tracecmd_local_events_system(const char *tracing_dir, + const char * const *sys_names) +{ + struct tep_handle *tep = NULL; + + tep = tep_alloc(); + if (!tep) + return NULL; + + if (tracecmd_fill_local_events_system(tracing_dir, tep, sys_names, NULL)) { + tep_free(tep); + tep = NULL; + } + + return tep; +} + +/** + * tracecmd_local_events - create a pevent from the events on system + * @tracing_dir: The directory that contains the events. + * + * Returns a pevent structure that contains the pevents local to + * the system. + */ +struct tep_handle *tracecmd_local_events(const char *tracing_dir) +{ + return tracecmd_local_events_system(tracing_dir, NULL); +} + +/** + * tracecmd_fill_local_events - Fill a pevent with the events on system + * @tracing_dir: The directory that contains the events. + * @tep: Allocated tep handler which will be filled + * @parsing_failures: return number of failures while parsing the event files + * + * Returns whether the operation succeeded + */ +int tracecmd_fill_local_events(const char *tracing_dir, + struct tep_handle *tep, int *parsing_failures) +{ + return tracecmd_fill_local_events_system(tracing_dir, tep, + NULL, parsing_failures); +} + /** * tracecmd_local_plugins - returns an array of available tracer plugins * @tracing_dir: The directory that contains the tracing directory From patchwork Wed Nov 27 14:02:30 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264089 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id DC92015AB for ; Wed, 27 Nov 2019 14:02:55 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id BD64B2075C for ; Wed, 27 Nov 2019 14:02:55 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="VZJP438B" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726920AbfK0OCy (ORCPT ); Wed, 27 Nov 2019 09:02:54 -0500 Received: from mail-lf1-f67.google.com ([209.85.167.67]:44467 "EHLO mail-lf1-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726655AbfK0OCx (ORCPT ); Wed, 27 Nov 2019 09:02:53 -0500 Received: by mail-lf1-f67.google.com with SMTP id v201so16207904lfa.11 for ; Wed, 27 Nov 2019 06:02:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=fT9xQH8HUdkRlHUX669ipLmb6sWWPVwYlySY8sYag00=; b=VZJP438Bei9KSqmbmbSPgh0tCrTAkQx7OFJbtIMWflfkOvFtkukaB5MYUi+SZ0tR2n /89abzv/upzYiMIySFKqK4m0UeeuhgYn9fkm1WHzCMetqVREvjBzQaL5Vzlt7QgUEwjB KAJ0CFlT3wBBDLG0IZr1TxcPPPjULbZhC5PtyH78Y1DU5zeDDPuPba0UCtPofpaWhVIx uRc8sWMLOwiTicLxwCisIa1rtop/V+fzCuO4cY4jzJF8jm9mHuWjMHRDvXw8w0XjGs8U vT/8gw2A9C6PFxj2YpsKdwcXbZw57z9z6iWag3pOw/39ITimNSi2KpAQh6dIuHudxkEI ZknA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=fT9xQH8HUdkRlHUX669ipLmb6sWWPVwYlySY8sYag00=; b=BS6KkL4xqBQ2D41XovrNQQntfh6Ri9Z36vClCPX6nTFXRWEcJXptK8IMj8uM+WrUym 25SNOINxv8qwTJCGo/m0vOU8rd8e0tjFXjPkze+eyBS5jnv6MFcBtPrbpA5Nwg29mOVk 5e9SH/rwFrSNbwS4eQmcb8lBM6sSPCMP/9iwin78RsfY0899WQ3QH7fLJK2k0tc5MM5V 5UdWBPaoXxPZIk2yPQ7FuqhQUgBsv/F8TqhB5vdINY6zWPk/b6MAksPldWWatkaiosq5 /Cm9zz/rRcdnuQKpqXyDy7d4Vrfq2hAobJRtpiCuw5RIWectzez9JGFzOiTZ38zPTiAe nCcQ== X-Gm-Message-State: APjAAAVj5ZElQvYjgRf/HNh7MO69M6VaTVtirbTOiZbXcL6TZ6G2o2S3 hz+9u9T13/zubzABB8Rk/+sutngvJpk= X-Google-Smtp-Source: APXvYqyhzbXRCHskHXJBvIFkDtk5kaOdofgLaJg32IWv0yi/zxeX/ZId9+QPp0z+rHNVbOqZNFfZoQ== X-Received: by 2002:ac2:4849:: with SMTP id 9mr28643705lfy.11.1574863371932; Wed, 27 Nov 2019 06:02:51 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:51 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 02/19] trace-cmd: Add support for negative time offsets in trace.dat file Date: Wed, 27 Nov 2019 16:02:30 +0200 Message-Id: <20191127140247.258766-3-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov When synchronizing timestamps between different machines, there are cases when the time offset is negative. This patch changes the way time offset is written and read from trace.dat file - as signed decimal, instead of hex. Signed-off-by: Tzvetomir Stoyanov --- include/trace-cmd/trace-cmd.h | 2 +- lib/trace-cmd/trace-input.c | 6 +++--- tracecmd/trace-read.c | 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 9363a26..7f9cb73 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -138,7 +138,7 @@ const char *tracecmd_buffer_instance_name(struct tracecmd_input *handle, int ind struct tracecmd_input *tracecmd_buffer_instance_handle(struct tracecmd_input *handle, int indx); int tracecmd_is_buffer_instance(struct tracecmd_input *handle); -void tracecmd_set_ts_offset(struct tracecmd_input *handle, unsigned long long offset); +void tracecmd_set_ts_offset(struct tracecmd_input *handle, long long offset); void tracecmd_set_ts2secs(struct tracecmd_input *handle, unsigned long long hz); void tracecmd_print_events(struct tracecmd_input *handle, const char *regex); diff --git a/lib/trace-cmd/trace-input.c b/lib/trace-cmd/trace-input.c index 3b187e3..91362f3 100644 --- a/lib/trace-cmd/trace-input.c +++ b/lib/trace-cmd/trace-input.c @@ -90,7 +90,7 @@ struct tracecmd_input { bool read_page; bool use_pipe; struct cpu_data *cpu_data; - unsigned long long ts_offset; + long long ts_offset; double ts2secs; char * cpustats; char * uname; @@ -2127,7 +2127,7 @@ static int init_cpu(struct tracecmd_input *handle, int cpu) } void tracecmd_set_ts_offset(struct tracecmd_input *handle, - unsigned long long offset) + long long offset) { handle->ts_offset = offset; } @@ -2305,7 +2305,7 @@ tracecmd_search_task_map(struct tracecmd_input *handle, static int handle_options(struct tracecmd_input *handle) { - unsigned long long offset; + long long offset; unsigned short option; unsigned int size; char *cpustats = NULL; diff --git a/tracecmd/trace-read.c b/tracecmd/trace-read.c index 4958fa8..1875b75 100644 --- a/tracecmd/trace-read.c +++ b/tracecmd/trace-read.c @@ -58,7 +58,7 @@ static struct list_head handle_list; struct input_files { struct list_head list; const char *file; - unsigned long long tsoffset; + long long tsoffset; unsigned long long ts2secs; }; static struct list_head input_files; @@ -1453,7 +1453,7 @@ void trace_report (int argc, char **argv) struct input_files *inputs; struct handle_list *handles; enum output_type otype; - unsigned long long tsoffset = 0; + long long tsoffset = 0; unsigned long long ts2secs = 0; unsigned long long ts2sc; int show_stat = 0; From patchwork Wed Nov 27 14:02:31 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264091 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 271EA13A4 for ; Wed, 27 Nov 2019 14:02:56 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 06A7C20678 for ; Wed, 27 Nov 2019 14:02:56 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="oLukeEr5" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726664AbfK0OCz (ORCPT ); Wed, 27 Nov 2019 09:02:55 -0500 Received: from mail-lf1-f65.google.com ([209.85.167.65]:33821 "EHLO mail-lf1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727022AbfK0OCy (ORCPT ); Wed, 27 Nov 2019 09:02:54 -0500 Received: by mail-lf1-f65.google.com with SMTP id l28so17300238lfj.1 for ; Wed, 27 Nov 2019 06:02:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=xcPmnM5x0UQ4YKDSV2MogiGotivYJlB+VWUCe41AAqY=; b=oLukeEr5R57LjFufV0FaI4zgibvG6Xj61+P7T41ZN+IdFQlWK8ywO0B/a1QuA3S4aH ROkW9kQ35Ek6Mx94cW12/5ECQ3uRK2vUba8g80vlNhvMeIC2tAB6ZYuuU2YSq5Do5YJU JhjY5slVNg6QWnE0rD6UjgsSyljopSVpXSwhnV32DF5YIQbVWcHPMb9VG9UK8GbpxtNJ fArelUZedcthmt7NopwGPVm3zos4hokLAbJwHoSWErGehF3TcxzEGQRWBMIoXL1djXxk YGnEC/Bu6Rg79kCMBixdW6wCtzgzRFQmc0NprN1xHUbRl0b6gVflHjQQ9CPKDaBobYsn c+7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=xcPmnM5x0UQ4YKDSV2MogiGotivYJlB+VWUCe41AAqY=; b=PWe6AWYLmt7NOqPO+eSdznqkrrxmwhWlDQyj8FXal7Zc37f35s8qwWyjAolozXyqo2 NkVS94tGS8yS/Obbpoe8cZigAXvY8y0vW9M7LSOTKlmRxRqxbr7D0DV/dgRe4sPbaEQR I9frC8DG8vWe26WtwH5xtvMcLGwAGGEKM14XHVAzYx8xE57ieShQ2l13RQyqujkN55t6 0c/5o3xwetYqasds+NcQeUsYSD3iidJV17xzQwZ15Pb/KI12539obSqj4GFKtnQmR7BI rioHn/Gw5g98KlJMZlFPH87/fNX/TnlCbfhRgWvlJw5HiOJvRJI2flBFjSZChUzlzzCI DmcA== X-Gm-Message-State: APjAAAXOjSkGQblWI1zybHuWGFhCxu1UiIhemxqOnPfTP+uxes7mYtLC mxIEnaDlPpJNKRHWUVAskR1Q5gkpICA= X-Google-Smtp-Source: APXvYqzmAZnsaJsk6m8wWym1ZVFsmjfB4hZ5sxRMgF9svKG9eEW+tfQ2RUWacsdLP2KHp+ZbfIQhIA== X-Received: by 2002:ac2:5dfa:: with SMTP id z26mr1246161lfq.103.1574863372981; Wed, 27 Nov 2019 06:02:52 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:52 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 03/19] trace-cmd: Add implementations of htonll() and ntohll() Date: Wed, 27 Nov 2019 16:02:31 +0200 Message-Id: <20191127140247.258766-4-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov Implementations of htonll() and ntohll() are added as macros, if they are not already defined. Signed-off-by: Tzvetomir Stoyanov --- include/trace-cmd/trace-msg.h | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/include/trace-cmd/trace-msg.h b/include/trace-cmd/trace-msg.h index aab8a69..654ca43 100644 --- a/include/trace-cmd/trace-msg.h +++ b/include/trace-cmd/trace-msg.h @@ -12,4 +12,14 @@ extern unsigned int page_size; +#ifndef htonll +# if __BYTE_ORDER == __LITTLE_ENDIAN +#define htonll(x) __bswap_64(x) +#define ntohll(x) __bswap_64(x) +#else +#define htonll(x) (x) +#define ntohll(x) (x) +#endif +#endif + #endif /* _TRACE_MSG_H_ */ From patchwork Wed Nov 27 14:02:32 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264097 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id AB5FB13A4 for ; Wed, 27 Nov 2019 14:03:00 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 67FD620722 for ; Wed, 27 Nov 2019 14:03:00 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="QWi7zMPE" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727107AbfK0ODA (ORCPT ); Wed, 27 Nov 2019 09:03:00 -0500 Received: from mail-lj1-f193.google.com ([209.85.208.193]:43071 "EHLO mail-lj1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726881AbfK0OC7 (ORCPT ); Wed, 27 Nov 2019 09:02:59 -0500 Received: by mail-lj1-f193.google.com with SMTP id a13so1434451ljm.10 for ; Wed, 27 Nov 2019 06:02:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=BFaTZJohWod3+kSaxINScVKs08RKM0y8+RK8we50yhg=; b=QWi7zMPEuowZ8VLYFNpZX4KdTq2zfOMLLeyMbGQy4I7She8zE8/SyNbsN7JViRtO3N UFQwoPPNshWafyaLdddnFPBI9fAEnbecskNF9Vg3pxIEGm9RKtOrZorG9eKEf99tJ23j mEs7dG/myStS6QRzANjM60+eKJCvH7ECF1/xUdPNMPMDfHxaVPwKVf9DnrKV/PsPRLBx AhrIJtLVX8jRhVfPJABgR/Nd8LZDGf/45ZjYyvW/R5OgPgVrZZONumMnFtkfJGMoEWXm R4jQ/aOqttOVubxMJAmtwnec5VkrA3Lpo48rnuukxt+vsNTEw/hhAlYMC6AwdxKFpACk Sa6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=BFaTZJohWod3+kSaxINScVKs08RKM0y8+RK8we50yhg=; b=Yvm9xdvMc0NUAKSzod52siHke8O5dwpqn+O8LltbdcqoJaV8IAUYmw5x4y/FYcW6t2 DJH9St2y3rCKJNYiGcAbVfphwbsQ7EjF/cqG3/2ZnAY2+OHlyC+wTa4b0onj81roJOAC fMzHMXiV/wXdnMswzRKdOSEJ3XxlTy86k2GoPxo7SZ7ggNbuAUg+CitQzDD+g3zw+SJ4 ypSqYrZPicKt3KpSqbm9rUKD88RyJkg1InoXo92IYegVhGbTDij2hdrZD0nTvuXQxhaq kXos0HOS3De60oh+p0lOHVb3N9pg1IQw2tlFZ3X9LrzPI2skpbTKTt4Z20MWWGv9BiPu lR+w== X-Gm-Message-State: APjAAAXAlPZHMRG4o0wgkCiammQCKFIborRV/A3kAcz9pkDPgCplJXVI xiFC5SJFaTMzl5z5Tu5N7nAhOIZMpXo= X-Google-Smtp-Source: APXvYqyurZ+BXASPfASqyaVy0XDQKZBrVbwfAaX4tOshGAPAwEZH188OG15yFrP6GwqXad18KKgv5w== X-Received: by 2002:a05:651c:1ba:: with SMTP id c26mr2152885ljn.126.1574863374403; Wed, 27 Nov 2019 06:02:54 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:53 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 04/19] trace-cmd: Add new library APIs for ftrace instances. Date: Wed, 27 Nov 2019 16:02:32 +0200 Message-Id: <20191127140247.258766-5-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov In order to reuse the code, the functionality related to ftrace instances is moved from trace-cmd application to libtracecmd. The following new library APIs are introduced: library structure, representing a ftrace instance: struct tracecmd_instance { char *name; char *clock; }; APIs for creating and deleting ftrace instances: struct tracecmd_instance *tracecmd_create_instance(const char *name); void tracecmd_free_instance(struct tracecmd_instance *instance); int tracecmd_make_instance(struct tracecmd_instance *instance); void tracecmd_remove_instance(struct tracecmd_instance *instance); APIs for reading and writing ftrace files, instance aware: char *tracecmd_get_instance_file(struct tracecmd_instance *instance, const char *file); char *tracecmd_get_instance_dir(struct tracecmd_instance *instance); int tracecmd_write_instance_file(struct tracecmd_instance *instance, const char *file, const char *str, const char *type); int tracecmd_write_file(const char *file, const char *str, const char *type); char *tracecmd_read_instance_file(struct tracecmd_instance *instance, char *file, int *psize); API for setting ftrace clock, instance aware: void tracecmd_set_clock(struct tracecmd_instance *instance, char **old_clock); Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 24 ++ lib/trace-cmd/Makefile | 1 + lib/trace-cmd/include/trace-cmd-local.h | 33 +-- lib/trace-cmd/trace-util.c | 71 ++++- tracecmd/include/trace-local.h | 6 +- tracecmd/trace-list.c | 2 +- tracecmd/trace-record.c | 341 +++++++----------------- tracecmd/trace-show.c | 2 + tracecmd/trace-stat.c | 20 +- 9 files changed, 207 insertions(+), 293 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 7f9cb73..5287d23 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -356,6 +356,30 @@ int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, int *nr_cpus, int *page_size, unsigned int **ports, bool *use_fifos); +/* --- ftrace instances --- */ + +struct tracecmd_instance { + char *name; + char *clock; +}; + +struct tracecmd_instance *tracecmd_create_instance(const char *name); +void tracecmd_free_instance(struct tracecmd_instance *instance); +int tracecmd_make_instance(struct tracecmd_instance *instance); +void tracecmd_remove_instance(struct tracecmd_instance *instance); +char * +tracecmd_get_instance_file(struct tracecmd_instance *instance, const char *file); +char *tracecmd_get_instance_dir(struct tracecmd_instance *instance); +int tracecmd_write_instance_file(struct tracecmd_instance *instance, + const char *file, const char *str, + const char *type); + +int tracecmd_write_file(const char *file, const char *str, const char *type); +char *tracecmd_read_instance_file(struct tracecmd_instance *instance, + char *file, int *psize); + +void tracecmd_set_clock(struct tracecmd_instance *instance, char **old_clock); + /* --- Plugin handling --- */ extern struct tep_plugin_option trace_ftrace_options[]; diff --git a/lib/trace-cmd/Makefile b/lib/trace-cmd/Makefile index 3b4b5aa..18c7013 100644 --- a/lib/trace-cmd/Makefile +++ b/lib/trace-cmd/Makefile @@ -13,6 +13,7 @@ OBJS += trace-input.o OBJS += trace-output.o OBJS += trace-recorder.o OBJS += trace-util.o +OBJS += trace-instance.o OBJS += trace-filter-hash.o OBJS += trace-msg.o diff --git a/lib/trace-cmd/include/trace-cmd-local.h b/lib/trace-cmd/include/trace-cmd-local.h index 09574db..eef4d39 100644 --- a/lib/trace-cmd/include/trace-cmd-local.h +++ b/lib/trace-cmd/include/trace-cmd-local.h @@ -18,36 +18,7 @@ #define STR(x) _STR(x) #define FILE_VERSION_STRING STR(FILE_VERSION) -static ssize_t __do_write(int fd, const void *data, size_t size) -{ - ssize_t tot = 0; - ssize_t w; - - do { - w = write(fd, data + tot, size - tot); - tot += w; - - if (!w) - break; - if (w < 0) - return w; - } while (tot != size); - - return tot; -} - -static ssize_t -__do_write_check(int fd, const void *data, size_t size) -{ - ssize_t ret; - - ret = __do_write(fd, data, size); - if (ret < 0) - return ret; - if (ret != size) - return -1; - - return 0; -} +ssize_t __do_write_check(int fd, const void *data, size_t size); +void __noreturn die(const char *fmt, ...); /* Can be overriden */ #endif /* _TRACE_CMD_LOCAL_H */ diff --git a/lib/trace-cmd/trace-util.c b/lib/trace-cmd/trace-util.c index 311f183..7f6a628 100644 --- a/lib/trace-cmd/trace-util.c +++ b/lib/trace-cmd/trace-util.c @@ -915,11 +915,6 @@ char *tracecmd_get_tracing_file(const char *name) return file; } -void tracecmd_put_tracing_file(char *name) -{ - free(name); -} - void __noreturn __vdie(const char *fmt, va_list ap) { int ret = errno; @@ -964,6 +959,38 @@ void __weak *malloc_or_die(unsigned int size) return data; } + +static ssize_t __do_write(int fd, const void *data, size_t size) +{ + ssize_t tot = 0; + ssize_t w; + + do { + w = write(fd, data + tot, size - tot); + tot += w; + + if (!w) + break; + if (w < 0) + return w; + } while (tot != size); + + return tot; +} + +ssize_t +__do_write_check(int fd, const void *data, size_t size) +{ + ssize_t ret; + + ret = __do_write(fd, data, size); + if (ret < 0) + return ret; + if (ret != size) + return -1; + + return 0; +} #define LOG_BUF_SIZE 1024 static void __plog(const char *prefix, const char *fmt, va_list ap, FILE *fp) { @@ -1081,3 +1108,37 @@ int tracecmd_stack_tracer_status(int *status) *status = num; return 1; /* full success */ } + +/* + * tracecmd_write_file - Write in trace file + * @file: Full name of the trace file. + * @str: Null terminated string, that will be written in the file. + * @type: Null terminated string, describing the current write operation. + * Used for logging purposes. + * + * Returns the number of written bytes, or -1 in case of an error + */ +int tracecmd_write_file(const char *file, const char *str, const char *type) +{ + char buf[BUFSIZ]; + int ret; + int fd; + + fd = open(file, O_WRONLY | O_TRUNC); + if (fd < 0) + die("opening to '%s'", file); + ret = write(fd, str, strlen(str)); + close(fd); + if (ret < 0 && type) { + /* write failed */ + fd = open(file, O_RDONLY); + if (fd < 0) + die("writing to '%s'", file); + /* the filter has the error */ + while ((ret = read(fd, buf, BUFSIZ)) > 0) + fprintf(stderr, "%.*s", ret, buf); + die("Failed %s of %s\n", type, file); + close(fd); + } + return ret; +} diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index fedc0b7..3a05e9c 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -181,7 +181,7 @@ struct pid_addr_maps { struct buffer_instance { struct buffer_instance *next; - const char *name; + struct tracecmd_instance *ftrace; char *cpumask; struct event_list *events; struct event_list **event_next; @@ -195,7 +195,6 @@ struct buffer_instance { struct func_list *filter_funcs; struct func_list *notrace_funcs; - const char *clock; unsigned int *client_ports; struct trace_seq *s_save; @@ -225,6 +224,8 @@ struct buffer_instance { bool use_fifos; }; +void init_top_instance(void); + extern struct buffer_instance top_instance; extern struct buffer_instance *buffer_instances; extern struct buffer_instance *first_instance; @@ -238,7 +239,6 @@ extern struct buffer_instance *first_instance; struct buffer_instance *create_instance(const char *name); void add_instance(struct buffer_instance *instance, int cpu_count); -char *get_instance_file(struct buffer_instance *instance, const char *file); void update_first_instance(struct buffer_instance *instance, int topt); void show_instance_file(struct buffer_instance *instance, const char *name); diff --git a/tracecmd/trace-list.c b/tracecmd/trace-list.c index 65099a5..e0782ed 100644 --- a/tracecmd/trace-list.c +++ b/tracecmd/trace-list.c @@ -33,7 +33,7 @@ void show_instance_file(struct buffer_instance *instance, const char *name) { char *path; - path = get_instance_file(instance, name); + path = tracecmd_get_instance_file(instance->ftrace, name); dump_file_content(path); tracecmd_put_tracing_file(path); } diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 80b2234..13a7cda 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -173,7 +173,7 @@ static struct reset_file *reset_files; /* Triggers need to be cleared in a special way */ static struct reset_file *reset_triggers; -struct buffer_instance top_instance = { .flags = BUFFER_FL_KEEP }; +struct buffer_instance top_instance; struct buffer_instance *buffer_instances; struct buffer_instance *first_instance; @@ -191,7 +191,7 @@ static inline int no_top_instance(void) return first_instance != &top_instance; } -static void init_instance(struct buffer_instance *instance) +void tracecmd_init_instance(struct buffer_instance *instance) { instance->event_next = &instance->events; } @@ -318,7 +318,7 @@ static void reset_save_file_cond(const char *file, int prio, */ void add_instance(struct buffer_instance *instance, int cpu_count) { - init_instance(instance); + tracecmd_init_instance(instance); instance->next = buffer_instances; if (first_instance == buffer_instances) first_instance = instance; @@ -371,7 +371,12 @@ struct buffer_instance *create_instance(const char *name) if (!instance) return NULL; memset(instance, 0, sizeof(*instance)); - instance->name = name; + + instance->ftrace = tracecmd_create_instance(name); + if (!instance->ftrace) { + free(instance); + return NULL; + } return instance; } @@ -471,7 +476,7 @@ void tracecmd_stat_cpu_instance(struct buffer_instance *instance, return; snprintf(file, 40, "per_cpu/cpu%d/stats", cpu); - path = get_instance_file(instance, file); + path = tracecmd_get_instance_file(instance->ftrace, file); free(file); fd = open(path, O_RDONLY); tracecmd_put_tracing_file(path); @@ -505,12 +510,12 @@ static void add_event(struct buffer_instance *instance, struct event_list *event static void reset_event_list(struct buffer_instance *instance) { instance->events = NULL; - init_instance(instance); + tracecmd_init_instance(instance); } static char *get_temp_file(struct buffer_instance *instance, int cpu) { - const char *name = instance->name; + const char *name = instance->ftrace->name; char *file = NULL; int size; @@ -557,7 +562,7 @@ static void put_temp_file(char *file) static void delete_temp_file(struct buffer_instance *instance, int cpu) { - const char *name = instance->name; + const char *name = instance->ftrace->name; char file[PATH_MAX]; if (name) @@ -783,96 +788,6 @@ static int set_ftrace(int set, int use_proc) return 0; } -/** - * get_instance_file - return the path to a instance file. - * @instance: buffer instance for the file - * @file: name of file to return - * - * Returns the path name of the @file for the given @instance. - * - * Must use tracecmd_put_tracing_file() to free the returned string. - */ -char * -get_instance_file(struct buffer_instance *instance, const char *file) -{ - char *buf; - char *path; - int ret; - - if (instance->name) { - ret = asprintf(&buf, "instances/%s/%s", instance->name, file); - if (ret < 0) - die("Failed to allocate name for %s/%s", instance->name, file); - path = tracecmd_get_tracing_file(buf); - free(buf); - } else - path = tracecmd_get_tracing_file(file); - - return path; -} - -static char * -get_instance_dir(struct buffer_instance *instance) -{ - char *buf; - char *path; - int ret; - - /* only works for instances */ - if (!instance->name) - return NULL; - - ret = asprintf(&buf, "instances/%s", instance->name); - if (ret < 0) - die("Failed to allocate for instance %s", instance->name); - path = tracecmd_get_tracing_file(buf); - free(buf); - - return path; -} - -static int write_file(const char *file, const char *str, const char *type) -{ - char buf[BUFSIZ]; - int fd; - int ret; - - fd = open(file, O_WRONLY | O_TRUNC); - if (fd < 0) - die("opening to '%s'", file); - ret = write(fd, str, strlen(str)); - close(fd); - if (ret < 0 && type) { - /* write failed */ - fd = open(file, O_RDONLY); - if (fd < 0) - die("writing to '%s'", file); - /* the filter has the error */ - while ((ret = read(fd, buf, BUFSIZ)) > 0) - fprintf(stderr, "%.*s", ret, buf); - die("Failed %s of %s\n", type, file); - close(fd); - } - return ret; -} - -static int -write_instance_file(struct buffer_instance *instance, - const char *file, const char *str, const char *type) -{ - struct stat st; - char *path; - int ret; - - path = get_instance_file(instance, file); - ret = stat(path, &st); - if (ret == 0) - ret = write_file(path, str, type); - tracecmd_put_tracing_file(path); - - return ret; -} - static void __clear_trace(struct buffer_instance *instance) { FILE *fp; @@ -882,7 +797,7 @@ static void __clear_trace(struct buffer_instance *instance) return; /* reset the trace */ - path = get_instance_file(instance, "trace"); + path = tracecmd_get_instance_file(instance->ftrace, "trace"); fp = fopen(path, "w"); if (!fp) die("writing to '%s'", path); @@ -916,8 +831,8 @@ static void clear_trace(void) static void reset_max_latency(struct buffer_instance *instance) { - write_instance_file(instance, - "tracing_max_latency", "0", "max_latency"); + tracecmd_write_instance_file(instance->ftrace, + "tracing_max_latency", "0", "max_latency"); } static void add_filter_pid(int pid, int exclude) @@ -1363,7 +1278,8 @@ static void add_event_pid(const char *buf) struct buffer_instance *instance; for_all_instances(instance) - write_instance_file(instance, "set_event_pid", buf, "event_pid"); + tracecmd_write_instance_file(instance->ftrace, + "set_event_pid", buf, "event_pid"); } static void add_new_filter_pid(int pid) @@ -1592,7 +1508,7 @@ set_plugin_instance(struct buffer_instance *instance, const char *name) if (is_guest(instance)) return; - path = get_instance_file(instance, "current_tracer"); + path = tracecmd_get_instance_file(instance->ftrace, "current_tracer"); fp = fopen(path, "w"); if (!fp) { /* @@ -1616,7 +1532,7 @@ set_plugin_instance(struct buffer_instance *instance, const char *name) /* Make sure func_stack_trace option is disabled */ /* First try instance file, then top level */ - path = get_instance_file(instance, "options/func_stack_trace"); + path = tracecmd_get_instance_file(instance->ftrace, "options/func_stack_trace"); fp = fopen(path, "w"); if (!fp) { tracecmd_put_tracing_file(path); @@ -1677,8 +1593,6 @@ static int set_option(const char *option) return 0; } -static char *read_instance_file(struct buffer_instance *instance, char *file, int *psize); - static void disable_func_stack_trace_instance(struct buffer_instance *instance) { struct stat st; @@ -1691,13 +1605,13 @@ static void disable_func_stack_trace_instance(struct buffer_instance *instance) if (is_guest(instance)) return; - path = get_instance_file(instance, "current_tracer"); + path = tracecmd_get_instance_file(instance->ftrace, "current_tracer"); ret = stat(path, &st); tracecmd_put_tracing_file(path); if (ret < 0) return; - content = read_instance_file(instance, "current_tracer", &size); + content = tracecmd_read_instance_file(instance->ftrace, "current_tracer", &size); cond = strstrip(content); if (memcmp(cond, "function", size - (cond - content)) !=0) goto out; @@ -1850,7 +1764,7 @@ static int trace_check_file_exists(struct buffer_instance *instance, char *file) char *path; int ret; - path = get_instance_file(instance, file); + path = tracecmd_get_instance_file(instance->ftrace, file); ret = stat(path, &st); tracecmd_put_tracing_file(path); @@ -1929,7 +1843,7 @@ reset_events_instance(struct buffer_instance *instance) } c = '0'; - path = get_instance_file(instance, "events/enable"); + path = tracecmd_get_instance_file(instance->ftrace, "events/enable"); fd = open(path, O_WRONLY); if (fd < 0) die("opening to '%s'", path); @@ -1937,7 +1851,7 @@ reset_events_instance(struct buffer_instance *instance) close(fd); tracecmd_put_tracing_file(path); - path = get_instance_file(instance, "events/*/filter"); + path = tracecmd_get_instance_file(instance->ftrace, "events/*/filter"); globbuf.gl_offs = 0; ret = glob(path, 0, NULL, &globbuf); tracecmd_put_tracing_file(path); @@ -2009,7 +1923,7 @@ static int find_trigger(const char *file, char *buf, int size, int fields) static void write_filter(const char *file, const char *filter) { - write_file(file, filter, "filter"); + tracecmd_write_file(file, filter, "filter"); } static void clear_filter(const char *file) @@ -2019,12 +1933,12 @@ static void clear_filter(const char *file) static void write_trigger(const char *file, const char *trigger) { - write_file(file, trigger, "trigger"); + tracecmd_write_file(file, trigger, "trigger"); } static void write_func_filter(const char *file, const char *trigger) { - write_file(file, trigger, "function filter"); + tracecmd_write_file(file, trigger, "function filter"); } static void clear_trigger(const char *file) @@ -2117,7 +2031,7 @@ static void update_reset_files(void) reset_files = reset->next; if (!keep) - write_file(reset->path, reset->reset, "reset"); + tracecmd_write_file(reset->path, reset->reset, "reset"); free(reset->path); free(reset->reset); free(reset); @@ -2198,7 +2112,7 @@ static int open_instance_fd(struct buffer_instance *instance, int fd; char *path; - path = get_instance_file(instance, file); + path = tracecmd_get_instance_file(instance->ftrace, file); fd = open(path, flags); if (fd < 0) { /* instances may not be created yet */ @@ -2227,7 +2141,7 @@ static int open_tracing_on(struct buffer_instance *instance) return fd; } -static void write_tracing_on(struct buffer_instance *instance, int on) +void write_tracing_on(struct buffer_instance *instance, int on) { int ret; int fd; @@ -2507,7 +2421,7 @@ static void set_mask(struct buffer_instance *instance) if (!instance->cpumask) return; - path = get_instance_file(instance, "tracing_cpumask"); + path = tracecmd_get_instance_file(instance->ftrace, "tracing_cpumask"); if (!path) die("could not allocate path"); reset_save_file(path, RESET_DEFAULT_PRIO); @@ -2555,39 +2469,6 @@ void tracecmd_enable_events(void) enable_events(first_instance); } -static void set_clock(struct buffer_instance *instance) -{ - char *path; - char *content; - char *str; - - if (is_guest(instance)) - return; - - if (!instance->clock) - return; - - /* The current clock is in brackets, reset it when we are done */ - content = read_instance_file(instance, "trace_clock", NULL); - - /* check if first clock is set */ - if (*content == '[') - str = strtok(content+1, "]"); - else { - str = strtok(content, "["); - if (!str) - die("Can not find clock in trace_clock"); - str = strtok(NULL, "]"); - } - path = get_instance_file(instance, "trace_clock"); - add_reset_file(path, str, RESET_DEFAULT_PRIO); - - free(content); - tracecmd_put_tracing_file(path); - - write_instance_file(instance, "trace_clock", instance->clock, "clock"); -} - static void set_max_graph_depth(struct buffer_instance *instance, char *max_graph_depth) { char *path; @@ -2596,16 +2477,16 @@ static void set_max_graph_depth(struct buffer_instance *instance, char *max_grap if (is_guest(instance)) return; - path = get_instance_file(instance, "max_graph_depth"); + path = tracecmd_get_instance_file(instance->ftrace, "max_graph_depth"); reset_save_file(path, RESET_DEFAULT_PRIO); tracecmd_put_tracing_file(path); - ret = write_instance_file(instance, "max_graph_depth", max_graph_depth, - NULL); + ret = tracecmd_write_instance_file(instance->ftrace, + "max_graph_depth", max_graph_depth, + NULL); if (ret < 0) die("could not write to max_graph_depth"); } - /** * create_event - create and event descriptor * @instance: instance to use @@ -2717,7 +2598,7 @@ static int expand_event_files(struct buffer_instance *instance, if (ret < 0) die("Failed to allocate event filter path for %s", file); - path = get_instance_file(instance, p); + path = tracecmd_get_instance_file(instance->ftrace, p); globbuf.gl_offs = 0; ret = glob(path, 0, NULL, &globbuf); @@ -3179,10 +3060,7 @@ create_recorder_instance_pipe(struct buffer_instance *instance, unsigned flags = recorder_flags | TRACECMD_RECORD_BLOCK; char *path; - if (instance->name) - path = get_instance_dir(instance); - else - path = tracecmd_find_tracing_dir(); + path = tracecmd_get_instance_dir(instance->ftrace); if (!path) die("malloc"); @@ -3192,7 +3070,7 @@ create_recorder_instance_pipe(struct buffer_instance *instance, recorder = tracecmd_create_buffer_recorder_fd(brass[1], cpu, flags, path); - if (instance->name) + if (instance->ftrace->name) tracecmd_put_tracing_file(path); return recorder; @@ -3227,10 +3105,10 @@ create_recorder_instance(struct buffer_instance *instance, const char *file, int if (brass) return create_recorder_instance_pipe(instance, cpu, brass); - if (!instance->name) + if (!instance->ftrace->name) return tracecmd_create_recorder_maxkb(file, cpu, recorder_flags, max_kb); - path = get_instance_dir(instance); + path = tracecmd_get_instance_dir(instance->ftrace); record = tracecmd_create_buffer_recorder_maxkb(file, cpu, recorder_flags, path, max_kb); @@ -3284,8 +3162,8 @@ static int create_recorder(struct buffer_instance *instance, int cpu, } if (fd < 0) die("Failed connecting to client"); - if (instance->name && !is_agent(instance)) - path = get_instance_dir(instance); + if (instance->ftrace->name && !is_agent(instance)) + path = tracecmd_get_instance_dir(instance->ftrace); else path = tracecmd_find_tracing_dir(); recorder = tracecmd_create_buffer_recorder_fd(fd, cpu, flags, path); @@ -3598,7 +3476,7 @@ static void connect_to_agent(struct buffer_instance *instance) bool use_fifos = false; if (!no_fifos) { - nr_fifos = open_guest_fifos(instance->name, &fds); + nr_fifos = open_guest_fifos(instance->ftrace->name, &fds); use_fifos = nr_fifos > 0; } @@ -3625,7 +3503,7 @@ static void connect_to_agent(struct buffer_instance *instance) if (nr_cpus != nr_fifos) { warning("number of FIFOs (%d) for guest %s differs " "from number of virtual CPUs (%d)", - nr_fifos, instance->name, nr_cpus); + nr_fifos, instance->ftrace->name, nr_cpus); nr_cpus = nr_cpus < nr_fifos ? nr_cpus : nr_fifos; } free(ports); @@ -3651,7 +3529,7 @@ static void setup_guest(struct buffer_instance *instance) int fd; /* Create a place to store the guest meta data */ - file = get_guest_file(output_file, instance->name); + file = get_guest_file(output_file, instance->ftrace->name); if (!file) die("Failed to allocate memory"); @@ -3827,7 +3705,7 @@ add_buffer_stat(struct tracecmd_output *handle, struct buffer_instance *instance int i; trace_seq_init(&s); - trace_seq_printf(&s, "\nBuffer: %s\n\n", instance->name); + trace_seq_printf(&s, "\nBuffer: %s\n\n", instance->ftrace->name); tracecmd_add_option(handle, TRACECMD_OPTION_CPUSTAT, s.len+1, s.buffer); trace_seq_destroy(&s); @@ -3893,7 +3771,7 @@ static void print_stat(struct buffer_instance *instance) return; if (!is_top_instance(instance)) - printf("\nBuffer: %s\n\n", instance->name); + printf("\nBuffer: %s\n\n", instance->ftrace->name); for (cpu = 0; cpu < instance->cpu_count; cpu++) trace_seq_do_printf(&instance->s_print[cpu]); @@ -3933,7 +3811,7 @@ static void write_guest_file(struct buffer_instance *instance) char **temp_files; int i, fd; - file = get_guest_file(output_file, instance->name); + file = get_guest_file(output_file, instance->ftrace->name); if (!file) die("Failed to allocate memory"); @@ -4049,7 +3927,7 @@ static void record_data(struct common_record_context *ctx) continue; buffer_options[i++] = tracecmd_add_buffer_option(handle, - instance->name, + instance->ftrace->name, cpus); add_buffer_stat(handle, instance); } @@ -4096,7 +3974,7 @@ static int write_func_file(struct buffer_instance *instance, if (!*list) return 0; - path = get_instance_file(instance, file); + path = tracecmd_get_instance_file(instance->ftrace, file); fd = open(path, O_WRONLY | O_TRUNC); if (fd < 0) @@ -4140,7 +4018,7 @@ static int functions_filtered(struct buffer_instance *instance) char *path; int fd; - path = get_instance_file(instance, "set_ftrace_filter"); + path = tracecmd_get_instance_file(instance->ftrace, "set_ftrace_filter"); fd = open(path, O_RDONLY); tracecmd_put_tracing_file(path); if (fd < 0) { @@ -4148,7 +4026,7 @@ static int functions_filtered(struct buffer_instance *instance) warning("Can not set set_ftrace_filter"); else warning("Can not set set_ftrace_filter for %s", - instance->name); + instance->ftrace->name); return 0; } @@ -4308,45 +4186,10 @@ static unsigned long long find_time_stamp(struct tep_handle *pevent) return ts; } -static char *read_instance_file(struct buffer_instance *instance, char *file, int *psize) -{ - char buffer[BUFSIZ]; - char *path; - char *buf; - int size = 0; - int fd; - int r; - - path = get_instance_file(instance, file); - fd = open(path, O_RDONLY); - tracecmd_put_tracing_file(path); - if (fd < 0) { - warning("%s not found, --date ignored", file); - return NULL; - } - do { - r = read(fd, buffer, BUFSIZ); - if (r <= 0) - continue; - if (size) - buf = realloc(buf, size+r+1); - else - buf = malloc(r+1); - if (!buf) - die("Failed to allocate instance file buffer"); - memcpy(buf+size, buffer, r); - size += r; - } while (r); - - buf[size] = '\0'; - if (psize) - *psize = size; - return buf; -} static char *read_file(char *file, int *psize) { - return read_instance_file(&top_instance, file, psize); + return tracecmd_read_instance_file(top_instance.ftrace, file, psize); } /* @@ -4479,7 +4322,7 @@ static void set_buffer_size_instance(struct buffer_instance *instance) snprintf(buf, BUFSIZ, "%d", buffer_size); - path = get_instance_file(instance, "buffer_size_kb"); + path = tracecmd_get_instance_file(instance->ftrace, "buffer_size_kb"); fd = open(path, O_WRONLY); if (fd < 0) { warning("can't open %s", path); @@ -4540,7 +4383,7 @@ static void clear_instance_triggers(struct buffer_instance *instance) enum event_iter_type type; enum event_process processed = PROCESSED_NONE; - path = get_instance_file(instance, "events"); + path = tracecmd_get_instance_file(instance->ftrace, "events"); if (!path) die("malloc"); @@ -4601,7 +4444,7 @@ static void clear_instance_filters(struct buffer_instance *instance) enum event_iter_type type; enum event_process processed = PROCESSED_NONE; - path = get_instance_file(instance, "events"); + path = tracecmd_get_instance_file(instance->ftrace, "events"); if (!path) die("malloc"); @@ -4637,7 +4480,8 @@ static void reset_clock(void) struct buffer_instance *instance; for_all_instances(instance) - write_instance_file(instance, "trace_clock", "local", "clock"); + tracecmd_write_instance_file(instance->ftrace, + "trace_clock", "local", "clock"); } static void reset_cpu_mask(void) @@ -4656,7 +4500,8 @@ static void reset_cpu_mask(void) strcat(buf, ",ffffffff"); for_all_instances(instance) - write_instance_file(instance, "tracing_cpumask", buf, "cpumask"); + tracecmd_write_instance_file(instance->ftrace, + "tracing_cpumask", buf, "cpumask"); } static void reset_event_pid(void) @@ -4685,7 +4530,7 @@ static void clear_func_filters(void) for_all_instances(instance) { for (i = 0; files[i]; i++) { - path = get_instance_file(instance, files[i]); + path = tracecmd_get_instance_file(instance->ftrace, files[i]); clear_func_filter(path); tracecmd_put_tracing_file(path); } @@ -4695,32 +4540,20 @@ static void clear_func_filters(void) static void make_instances(void) { struct buffer_instance *instance; - struct stat st; - char *path; - int ret; for_each_instance(instance) { if (is_guest(instance)) continue; - - path = get_instance_dir(instance); - ret = stat(path, &st); - if (ret < 0) { - ret = mkdir(path, 0777); - if (ret < 0) - die("mkdir %s", path); - } else + if (tracecmd_make_instance(instance->ftrace) > 0) { /* Don't delete instances that already exist */ instance->flags |= BUFFER_FL_KEEP; - tracecmd_put_tracing_file(path); + } } } void tracecmd_remove_instances(void) { struct buffer_instance *instance; - char *path; - int ret; for_each_instance(instance) { /* Only delete what we created */ @@ -4730,11 +4563,7 @@ void tracecmd_remove_instances(void) close(instance->tracing_on_fd); instance->tracing_on_fd = 0; } - path = get_instance_dir(instance); - ret = rmdir(path); - if (ret < 0) - die("rmdir %s", path); - tracecmd_put_tracing_file(path); + tracecmd_remove_instance(instance->ftrace); } } @@ -5028,7 +4857,7 @@ static int test_stacktrace_trigger(struct buffer_instance *instance) int ret = 0; int fd; - path = get_instance_file(instance, "events/sched/sched_switch/trigger"); + path = tracecmd_get_instance_file(instance->ftrace, "events/sched/sched_switch/trigger"); clear_trigger(path); @@ -5210,6 +5039,15 @@ void update_first_instance(struct buffer_instance *instance, int topt) first_instance = buffer_instances; } +void init_top_instance(void) +{ + if (!top_instance.ftrace) + top_instance.ftrace = tracecmd_create_instance(NULL); + top_instance.cpu_count = count_cpus(); + top_instance.flags = BUFFER_FL_KEEP; + tracecmd_init_instance(&top_instance); +} + enum { OPT_user = 243, OPT_procmap = 244, @@ -5234,7 +5072,7 @@ void trace_stop(int argc, char **argv) int topt = 0; struct buffer_instance *instance = &top_instance; - init_instance(instance); + init_top_instance(); for (;;) { int c; @@ -5275,7 +5113,7 @@ void trace_restart(int argc, char **argv) int topt = 0; struct buffer_instance *instance = &top_instance; - init_instance(instance); + init_top_instance(); for (;;) { int c; @@ -5317,7 +5155,7 @@ void trace_reset(int argc, char **argv) int topt = 0; struct buffer_instance *instance = &top_instance; - init_instance(instance); + init_top_instance(); /* if last arg is -a, then -b and -d apply to all instances */ int last_specified_all = 0; @@ -5402,9 +5240,8 @@ static void init_common_record_context(struct common_record_context *ctx, memset(ctx, 0, sizeof(*ctx)); ctx->instance = &top_instance; ctx->curr_cmd = curr_cmd; - init_instance(ctx->instance); local_cpu_count = count_cpus(); - ctx->instance->cpu_count = local_cpu_count; + init_top_instance(); } #define IS_EXTRACT(ctx) ((ctx)->curr_cmd == CMD_extract) @@ -5642,7 +5479,7 @@ static void parse_record_options(int argc, } break; case 'C': - ctx->instance->clock = optarg; + ctx->instance->ftrace->clock = optarg; break; case 'v': neg_event = 1; @@ -5964,6 +5801,23 @@ static bool has_local_instances(void) return false; } +static void set_clock(struct buffer_instance *instance) +{ + char *old_clock = NULL; + char *path; + + if (is_guest(instance)) + return; + + tracecmd_set_clock(instance->ftrace, &old_clock); + if (old_clock) { + path = tracecmd_get_instance_file(instance->ftrace, "trace_clock"); + if (path) + add_reset_file(path, old_clock, RESET_DEFAULT_PRIO); + free(old_clock); + tracecmd_put_tracing_file(path); + } +} /* * This function contains common code for the following commands: * record, start, stream, profile. @@ -6015,7 +5869,6 @@ static void record_trace(int argc, char **argv, for_all_instances(instance) set_clock(instance); - /* Record records the date first */ if (ctx->date && ((IS_RECORD(ctx) && has_local_instances()) || IS_RECORD_AGENT(ctx))) diff --git a/tracecmd/trace-show.c b/tracecmd/trace-show.c index 96bfe77..ca0f4cf 100644 --- a/tracecmd/trace-show.c +++ b/tracecmd/trace-show.c @@ -51,6 +51,8 @@ void trace_show(int argc, char **argv) {NULL, 0, NULL, 0} }; + init_top_instance(); + while ((c = getopt_long(argc-1, argv+1, "B:c:fsp", long_options, &option_index)) >= 0) { switch (c) { diff --git a/tracecmd/trace-stat.c b/tracecmd/trace-stat.c index 538f4ad..32aebc5 100644 --- a/tracecmd/trace-stat.c +++ b/tracecmd/trace-stat.c @@ -30,7 +30,7 @@ static int get_instance_file_fd(struct buffer_instance *instance, char *path; int fd; - path = get_instance_file(instance, file); + path = tracecmd_get_instance_file(instance->ftrace, file); fd = open(path, O_RDONLY); tracecmd_put_tracing_file(path); @@ -347,7 +347,7 @@ static void report_events(struct buffer_instance *instance) free(str); - path = get_instance_file(instance, "events"); + path = tracecmd_get_instance_file(instance->ftrace, "events"); if (!path) die("malloc"); @@ -436,7 +436,7 @@ static void report_event_filters(struct buffer_instance *instance) enum event_iter_type type; enum event_process processed = PROCESSED_NONE; - path = get_instance_file(instance, "events"); + path = tracecmd_get_instance_file(instance->ftrace, "events"); if (!path) die("malloc"); @@ -509,7 +509,7 @@ static void report_event_triggers(struct buffer_instance *instance) enum event_iter_type type; enum event_process processed = PROCESSED_NONE; - path = get_instance_file(instance, "events"); + path = tracecmd_get_instance_file(instance->ftrace, "events"); if (!path) die("malloc"); @@ -598,7 +598,7 @@ static void report_graph_funcs(struct buffer_instance *instance) { char *path; - path = get_instance_file(instance, "set_graph_function"); + path = tracecmd_get_instance_file(instance->ftrace, "set_graph_function"); if (!path) die("malloc"); @@ -606,7 +606,7 @@ static void report_graph_funcs(struct buffer_instance *instance) tracecmd_put_tracing_file(path); - path = get_instance_file(instance, "set_graph_notrace"); + path = tracecmd_get_instance_file(instance->ftrace, "set_graph_notrace"); if (!path) die("malloc"); @@ -619,7 +619,7 @@ static void report_ftrace_filters(struct buffer_instance *instance) { char *path; - path = get_instance_file(instance, "set_ftrace_filter"); + path = tracecmd_get_instance_file(instance->ftrace, "set_ftrace_filter"); if (!path) die("malloc"); @@ -627,7 +627,7 @@ static void report_ftrace_filters(struct buffer_instance *instance) tracecmd_put_tracing_file(path); - path = get_instance_file(instance, "set_ftrace_notrace"); + path = tracecmd_get_instance_file(instance->ftrace, "set_ftrace_notrace"); if (!path) die("malloc"); @@ -857,7 +857,7 @@ static void stat_instance(struct buffer_instance *instance) if (instance != &top_instance) { if (instance != first_instance) printf("---------------\n"); - printf("Instance: %s\n", instance->name); + printf("Instance: %s\n", instance->ftrace->name); } report_plugin(instance); @@ -882,6 +882,8 @@ void trace_stat (int argc, char **argv) int status; int c; + init_top_instance(); + for (;;) { c = getopt(argc-1, argv+1, "tB:"); if (c == -1) From patchwork Wed Nov 27 14:02:33 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264093 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id B450F13A4 for ; Wed, 27 Nov 2019 14:02:59 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 8BC5520722 for ; Wed, 27 Nov 2019 14:02:59 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="mmGfNhEG" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727099AbfK0OC7 (ORCPT ); Wed, 27 Nov 2019 09:02:59 -0500 Received: from mail-lf1-f65.google.com ([209.85.167.65]:46204 "EHLO mail-lf1-f65.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727090AbfK0OC7 (ORCPT ); Wed, 27 Nov 2019 09:02:59 -0500 Received: by mail-lf1-f65.google.com with SMTP id a17so17230642lfi.13 for ; Wed, 27 Nov 2019 06:02:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ldCDagl9RqAknwMP7THNOte9M0qIZeza4fKWvwegzY0=; b=mmGfNhEGvUlrI89jMcmxYhYcSfHHvrS+yYzPXmVVw3FRuRLoVGFtC/fcergINOjayD H0qjFfCIvtz0hBvvSpgzcryvQbxweiHH3xaNA+Y1bh2KOzSOScwGLPLLi118RET3NX5Z bWAlZzab8eFQq0ck4Oq41Khf1gcSNgocda2HJWZ0J0FMOBRnm7vyOeSc4jTMlzNEkZSr IW55uXfk57c/X0FUV1C8Bosz9NkAlJwwhKjkDK3MYntXFtsaU4B6hmdvu/JEqxgZUX0B x7/zgwY6xU1/98107ecvPalwIbMtV1cb7Q9kn58Vf0a1qb2xGsIK92sEa7PFn5fbQ9Q5 I8hw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ldCDagl9RqAknwMP7THNOte9M0qIZeza4fKWvwegzY0=; b=eJE3tmrQgCMOSQ66/+UP2aebWF9qzjXCgJBv8ig0yakXLtA4LRo//bznwIIfp2t/7i wanuRwQej9TnCeA12cpC/vP6BFdKxhVX+NUe2DbJ0Lxuhwcj1F/fFEuzY94mkO/Jrbvy R/bLpE5GWOQxo3tpGe83u9lT55UJboq3H5ePY2IhZbtFwn0/XWuErPc1e9lrwXsmwXRh 2nhYf9ebM9XB/ZrlGQX+G69XiTvMveDJGVFX2BRQjEYQbbMqZrJAFrh9LeCBGB2GM6nP GlxyqDoshE9pBH+pZf0hAEyxilwcYuhMRZGJ21m0nMH8PbfM/86s8afeIN8u98YY9m/Y Ch7g== X-Gm-Message-State: APjAAAU9wgRxvga4+onrE9/wSqf1JcDKOPWbtWpahdZ9RuA2O2lkcI82 plxA4fLKCpDkqVnxBqizhG9Mfg/NMlM= X-Google-Smtp-Source: APXvYqxk3Zege4jTqZwMOjs4rzSPXSyMosDGaJAKl68QuydbM+sOr5bM340ZVo3IaoY1gWpjnzUo6A== X-Received: by 2002:a19:ef10:: with SMTP id n16mr23114147lfh.187.1574863375461; Wed, 27 Nov 2019 06:02:55 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:54 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 05/19] trace-cmd: Add new library API for local CPU count Date: Wed, 27 Nov 2019 16:02:33 +0200 Message-Id: <20191127140247.258766-6-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org In order to reuse the code, the function detecting the number of local CPU is moved from trace-cmd application to libtracecmd. The following new library API is introduced: int tracecmd_count_cpus(void); Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 3 +++ lib/trace-cmd/trace-util.c | 40 +++++++++++++++++++++++++++++ tracecmd/include/trace-local.h | 2 -- tracecmd/trace-agent.c | 2 +- tracecmd/trace-profile.c | 2 +- tracecmd/trace-record.c | 46 +++------------------------------- tracecmd/trace-stat.c | 4 +-- 7 files changed, 50 insertions(+), 49 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 5287d23..5d4292e 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -427,6 +427,9 @@ void tracecmd_plog(const char *fmt, ...); void tracecmd_plog_error(const char *fmt, ...); int tracecmd_set_logfile(char *logfile); +/* --- System --- */ +int tracecmd_count_cpus(void); + /* --- Hack! --- */ int tracecmd_blk_hack(struct tracecmd_input *handle); diff --git a/lib/trace-cmd/trace-util.c b/lib/trace-cmd/trace-util.c index 7f6a628..1d90ed6 100644 --- a/lib/trace-cmd/trace-util.c +++ b/lib/trace-cmd/trace-util.c @@ -1109,6 +1109,46 @@ int tracecmd_stack_tracer_status(int *status) return 1; /* full success */ } +int tracecmd_count_cpus(void) +{ + FILE *fp; + char buf[1024]; + int cpus = 0; + char *pbuf; + size_t *pn; + size_t n; + int r; + + cpus = sysconf(_SC_NPROCESSORS_CONF); + if (cpus > 0) + return cpus; + + warning("sysconf could not determine number of CPUS"); + + /* Do the hack to figure out # of CPUS */ + n = 1024; + pn = &n; + pbuf = buf; + + fp = fopen("/proc/cpuinfo", "r"); + if (!fp) + die("Can not read cpuinfo"); + + while ((r = getline(&pbuf, pn, fp)) >= 0) { + char *p; + + if (strncmp(buf, "processor", 9) != 0) + continue; + for (p = buf+9; isspace(*p); p++) + ; + if (*p == ':') + cpus++; + } + fclose(fp); + + return cpus; +} + /* * tracecmd_write_file - Write in trace file * @file: Full name of the trace file. diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index 3a05e9c..a51f0d0 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -243,8 +243,6 @@ void update_first_instance(struct buffer_instance *instance, int topt); void show_instance_file(struct buffer_instance *instance, const char *name); -int count_cpus(void); - /* moved from trace-cmd.h */ void tracecmd_create_top_instance(char *name); void tracecmd_remove_instances(void); diff --git a/tracecmd/trace-agent.c b/tracecmd/trace-agent.c index 93e3edf..1c6e0a3 100644 --- a/tracecmd/trace-agent.c +++ b/tracecmd/trace-agent.c @@ -203,7 +203,7 @@ static void agent_serve(unsigned int port) signal(SIGCHLD, handle_sigchld); - nr_cpus = count_cpus(); + nr_cpus = tracecmd_count_cpus(); page_size = getpagesize(); sd = make_vsock(port); diff --git a/tracecmd/trace-profile.c b/tracecmd/trace-profile.c index 231e381..cfae2a2 100644 --- a/tracecmd/trace-profile.c +++ b/tracecmd/trace-profile.c @@ -1314,7 +1314,7 @@ void trace_init_profile(struct tracecmd_input *handle, struct hook_list *hook, * system. */ if (!h->cpus) - h->cpus = count_cpus(); + h->cpus = tracecmd_count_cpus(); list_head_init(&h->migrate_starts); h->cpu_starts = malloc(sizeof(*h->cpu_starts) * h->cpus); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 13a7cda..4459c90 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -2726,46 +2726,6 @@ static void expand_event_list(void) expand_event_instance(instance); } -int count_cpus(void) -{ - FILE *fp; - char buf[1024]; - int cpus = 0; - char *pbuf; - size_t *pn; - size_t n; - int r; - - cpus = sysconf(_SC_NPROCESSORS_CONF); - if (cpus > 0) - return cpus; - - warning("sysconf could not determine number of CPUS"); - - /* Do the hack to figure out # of CPUS */ - n = 1024; - pn = &n; - pbuf = buf; - - fp = fopen("/proc/cpuinfo", "r"); - if (!fp) - die("Can not read cpuinfo"); - - while ((r = getline(&pbuf, pn, fp)) >= 0) { - char *p; - - if (strncmp(buf, "processor", 9) != 0) - continue; - for (p = buf+9; isspace(*p); p++) - ; - if (*p == ':') - cpus++; - } - fclose(fp); - - return cpus; -} - static void finish(int sig) { /* all done */ @@ -4487,7 +4447,7 @@ static void reset_clock(void) static void reset_cpu_mask(void) { struct buffer_instance *instance; - int cpus = count_cpus(); + int cpus = tracecmd_count_cpus(); int fullwords = (cpus - 1) / 32; int bits = (cpus - 1) % 32 + 1; int len = (fullwords + 1) * 9; @@ -5043,7 +5003,7 @@ void init_top_instance(void) { if (!top_instance.ftrace) top_instance.ftrace = tracecmd_create_instance(NULL); - top_instance.cpu_count = count_cpus(); + top_instance.cpu_count = tracecmd_count_cpus(); top_instance.flags = BUFFER_FL_KEEP; tracecmd_init_instance(&top_instance); } @@ -5240,7 +5200,7 @@ static void init_common_record_context(struct common_record_context *ctx, memset(ctx, 0, sizeof(*ctx)); ctx->instance = &top_instance; ctx->curr_cmd = curr_cmd; - local_cpu_count = count_cpus(); + local_cpu_count = tracecmd_count_cpus(); init_top_instance(); } diff --git a/tracecmd/trace-stat.c b/tracecmd/trace-stat.c index 32aebc5..44ee559 100644 --- a/tracecmd/trace-stat.c +++ b/tracecmd/trace-stat.c @@ -737,7 +737,7 @@ static void report_cpumask(struct buffer_instance *instance) cont = strstrip(str); /* check to make sure all CPUs on this machine are set */ - cpus = count_cpus(); + cpus = tracecmd_count_cpus(); for (i = strlen(cont) - 1; i >= 0 && cpus > 0; i--) { if (cont[i] == ',') @@ -896,7 +896,7 @@ void trace_stat (int argc, char **argv) instance = create_instance(optarg); if (!instance) die("Failed to create instance"); - add_instance(instance, count_cpus()); + add_instance(instance, tracecmd_count_cpus()); /* top instance requires direct access */ if (!topt && is_top_instance(first_instance)) first_instance = instance; From patchwork Wed Nov 27 14:02:34 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264095 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id DCBF215AB for ; Wed, 27 Nov 2019 14:02:59 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id BCCF0206F0 for ; Wed, 27 Nov 2019 14:02:59 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="NK4yteiB" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727090AbfK0OC7 (ORCPT ); Wed, 27 Nov 2019 09:02:59 -0500 Received: from mail-lj1-f193.google.com ([209.85.208.193]:45411 "EHLO mail-lj1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727092AbfK0OC7 (ORCPT ); Wed, 27 Nov 2019 09:02:59 -0500 Received: by mail-lj1-f193.google.com with SMTP id n21so24574380ljg.12 for ; Wed, 27 Nov 2019 06:02:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=MDo/x8wn/ceP5KxNTdkVSVvKxX8fmIwrAlEm4BRjP/4=; b=NK4yteiBuU6LnjIP5wcBeMva2fjrWkSrQFebfs04cyodCGNISL/sQ53zGwqrUJX9pV RtQSg6Hq2Qs0wYqlTdIdMOECR+LvcZmZqFsqzVJxFvMxPBlr/kSCDLluhrNXgWd5mVME i+6oyUwSZf+gHz5Dw48wWN3f4nzRii+ZOvflvVZv8Zzawo+9qeR44cS6GmQCvecg5sYH rxi2ztuHNOwLKtSDwn5hCygK7oFksZKeNoO0+5Oa7tkxPtgvBXAx2pfQKJP1Ilz39RQp xnrWL3nRV3Y8C/1Q0VMdrt/d/pJqvGr5PKaHwS4MHnm49D2SrPDSBagQC9spEtptY1q2 OPtA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=MDo/x8wn/ceP5KxNTdkVSVvKxX8fmIwrAlEm4BRjP/4=; b=FAC4dsZLEb4IPOJbZZJxqOGFt6XcZPaWEFqrNEWFVLx+iBDpqAbTLSM6LWi6qXAs1r DwunYpTdmL6CmrY9UApA9eAQYlKJsc69QO32Sz212FKube3+u5JUjSKKpf90szAlM/dM KeehWWfuXhFja6m8mOlDdQNfnTAb7nHJGkeiEhCNV+Vufzzmdara6l2p18knFeHvKCHw AkChtmg/6aFZWgFVA0g2XbUyoL3vSTJ8vEcrG0HrN/mgYO8WZZ3b0P3lhcVtZDM/PrKC CPpOCO0XsKWvDyCyHUJIkDhmjv9Zp20nAr9NUyNqAlHLdOGSqsUNirjSOMfaii7R/RTE LB3w== X-Gm-Message-State: APjAAAVslYUo8kRPGHy2yldba4qrswLKwQO6ZJMcpARHvR00vFWPY07I atQMgLYPw3egNuscaiWiFpU= X-Google-Smtp-Source: APXvYqwzZqMVX9h9cR8g/ov5CyyEejWRtVHqaG4SRNJ8dDQ2pASVGF0l6Eu6aaFQGsm1xXD+d14vJA== X-Received: by 2002:a05:651c:289:: with SMTP id b9mr31825766ljo.80.1574863376588; Wed, 27 Nov 2019 06:02:56 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:56 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 06/19] trace-cmd: Add new library API for reading ftrace buffers Date: Wed, 27 Nov 2019 16:02:34 +0200 Message-Id: <20191127140247.258766-7-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org A new libtracecmd API is introduced: int tracecmd_iterate_raw_events(struct tep_handle *tep, struct tracecmd_instance *instance, int (*callback)(struct tep_event *, struct tep_record *, int, void *context), void *callback_context); It reads events from trace_pipe_raw, per cpu ftrace buffer, and calls a user callback for each of them. The API is instance aware. Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 8 +++ lib/trace-cmd/trace-util.c | 114 ++++++++++++++++++++++++++++++++++ 2 files changed, 122 insertions(+) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 5d4292e..831bb1a 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -380,6 +380,14 @@ char *tracecmd_read_instance_file(struct tracecmd_instance *instance, void tracecmd_set_clock(struct tracecmd_instance *instance, char **old_clock); +int tracecmd_iterate_raw_events(struct tep_handle *tep, + struct tracecmd_instance *instance, + int (*callback)(struct tep_event *, + struct tep_record *, + int, void *context), + void *callback_context); + + /* --- Plugin handling --- */ extern struct tep_plugin_option trace_ftrace_options[]; diff --git a/lib/trace-cmd/trace-util.c b/lib/trace-cmd/trace-util.c index 1d90ed6..ee6f48a 100644 --- a/lib/trace-cmd/trace-util.c +++ b/lib/trace-cmd/trace-util.c @@ -1182,3 +1182,117 @@ int tracecmd_write_file(const char *file, const char *str, const char *type) } return ret; } + +static int +get_events_in_page(struct tep_handle *tep, void *page, + int size, int cpu, + int (*callback)(struct tep_event *, + struct tep_record *, + int, void *), + void *callback_context) +{ + struct tep_record *last_record = NULL; + struct tep_event *event = NULL; + struct tep_record *record; + int id, cnt = 0; + + if (size <= 0) + return 0; + + while (true) { + event = NULL; + record = tracecmd_read_page_record(tep, page, size, + last_record); + if (!record) + break; + free_record(last_record); + id = tep_data_type(tep, record); + event = tep_find_event(tep, id); + if (event && callback) { + if (callback(event, record, cpu, callback_context)) + break; + } + last_record = record; + } + free_record(last_record); + + return cnt; +} + +/* + * tracecmd_iterate_raw_events - Iterate through events in trace_pipe_raw + * per CPU trace files + * @tep: a handle to the trace event parser context + * @instance: ftrace instance, can be NULL for the top instance + * @callback: A user function, called for each record from the file. + * @callback_context: A custom context, passed to the user callback function + * + * If the @callback returns non-zero, the iteration stops. + * + * Returns -1 in case of an error, or 0 otherwise. + */ +int tracecmd_iterate_raw_events(struct tep_handle *tep, + struct tracecmd_instance *instance, + int (*callback)(struct tep_event *, + struct tep_record *, + int, void *), + void *callback_context) +{ + unsigned int p_size; + struct dirent *dent; + char file[PATH_MAX]; + void *page = NULL; + struct stat st; + char *path; + DIR *dir; + int ret; + int cpu; + int fd; + int r; + + p_size = getpagesize(); + path = tracecmd_get_instance_file(instance, "per_cpu"); + if (!path) + return -1; + dir = opendir(path); + if (!dir) { + ret = -1; + goto error; + } + page = malloc(p_size); + if (!page) { + ret = -1; + goto error; + } + while ((dent = readdir(dir))) { + const char *name = dent->d_name; + + if (strlen(name) < 4 || strncmp(name, "cpu", 3) != 0) + continue; + cpu = atoi(name + 3); + sprintf(file, "%s/%s", path, name); + ret = stat(file, &st); + if (ret < 0 || !S_ISDIR(st.st_mode)) + continue; + + sprintf(file, "%s/%s/trace_pipe_raw", path, name); + fd = open(file, O_RDONLY | O_NONBLOCK); + if (fd < 0) + continue; + do { + r = read(fd, page, p_size); + if (r > 0) + get_events_in_page(tep, page, r, cpu, + callback, callback_context); + } while (r > 0); + close(fd); + } + ret = 0; + +error: + if (dir) + closedir(dir); + free(page); + tracecmd_put_tracing_file(path); + return ret; +} From patchwork Wed Nov 27 14:02:35 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264099 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id DC76415AB for ; Wed, 27 Nov 2019 14:03:00 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id B2EC8206F0 for ; Wed, 27 Nov 2019 14:03:00 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="SiIWRKkO" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727113AbfK0ODA (ORCPT ); Wed, 27 Nov 2019 09:03:00 -0500 Received: from mail-lj1-f196.google.com ([209.85.208.196]:39865 "EHLO mail-lj1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727097AbfK0ODA (ORCPT ); Wed, 27 Nov 2019 09:03:00 -0500 Received: by mail-lj1-f196.google.com with SMTP id e10so15439296ljj.6 for ; Wed, 27 Nov 2019 06:02:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=1vr5+JkKcuoZVsjx/XbK96E0u7JOyC3v723be9HMndo=; b=SiIWRKkOMi5we0zS46d4f+sPSsl/CTUDDBvSIi/5Qei0ETCc+fs89/sPQyqhgNilLC JifPErUuzH/8BdKCnPzqQh8QjJggpWYdIMZnGqNpxGu8BzeXogwl4jYXC9TihymOva8X 2T6VZshVCDShLyr4biLWavJzhOfGp13HiomTloBC/Hnkff29iKD8rydJGUYYeygR5c9j e3O9YHFqs63b2KuIUbpRNArgKMFovzRqWaAH/ajV+723qPDhZa1mxhz7gPaP7/kgeviX rhgIBw3bzj04wjzYznBJBZSX7Sa30rWpe8ES3FojxpryVVu8LOHGT6nwa6//VlhD9oZL 6FZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=1vr5+JkKcuoZVsjx/XbK96E0u7JOyC3v723be9HMndo=; b=DZHqCNg6tYdKLoiJGski5hcvqu1mqKytCkKgtRC5QrXsG0lNranuNSV7MMdGWMuQTz VCHWGcv58PSBQ9XmQzPFKZqagG2HYLf1MsBNEs5hPZupu4jyfSTFD4p1ZQkhqX7lW8XV KRvegOB2v6w5crKUihDzWe4h0d3zxpeSsl8lLvnPw9D6gw7Qf+LNq25nCU4ikCW/tQ19 ma7vEWqGeJ2/h7VnPbr+U46PnP7QKnTZzI47B+4UNgSS8M1Z5/C5k1J+cQ51dLA4zdld PUzpJPyb8aWRRrookSNjQT605L64MiP8ymyGCIJYOdmjUluGGUcJS9SCq/0BniFu7chC smuA== X-Gm-Message-State: APjAAAVBtH8M0t3HNSD5laLsKKUEXDfEysEr1AqQWOWbhkGn9/lynvCl UoecfU8HZ8S3ZpiiT+emX/k= X-Google-Smtp-Source: APXvYqwjfMf+LkPjE5bnQoW3J9kpWMXLkvdqicT9ERpnf6FAJfuUbILZ/2evsOR7S6cB+0driS/Rxg== X-Received: by 2002:a2e:809a:: with SMTP id i26mr5662038ljg.108.1574863377811; Wed, 27 Nov 2019 06:02:57 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:57 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 07/19] trace-cmd: Find and store pids of tasks, which run virtual CPUs of given VM Date: Wed, 27 Nov 2019 16:02:35 +0200 Message-Id: <20191127140247.258766-8-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov In order to match host and guest events, a mapping between guest VCPU and the host task, running this VCPU is needed. Extended existing struct guest to hold such mapping and added logic in read_qemu_guests() function to initialize it. Implemented a new internal API, get_guest_vcpu_pid(), to retrieve VCPU-task mapping for given VM. Signed-off-by: Tzvetomir Stoyanov --- tracecmd/include/trace-local.h | 2 ++ tracecmd/trace-record.c | 57 ++++++++++++++++++++++++++++++++++ 2 files changed, 59 insertions(+) diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index a51f0d0..51abef1 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -243,6 +243,8 @@ void update_first_instance(struct buffer_instance *instance, int topt); void show_instance_file(struct buffer_instance *instance, const char *name); +int get_guest_vcpu_pid(unsigned int guest_cid, unsigned int guest_vcpu); + /* moved from trace-cmd.h */ void tracecmd_create_top_instance(char *name); void tracecmd_remove_instances(void); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 4459c90..fd7ca82 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -2873,10 +2873,12 @@ static bool is_digits(const char *s) return true; } +#define VCPUS_MAX 256 struct guest { char *name; int cid; int pid; + int cpu_pid[VCPUS_MAX]; }; static struct guest *guests; @@ -2894,6 +2896,46 @@ static char *get_qemu_guest_name(char *arg) return arg; } +static void read_qemu_guests_pids(char *guest_task, struct guest *guest) +{ + struct dirent *entry; + char path[PATH_MAX]; + char *buf = NULL; + size_t n = 0; + int vcpu; + DIR *dir; + FILE *f; + + snprintf(path, sizeof(path), "/proc/%s/task", guest_task); + dir = opendir(path); + if (!dir) + return; + + while ((entry = readdir(dir))) { + if (!(entry->d_type == DT_DIR && is_digits(entry->d_name))) + continue; + + snprintf(path, sizeof(path), "/proc/%s/task/%s/comm", + guest_task, entry->d_name); + f = fopen(path, "r"); + if (!f) + continue; + if (getline(&buf, &n, f) < 0) + goto next; + if (strncmp(buf, "CPU ", 4) != 0) + goto next; + + vcpu = atoi(buf+4); + if (!(vcpu >= 0 && vcpu < VCPUS_MAX)) + goto next; + guest->cpu_pid[vcpu] = atoi(entry->d_name); + +next: + fclose(f); + } + free(buf); +} + static void read_qemu_guests(void) { static bool initialized; @@ -2957,6 +2999,8 @@ static void read_qemu_guests(void) if (!is_qemu) goto next; + read_qemu_guests_pids(entry->d_name, &guest); + guests = realloc(guests, (guests_len + 1) * sizeof(*guests)); if (!guests) die("Can not allocate guest buffer"); @@ -3002,6 +3046,19 @@ static char *parse_guest_name(char *guest, int *cid, int *port) return guest; } +int get_guest_vcpu_pid(unsigned int guest_cid, unsigned int guest_vcpu) +{ + int i; + + if (!guests || guest_vcpu >= VCPUS_MAX) + return -1; + + for (i = 0; i < guests_len; i++) + if (guest_cid == guests[i].cid) + return guests[i].cpu_pid[guest_vcpu]; + return -1; +} + static void set_prio(int prio) { struct sched_param sp; From patchwork Wed Nov 27 14:02:36 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264101 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 9600A14ED for ; Wed, 27 Nov 2019 14:03:01 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 75EB620678 for ; Wed, 27 Nov 2019 14:03:01 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="OdHm6J9W" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727121AbfK0ODB (ORCPT ); Wed, 27 Nov 2019 09:03:01 -0500 Received: from mail-lf1-f66.google.com ([209.85.167.66]:41911 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727092AbfK0ODB (ORCPT ); Wed, 27 Nov 2019 09:03:01 -0500 Received: by mail-lf1-f66.google.com with SMTP id m30so15407935lfp.8 for ; Wed, 27 Nov 2019 06:02:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=mbo/FhDWiM3iQRKq3HmZqi0SKBs3Z36LWNAIYDw5KJA=; b=OdHm6J9W+J40uKADy9dH+JZmgHNKCEZ5ud2aaSERrbd8zjgyHa6NuDmk44JtRIXGWE YGCk0Mif9F0jaA18cmRUrf6ov1FiyV4xptwDQO8fYvezhKakmDoBlaSs+9kljJfHWPOS rh5yD4wIDyCY9OKHOy/rcCdeLKVbnBv3DusmIszz5fM8yZpSyNSDQBoPcpAGNJrNHEfR HftP4uDGiko6DqEnNN4co2T2CFDdzp+4ME7gwnyNZBCf/mDcXEZa/WAhnTzd98scsoaH uTf5hjNJ9AJuxERFef97qEmgJ5OCYhILGh7aDQhlSaxgxgh4W9HkH/R4irXOxYdEEUzq BVxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=mbo/FhDWiM3iQRKq3HmZqi0SKBs3Z36LWNAIYDw5KJA=; b=UdxzPEeyE5dH+eKuGv9MFxEzGb0mFShyL519W21wzRmbIsshisujY1RwkL7zqkVNis oEXbbdnoXnLP4i2EmNDhZqFie5j2BPAbhc64mm5Lo/lTUxIOU2SRj86hGhKKtQOPNYs6 lt5DLiXLxga6XT8K97W0NgjHZLchbzd8AKYoUc4ijK4wJpysevyuiYRq7L26BmYV5Z3X tOMCCzWfMIfenUzyAR2CHMIPnnHsPB8ZjWk/tP/9cIxJQwX0uw8r3jUdeucU5lo2YhZE nfg4BM1rm6fc+E/BuJBgqvWaer7WIXPmVSJqunZtKhEghpNqzACiMv8rIPzhWgJ5+aY9 ilIw== X-Gm-Message-State: APjAAAUdTT0/vNk2nI2kE/bmXXAULaJjn6gf1EFNVCbXOoMrQhaC7o6o Ks11dZ10ZIhS9e0nTkMAQLc= X-Google-Smtp-Source: APXvYqyh5H1Z1plCulI2pVQro1N0NBAX6kyID2JWn2TcDlwa7AVW1dJ9m2uNMVl/THtUdjgVOYfhHA== X-Received: by 2002:ac2:5e9c:: with SMTP id b28mr15611156lfq.138.1574863379137; Wed, 27 Nov 2019 06:02:59 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:58 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 08/19] trace-cmd: --del the tracee address map into the guest's trace.dat file Date: Wed, 27 Nov 2019 16:02:36 +0200 Message-Id: <20191127140247.258766-9-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org The trace-cmd option "--proc-map" saves the address map of the traced applications in the trace.dat file. It does not work if that option is specified as guest command line parameter. Signed-off-by: Tzvetomir Stoyanov (VMware) --- tracecmd/trace-record.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index fd7ca82..a08ee52 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -3802,6 +3802,7 @@ enum { static void add_options(struct tracecmd_output *handle, struct common_record_context *ctx) { + struct buffer_instance *instance; int type = 0; if (ctx->date2ts) { @@ -3818,6 +3819,9 @@ static void add_options(struct tracecmd_output *handle, struct common_record_con add_option_hooks(handle); add_uname(handle); add_version(handle); + for_all_instances(instance) { + add_pid_maps(handle, instance); + } } static void write_guest_file(struct buffer_instance *instance) @@ -3953,10 +3957,6 @@ static void record_data(struct common_record_context *ctx) if (!no_top_instance() && !top_instance.msg_handle) print_stat(&top_instance); - for_all_instances(instance) { - add_pid_maps(handle, instance); - } - tracecmd_append_cpu_data(handle, local_cpu_count, temp_files); for (i = 0; i < max_cpu_count; i++) From patchwork Wed Nov 27 14:02:37 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264103 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 17A2814ED for ; Wed, 27 Nov 2019 14:03:04 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id E2C3B206F0 for ; Wed, 27 Nov 2019 14:03:03 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="UpUyJSYl" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727109AbfK0ODD (ORCPT ); Wed, 27 Nov 2019 09:03:03 -0500 Received: from mail-lf1-f66.google.com ([209.85.167.66]:42638 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727116AbfK0ODD (ORCPT ); Wed, 27 Nov 2019 09:03:03 -0500 Received: by mail-lf1-f66.google.com with SMTP id y19so17243018lfl.9 for ; Wed, 27 Nov 2019 06:03:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=Irh037ZGGW4R8h8ErESe2jql4GwDXX/8LCDplJHfmvE=; b=UpUyJSYlmU+O7CuJcC+5/GMw9VO90u8Ue15zgzeUG5BgFq9qq6RLHya+94aQy0tWw7 SzeUj2ASUi6roM3KARS39XBDoBsbWNLShOu9DdydieQx5hI+YCVHcOvg3Vg1lLRk6E/n uVRcmKx5MOGMS+oxAhY372aQldchMSRYPqQAgZb0ZBVo2Hz40p0FAcsrGbaUorQFOgSn lhdzLfS64XAsBP/l7tuY8v55+AKpYf13CcM6qj0YOQbKvAGn+6FhszDDZ81/BevYRrYd C4fS7p5n580aupuxwzm5yGAyZTL6w+YQOJ+ou8fJsmo6LzrAADcJENG1keThfqvH73Vr VNDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=Irh037ZGGW4R8h8ErESe2jql4GwDXX/8LCDplJHfmvE=; b=CBu2UzDbHT7kzdSqvVYvP5p4rOj0tUMPFkQ7PXdASGkv5PHXpIzOaZHdqO3VCnWfLM ujYYybeSI0CmLV6HSuFLzb1FqNc+k1hh0zbbbyz+4zqPF12w9+PxqFDhrJuL2fEOk7if msQCB+0x16BP7l6k9IAVCSq0JYHyiEEfLYEBVLIhKIFI5Gsg3kM8LP0f+xiE75rnodV0 6LrxAidOGb0LwCl6vE4RFKY160WLxmKp8T6ETHhjv67zNrv71upWp/WOl7hu0cOXwjpu TZ5ITc7PEMlUAtOM+xLGHiS6+ednN36+zX4HzNbBHfRZx6T8xN6RrZdKVc5fOUqIZoHs /pQQ== X-Gm-Message-State: APjAAAUl0VVOUSWzAMg9cgIPCN9Z8yNYhnZCPRckKhGV4tc4cmlsxulh 9vlcti5csEZwt7HUTtPx97M= X-Google-Smtp-Source: APXvYqx7QOIHNGs1ei/wsiOG4HBZrs6hs+BsRnEvIZWdCA95yEdtfMo2yfj4UzG6O4CVYlJaYOYfUQ== X-Received: by 2002:ac2:4578:: with SMTP id k24mr1974407lfm.72.1574863380354; Wed, 27 Nov 2019 06:03:00 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.02.59 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:02:59 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 09/19] trace-cmd: Implement new API tracecmd_add_option_v() Date: Wed, 27 Nov 2019 16:02:37 +0200 Message-Id: <20191127140247.258766-10-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov A new tracecmd API tracecmd_add_option_v() is introduced. It adds new option in trace.dat, similar to tracecmd_add_option(), but the option's data is passed as list of buffers. The standard struct iovec is used as input parameter, containing the option's data buffers. Signed-off-by: Tzvetomir Stoyanov --- include/trace-cmd/trace-cmd.h | 5 ++ include/traceevent/event-parse.h | 1 + lib/trace-cmd/trace-output.c | 116 +++++++++++++++++++++++++++---- 3 files changed, 108 insertions(+), 14 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 831bb1a..47fa463 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -261,11 +261,16 @@ struct tracecmd_output *tracecmd_create_init_file_override(const char *output_fi struct tracecmd_option *tracecmd_add_option(struct tracecmd_output *handle, unsigned short id, int size, const void *data); +struct tracecmd_option * +tracecmd_add_option_v(struct tracecmd_output *handle, + unsigned short id, const struct iovec *vector, int count); + struct tracecmd_option *tracecmd_add_buffer_option(struct tracecmd_output *handle, const char *name, int cpus); int tracecmd_write_cpus(struct tracecmd_output *handle, int cpus); int tracecmd_write_options(struct tracecmd_output *handle); +int tracecmd_append_options(struct tracecmd_output *handle); int tracecmd_update_option(struct tracecmd_output *handle, struct tracecmd_option *option, int size, const void *data); diff --git a/include/traceevent/event-parse.h b/include/traceevent/event-parse.h index a77af4c..30e06a7 100644 --- a/include/traceevent/event-parse.h +++ b/include/traceevent/event-parse.h @@ -11,6 +11,7 @@ #include #include #include +#include #include "traceevent/trace-seq.h" diff --git a/lib/trace-cmd/trace-output.c b/lib/trace-cmd/trace-output.c index be4d3f5..db65ee4 100644 --- a/lib/trace-cmd/trace-output.c +++ b/lib/trace-cmd/trace-output.c @@ -950,21 +950,27 @@ static struct tracecmd_output *create_file(const char *output_file, } /** - * tracecmd_add_option - add options to the file + * tracecmd_add_option_v - add options to the file * @handle: the output file handle name * @id: the id of the option * @size: the size of the option data * @data: the data to write to the file. + * @vector: array of vectors, pointing to the data to write in the file + * @count: number of items in the vector array + * * * Returns handle to update option if needed. * Just the content can be updated, with smaller or equal to * content than the specified size. */ struct tracecmd_option * -tracecmd_add_option(struct tracecmd_output *handle, - unsigned short id, int size, const void *data) +tracecmd_add_option_v(struct tracecmd_output *handle, + unsigned short id, const struct iovec *vector, int count) + { struct tracecmd_option *option; + char *data = NULL; + int i, size = 0; /* * We can only add options before they were written. @@ -973,32 +979,63 @@ tracecmd_add_option(struct tracecmd_output *handle, if (handle->options_written) return NULL; - handle->nr_options++; + for (i = 0; i < count; i++) + size += vector[i].iov_len; + /* Some IDs (like TRACECMD_OPTION_TRACECLOCK) pass vector with 0 / NULL data */ + if (size) { + data = malloc(size); + if (!data) { + warning("Insufficient memory"); + return NULL; + } + } option = malloc(sizeof(*option)); if (!option) { warning("Could not allocate space for option"); + free(data); return NULL; } - option->id = id; - option->size = size; - option->data = malloc(size); - if (!option->data) { - warning("Insufficient memory"); - free(option); - return NULL; + handle->nr_options++; + option->data = data; + for (i = 0; i < count; i++) { + if (vector[i].iov_base && vector[i].iov_len) { + memcpy(data, vector[i].iov_base, vector[i].iov_len); + data += vector[i].iov_len; + } } - /* Some IDs (like TRACECMD_OPTION_TRACECLOCK) pass 0 / NULL data */ - if (size) - memcpy(option->data, data, size); + option->size = size; + option->id = id; list_add_tail(&option->list, &handle->options); return option; } +/** + * tracecmd_add_option - add options to the file + * @handle: the output file handle name + * @id: the id of the option + * @size: the size of the option data + * @data: the data to write to the file. + * + * Returns handle to update option if needed. + * Just the content can be updated, with smaller or equal to + * content than the specified size. + */ +struct tracecmd_option * +tracecmd_add_option(struct tracecmd_output *handle, + unsigned short id, int size, const void *data) +{ + struct iovec vect; + + vect.iov_base = (void *) data; + vect.iov_len = size; + return tracecmd_add_option_v(handle, id, &vect, 1); +} + int tracecmd_write_cpus(struct tracecmd_output *handle, int cpus) { cpus = convert_endian_4(handle, cpus); @@ -1046,6 +1083,57 @@ int tracecmd_write_options(struct tracecmd_output *handle) return 0; } +int tracecmd_append_options(struct tracecmd_output *handle) +{ + struct tracecmd_option *options; + unsigned short option; + unsigned short endian2; + unsigned int endian4; + off_t offset; + int r; + + /* If already written, ignore */ + if (handle->options_written) + return 0; + + if (lseek64(handle->fd, 0, SEEK_END) == (off_t)-1) + return -1; + offset = lseek64(handle->fd, -2, SEEK_CUR); + if (offset == (off_t)-1) + return -1; + + r = pread(handle->fd, &option, 2, offset); + if (r != 2 || option != TRACECMD_OPTION_DONE) + return -1; + + list_for_each_entry(options, &handle->options, list) { + endian2 = convert_endian_2(handle, options->id); + if (do_write_check(handle, &endian2, 2)) + return -1; + + endian4 = convert_endian_4(handle, options->size); + if (do_write_check(handle, &endian4, 4)) + return -1; + + /* Save the data location in case it needs to be updated */ + options->offset = lseek64(handle->fd, 0, SEEK_CUR); + + if (do_write_check(handle, options->data, + options->size)) + return -1; + } + + option = TRACECMD_OPTION_DONE; + + if (do_write_check(handle, &option, 2)) + return -1; + + handle->options_written = 1; + handle->options_written = 1; + + return 0; +} + int tracecmd_update_option(struct tracecmd_output *handle, struct tracecmd_option *option, int size, const void *data) From patchwork Wed Nov 27 14:02:38 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264105 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 49E2313A4 for ; Wed, 27 Nov 2019 14:03:04 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 200452075C for ; Wed, 27 Nov 2019 14:03:04 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="ksjYqnlk" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727116AbfK0ODD (ORCPT ); Wed, 27 Nov 2019 09:03:03 -0500 Received: from mail-lj1-f196.google.com ([209.85.208.196]:46090 "EHLO mail-lj1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726881AbfK0ODD (ORCPT ); Wed, 27 Nov 2019 09:03:03 -0500 Received: by mail-lj1-f196.google.com with SMTP id e9so24590228ljp.13 for ; Wed, 27 Nov 2019 06:03:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=S5U9SmDY9JT28W6d0apExNxzS8k4zqM51/rvn+do++I=; b=ksjYqnlkwrD1Xfve7ToftW71jaMeOXHV4/XZmQD8cgzgAMF7zccBaqlX3OKm8J9dZY lTeGx7kwqm6giWjtl8622C6ebsE/IIXJ9uCgSsVZjGZl509AdpBMNX6TCGZ/cvCyWVG6 V7ax4fTfeyIdZX1lx2KSAK7MKZDtDrB0NT/3u6RFXd6nGKZYN41qy17Z/zWmIplIyxg7 CjS4bIHc82Y1piOcJWnXcWhkkJgXpTIda4jRXKebm8oNWrqP5USlLXg9x/PJjYa3g7kE HFtYbU8Uak6adiX+b87geovv2gK4EfcRbl4WzaHnZNbsJbH4T5kp6eCgxjqFWbHdLrXQ Qqjw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=S5U9SmDY9JT28W6d0apExNxzS8k4zqM51/rvn+do++I=; b=jpNJeAcX2HB7RE3z2+sTYpUXYHZFO94f69zq/g7WJwIlIn8XtwlbRB4BAjmS+Kf5CZ 5s8T/oViIHv+SGbJGpLeK+o4SsJL41J9SfLKHLuWt2HBVjQ+m572SD9iPu8CTi2012uE frtfhmuZsQrAgpXTgA8yNxfz5NpzVTJGbDC1RNOypai4KQBZnI7iRYn1Kpv6eqH9S5OC 6XYa4L5pTg6yFFHxCacenKI5V/swjK3UsiSXviZCfICveRWFNChqwYAsC5JTfdGTZLoR h1tCmloBh+HNgvSwwz8WNQSzx41HF45jvKN1nUDMpnTNtMdkON1o1lPYIYYcAEkRVujQ BKIQ== X-Gm-Message-State: APjAAAU8PKVOZeLl5ayoUU5WQJugY+EevbU/BYhA53VmVc2MjTRioqUi RnGUZ4qPAP2CBJGTRN8Yssv02WgBkkE= X-Google-Smtp-Source: APXvYqxjGc64k0j7EuzF5Fubu/GifdrGg6/3op2VS09zS6sWKHVpk0Oqexf+CVQf+FdyA37DsJ2eOA== X-Received: by 2002:a2e:b4da:: with SMTP id r26mr28468673ljm.153.1574863381401; Wed, 27 Nov 2019 06:03:01 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:00 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 10/19] trace-cmd: Add new API to generate a unique ID of the tracing session Date: Wed, 27 Nov 2019 16:02:38 +0200 Message-Id: <20191127140247.258766-11-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org A new libtracecmd API is implemented: unsigned long long tracecmd_generate_traceid(void); At trace-cmd init phase a unique ID, used for the current tracing session. Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 1 + lib/trace-cmd/trace-util.c | 31 +++++++++++++++++++++++++++++++ tracecmd/include/trace-local.h | 1 + tracecmd/trace-record.c | 1 + 4 files changed, 34 insertions(+) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 47fa463..6d50b08 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -441,6 +441,7 @@ void tracecmd_plog_error(const char *fmt, ...); int tracecmd_set_logfile(char *logfile); /* --- System --- */ +unsigned long long tracecmd_generate_traceid(void); int tracecmd_count_cpus(void); /* --- Hack! --- */ diff --git a/lib/trace-cmd/trace-util.c b/lib/trace-cmd/trace-util.c index ee6f48a..fdafbd6 100644 --- a/lib/trace-cmd/trace-util.c +++ b/lib/trace-cmd/trace-util.c @@ -18,6 +18,8 @@ #include #include #include +#include +#include #include "trace-cmd.h" #include "event-utils.h" @@ -1296,3 +1298,32 @@ error: tracecmd_put_tracing_file(path); return ret; } + +#define FNV_64_PRIME 0x100000001b3ULL +unsigned long long tracecmd_generate_traceid(void) +{ + unsigned long long hash = 0; + unsigned char *ustr; + struct sysinfo sinfo; + struct timespec ts; + char *str = NULL; + + clock_gettime(CLOCK_MONOTONIC_RAW, &ts); + sysinfo(&sinfo); + asprintf(&str, "%ld %ld %ld %ld %ld %ld %ld %ld %d", + ts.tv_sec, ts.tv_nsec, + sinfo.loads[0], sinfo.loads[1], sinfo.loads[2], + sinfo.freeram, sinfo.sharedram, sinfo.freeswap, + sinfo.procs); + if (!str) + return 0; + ustr = (unsigned char *)str; + hash = 0; + while (*ustr) { + hash ^= (unsigned long long)*ustr++; + hash *= FNV_64_PRIME; + } + + free(str); + return hash; +} diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index 51abef1..6203e0d 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -182,6 +182,7 @@ struct pid_addr_maps { struct buffer_instance { struct buffer_instance *next; struct tracecmd_instance *ftrace; + unsigned long long trace_id; char *cpumask; struct event_list *events; struct event_list **event_next; diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index a08ee52..70d75f6 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -5062,6 +5062,7 @@ void init_top_instance(void) top_instance.ftrace = tracecmd_create_instance(NULL); top_instance.cpu_count = tracecmd_count_cpus(); top_instance.flags = BUFFER_FL_KEEP; + top_instance.trace_id = tracecmd_generate_traceid(); tracecmd_init_instance(&top_instance); } From patchwork Wed Nov 27 14:02:39 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264107 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 3FC8414ED for ; Wed, 27 Nov 2019 14:03:06 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 1F478206F0 for ; Wed, 27 Nov 2019 14:03:06 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="dDthyxBh" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727124AbfK0ODG (ORCPT ); Wed, 27 Nov 2019 09:03:06 -0500 Received: from mail-lj1-f196.google.com ([209.85.208.196]:45430 "EHLO mail-lj1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727092AbfK0ODF (ORCPT ); Wed, 27 Nov 2019 09:03:05 -0500 Received: by mail-lj1-f196.google.com with SMTP id n21so24574809ljg.12 for ; Wed, 27 Nov 2019 06:03:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=vzdQWNEyuhaMk+jU/YVwiG5laND8tSKj4Bi90X0jfs4=; b=dDthyxBhHjYvlRVcmgbO/pnrnlxyfQ8mPXGgjDw6C/8otLC0/QSiIFXpK/JsP2kI6M HifDkzDtimgt3HENFCAcNZ5lectgsAcCuchibTym41hbew94zmUM8kk0iMZwbE8gKhNJ Q3XTttuMH9vGd0N8qB9V+nHxR3I/k2vpCnC/fVAZfh3ldSAqytV+ZAlDKNfTEpN17SYF OessfFNS8Pg8YQGioM1OtPU9KegBE3BhmyRfcd0IytUBXxlgYzKBmCs7zo6FWFY7RUqH bJ3odTOwkZpxpYRk4N4O2zteULWebVFatNnoT2jdbe+iSWUbBpJjNt3o3B45YEErjQqF a6Wg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=vzdQWNEyuhaMk+jU/YVwiG5laND8tSKj4Bi90X0jfs4=; b=o2H//RfFHhnXZP2l9GyTs1j12FLx/iLXtBMCvIzGMa9MG1AHLZoBNavOm1xE21fBJc j9fl3eRmHvra+Z4egLNbhwZ1N84TR3XWpTkaTeug+m5gzEIl0nrnZp8UIG07y5TintxL emsexEi14kgSaHWpouISRFJWgSsQy/80zJ8rh3l7ekBpvvkwvUNV6sxkW85QSyx718sN T3FrKOMO5EoDATNElES5BeVLuUduQ6WQX0NcsxHvwdbQXUkcbc5pfIx+OB+ys88oE4ML +V5anu7KgmDoUjjQv5XN5XO+OkO2D0ma/92Uj8I7Zn/8YutprKuA+v8cW/yFYZcuBLP3 nlow== X-Gm-Message-State: APjAAAU+3M3P+0fTzxWstq3Kt8zUDK+V3oBSA1tafxINcsan0siv4mR8 Cp7stFGrqWIIC7bmgdBo8PY= X-Google-Smtp-Source: APXvYqyAtMDmxXTT8dq1gpbziqQAi/bG5g2O9qVTjylxQtD74lOdkKA977akPjkHVLKM3uGZQU1mrw== X-Received: by 2002:a2e:9b4b:: with SMTP id o11mr31199375ljj.252.1574863382553; Wed, 27 Nov 2019 06:03:02 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:01 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 11/19] trace-cmd: Store the session tracing ID in the trace.dat file Date: Wed, 27 Nov 2019 16:02:39 +0200 Message-Id: <20191127140247.258766-12-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org The ID of the current tracing session is stored in the trace.dat file. A new file option is introduced: TRACECMD_OPTION_TRACEID The data is stored in the file as NULL terminated string: "\nTraceID: %llu\n" A new libtracecmd API is introduced, to get the ID when the trace.dat file is read: unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle); Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 2 ++ lib/trace-cmd/trace-input.c | 25 +++++++++++++++++++++++++ tracecmd/trace-record.c | 16 ++++++++++++++++ 3 files changed, 43 insertions(+) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 6d50b08..82def44 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -86,6 +86,7 @@ enum { TRACECMD_OPTION_CPUCOUNT, TRACECMD_OPTION_VERSION, TRACECMD_OPTION_PROCMAPS, + TRACECMD_OPTION_TRACEID, }; enum { @@ -128,6 +129,7 @@ int tracecmd_copy_headers(struct tracecmd_input *handle, int fd); void tracecmd_set_flag(struct tracecmd_input *handle, int flag); void tracecmd_clear_flag(struct tracecmd_input *handle, int flag); unsigned long tracecmd_get_flags(struct tracecmd_input *handle); +unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle); void tracecmd_parse_trace_clock(struct tracecmd_input *handle, char *file, int size); diff --git a/lib/trace-cmd/trace-input.c b/lib/trace-cmd/trace-input.c index 91362f3..40d9825 100644 --- a/lib/trace-cmd/trace-input.c +++ b/lib/trace-cmd/trace-input.c @@ -79,6 +79,7 @@ struct tracecmd_input { struct tep_plugin_list *plugin_list; struct tracecmd_input *parent; unsigned long flags; + unsigned long long trace_id; int fd; int long_size; int page_size; @@ -2169,6 +2170,15 @@ static void procmap_free(struct pid_addr_maps *maps) free(maps); } +static int trace_traceid_load(struct tracecmd_input *handle, char *buf) +{ + + if (sscanf(buf, "%*s %llu", &handle->trace_id) == 1) + return 0; + + return -1; +} + #define STR_PROCMAP_LINE_MAX (PATH_MAX+22) static int trace_pid_map_load(struct tracecmd_input *handle, char *buf) { @@ -2406,6 +2416,10 @@ static int handle_options(struct tracecmd_input *handle) if (buf[size-1] == '\0') trace_pid_map_load(handle, buf); break; + case TRACECMD_OPTION_TRACEID: + if (buf[size-1] == '\0') + trace_traceid_load(handle, buf); + break; default: warning("unknown option %d", option); break; @@ -3507,3 +3521,14 @@ void tracecmd_set_show_data_func(struct tracecmd_input *handle, { handle->show_data_func = func; } + +/** + * tracecmd_get_traceid - get the trace id of the session + * @handle: input handle for the trace.dat file + * + * Returns the trace id, written in the trace file + */ +unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle) +{ + return handle->trace_id; +} diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 70d75f6..938b642 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -3715,6 +3715,19 @@ add_pid_maps(struct tracecmd_output *handle, struct buffer_instance *instance) trace_seq_destroy(&s); } +static void +add_trace_id(struct tracecmd_output *handle, struct buffer_instance *instance) +{ + char *str = NULL; + int len; + + len = asprintf(&str, "\nTraceID: %llu\n", instance->trace_id); + if (len < 1) + return; + tracecmd_add_option(handle, TRACECMD_OPTION_TRACEID, len + 1, str); + free(str); +} + static void add_buffer_stat(struct tracecmd_output *handle, struct buffer_instance *instance) { @@ -3819,6 +3832,9 @@ static void add_options(struct tracecmd_output *handle, struct common_record_con add_option_hooks(handle); add_uname(handle); add_version(handle); + if (!no_top_instance()) + add_trace_id(handle, &top_instance); + for_all_instances(instance) { add_pid_maps(handle, instance); } From patchwork Wed Nov 27 14:02:40 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264109 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 7D97314ED for ; Wed, 27 Nov 2019 14:03:07 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 5487920678 for ; Wed, 27 Nov 2019 14:03:07 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="rDJ5NJkE" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727079AbfK0ODH (ORCPT ); Wed, 27 Nov 2019 09:03:07 -0500 Received: from mail-lf1-f67.google.com ([209.85.167.67]:41921 "EHLO mail-lf1-f67.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726881AbfK0ODH (ORCPT ); Wed, 27 Nov 2019 09:03:07 -0500 Received: by mail-lf1-f67.google.com with SMTP id m30so15408210lfp.8 for ; Wed, 27 Nov 2019 06:03:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=M/GfosiKk5bCXP9F9bcx9pX457vtMw8R1tU56CHUnBw=; b=rDJ5NJkECzqyHM4CvvZ+JKwX1sSyc0xb5ogMYq+x9L+kSK7Eww71+hL2GbLzfL2pjU tRXimqzRql/Pd+ywt+qrLFykSfJ+O2kP0k6Rm3jWw2xToeLLQGZE0HRnpbhiYPtvtrq+ 089lFeuLIpU2C6dTAxd2gHiA7RDsDv7q68KTb9u0yYNvrz8DVsVfowuQs1Y1eaGiVckq zJhpbeqFx4FWFVMazlJx6+wk2rK6L5+2lDViApzIHEFhA9BdfG4kOmZNG+ieIb/4KC2q F4m13gx/q3BBFpoGSNVtPtmhhQhfoREYWvAe8FtECKX1LEUmZGCmV00qsEdSdtn5nQAE 3www== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=M/GfosiKk5bCXP9F9bcx9pX457vtMw8R1tU56CHUnBw=; b=N93DTXQgL3iiYQVgrx49ngMxv0XwZrZD5SDqVj3QetBAoS42dOqebzehNB4o/Rp6/Z biN09cD5r2jU74PpP/fHoTxImUKf4+cRmcyWwlERw5Ucp1aDYD23opbhNu3n75kiW1Zb EyNnIVmeUyA3LG1obG1CNv21lSDk18UqksVYZWpIw8hx+W4GiUb/6MsLls+eO4rqnHp6 CJU9SEmeAaP3Z12oj2PSBffhM8V7Z63ed5of+WKjsYplMvGqm/6BRDIErNhRoZkmIcAf F6xxAfaO4CpRBvEJux2J82+JswgYDv5L6EEHrprup9oL/RGtp5pY+ThGUeBTK3IYqIuw UD6A== X-Gm-Message-State: APjAAAVnDIKHFkR4ZLwFt7SGU+C9CwKZMgRFPrNhZbNgb19q30NrGxjw 7SLnCrF6YryQyj9hgbC6Voc= X-Google-Smtp-Source: APXvYqywCB2+jHvKfwED1TI0Vf0xvILw7IanSgdoJwcfQnAYw40moPamGSTAZGFcHOdLuw2u3wGj3g== X-Received: by 2002:ac2:5967:: with SMTP id h7mr28143554lfp.119.1574863383717; Wed, 27 Nov 2019 06:03:03 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:03 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 12/19] trace-cmd: Exchange tracing IDs between host and guest Date: Wed, 27 Nov 2019 16:02:40 +0200 Message-Id: <20191127140247.258766-13-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org Extend the trace request and trace reply messages, to include also the IDs of host and guest tracing sessions. Those IDs are used to unambiguously match the tracing sessions, when reading trace.dat files. Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 12 ++++++++---- lib/trace-cmd/trace-msg.c | 31 +++++++++++++++++++++++-------- tracecmd/include/trace-local.h | 5 +++-- tracecmd/trace-agent.c | 12 +++++++----- tracecmd/trace-record.c | 12 +++++++++--- 5 files changed, 50 insertions(+), 22 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 82def44..90fa146 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -353,16 +353,20 @@ bool tracecmd_msg_done(struct tracecmd_msg_handle *msg_handle); void tracecmd_msg_set_done(struct tracecmd_msg_handle *msg_handle); int tracecmd_msg_send_trace_req(struct tracecmd_msg_handle *msg_handle, - int argc, char **argv, bool use_fifos); + int argc, char **argv, bool use_fifos, + unsigned long long trace_id); int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, - int *argc, char ***argv, bool *use_fifos); + int *argc, char ***argv, bool *use_fifos, + unsigned long long *trace_id); int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int nr_cpus, int page_size, - unsigned int *ports, bool use_fifos); + unsigned int *ports, bool use_fifos, + unsigned long long trace_id); int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, int *nr_cpus, int *page_size, - unsigned int **ports, bool *use_fifos); + unsigned int **ports, bool *use_fifos, + unsigned long long *trace_id); /* --- ftrace instances --- */ struct tracecmd_instance { diff --git a/lib/trace-cmd/trace-msg.c b/lib/trace-cmd/trace-msg.c index 9c8a690..a34297f 100644 --- a/lib/trace-cmd/trace-msg.c +++ b/lib/trace-cmd/trace-msg.c @@ -63,12 +63,14 @@ struct tracecmd_msg_rinit { struct tracecmd_msg_trace_req { be32 flags; be32 argc; + u64 trace_id; } __attribute__((packed)); struct tracecmd_msg_trace_resp { be32 flags; be32 cpus; be32 page_size; + u64 trace_id; } __attribute__((packed)); struct tracecmd_msg_header { @@ -811,7 +813,8 @@ int tracecmd_msg_wait_close_resp(struct tracecmd_msg_handle *msg_handle) return tracecmd_msg_wait_for_cmd(msg_handle, MSG_CLOSE_RESP); } -static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, bool use_fifos) +static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, + bool use_fifos, unsigned long long trace_id) { size_t args_size = 0; char *p; @@ -823,6 +826,7 @@ static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, bool msg->hdr.size = htonl(ntohl(msg->hdr.size) + args_size); msg->trace_req.flags = use_fifos ? htonl(MSG_TRACE_USE_FIFOS) : htonl(0); msg->trace_req.argc = htonl(argc); + msg->trace_req.trace_id = htonll(trace_id); msg->buf = calloc(args_size, 1); if (!msg->buf) return -ENOMEM; @@ -835,13 +839,15 @@ static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, bool } int tracecmd_msg_send_trace_req(struct tracecmd_msg_handle *msg_handle, - int argc, char **argv, bool use_fifos) + int argc, char **argv, bool use_fifos, + unsigned long long trace_id) { struct tracecmd_msg msg; int ret; tracecmd_msg_init(MSG_TRACE_REQ, &msg); - ret = make_trace_req(&msg, argc, argv, use_fifos); + ret = make_trace_req(&msg, argc, argv, + use_fifos, trace_id); if (ret < 0) return ret; @@ -854,7 +860,8 @@ int tracecmd_msg_send_trace_req(struct tracecmd_msg_handle *msg_handle, * free(argv); */ int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, - int *argc, char ***argv, bool *use_fifos) + int *argc, char ***argv, bool *use_fifos, + unsigned long long *trace_id) { struct tracecmd_msg msg; char *p, *buf_end, **args; @@ -901,6 +908,7 @@ int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, *argc = nr_args; *argv = args; *use_fifos = ntohl(msg.trace_req.flags) & MSG_TRACE_USE_FIFOS; + *trace_id = ntohll(msg.trace_req.trace_id); /* * On success we're passing msg.buf to the caller through argv[0] so we @@ -921,7 +929,8 @@ out: } static int make_trace_resp(struct tracecmd_msg *msg, int page_size, int nr_cpus, - unsigned int *ports, bool use_fifos) + unsigned int *ports, bool use_fifos, + unsigned long long trace_id) { int data_size; @@ -935,19 +944,22 @@ static int make_trace_resp(struct tracecmd_msg *msg, int page_size, int nr_cpus, msg->trace_resp.flags = use_fifos ? htonl(MSG_TRACE_USE_FIFOS) : htonl(0); msg->trace_resp.cpus = htonl(nr_cpus); msg->trace_resp.page_size = htonl(page_size); + msg->trace_resp.trace_id = htonll(trace_id); return 0; } int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int nr_cpus, int page_size, - unsigned int *ports, bool use_fifos) + unsigned int *ports, bool use_fifos, + unsigned long long trace_id) { struct tracecmd_msg msg; int ret; tracecmd_msg_init(MSG_TRACE_RESP, &msg); - ret = make_trace_resp(&msg, page_size, nr_cpus, ports, use_fifos); + ret = make_trace_resp(&msg, page_size, nr_cpus, ports, + use_fifos, trace_id); if (ret < 0) return ret; @@ -956,13 +968,15 @@ int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, int *nr_cpus, int *page_size, - unsigned int **ports, bool *use_fifos) + unsigned int **ports, bool *use_fifos, + unsigned long long *trace_id) { struct tracecmd_msg msg; char *p, *buf_end; ssize_t buf_len; int i, ret; + memset(&msg, 0, sizeof(msg)); ret = tracecmd_msg_recv(msg_handle->fd, &msg); if (ret < 0) return ret; @@ -981,6 +995,7 @@ int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, *use_fifos = ntohl(msg.trace_resp.flags) & MSG_TRACE_USE_FIFOS; *nr_cpus = ntohl(msg.trace_resp.cpus); *page_size = ntohl(msg.trace_resp.page_size); + *trace_id = ntohll(msg.trace_resp.trace_id); *ports = calloc(*nr_cpus, sizeof(**ports)); if (!*ports) { ret = -ENOMEM; diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index 6203e0d..a6f79c5 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -98,8 +98,9 @@ void trace_usage(int argc, char **argv); int trace_record_agent(struct tracecmd_msg_handle *msg_handle, int cpus, int *fds, - int argc, char **argv, bool use_fifos); - + int argc, char **argv, + bool use_fifos, + unsigned long long trace_id); struct hook_list; void trace_init_profile(struct tracecmd_input *handle, struct hook_list *hooks, diff --git a/tracecmd/trace-agent.c b/tracecmd/trace-agent.c index 1c6e0a3..cc330b7 100644 --- a/tracecmd/trace-agent.c +++ b/tracecmd/trace-agent.c @@ -128,6 +128,7 @@ cleanup: static void agent_handle(int sd, int nr_cpus, int page_size) { struct tracecmd_msg_handle *msg_handle; + unsigned long long trace_id; unsigned int *ports; char **argv = NULL; int argc = 0; @@ -144,7 +145,8 @@ static void agent_handle(int sd, int nr_cpus, int page_size) if (!msg_handle) die("Failed to allocate message handle"); - ret = tracecmd_msg_recv_trace_req(msg_handle, &argc, &argv, &use_fifos); + ret = tracecmd_msg_recv_trace_req(msg_handle, &argc, &argv, + &use_fifos, &trace_id); if (ret < 0) die("Failed to receive trace request"); @@ -153,13 +155,13 @@ static void agent_handle(int sd, int nr_cpus, int page_size) if (!use_fifos) make_vsocks(nr_cpus, fds, ports); - + trace_id = tracecmd_generate_traceid(); ret = tracecmd_msg_send_trace_resp(msg_handle, nr_cpus, page_size, - ports, use_fifos); + ports, use_fifos, trace_id); if (ret < 0) die("Failed to send trace response"); - - trace_record_agent(msg_handle, nr_cpus, fds, argc, argv, use_fifos); + trace_record_agent(msg_handle, nr_cpus, fds, argc, argv, + use_fifos, trace_id); free(argv[0]); free(argv); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 938b642..117ecfd 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -3507,12 +3507,16 @@ static void connect_to_agent(struct buffer_instance *instance) die("Failed to allocate message handle"); ret = tracecmd_msg_send_trace_req(msg_handle, instance->argc, - instance->argv, use_fifos); + instance->argv, use_fifos, + top_instance.trace_id); + if (ret < 0) die("Failed to send trace request"); ret = tracecmd_msg_recv_trace_resp(msg_handle, &nr_cpus, &page_size, - &ports, &use_fifos); + &ports, &use_fifos, + &instance->trace_id); + if (ret < 0) die("Failed to receive trace response"); @@ -6118,7 +6122,8 @@ void trace_record(int argc, char **argv) int trace_record_agent(struct tracecmd_msg_handle *msg_handle, int cpus, int *fds, int argc, char **argv, - bool use_fifos) + bool use_fifos, + unsigned long long trace_id) { struct common_record_context ctx; char **argv_plus; @@ -6148,6 +6153,7 @@ int trace_record_agent(struct tracecmd_msg_handle *msg_handle, ctx.instance->flags |= BUFFER_FL_AGENT; ctx.instance->msg_handle = msg_handle; msg_handle->version = V3_PROTOCOL; + top_instance.trace_id = trace_id; record_trace(argc, argv, &ctx); free(argv_plus); From patchwork Wed Nov 27 14:02:41 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264111 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 6C81313A4 for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 434B720678 for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="JmCzLLVe" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727017AbfK0ODJ (ORCPT ); Wed, 27 Nov 2019 09:03:09 -0500 Received: from mail-lf1-f66.google.com ([209.85.167.66]:42647 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727097AbfK0ODI (ORCPT ); Wed, 27 Nov 2019 09:03:08 -0500 Received: by mail-lf1-f66.google.com with SMTP id y19so17243247lfl.9 for ; Wed, 27 Nov 2019 06:03:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=B224P4RxVMyJM0B0WPGLDNxjdh952JhNi7+WGoEhibc=; b=JmCzLLVeCcFNP9pMJjS5jFiteIgTTz3XuP+Zq6PBpfmfJ3poiAD5QFl/xi7Sd/G/6U tv2tsxwAdZcy20GRgBXUIyClGbVQ+Z7TtHPYrfrGYT9LitMnX/ZYjiikRYgstYneGuds nFcLJhysX1JpqVbhcsAHJBaLaVPosykA91bP3ADU/CN6FCqhMQmu0csNnuGqsifPRwvY kiKJEwdhQq9BCFQDW51n24iHvk6p7sNJh80/3qU3GBopVTp+SeHB+qJZU5u9O/mxWCKk NPM1UJkn5AYrk86kBCXT2uEwH90MvFOhAU/Yxu++7wNXVO8B4RCbFNjK9slsyCj2oxVL wGEg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=B224P4RxVMyJM0B0WPGLDNxjdh952JhNi7+WGoEhibc=; b=WfPQ/nZgF0n/kDdwZ4YGz2H+ChIUV6mskVzOqYKiBW4Mf3scS2n0sTNnaoFmicfzDS tIJruBvSJPMljeZ+N7oc7WCVkAiaTGmt/eYEHp8A8Aayru7dk4JCkSMRjZksxfy/PaJY 1dCle4bghDsuouTI6G2nLc43oyyqwsLl52jkq0MkstSz1hUuAFmOfkA2VMnFy1wEVeV2 LLvxTyQ6bLCjBHRZCGV+5KseutNoYM3lAF4mv3HTLhQrHoWiZSYuvL0Hv1US3I2YLAbw Wt+T1ZPPj4ltogXCgNM8N5zgxIBz/0saQg5Bwzdr72u2fbM64ZV9zM/8+EUMf80STpLe yQZg== X-Gm-Message-State: APjAAAU7rHDlzfVmnM8zmsq/HVmrYLN5alR01Xy7RYUErtchFS9VbBAj Io0YzU6KCgBuMmMGgu46Uqie5rdsB1g= X-Google-Smtp-Source: APXvYqyZQi4yARCKNB0Jl+YgBmr6x+P3w+XiF8/ejlouPj8ymomFPc5DPKY53kcfubbs2+QQVMre5g== X-Received: by 2002:ac2:5a48:: with SMTP id r8mr1808588lfn.179.1574863384839; Wed, 27 Nov 2019 06:03:04 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:04 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 13/19] trace-cmd: Implement new option in trace.dat file: TRACECMD_OPTION_TIME_SHIFT Date: Wed, 27 Nov 2019 16:02:41 +0200 Message-Id: <20191127140247.258766-14-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org From: Tzvetomir Stoyanov The TRACECMD_OPTION_TIME_SHIFT is used when synchronizing trace time stamps between two trace.dat files. It contains multiple long long (time, offset) pairs, describing time stamps _offset_, measured in the given local _time_. The content of the option buffer is: 8 bytes - long long integer, ID of the tracing session 4 bytes - integer, count of timestamp offsets long long array of size _count_, local time in which the offset is measured long long array of size _count_, offset of the time stamps Signed-off-by: Tzvetomir Stoyanov --- include/trace-cmd/trace-cmd.h | 6 ++ lib/trace-cmd/trace-input.c | 170 +++++++++++++++++++++++++++++++++- 2 files changed, 174 insertions(+), 2 deletions(-) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 90fa146..1240b4a 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -87,6 +87,7 @@ enum { TRACECMD_OPTION_VERSION, TRACECMD_OPTION_PROCMAPS, TRACECMD_OPTION_TRACEID, + TRACECMD_OPTION_TIME_SHIFT, }; enum { @@ -130,6 +131,11 @@ void tracecmd_set_flag(struct tracecmd_input *handle, int flag); void tracecmd_clear_flag(struct tracecmd_input *handle, int flag); unsigned long tracecmd_get_flags(struct tracecmd_input *handle); unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle); +int tracecmd_get_guest_cpumap(struct tracecmd_input *handle, + unsigned long long trace_id, + char *name, + int *vcpu_count, int *cpu_pid); +unsigned long long tracecmd_get_tsync_peer(struct tracecmd_input *handle); void tracecmd_parse_trace_clock(struct tracecmd_input *handle, char *file, int size); diff --git a/lib/trace-cmd/trace-input.c b/lib/trace-cmd/trace-input.c index 40d9825..a6b675a 100644 --- a/lib/trace-cmd/trace-input.c +++ b/lib/trace-cmd/trace-input.c @@ -74,6 +74,18 @@ struct input_buffer_instance { size_t offset; }; +struct ts_offset_sample { + long long time; + long long offset; +}; + +struct host_trace_info { + bool sync_enable; + unsigned long long trace_id; + int ts_samples_count; + struct ts_offset_sample *ts_samples; +}; + struct tracecmd_input { struct tep_handle *pevent; struct tep_plugin_list *plugin_list; @@ -92,6 +104,7 @@ struct tracecmd_input { bool use_pipe; struct cpu_data *cpu_data; long long ts_offset; + struct host_trace_info host; double ts2secs; char * cpustats; char * uname; @@ -1072,6 +1085,67 @@ static void free_next(struct tracecmd_input *handle, int cpu) free_record(record); } +static inline unsigned long long +timestamp_correction_calc(unsigned long long ts, struct ts_offset_sample *min, + struct ts_offset_sample *max) +{ + long long tscor = min->offset + + (((((long long)ts) - min->time)* + (max->offset-min->offset))/(max->time-min->time)); + + if (tscor < 0) + return ts - llabs(tscor); + + return ts + tscor; +} + +static unsigned long long timestamp_correct(unsigned long long ts, + struct tracecmd_input *handle) +{ + struct host_trace_info *host = &handle->host; + int min, mid, max; + + if (handle->ts_offset) + return ts + handle->ts_offset; + + if (!host->sync_enable || !host->ts_samples_count || !host->ts_samples) + return ts; + + /* We have one sample, nothing to calc here */ + if (host->ts_samples_count == 1) + return ts + host->ts_samples[0].offset; + + /* We have two samples, nothing to search here */ + if (host->ts_samples_count == 2) + return timestamp_correction_calc(ts, &host->ts_samples[0], + &host->ts_samples[1]); + + /* We have more than two samples */ + if (ts <= host->ts_samples[0].time) + return timestamp_correction_calc(ts, + &host->ts_samples[0], + &host->ts_samples[1]); + else if (ts >= host->ts_samples[host->ts_samples_count-1].time) + return timestamp_correction_calc(ts, + &host->ts_samples[host->ts_samples_count-2], + &host->ts_samples[host->ts_samples_count-1]); + min = 0; + max = host->ts_samples_count-1; + mid = (min + max)/2; + while (min <= max) { + if (ts < host->ts_samples[mid].time) + max = mid - 1; + else if (ts > host->ts_samples[mid].time) + min = mid + 1; + else + break; + mid = (min + max)/2; + } + + return timestamp_correction_calc(ts, &host->ts_samples[mid], + &host->ts_samples[mid+1]); +} + /* * Page is mapped, now read in the page header info. */ @@ -1093,7 +1167,7 @@ static int update_page_info(struct tracecmd_input *handle, int cpu) kbuffer_subbuffer_size(kbuf)); return -1; } - handle->cpu_data[cpu].timestamp = kbuffer_timestamp(kbuf) + handle->ts_offset; + handle->cpu_data[cpu].timestamp = timestamp_correct(kbuffer_timestamp(kbuf), handle); if (handle->ts2secs) handle->cpu_data[cpu].timestamp *= handle->ts2secs; @@ -1820,7 +1894,7 @@ read_again: goto read_again; } - handle->cpu_data[cpu].timestamp = ts + handle->ts_offset; + handle->cpu_data[cpu].timestamp = timestamp_correct(ts, handle); if (handle->ts2secs) { handle->cpu_data[cpu].timestamp *= handle->ts2secs; @@ -2143,6 +2217,47 @@ void tracecmd_set_ts2secs(struct tracecmd_input *handle, handle->use_trace_clock = false; } +static int tsync_offset_cmp(const void *a, const void *b) +{ + struct ts_offset_sample *ts_a = (struct ts_offset_sample *)a; + struct ts_offset_sample *ts_b = (struct ts_offset_sample *)b; + + if (ts_a->time > ts_b->time) + return 1; + if (ts_a->time < ts_b->time) + return -1; + return 0; +} + +static void tsync_offset_load(struct tracecmd_input *handle, char *buf) +{ + struct host_trace_info *host = &handle->host; + long long *buf8 = (long long *)buf; + int i, j; + + for (i = 0; i < host->ts_samples_count; i++) { + host->ts_samples[i].time = tep_read_number(handle->pevent, + buf8 + i, 8); + host->ts_samples[i].offset = tep_read_number(handle->pevent, + buf8 + host->ts_samples_count+i, 8); + } + qsort(host->ts_samples, host->ts_samples_count, + sizeof(struct ts_offset_sample), tsync_offset_cmp); + /* Filter possible samples with equal time */ + for (i = 0, j = 0; i < host->ts_samples_count; i++) { + if (i == 0 || host->ts_samples[i].time != host->ts_samples[i-1].time) + host->ts_samples[j++] = host->ts_samples[i]; + } + host->ts_samples_count = j; + host->sync_enable = true; +} + +static void trace_tsync_offset_free(struct host_trace_info *host) +{ + free(host->ts_samples); + host->ts_samples = NULL; +} + static int trace_pid_map_cmp(const void *a, const void *b) { struct tracecmd_proc_addr_map *m_a = (struct tracecmd_proc_addr_map *)a; @@ -2323,6 +2438,7 @@ static int handle_options(struct tracecmd_input *handle) struct input_buffer_instance *buffer; struct hook_list *hook; char *buf; + int sampes_size; int cpus; /* By default, use usecs, unless told otherwise */ @@ -2370,6 +2486,28 @@ static int handle_options(struct tracecmd_input *handle) offset = strtoll(buf, NULL, 0); handle->ts_offset += offset; break; + case TRACECMD_OPTION_TIME_SHIFT: + /* + * long long int (8 bytes) trace session ID + * int (4 bytes) count of timestamp offsets. + * long long array of size [count] of times, + * when the offsets were calculated. + * long long array of size [count] of timestamp offsets. + */ + if (size < 12 || handle->flags & TRACECMD_FL_IGNORE_DATE) + break; + handle->host.trace_id = tep_read_number(handle->pevent, + buf, 8); + handle->host.ts_samples_count = tep_read_number(handle->pevent, + buf + 8, 4); + sampes_size = (8 * handle->host.ts_samples_count); + if (size != (12 + (2 * sampes_size))) + break; + handle->host.ts_samples = malloc(2 * sampes_size); + if (!handle->host.ts_samples) + return -ENOMEM; + tsync_offset_load(handle, buf + 12); + break; case TRACECMD_OPTION_CPUSTAT: buf[size-1] = '\n'; cpustats = realloc(cpustats, cpustats_size + size + 1); @@ -3078,6 +3216,8 @@ void tracecmd_close(struct tracecmd_input *handle) trace_pid_map_free(handle->pid_maps); handle->pid_maps = NULL; + trace_tsync_offset_free(&handle->host); + if (handle->flags & TRACECMD_FL_BUFFER_INSTANCE) tracecmd_close(handle->parent); else { @@ -3532,3 +3672,29 @@ unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle) { return handle->trace_id; } + +/** + * tracecmd_get_tsync_peer - get the trace session id of the peer host + * @handle: input handle for the trace.dat file + * + * Returns the trace id of the peer host, written in the trace file + * + * This information is stored in guest trace.dat file + */ +unsigned long long tracecmd_get_tsync_peer(struct tracecmd_input *handle) +{ + return handle->host.trace_id; +} + +/** + * tracecmd_enable_tsync - enable / disable the timestamps correction + * @handle: input handle for the trace.dat file + * @enable: enable / disable the timestamps correction + * + * Enables or disables timestamps correction on file load, using the array of + * recorded time offsets + */ +void tracecmd_enable_tsync(struct tracecmd_input *handle, bool enable) +{ + handle->host.sync_enable = enable; +} From patchwork Wed Nov 27 14:02:42 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264113 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 9432C15AB for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 749BF20678 for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="Xe4kyggi" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727092AbfK0ODJ (ORCPT ); Wed, 27 Nov 2019 09:03:09 -0500 Received: from mail-lj1-f194.google.com ([209.85.208.194]:34680 "EHLO mail-lj1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727010AbfK0ODJ (ORCPT ); Wed, 27 Nov 2019 09:03:09 -0500 Received: by mail-lj1-f194.google.com with SMTP id m6so17238292ljc.1 for ; Wed, 27 Nov 2019 06:03:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=pbuFv0yv5tgT3SrGGk+k+VcmU2kaGyJe5g4zuALr9KM=; b=Xe4kyggi/NjQKqv7T+CmkuniiNR7hxFuOUBTPLA5lPDL2oNsXuNiXhleySY+oTvNFh ixsHuENFi6L8F8N1z2UpbRJd8edXCf7scAMLu3EIliizGIF9Eb94nnLkczlFZfzxAEE1 JWCB5eKvv502wsrzc+Bov4+zqGtgPZJIBvDe6mdsAXkrB6qdVgBPn0SOGUWlb03vkwGo HkesmqKvEcXnN3XumrQorr11wboFWMbWjDnixfCAY7epiLG/bulXGBQty2R2Lj06eugv q1VYFvcm/vVr42w3q/U6wmZ9ltThhWSXx1QWwLfhEru/1hH6VD+HipwiTi8/9bYx/hQp HkcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=pbuFv0yv5tgT3SrGGk+k+VcmU2kaGyJe5g4zuALr9KM=; b=RGCp5HGlz/G+w9TvhaFuLyRX2clhg5tLCqRubj3Tuh+nShiFLLJOHuHyGldHPjbEzn xDyhiahbRMCYLdDe9eB7cz9IEkZQmnMUEsQRHPEw4sJp6dRVGitUNpNfbL4pdttMBXDJ gtZoZAzHJauWdQn1RyUFsz4ZohoZZHj8GIaVJoD/KbK97jXarr3Aaxf4X+FZTGxhq+1H bzfz4YKvD6s14/83BJM2ALazIERbv1LRNoIgduSh0RwlYF+RqYfr458rRj5DrSHYVfmp Dsl9CMufeMShYpUv5Uf/H4DHJLd1aGzBtVwTXdnciqvMo03V36SiddISLctntydxTRa+ 0lnA== X-Gm-Message-State: APjAAAUJQvHPMOnUhaRAo4ha88C3xfonb+R7esZ7QvQK7n6W7sSq5DKa Mu67el8IEdECXQDa1JbrN5hRV6apc44= X-Google-Smtp-Source: APXvYqxTGXj1vvVneDyH45AXQy/iEE5gN4ayzWuNlUJr0tRvTkeVJsRFO3Nc8uGPG0WRjxl0Y5TO1g== X-Received: by 2002:a2e:740d:: with SMTP id p13mr6555739ljc.25.1574863385941; Wed, 27 Nov 2019 06:03:05 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.04 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:05 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 14/19] trace-cmd: Add guest information in host's trace.dat file Date: Wed, 27 Nov 2019 16:02:42 +0200 Message-Id: <20191127140247.258766-15-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org New trace.dat option is introduced: TRACECMD_OPTION_GUEST. Written in the host's trace.dat file, it contains information about guests, traced at the same time: guest trace ID, number of VCPUs and PIDs of the host tasks, running those VCPU. The data is stored in the file as NULL terminated string: "Guest %s %llu %d\n" -> guest name, number of VCPUs "%d %d\n" -> VCPU, PID of host task ..... "%d %d\n" -> VCPU, PID of host task Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 1 + lib/trace-cmd/trace-input.c | 113 ++++++++++++++++++++++++++++++++++ tracecmd/trace-record.c | 45 ++++++++++++++ 3 files changed, 159 insertions(+) diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 1240b4a..17badf2 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -88,6 +88,7 @@ enum { TRACECMD_OPTION_PROCMAPS, TRACECMD_OPTION_TRACEID, TRACECMD_OPTION_TIME_SHIFT, + TRACECMD_OPTION_GUEST, }; enum { diff --git a/lib/trace-cmd/trace-input.c b/lib/trace-cmd/trace-input.c index a6b675a..e36ebaa 100644 --- a/lib/trace-cmd/trace-input.c +++ b/lib/trace-cmd/trace-input.c @@ -79,6 +79,14 @@ struct ts_offset_sample { long long offset; }; +struct guest_trace_info { + struct guest_trace_info *next; + char *name; + unsigned long long trace_id; + int vcpu_count; + int *cpu_pid; +}; + struct host_trace_info { bool sync_enable; unsigned long long trace_id; @@ -112,6 +120,7 @@ struct tracecmd_input { char * trace_clock; struct input_buffer_instance *buffers; int parsing_failures; + struct guest_trace_info *guest; struct tracecmd_ftrace finfo; @@ -2294,6 +2303,73 @@ static int trace_traceid_load(struct tracecmd_input *handle, char *buf) return -1; } +static void trace_guests_free(struct tracecmd_input *handle) +{ + struct guest_trace_info *guest; + + while (handle->guest) { + guest = handle->guest; + handle->guest = handle->guest->next; + free(guest->name); + free(guest->cpu_pid); + free(guest); + } +} + +static int trace_guest_load(struct tracecmd_input *handle, char *buf) +{ + struct guest_trace_info *guest = NULL; + unsigned long long tid; + char *line; + int cpu, pid; + + line = strchr(buf, '\n'); + if (!line) + goto error; + *line = '\0'; + + guest = calloc(1, sizeof(struct guest_trace_info)); + if (!guest) + goto error; + + if (sscanf(buf, "%*s %ms %llu %d", &guest->name, &tid, &cpu) != 3) + goto error; + guest->trace_id = tid; + guest->vcpu_count = cpu; + + guest->cpu_pid = calloc(guest->vcpu_count, sizeof(int)); + if (!guest->cpu_pid) + goto error; + + buf = line + 1; + line = strchr(buf, '\n'); + while (line) { + *line = '\0'; + if (sscanf(buf, "%d %d", &cpu, &pid) != 2) + goto error; + + if (cpu < guest->vcpu_count) + guest->cpu_pid[cpu] = pid; + buf = line + 1; + if (!*buf) + break; + + line = strchr(buf, '\n'); + } + + guest->next = handle->guest; + handle->guest = guest; + return 0; + +error: + if (guest) { + free(guest->cpu_pid); + free(guest->name); + free(guest); + } + return -1; +} + #define STR_PROCMAP_LINE_MAX (PATH_MAX+22) static int trace_pid_map_load(struct tracecmd_input *handle, char *buf) { @@ -2558,6 +2634,10 @@ static int handle_options(struct tracecmd_input *handle) if (buf[size-1] == '\0') trace_traceid_load(handle, buf); break; + case TRACECMD_OPTION_GUEST: + if (buf[size-1] == '\0') + trace_guest_load(handle, buf); + break; default: warning("unknown option %d", option); break; @@ -3217,6 +3297,7 @@ void tracecmd_close(struct tracecmd_input *handle) handle->pid_maps = NULL; trace_tsync_offset_free(&handle->host); + trace_guests_free(handle); if (handle->flags & TRACECMD_FL_BUFFER_INSTANCE) tracecmd_close(handle->parent); @@ -3673,6 +3754,38 @@ unsigned long long tracecmd_get_traceid(struct tracecmd_input *handle) return handle->trace_id; } +/** + * tracecmd_get_guest_cpumap - get the mapping of guest VCPU to host process + * @handle: input handle for the trace.dat file + * @trace_id: ID of the guest tracing session + * + * Returns @name of the guest, number of VPUs (@vcpu_count) + * and array @cpu_pid with size @vcpu_count. Array index is VCPU id, array + * content is PID of the host process, running this VCPU. + * + * This information is stored in host trace.dat file + */ +int tracecmd_get_guest_cpumap(struct tracecmd_input *handle, + unsigned long long trace_id, + char *name, + int *vcpu_count, int *cpu_pid) +{ + struct guest_trace_info *guest = handle->guest; + + while (guest) { + if (guest->trace_id == trace_id) + break; + guest = guest->next; + } + if (!guest) + return -1; + + name = guest->name; + *vcpu_count = guest->vcpu_count; + cpu_pid = guest->cpu_pid; + return 0; +} + /** * tracecmd_get_tsync_peer - get the trace session id of the peer host * @handle: input handle for the trace.dat file diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 117ecfd..1d9ba3c 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -2884,6 +2884,19 @@ struct guest { static struct guest *guests; static size_t guests_len; +static struct guest *get_guest_info(unsigned int guest_cid) +{ + int i; + + if (!guests) + return NULL; + + for (i = 0; i < guests_len; i++) + if (guest_cid == guests[i].cid) + return guests + i; + return NULL; +} + static char *get_qemu_guest_name(char *arg) { char *tok, *end = arg; @@ -3689,6 +3702,33 @@ static void append_buffer(struct tracecmd_output *handle, } } +static void +add_guest_info(struct tracecmd_output *handle, struct buffer_instance *instance) +{ + struct guest *guest = get_guest_info(instance->cid); + struct trace_seq s; + int i; + + if (!guest) + return; + for (i = 0; i < VCPUS_MAX; i++) + if (!guest->cpu_pid[i]) + break; + + trace_seq_init(&s); + + trace_seq_printf(&s, "Guest %s %llu %d\n", + guest->name, instance->trace_id, i); + for (i = 0; i < VCPUS_MAX; i++) { + if (!guest->cpu_pid[i]) + break; + trace_seq_printf(&s, "%d %d\n", i, guest->cpu_pid[i]); + } + trace_seq_terminate(&s); + tracecmd_add_option(handle, TRACECMD_OPTION_GUEST, + s.len + 1, s.buffer); + trace_seq_destroy(&s); +} static void add_pid_maps(struct tracecmd_output *handle, struct buffer_instance *instance) @@ -3977,6 +4017,11 @@ static void record_data(struct common_record_context *ctx) if (!no_top_instance() && !top_instance.msg_handle) print_stat(&top_instance); + for_all_instances(instance) { + if (is_guest(instance)) + add_guest_info(handle, instance); + } + tracecmd_append_cpu_data(handle, local_cpu_count, temp_files); for (i = 0; i < max_cpu_count; i++) From patchwork Wed Nov 27 14:02:43 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264115 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id BC0851863 for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 9C8F720678 for ; Wed, 27 Nov 2019 14:03:09 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="bxgndUow" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727010AbfK0ODJ (ORCPT ); Wed, 27 Nov 2019 09:03:09 -0500 Received: from mail-lj1-f194.google.com ([209.85.208.194]:40261 "EHLO mail-lj1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726881AbfK0ODJ (ORCPT ); Wed, 27 Nov 2019 09:03:09 -0500 Received: by mail-lj1-f194.google.com with SMTP id s22so5596628ljs.7 for ; Wed, 27 Nov 2019 06:03:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=jHtuBCIR6rovpENMXqQ38oTXPRpvn9y0woRZuvJrdOg=; b=bxgndUowyF5FC0l6RbQjNNnH0yutlEOs37PsokB51QpZViKzYipSZ1JrdrBQxy7YYJ 3nIgT929r5DveUH7C24GGaR3VFQafRWCzXvNy+G2L+U2K5HK2qHgh7zLW10xXxvZvQqu yAZTg08kaWJMmcashNkXYUNhpuZEGVhIjJZsi8zG9U+40M2L8jZaB66hlQ5Qy/Q7tkYI AwH8VubKjBnCLNyTfw2d4uAhlpAMdjlHVMF5X7t/w14jdmdqB3S5txiCkxo6s2T9AAzC JzYyV49DK5jjJzLA7lx2pCpIA/BayHXkF4ccBPFS44+HzywrGHZ9DF5+d2cEeqYY+0xf gqTA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=jHtuBCIR6rovpENMXqQ38oTXPRpvn9y0woRZuvJrdOg=; b=U46ZmChxiVHQhZqCGpT6ZNqQHoRHuBLk2SHVwiPoHxg3uIQdrOUIiscqjRDA99Y6ec jOozJ9TWXR7THmjI36dtjgwkc3syonO+zQ5bZkUM1re2dSKiXvUKyxRVU1D5T3FH8Lly vzxP8o0UUFryrru2S+7ZIg2woOS1pg18wYGHwJB/WiFzzkwzmJnS5/L+e733Iz/p3gfX YQK0b2Rx90aUY5rtn2iL4j08NkHjag3AUTqdnbQEtxK2YjzcA8ETBdK8WtHowm0G5BSo rJ6DHozt+CLkOdTgV+HURZqlMkKWQl9b100nYZbrRf6bAnd6tuEdR9S64ilGB8CR3Gqn doog== X-Gm-Message-State: APjAAAXz3F99qlyAy3NJOURlJaplJDgZOTN+rW5Ed+aFoUEFMWQ2Laui ld/LCfy/XPOIO4Mv+Y7zuY4YOzFHD5Y= X-Google-Smtp-Source: APXvYqwz+fEQIw8HAZqD14q/koQpbAPPcPHouU0w0lexhUwnlhT2XQ8n7N4jAe+KaWYcNotEVPMOTg== X-Received: by 2002:a2e:2a43:: with SMTP id q64mr31693903ljq.242.1574863387182; Wed, 27 Nov 2019 06:03:07 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.05 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:06 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 15/19] trace-cmd: Add host trace clock as guest trace argument Date: Wed, 27 Nov 2019 16:02:43 +0200 Message-Id: <20191127140247.258766-16-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org When tracing host and guest machines, both should use the same tracing clock for event timestamps. If a clock is specified as host tracing argument, with option "-C clock_name", the same is injected as guest tracing argument. If the user wants to use different tracing clocks, it can specify it using "-C clock_name" as guest tracing argument. In that case, the one specified by the user has higher priority. Signed-off-by: Tzvetomir Stoyanov (VMware) --- tracecmd/trace-record.c | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-) diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 1d9ba3c..4f18283 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -5406,6 +5406,8 @@ static void parse_record_options(int argc, char *sav; int name_counter = 0; int neg_event = 0; + struct buffer_instance *instance; + bool guest_config = false; init_common_record_context(ctx, curr_cmd); @@ -5563,6 +5565,7 @@ static void parse_record_options(int argc, break; case 'C': ctx->instance->ftrace->clock = optarg; + guest_config = true; break; case 'v': neg_event = 1; @@ -5780,14 +5783,26 @@ static void parse_record_options(int argc, /* If --date is specified, prepend it to all guest VM flags */ if (ctx->date) { - struct buffer_instance *instance; - for_all_instances(instance) { if (is_guest(instance)) add_argv(instance, "--date", true); } } + if (guest_config) { + /* If -C is specified, prepend clock to all guest VM flags */ + for_all_instances(instance) { + if (top_instance.ftrace->clock) { + if (is_guest(instance)) { + add_argv(instance, + (char *)top_instance.ftrace->clock, + true); + add_argv(instance, "-C", true); + } + } + } + } + if (!ctx->filtered && ctx->instance->filter_mod) add_func(&ctx->instance->filter_funcs, ctx->instance->filter_mod, "*"); From patchwork Wed Nov 27 14:02:44 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264117 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 5EAEF13A4 for ; Wed, 27 Nov 2019 14:03:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 3EA7A206F0 for ; Wed, 27 Nov 2019 14:03:11 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="tLfByzw0" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726881AbfK0ODL (ORCPT ); Wed, 27 Nov 2019 09:03:11 -0500 Received: from mail-lj1-f196.google.com ([209.85.208.196]:36583 "EHLO mail-lj1-f196.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727022AbfK0ODK (ORCPT ); Wed, 27 Nov 2019 09:03:10 -0500 Received: by mail-lj1-f196.google.com with SMTP id k15so24632900lja.3 for ; Wed, 27 Nov 2019 06:03:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=BjJ+tT+AgkBiCcWy5862LqL/Pge2Pf+XNzi+wq1cCK0=; b=tLfByzw0Iz+olrYDDF0N9w1WfGih0Rv4LGj8JXOmhEcwKu1AlPS/VfOh8G8mx/cIdo 2N571ynpot2cieiLYMaRsW0mgrXkP0zWaXxjab+PmSmUYOeuhhyNDbwJC4F5UKxrwpe3 1qDvuSNvSceq41TdBGMzZsGAAVSxnYaDv47vw75y4189VQQqfkKh7GReGVNmOU4F3tzR wW2EdNQczZffkj5X8QODkPhkCsXNGwxZY26AVKwkYmRjS68ePJNiVvNI8fUqCWR64T5d yGhuP1UFm8RcF/rr+ULsMGViAvGg+twzOGFyYJcmtYYUGK8ndGvDSM4ovgUwY6GzE9wY LT6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=BjJ+tT+AgkBiCcWy5862LqL/Pge2Pf+XNzi+wq1cCK0=; b=flxMeZkVfMagJMAEHjuDEdMJ82lqHQOZn/K3Hv1fIAx/Zpltzx6iBt8Uo5z2UVpdRi nGzWsob/1KFmdt3YYyWf1Y8AHywEraryIJwoScQT2s8NnmKM31uJVYn9jDylVVENqSlz G18G/eYJanq8jekHYHvAZNSlTMxfQLSpS3YdxvZGPOYv2MICbHQj/Xmufn1/PJUvw0PJ DZ12c6wyOsdWO8opgwXzJ7G2M0J2NuIUvwbr0v8AWoTLHk5Ko7hIaN/cyLl+qh2oqHqE JsfVxoBiBkifVKxNNdC1SMVDBa5JymTD2TXM61M7Pj5fDOTtjS9VGOHuKcye7BbcKjxd zVCA== X-Gm-Message-State: APjAAAXN+6wcUz1dOllemygVSdhJWEMeFWcqOTzyFc/ukHOB8V7A9Dk1 k/KSUveb5q5jL+z7ShWIUbY= X-Google-Smtp-Source: APXvYqyyB//fGeWnRl8Yqd+WiO7OclshZw5+XOze+WgleNbypFera9yfTk5j51uTEy46jvW/GTI8Iw== X-Received: by 2002:a2e:93d5:: with SMTP id p21mr19128488ljh.50.1574863388401; Wed, 27 Nov 2019 06:03:08 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:07 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 16/19] trace-cmd: Refactor few trace-cmd internal functions. Date: Wed, 27 Nov 2019 16:02:44 +0200 Message-Id: <20191127140247.258766-17-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org In order to reuse code inside trace-cmd application context, few functions are made non static: int make_vsock(unsigned int port); int get_vsock_port(int sd, unsigned int *port); int open_vsock(unsigned int cid, unsigned int port); char *get_guest_file(const char *file, const char *guest); Signed-off-by: Tzvetomir Stoyanov (VMware) --- tracecmd/include/trace-local.h | 8 ++++++++ tracecmd/trace-agent.c | 4 ++-- tracecmd/trace-record.c | 8 ++++---- 3 files changed, 14 insertions(+), 6 deletions(-) diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index a6f79c5..17ef31a 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -19,6 +19,8 @@ #define GUEST_FIFO_FMT GUEST_DIR_FMT "/" GUEST_PIPE_NAME "%d" #define VIRTIO_FIFO_FMT "/dev/virtio-ports/" GUEST_PIPE_NAME "%d" +#define TRACE_FILENAME "trace.dat" + /* fix stupid glib guint64 typecasts and printf formats */ typedef unsigned long long u64; @@ -258,6 +260,12 @@ void tracecmd_disable_tracing(void); void tracecmd_enable_tracing(void); void tracecmd_stat_cpu(struct trace_seq *s, int cpu); +int make_vsock(unsigned int port); +int get_vsock_port(int sd, unsigned int *port); +int open_vsock(unsigned int cid, unsigned int port); + +char *get_guest_file(const char *file, const char *guest); + /* No longer in event-utils.h */ void __noreturn die(const char *fmt, ...); /* Can be overriden */ void *malloc_or_die(unsigned int size); /* Can be overridden */ diff --git a/tracecmd/trace-agent.c b/tracecmd/trace-agent.c index cc330b7..530f972 100644 --- a/tracecmd/trace-agent.c +++ b/tracecmd/trace-agent.c @@ -40,7 +40,7 @@ static int get_local_cid(unsigned int *cid) return ret; } -static int make_vsock(unsigned int port) +int make_vsock(unsigned int port) { struct sockaddr_vm addr = { .svm_family = AF_VSOCK, @@ -64,7 +64,7 @@ static int make_vsock(unsigned int port) return sd; } -static int get_vsock_port(int sd, unsigned int *port) +int get_vsock_port(int sd, unsigned int *port) { struct sockaddr_vm addr; socklen_t addr_len = sizeof(addr); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 4f18283..288dbcc 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -68,7 +68,7 @@ static int rt_prio; static int keep; -static const char *output_file = "trace.dat"; +static const char *output_file = TRACE_FILENAME; static int latency; static int sleep_time = 1000; @@ -536,7 +536,7 @@ static char *get_temp_file(struct buffer_instance *instance, int cpu) return file; } -static char *get_guest_file(const char *file, const char *guest) +char *get_guest_file(const char *file, const char *guest) { const char *p; char *out = NULL; @@ -2772,7 +2772,7 @@ static int connect_port(const char *host, unsigned int port) } #ifdef VSOCK -static int open_vsock(unsigned int cid, unsigned int port) +int open_vsock(unsigned int cid, unsigned int port) { struct sockaddr_vm addr = { .svm_family = AF_VSOCK, @@ -2835,7 +2835,7 @@ static bool can_splice_read_vsock(void) } #else -static inline int open_vsock(unsigned int cid, unsigned int port) +int open_vsock(unsigned int cid, unsigned int port) { die("vsock is not supported"); return -1; From patchwork Wed Nov 27 14:02:45 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264121 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id AA58C15AB for ; Wed, 27 Nov 2019 14:03:15 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 6FFB620678 for ; Wed, 27 Nov 2019 14:03:15 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="s50DR9ga" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727007AbfK0ODP (ORCPT ); Wed, 27 Nov 2019 09:03:15 -0500 Received: from mail-lj1-f193.google.com ([209.85.208.193]:35108 "EHLO mail-lj1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727022AbfK0ODP (ORCPT ); Wed, 27 Nov 2019 09:03:15 -0500 Received: by mail-lj1-f193.google.com with SMTP id j6so15606111lja.2 for ; Wed, 27 Nov 2019 06:03:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=b09CHPqAEDHhUHD6KdocCn09JKBIicdWIl4Svp8R/WI=; b=s50DR9gauLCC7lAVDm9RHKNFw25MQiCkJaJ7u1KplsVe/sVUbeGod3TDS4o4OQ2FTm G3K3HRqR4N5STfYmqWxP6g16u32oAd9BaXpXuLHIkNh9ba3auSh5wY0tgNUaPR7U2p7z mTu/m70QBiTmFfV+/ORRSmcitBoxOhlGwJo3D7olh/bFbOt+Ym3V4zFjjX36XFKbMv8p eQq500/Dkky+UW/ikFRlAa3MVJT70CZdAQyeA81ofS5XKZLoO/SYMGEFzkoi8z+Pz9Jt EeUWJySvwnR3oscn59fA5RHlCu8cB13NIJh0jZtRA5UXZqIk1rQoLtZWlXaPQm394+A8 pXPg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=b09CHPqAEDHhUHD6KdocCn09JKBIicdWIl4Svp8R/WI=; b=U7RjJcAR3jfIl+W3Q++wxURCPOrbwol7qhBrVwhrkj5FGtzViwpRY05vEPHr1FS3Ja jI4duGmBsgkFvI2uKgI7W0rbbmcydOXxCQPUH1TaQJF+zth8No3cku7WuxtGSYU5/aou wn2G+WypTaYFzeC+aNpdc288zwUhQLU20svNj8waKLv4UQtsSxKouRxDnuzJiq4cwtIJ ujmM5Cc/fjeWx/k4hPB8sCb/wwOE9En/CrnhGHcVv8MrQ8IDnQb+T4sNXs0KE3xAo7U1 yVebX5WFhJ+RBpljNKrRUOfFdBEXDuegWcH9XmWuLbJUJ2GSh4HjgvDQ/TjFn3itvoEu dIKw== X-Gm-Message-State: APjAAAVMo27zhRRQK6vWjhOL5Z8OrLDDkGKulJizb6YuVziiAigYewxM h0jtq25naUxFwV1PFcjdA9Fsq4mtybo= X-Google-Smtp-Source: APXvYqyoQNPk4R7bwtG78UfB2l7mvyaij+Sjjj57fcw+rJXBFs4+hfY4BIfT7YOXVDWlAAeZgqrCJA== X-Received: by 2002:a2e:2c19:: with SMTP id s25mr30972969ljs.26.1574863389657; Wed, 27 Nov 2019 06:03:09 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:09 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 17/19] trace-cmd: Basic infrastructure for host - guest timestamp synchronization Date: Wed, 27 Nov 2019 16:02:45 +0200 Message-Id: <20191127140247.258766-18-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org The infrastructure for host - guest timestamp synchronization is divided in two parts: - logic in libtracecmd - logic in trace-cmd application The libtracecmd is extended with new trace message, MSG_TIME_SYNC, used to exchange time synch information between host and guest. The trace request and response messages are extended to handle the time synch negotiation. The logic is implemented in trace-timesync.c file: - Register / unregister time sync protocols. - Choosing what protocol will be used for a tracing session. - Init common context, used by all protocols - a ftrace instance, vsockets. - Invoke protocol routines to perform time synchronization. - Store calculated offsets in an array. The trace-cmd application is extended to perform timestamp synchronization. The main logic is in trace-tsync.c file - Negotiate what time synch algorithm will be used for the tracing session. - Run pthreads, to do continuous timestamp synchronization, during the trace. - Store calculated offsets in guest's trace.dat file, using TRACECMD_OPTION_TIME_SHIFT option - A new trace-cmd option is added, to control the timestamp synchronization: --tsync-interval: set the time sync loop interval, in ms. The default value is 0 - timestamp synchronization is performed twice, before and after the trace. If a negative number is specified, the timestamp synchronization is disabled. Signed-off-by: Tzvetomir Stoyanov (VMware) --- Documentation/trace-cmd-record.1.txt | 6 + include/trace-cmd/trace-cmd.h | 54 ++- lib/trace-cmd/Makefile | 1 + lib/trace-cmd/include/trace-tsync-local.h | 36 ++ lib/trace-cmd/trace-msg.c | 149 ++++++- lib/trace-cmd/trace-timesync.c | 461 ++++++++++++++++++++++ tracecmd/Makefile | 3 +- tracecmd/include/trace-local.h | 11 + tracecmd/trace-agent.c | 34 +- tracecmd/trace-record.c | 37 +- tracecmd/trace-tsync.c | 265 +++++++++++++ tracecmd/trace-usage.c | 4 + 12 files changed, 1034 insertions(+), 27 deletions(-) create mode 100644 lib/trace-cmd/include/trace-tsync-local.h create mode 100644 lib/trace-cmd/trace-timesync.c create mode 100644 tracecmd/trace-tsync.c diff --git a/Documentation/trace-cmd-record.1.txt b/Documentation/trace-cmd-record.1.txt index 0d75e43..fc76cd5 100644 --- a/Documentation/trace-cmd-record.1.txt +++ b/Documentation/trace-cmd-record.1.txt @@ -338,6 +338,12 @@ OPTIONS the offset will also be in nanoseconds even if the displayed units are in microseconds. +*--tsync-interval*:: + Set the loop interval, in ms, for timestamps synchronization with guests: + If a negative number is specified, timestamps synchronization is disabled + If 0 is specified, no loop is performed - timestamps offset is calculated only twice," + at the beginnig and at the end of the trace\n" + *--stderr*:: Have output go to stderr instead of stdout, but the output of the command executed will not be changed. This is useful if you want to monitor the diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 17badf2..6abcc9f 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -6,6 +6,7 @@ #ifndef _TRACE_CMD_H #define _TRACE_CMD_H +#include #include "traceevent/event-parse.h" #define ARRAY_SIZE(_a) (sizeof(_a) / sizeof((_a)[0])) @@ -361,19 +362,35 @@ void tracecmd_msg_set_done(struct tracecmd_msg_handle *msg_handle); int tracecmd_msg_send_trace_req(struct tracecmd_msg_handle *msg_handle, int argc, char **argv, bool use_fifos, - unsigned long long trace_id); + unsigned long long trace_id, + unsigned int tsync_protos); int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, int *argc, char ***argv, bool *use_fifos, - unsigned long long *trace_id); + unsigned long long *trace_id, + unsigned int *tsync_protos); int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int nr_cpus, int page_size, unsigned int *ports, bool use_fifos, - unsigned long long trace_id); + unsigned long long trace_id, + unsigned int tsync_proto, + unsigned int tsync_port); int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, int *nr_cpus, int *page_size, unsigned int **ports, bool *use_fifos, - unsigned long long *trace_id); + unsigned long long *trace_id, + unsigned int *tsync_proto, + unsigned int *tsync_port); + +int tracecmd_msg_send_time_sync(struct tracecmd_msg_handle *msg_handle, + unsigned int sync_protocol, + unsigned int sync_msg_id, + unsigned int payload_size, char *payload); +int tracecmd_msg_recv_time_sync(struct tracecmd_msg_handle *msg_handle, + unsigned int *sync_protocol, + unsigned int *sync_msg_id, + unsigned int *payload_size, char **payload); + /* --- ftrace instances --- */ struct tracecmd_instance { @@ -406,6 +423,35 @@ int tracecmd_iterate_raw_events(struct tep_handle *tep, void *callback_context); +/* --- Timestamp synchronization --- */ + +enum{ + TRACECMD_TIME_SYNC_PROTO_NONE = 0, +}; +enum{ + TRACECMD_TIME_SYNC_CMD_PROBE = 1, + TRACECMD_TIME_SYNC_CMD_STOP = 2, +}; + +#define TRACECMD_TIME_SYNC_PROTO_PTP_WEIGHT 10 + +struct tracecmd_time_sync { + unsigned int sync_proto; + int loop_interval; + sem_t sem; + char *clock_str; + struct tracecmd_msg_handle *msg_handle; + void *context; +}; + +unsigned int tracecmd_tsync_proto_getall(void); +unsigned int tracecmd_tsync_proto_select(unsigned int protos); +void tracecmd_tsync_with_host(struct tracecmd_time_sync *tsync); +void tracecmd_tsync_with_guest(struct tracecmd_time_sync *tsync); +int tracecmd_tsync_get_offsets(struct tracecmd_time_sync *tsync, + int *count, + long long **ts, long long **offsets); +void tracecmd_tsync_free(struct tracecmd_time_sync *tsync); /* --- Plugin handling --- */ extern struct tep_plugin_option trace_ftrace_options[]; diff --git a/lib/trace-cmd/Makefile b/lib/trace-cmd/Makefile index 18c7013..6221b36 100644 --- a/lib/trace-cmd/Makefile +++ b/lib/trace-cmd/Makefile @@ -16,6 +16,7 @@ OBJS += trace-util.o OBJS += trace-instance.o OBJS += trace-filter-hash.o OBJS += trace-msg.o +OBJS += trace-timesync.o # Additional util objects OBJS += trace-blk-hack.o diff --git a/lib/trace-cmd/include/trace-tsync-local.h b/lib/trace-cmd/include/trace-tsync-local.h new file mode 100644 index 0000000..72a6556 --- /dev/null +++ b/lib/trace-cmd/include/trace-tsync-local.h @@ -0,0 +1,36 @@ +/* SPDX-License-Identifier: LGPL-2.1 */ +/* + * Copyright (C) 2019, VMware, Tzvetomir Stoyanov + * + */ +#ifndef _TRACE_TSYNC_LOCAL_H +#define _TRACE_TSYNC_LOCAL_H + +#include + +struct clock_sync_context { + void *proto_data; + bool server; + struct tracecmd_instance *vinst; + + int sync_size; + int sync_count; + long long *sync_ts; + long long *sync_offsets; + + unsigned int local_cid; + unsigned int local_port; + unsigned int remote_cid; + unsigned int remote_port; +}; + +int tracecmd_tsync_proto_register(unsigned int proto_id, int weight, + int (*init)(struct tracecmd_time_sync *), + int (*free)(struct tracecmd_time_sync *), + int (*calc)(struct tracecmd_time_sync *, + long long *, long long *)); +int tracecmd_tsync_proto_unregister(unsigned int proto_id); + +int ptp_clock_sync_register(void); + +#endif /* _TRACE_TSYNC_LOCAL_H */ diff --git a/lib/trace-cmd/trace-msg.c b/lib/trace-cmd/trace-msg.c index a34297f..8944013 100644 --- a/lib/trace-cmd/trace-msg.c +++ b/lib/trace-cmd/trace-msg.c @@ -26,8 +26,12 @@ #include "trace-local.h" #include "trace-msg.h" +typedef __u16 u16; +typedef __s16 s16; typedef __u32 u32; typedef __be32 be32; +typedef __u64 u64; +typedef __s64 s64; static inline void dprint(const char *fmt, ...) { @@ -64,6 +68,7 @@ struct tracecmd_msg_trace_req { be32 flags; be32 argc; u64 trace_id; + be32 tsync_protos; } __attribute__((packed)); struct tracecmd_msg_trace_resp { @@ -71,6 +76,13 @@ struct tracecmd_msg_trace_resp { be32 cpus; be32 page_size; u64 trace_id; + be32 tsync_proto; + be32 tsync_port; +} __attribute__((packed)); + +struct tracecmd_msg_tsync { + be32 sync_protocol; + be32 sync_msg_id; } __attribute__((packed)); struct tracecmd_msg_header { @@ -88,7 +100,8 @@ struct tracecmd_msg_header { C(NOT_SUPP, 5, 0), \ C(TRACE_REQ, 6, sizeof(struct tracecmd_msg_trace_req)), \ C(TRACE_RESP, 7, sizeof(struct tracecmd_msg_trace_resp)),\ - C(CLOSE_RESP, 8, 0), + C(CLOSE_RESP, 8, 0), \ + C(TIME_SYNC, 9, sizeof(struct tracecmd_msg_tsync)), #undef C #define C(a,b,c) MSG_##a = b @@ -122,6 +135,7 @@ struct tracecmd_msg { struct tracecmd_msg_rinit rinit; struct tracecmd_msg_trace_req trace_req; struct tracecmd_msg_trace_resp trace_resp; + struct tracecmd_msg_tsync tsync; }; char *buf; } __attribute__((packed)); @@ -264,6 +278,17 @@ static int tracecmd_msg_send(int fd, struct tracecmd_msg *msg) return ret; } +static int tracecmd_msg_send_nofree(int fd, struct tracecmd_msg *msg) +{ + int ret = 0; + + ret = msg_write(fd, msg); + if (ret < 0) + ret = -ECOMM; + + return ret; +} + static int msg_read(int fd, void *buf, u32 size, int *n) { ssize_t r; @@ -814,7 +839,8 @@ int tracecmd_msg_wait_close_resp(struct tracecmd_msg_handle *msg_handle) } static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, - bool use_fifos, unsigned long long trace_id) + bool use_fifos, unsigned long long trace_id, + unsigned int tsync_protos) { size_t args_size = 0; char *p; @@ -824,7 +850,11 @@ static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, args_size += strlen(argv[i]) + 1; msg->hdr.size = htonl(ntohl(msg->hdr.size) + args_size); - msg->trace_req.flags = use_fifos ? htonl(MSG_TRACE_USE_FIFOS) : htonl(0); + msg->trace_req.flags = 0; + if (use_fifos) + msg->trace_req.flags |= MSG_TRACE_USE_FIFOS; + msg->trace_req.flags = htonl(msg->trace_req.flags); + msg->trace_req.tsync_protos = htonl(tsync_protos); msg->trace_req.argc = htonl(argc); msg->trace_req.trace_id = htonll(trace_id); msg->buf = calloc(args_size, 1); @@ -840,28 +870,30 @@ static int make_trace_req(struct tracecmd_msg *msg, int argc, char **argv, int tracecmd_msg_send_trace_req(struct tracecmd_msg_handle *msg_handle, int argc, char **argv, bool use_fifos, - unsigned long long trace_id) + unsigned long long trace_id, + unsigned int tsync_protos) { struct tracecmd_msg msg; int ret; tracecmd_msg_init(MSG_TRACE_REQ, &msg); ret = make_trace_req(&msg, argc, argv, - use_fifos, trace_id); + use_fifos, trace_id, tsync_protos); if (ret < 0) return ret; return tracecmd_msg_send(msg_handle->fd, &msg); } - /* - * NOTE: On success, the returned `argv` should be freed with: - * free(argv[0]); - * free(argv); - */ +/* + * NOTE: On success, the returned `argv` should be freed with: + * free(argv[0]); + * free(argv); + */ int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, int *argc, char ***argv, bool *use_fifos, - unsigned long long *trace_id) + unsigned long long *trace_id, + unsigned int *tsync_protos) { struct tracecmd_msg msg; char *p, *buf_end, **args; @@ -908,6 +940,7 @@ int tracecmd_msg_recv_trace_req(struct tracecmd_msg_handle *msg_handle, *argc = nr_args; *argv = args; *use_fifos = ntohl(msg.trace_req.flags) & MSG_TRACE_USE_FIFOS; + *tsync_protos = ntohl(msg.trace_req.tsync_protos); *trace_id = ntohll(msg.trace_req.trace_id); /* @@ -928,9 +961,81 @@ out: return ret; } +int tracecmd_msg_send_time_sync(struct tracecmd_msg_handle *msg_handle, + unsigned int sync_protocol, + unsigned int sync_msg_id, + unsigned int payload_size, char *payload) +{ + struct tracecmd_msg msg; + + tracecmd_msg_init(MSG_TIME_SYNC, &msg); + msg.tsync.sync_protocol = htonl(sync_protocol); + msg.tsync.sync_msg_id = htonl(sync_msg_id); + msg.hdr.size = htonl(ntohl(msg.hdr.size) + payload_size); + + msg.buf = payload; + return tracecmd_msg_send_nofree(msg_handle->fd, &msg); +} + +int tracecmd_msg_recv_time_sync(struct tracecmd_msg_handle *msg_handle, + unsigned int *sync_protocol, + unsigned int *sync_msg_id, + unsigned int *payload_size, char **payload) +{ + struct tracecmd_msg msg; + int ret = -1; + int buf_size; + + memset(&msg, 0, sizeof(msg)); + ret = tracecmd_msg_recv(msg_handle->fd, &msg); + if (ret < 0) + goto out; + + if (ntohl(msg.hdr.cmd) != MSG_TIME_SYNC) { + ret = -EOPNOTSUPP; + goto out; + } + + if (sync_protocol) + *sync_protocol = ntohl(msg.tsync.sync_protocol); + if (sync_msg_id) + *sync_msg_id = ntohl(msg.tsync.sync_msg_id); + + buf_size = msg_buf_len(&msg); + if (buf_size < 0) { + ret = -EINVAL; + goto out; + } + + if (buf_size && payload && payload_size) { + if (*payload_size) { + if (*payload_size != buf_size || *payload == NULL) { + ret = -ENOMEM; + goto out; + } + memcpy(*payload, msg.buf, buf_size); + goto out; + } + + *payload = malloc(buf_size); + if (*payload == NULL) { + ret = -ENOMEM; + goto out; + } + *payload_size = buf_size; + memcpy(*payload, msg.buf, buf_size); + } + +out: + msg_free(&msg); + return ret; +} + static int make_trace_resp(struct tracecmd_msg *msg, int page_size, int nr_cpus, unsigned int *ports, bool use_fifos, - unsigned long long trace_id) + unsigned long long trace_id, + unsigned int tsync_proto, + unsigned int tsync_port) { int data_size; @@ -941,7 +1046,13 @@ static int make_trace_resp(struct tracecmd_msg *msg, int page_size, int nr_cpus, write_uints(msg->buf, data_size, ports, nr_cpus); msg->hdr.size = htonl(ntohl(msg->hdr.size) + data_size); - msg->trace_resp.flags = use_fifos ? htonl(MSG_TRACE_USE_FIFOS) : htonl(0); + msg->trace_resp.flags = 0; + if (use_fifos) + msg->trace_resp.flags |= MSG_TRACE_USE_FIFOS; + msg->trace_resp.flags = htonl(msg->trace_resp.flags); + msg->trace_resp.tsync_proto = htonl(tsync_proto); + msg->trace_resp.tsync_port = htonl(tsync_port); + msg->trace_resp.cpus = htonl(nr_cpus); msg->trace_resp.page_size = htonl(page_size); msg->trace_resp.trace_id = htonll(trace_id); @@ -952,14 +1063,16 @@ static int make_trace_resp(struct tracecmd_msg *msg, int page_size, int nr_cpus, int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int nr_cpus, int page_size, unsigned int *ports, bool use_fifos, - unsigned long long trace_id) + unsigned long long trace_id, + unsigned int tsync_proto, + unsigned int tsync_port) { struct tracecmd_msg msg; int ret; tracecmd_msg_init(MSG_TRACE_RESP, &msg); ret = make_trace_resp(&msg, page_size, nr_cpus, ports, - use_fifos, trace_id); + use_fifos, trace_id, tsync_proto, tsync_port); if (ret < 0) return ret; @@ -969,7 +1082,9 @@ int tracecmd_msg_send_trace_resp(struct tracecmd_msg_handle *msg_handle, int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, int *nr_cpus, int *page_size, unsigned int **ports, bool *use_fifos, - unsigned long long *trace_id) + unsigned long long *trace_id, + unsigned int *tsync_proto, + unsigned int *tsync_port) { struct tracecmd_msg msg; char *p, *buf_end; @@ -996,6 +1111,8 @@ int tracecmd_msg_recv_trace_resp(struct tracecmd_msg_handle *msg_handle, *nr_cpus = ntohl(msg.trace_resp.cpus); *page_size = ntohl(msg.trace_resp.page_size); *trace_id = ntohll(msg.trace_resp.trace_id); + *tsync_proto = ntohl(msg.trace_resp.tsync_proto); + *tsync_port = ntohl(msg.trace_resp.tsync_port); *ports = calloc(*nr_cpus, sizeof(**ports)); if (!*ports) { ret = -ENOMEM; diff --git a/lib/trace-cmd/trace-timesync.c b/lib/trace-cmd/trace-timesync.c new file mode 100644 index 0000000..ad163c5 --- /dev/null +++ b/lib/trace-cmd/trace-timesync.c @@ -0,0 +1,461 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * Copyright (C) 2019, VMware, Tzvetomir Stoyanov + * + */ + +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include "trace-cmd.h" +#include "trace-cmd-local.h" +#include "trace-tsync-local.h" + +struct tsync_proto { + struct tsync_proto *next; + unsigned int proto_id; + int weight; + + int (*clock_sync_init)(struct tracecmd_time_sync *clock_context); + int (*clock_sync_free)(struct tracecmd_time_sync *clock_context); + int (*clock_sync_calc)(struct tracecmd_time_sync *clock_context, + long long *offset, long long *timestamp); +} static * tsync_proto_list; + +static struct tsync_proto *tsync_proto_get(unsigned int proto_id) +{ + struct tsync_proto *proto = tsync_proto_list; + + while (proto) { + if (proto->proto_id == proto_id) + return proto; + proto = proto->next; + } + return NULL; +} + +int tracecmd_tsync_proto_register(unsigned int proto_id, int weight, + int (*init)(struct tracecmd_time_sync *), + int (*free)(struct tracecmd_time_sync *), + int (*calc)(struct tracecmd_time_sync *, + long long *, long long *)) +{ + struct tsync_proto *proto; + + if (tsync_proto_get(proto_id)) + return -1; + proto = calloc(1, sizeof(struct tsync_proto)); + if (!proto) + return -1; + proto->proto_id = proto_id; + proto->weight = weight; + proto->clock_sync_init = init; + proto->clock_sync_free = free; + proto->clock_sync_calc = calc; + + proto->next = tsync_proto_list; + tsync_proto_list = proto; + return 0; +} + +int tracecmd_tsync_proto_unregister(unsigned int proto_id) +{ + struct tsync_proto *proto = tsync_proto_list; + struct tsync_proto *pdel; + + if (tsync_proto_list && tsync_proto_list->proto_id == proto_id) { + pdel = tsync_proto_list; + tsync_proto_list = pdel->next; + free(pdel); + return 0; + } + + while (proto->next) { + if (proto->next->proto_id == proto_id) { + pdel = proto->next; + proto->next = pdel->next; + free(pdel); + return 0; + } + proto = proto->next; + } + + return -1; +} + +/** + * tracecmd_tsync_get_offsets - Return the calculated time offsests + * + * @tsync: Pointer to time sync context. + * @count: Returns the number of calculated time offsets. + * @ts: Array of size @count containing timestamps of callculated offsets + * @offsets: array of size @count, containing offsets for each timestamp. + * + * Retuns -1 in case of an error, or 0 otherwise + */ +int tracecmd_tsync_get_offsets(struct tracecmd_time_sync *tsync, + int *count, + long long **ts, long long **offsets) +{ + struct clock_sync_context *tsync_context; + + if (!tsync || !tsync->context) + return -1; + tsync_context = (struct clock_sync_context *)tsync->context; + if (count) + *count = tsync_context->sync_count; + if (ts) + *ts = tsync_context->sync_ts; + if (offsets) + *offsets = tsync_context->sync_offsets; + return 0; +} + +/** + * tracecmd_tsync_proto_select - Select time sync protocol, to be used for + * timestamp synchronization with a peer. + * + * @protos: Bitmask of time sync protocols, supported by the peer. + * + * Retuns Id of a time sync protocol, that can be used with the peer, or 0 + * in case there is no match with supported protocols. + */ +unsigned int tracecmd_tsync_proto_select(unsigned int protos) +{ + struct tsync_proto *proto = tsync_proto_list; + struct tsync_proto *selected = NULL; + + while (proto) { + if (proto->proto_id & protos) { + if (selected) { + if (selected->weight < proto->weight) + selected = proto; + } else + selected = proto; + } + proto = proto->next; + } + + if (selected) + return selected->proto_id; + + return 0; +} + +/** + * tracecmd_tsync_proto_getall - Returns bitmask of all supported + * time sync protocols. + * + */ +unsigned int tracecmd_tsync_proto_getall(void) +{ + struct tsync_proto *proto = tsync_proto_list; + unsigned int protos = 0; + + while (proto) { + protos |= proto->proto_id; + proto = proto->next; + } + + return protos; +} + +static int get_vsocket_params(int fd, unsigned int *lcid, unsigned int *lport, + unsigned int *rcid, unsigned int *rport) +{ + struct sockaddr_vm addr; + socklen_t addr_len = sizeof(addr); + + memset(&addr, 0, sizeof(addr)); + if (getsockname(fd, (struct sockaddr *)&addr, &addr_len)) + return -1; + if (addr.svm_family != AF_VSOCK) + return -1; + *lport = addr.svm_port; + *lcid = addr.svm_cid; + + memset(&addr, 0, sizeof(addr)); + addr_len = sizeof(addr); + if (getpeername(fd, (struct sockaddr *)&addr, &addr_len)) + return -1; + if (addr.svm_family != AF_VSOCK) + return -1; + *rport = addr.svm_port; + *rcid = addr.svm_cid; + + return 0; +} + +static struct tracecmd_instance * +clock_synch_create_instance(const char *clock, unsigned int cid) +{ + struct tracecmd_instance *vinst; + char inst_name[256]; + + snprintf(inst_name, 256, "clock_synch-%d", cid); + + vinst = tracecmd_create_instance(inst_name); + if (!vinst) + return NULL; + + tracecmd_make_instance(vinst); + tracecmd_write_instance_file(vinst, "trace", "\0", NULL); + if (clock) + vinst->clock = strdup(clock); + tracecmd_set_clock(vinst, NULL); + return vinst; +} + +static void +clock_synch_delete_instance(struct tracecmd_instance *inst) +{ + if (!inst) + return; + tracecmd_remove_instance(inst); + free(inst->clock); + tracecmd_free_instance(inst); +} + +static int clock_context_init(struct tracecmd_time_sync *tsync, bool server) +{ + struct clock_sync_context *clock = NULL; + struct tsync_proto *protocol; + + if (tsync->context) + return 0; + + protocol = tsync_proto_get(tsync->sync_proto); + if (!protocol) + return -1; + + clock = calloc(1, sizeof(struct clock_sync_context)); + if (!clock) + return -1; + + clock->server = server; + if (get_vsocket_params(tsync->msg_handle->fd, &clock->local_cid, + &clock->local_port, &clock->remote_cid, + &clock->remote_port)) + goto error; + + clock->vinst = clock_synch_create_instance(tsync->clock_str, + clock->remote_cid); + if (!clock->vinst) + goto error; + + tsync->context = clock; + if (protocol->clock_sync_init && protocol->clock_sync_init(tsync) < 0) + goto error; + + return 0; +error: + tsync->context = NULL; + free(clock); + return -1; +} + +/** + * tracecmd_tsync_free - Free time sync context, allocated by + * tracecmd_tsync_with_host() or tracecmd_tsync_with_guest() APIs + * + * @tsync: Pointer to time sync context. + * + */ +void tracecmd_tsync_free(struct tracecmd_time_sync *tsync) +{ + struct clock_sync_context *tsync_context; + struct tsync_proto *proto; + + if (!tsync->context) + return; + tsync_context = (struct clock_sync_context *)tsync->context; + + proto = tsync_proto_get(tsync->sync_proto); + if (proto && proto->clock_sync_free) + proto->clock_sync_free(tsync); + + clock_synch_delete_instance(tsync_context->vinst); + tsync_context->vinst = NULL; + + free(tsync_context->sync_ts); + free(tsync_context->sync_offsets); + tsync_context->sync_ts = NULL; + tsync_context->sync_offsets = NULL; + tsync_context->sync_count = 0; + tsync_context->sync_size = 0; + sem_destroy(&tsync->sem); + free(tsync->clock_str); +} + +static int tracecmd_tsync_send(struct tracecmd_time_sync *tsync, + struct tsync_proto *proto) +{ + long long timestamp = 0; + long long offset = 0; + int ret; + + ret = proto->clock_sync_calc(tsync, &offset, ×tamp); + + return ret; +} + +/** + * tracecmd_tsync_with_host - Synchronize timestamps with host + * + * @tsync: Pointer to time sync context. + * + * This API is supposed to be called in guest context. It waits for a time + * sync request from the host and replies with a time sample, until time sync + * stop command is received. + * + */ +void tracecmd_tsync_with_host(struct tracecmd_time_sync *tsync) +{ + struct tsync_proto *proto; + unsigned int protocol; + unsigned int command; + int ret; + + proto = tsync_proto_get(tsync->sync_proto); + if (!proto || !proto->clock_sync_calc) + return; + + clock_context_init(tsync, true); + if (!tsync->context) + return; + + while (true) { + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &protocol, &command, + NULL, NULL); + + if (ret || + protocol != TRACECMD_TIME_SYNC_PROTO_NONE || + command != TRACECMD_TIME_SYNC_CMD_PROBE) + break; + ret = tracecmd_tsync_send(tsync, proto); + if (ret) + break; + } +} + +static int tracecmd_tsync_get(struct tracecmd_time_sync *tsync, + struct tsync_proto *proto, + int array_step) +{ + struct clock_sync_context *clock; + long long *sync_offsets = NULL; + long long *sync_ts = NULL; + long long timestamp = 0; + long long offset = 0; + int ret; + + ret = proto->clock_sync_calc(tsync, &offset, ×tamp); + if (ret) { + warning("Failed to synchronize timestamps with guest"); + return -1; + } + if (!offset || !timestamp) + return 0; + clock = tsync->context; + if (clock->sync_count >= clock->sync_size) { + sync_ts = realloc(clock->sync_ts, + (clock->sync_size + array_step) * sizeof(long long)); + sync_offsets = realloc(clock->sync_offsets, + (clock->sync_size + array_step) * sizeof(long long)); + if (!sync_ts || !sync_offsets) { + free(sync_ts); + free(sync_offsets); + return -1; + } + clock->sync_size += array_step; + clock->sync_ts = sync_ts; + clock->sync_offsets = sync_offsets; + } + + clock->sync_ts[clock->sync_count] = timestamp; + clock->sync_offsets[clock->sync_count] = offset; + clock->sync_count++; + + return 0; +} + +#define TIMER_SEC_NANO 1000000000LL +static inline void get_ts_loop_delay(struct timespec *timeout, int delay_ms) +{ + memset(timeout, 0, sizeof(struct timespec)); + clock_gettime(CLOCK_REALTIME, timeout); + + timeout->tv_nsec += ((unsigned long long)delay_ms * 1000000LL); + + if (timeout->tv_nsec >= TIMER_SEC_NANO) { + timeout->tv_sec += timeout->tv_nsec / TIMER_SEC_NANO; + timeout->tv_nsec %= TIMER_SEC_NANO; + } +} + +#define CLOCK_TS_ARRAY 5 +/** + * tracecmd_tsync_with_guest - Synchronize timestamps with guest + * + * @tsync: Pointer to time sync context. + * + * This API is supposed to be called in host context, in a separate thread. + * It loops infinite, until the timesync semaphore is released. + * + */ +void tracecmd_tsync_with_guest(struct tracecmd_time_sync *tsync) +{ + int ts_array_size = CLOCK_TS_ARRAY; + struct tsync_proto *proto; + struct timespec timeout; + bool end = false; + int ret; + + proto = tsync_proto_get(tsync->sync_proto); + if (!proto || !proto->clock_sync_calc) + return; + + clock_context_init(tsync, false); + if (!tsync->context) + return; + + if (tsync->loop_interval > 0 && + tsync->loop_interval < (CLOCK_TS_ARRAY * 1000)) + ts_array_size = (CLOCK_TS_ARRAY * 1000) / tsync->loop_interval; + + while (true) { + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_NONE, + TRACECMD_TIME_SYNC_CMD_PROBE, + 0, NULL); + ret = tracecmd_tsync_get(tsync, proto, ts_array_size); + if (ret || end) + break; + if (tsync->loop_interval > 0) { + get_ts_loop_delay(&timeout, tsync->loop_interval); + ret = sem_timedwait(&tsync->sem, &timeout); + if (ret < 0) { + if (errno != ETIMEDOUT && errno != EINTR) + break; + } else if (!ret) + end = true; + } else { + sem_wait(&tsync->sem); + end = true; + } + }; + + tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_NONE, + TRACECMD_TIME_SYNC_CMD_STOP, + 0, NULL); +} diff --git a/tracecmd/Makefile b/tracecmd/Makefile index 29a623b..908dab2 100644 --- a/tracecmd/Makefile +++ b/tracecmd/Makefile @@ -30,6 +30,7 @@ TRACE_CMD_OBJS += trace-check-events.o TRACE_CMD_OBJS += trace-show.o TRACE_CMD_OBJS += trace-list.o TRACE_CMD_OBJS += trace-usage.o +TRACE_CMD_OBJS += trace-tsync.o ifeq ($(VSOCK_DEFINED), 1) TRACE_CMD_OBJS += trace-agent.o @@ -42,7 +43,7 @@ all_objs := $(sort $(ALL_OBJS)) all_deps := $(all_objs:$(bdir)/%.o=$(bdir)/.%.d) CONFIG_INCLUDES = -CONFIG_LIBS = -lrt +CONFIG_LIBS = -lrt -lpthread CONFIG_FLAGS = all: $(TARGETS) diff --git a/tracecmd/include/trace-local.h b/tracecmd/include/trace-local.h index 17ef31a..d652317 100644 --- a/tracecmd/include/trace-local.h +++ b/tracecmd/include/trace-local.h @@ -226,6 +226,10 @@ struct buffer_instance { unsigned int port; int *fds; bool use_fifos; + + pthread_t tsync_thread; + bool tsync_thread_running; + struct tracecmd_time_sync tsync; }; void init_top_instance(void); @@ -260,6 +264,13 @@ void tracecmd_disable_tracing(void); void tracecmd_enable_tracing(void); void tracecmd_stat_cpu(struct trace_seq *s, int cpu); +int tracecmd_host_tsync(struct buffer_instance *instance, + unsigned int tsync_port); +void tracecmd_host_tsync_complete(struct buffer_instance *instance); +unsigned int tracecmd_guest_tsync(unsigned int tsync_protos, char *clock, + unsigned int *tsync_port, + pthread_t *thr_id); + int make_vsock(unsigned int port); int get_vsock_port(int sd, unsigned int *port); int open_vsock(unsigned int cid, unsigned int port); diff --git a/tracecmd/trace-agent.c b/tracecmd/trace-agent.c index 530f972..1581de8 100644 --- a/tracecmd/trace-agent.c +++ b/tracecmd/trace-agent.c @@ -19,6 +19,7 @@ #include #include #include +#include #include "trace-local.h" #include "trace-msg.h" @@ -125,11 +126,28 @@ cleanup: return ret; } +static char *get_clock(int argc, char **argv) +{ + int i; + + if (!argc || !argv) + return NULL; + + for (i = 0; i < argc - 1; i++) { + if (!strcmp("-C", argv[i])) + return argv[i+1]; + } + return NULL; +} + static void agent_handle(int sd, int nr_cpus, int page_size) { struct tracecmd_msg_handle *msg_handle; unsigned long long trace_id; + unsigned int tsync_protos = 0; + unsigned int tsync_port = 0; unsigned int *ports; + pthread_t sync_thr; char **argv = NULL; int argc = 0; bool use_fifos; @@ -146,7 +164,8 @@ static void agent_handle(int sd, int nr_cpus, int page_size) die("Failed to allocate message handle"); ret = tracecmd_msg_recv_trace_req(msg_handle, &argc, &argv, - &use_fifos, &trace_id); + &use_fifos, &trace_id, + &tsync_protos); if (ret < 0) die("Failed to receive trace request"); @@ -155,14 +174,25 @@ static void agent_handle(int sd, int nr_cpus, int page_size) if (!use_fifos) make_vsocks(nr_cpus, fds, ports); + if (tsync_protos) { + tsync_protos = tracecmd_guest_tsync(tsync_protos, + get_clock(argc, argv), + &tsync_port, &sync_thr); + if (!tsync_protos) + warning("Failed to negotiate timestamps synchronization with the host"); + } trace_id = tracecmd_generate_traceid(); ret = tracecmd_msg_send_trace_resp(msg_handle, nr_cpus, page_size, - ports, use_fifos, trace_id); + ports, use_fifos, trace_id, + tsync_protos, tsync_port); if (ret < 0) die("Failed to send trace response"); trace_record_agent(msg_handle, nr_cpus, fds, argc, argv, use_fifos, trace_id); + if (tsync_protos) + pthread_join(sync_thr, NULL); + free(argv[0]); free(argv); free(ports); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 288dbcc..50f24b4 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -670,6 +670,11 @@ static void tell_guests_to_stop(void) tracecmd_msg_send_close_msg(instance->msg_handle); } + for_all_instances(instance) { + if (is_guest(instance)) + tracecmd_host_tsync_complete(instance); + } + /* Wait for guests to acknowledge */ for_all_instances(instance) { if (is_guest(instance)) { @@ -3501,6 +3506,8 @@ static void connect_to_agent(struct buffer_instance *instance) { struct tracecmd_msg_handle *msg_handle; int sd, ret, nr_fifos, nr_cpus, page_size; + unsigned int tsync_protos_reply = 0; + unsigned int tsync_port = 0; unsigned int *ports; int i, *fds = NULL; bool use_fifos = false; @@ -3519,19 +3526,32 @@ static void connect_to_agent(struct buffer_instance *instance) if (!msg_handle) die("Failed to allocate message handle"); + if (instance->tsync.loop_interval >= 0) + instance->tsync.sync_proto = tracecmd_tsync_proto_getall(); + ret = tracecmd_msg_send_trace_req(msg_handle, instance->argc, instance->argv, use_fifos, - top_instance.trace_id); + top_instance.trace_id, + instance->tsync.sync_proto); if (ret < 0) die("Failed to send trace request"); ret = tracecmd_msg_recv_trace_resp(msg_handle, &nr_cpus, &page_size, &ports, &use_fifos, - &instance->trace_id); + &instance->trace_id, + &tsync_protos_reply, &tsync_port); if (ret < 0) - die("Failed to receive trace response"); + die("Failed to receive trace response %d", ret); + + if (instance->tsync.sync_proto) { + if (instance->tsync.sync_proto & tsync_protos_reply) { + instance->tsync.sync_proto = tsync_protos_reply; + tracecmd_host_tsync(instance, tsync_port); + } else + warning("Failed to negotiate timestamps synchronization with the guest"); + } if (use_fifos) { if (nr_cpus != nr_fifos) { @@ -3578,7 +3598,9 @@ static void setup_guest(struct buffer_instance *instance) close(fd); } -static void setup_agent(struct buffer_instance *instance, struct common_record_context *ctx) +static void setup_agent(struct buffer_instance *instance, + struct common_record_context *ctx) + { struct tracecmd_output *network_handle; @@ -5132,6 +5154,7 @@ void init_top_instance(void) } enum { + OPT_tsyncinterval = 242, OPT_user = 243, OPT_procmap = 244, OPT_quiet = 245, @@ -5434,6 +5457,7 @@ static void parse_record_options(int argc, {"proc-map", no_argument, NULL, OPT_procmap}, {"user", required_argument, NULL, OPT_user}, {"module", required_argument, NULL, OPT_module}, + {"tsync-interval", required_argument, NULL, OPT_tsyncinterval}, {NULL, 0, NULL, 0} }; @@ -5772,6 +5796,10 @@ static void parse_record_options(int argc, ctx->instance->filter_mod = optarg; ctx->filtered = 0; break; + case OPT_tsyncinterval: + top_instance.tsync.loop_interval = atoi(optarg); + guest_config = true; + break; case OPT_quiet: case 'q': quiet = true; @@ -5800,6 +5828,7 @@ static void parse_record_options(int argc, add_argv(instance, "-C", true); } } + instance->tsync.loop_interval = top_instance.tsync.loop_interval; } } diff --git a/tracecmd/trace-tsync.c b/tracecmd/trace-tsync.c new file mode 100644 index 0000000..dbcf9f1 --- /dev/null +++ b/tracecmd/trace-tsync.c @@ -0,0 +1,265 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * Copyright (C) 2019, VMware, Tzvetomir Stoyanov + * + */ +#include +#include +#include +#include +#include +#include +#include + +#include "trace-local.h" +#include "trace-msg.h" + +static int get_first_cpu(cpu_set_t **pin_mask, size_t *m_size) +{ + int cpus = tracecmd_count_cpus(); + cpu_set_t *cpu_mask; + int mask_size; + int i; + + cpu_mask = CPU_ALLOC(cpus); + *pin_mask = CPU_ALLOC(cpus); + if (!cpu_mask || !*pin_mask || 1) + goto error; + + mask_size = CPU_ALLOC_SIZE(cpus); + CPU_ZERO_S(mask_size, cpu_mask); + CPU_ZERO_S(mask_size, *pin_mask); + + if (sched_getaffinity(0, mask_size, cpu_mask) == -1) + goto error; + + for (i = 0; i < cpus; i++) { + if (CPU_ISSET_S(i, mask_size, cpu_mask)) { + CPU_SET_S(i, mask_size, *pin_mask); + break; + } + } + + if (CPU_COUNT_S(mask_size, *pin_mask) < 1) + goto error; + + CPU_FREE(cpu_mask); + *m_size = mask_size; + return 0; + +error: + if (cpu_mask) + CPU_FREE(cpu_mask); + if (*pin_mask) + CPU_FREE(*pin_mask); + *pin_mask = NULL; + *m_size = 0; + return -1; +} + +static void *tsync_host_thread(void *data) +{ + struct tracecmd_time_sync *tsync = NULL; + + tsync = (struct tracecmd_time_sync *)data; + + tracecmd_tsync_with_guest(tsync); + + tracecmd_msg_handle_close(tsync->msg_handle); + tsync->msg_handle = NULL; + + pthread_exit(0); +} + +int tracecmd_host_tsync(struct buffer_instance *instance, + unsigned int tsync_port) +{ + struct tracecmd_msg_handle *msg_handle = NULL; + cpu_set_t *pin_mask = NULL; + pthread_attr_t attrib; + size_t mask_size = 0; + int ret; + int fd; + + if (!instance->tsync.sync_proto) + return -1; + + fd = open_vsock(instance->cid, tsync_port); + if (fd < 0) { + ret = -1; + goto out; + } + msg_handle = tracecmd_msg_handle_alloc(fd, 0); + if (!msg_handle) { + ret = -1; + goto out; + } + + instance->tsync.msg_handle = msg_handle; + if (top_instance.ftrace->clock) + instance->tsync.clock_str = strdup(top_instance.ftrace->clock); + ret = sem_init(&instance->tsync.sem, 0, 0); + if (ret) + goto out; + + pthread_attr_init(&attrib); + pthread_attr_setdetachstate(&attrib, PTHREAD_CREATE_JOINABLE); + if (!get_first_cpu(&pin_mask, &mask_size)) + pthread_attr_setaffinity_np(&attrib, mask_size, pin_mask); + + ret = pthread_create(&instance->tsync_thread, &attrib, + tsync_host_thread, &instance->tsync); + if (!ret) + instance->tsync_thread_running = true; + if (pin_mask) + CPU_FREE(pin_mask); + pthread_attr_destroy(&attrib); + +out: + if (ret) { + if (msg_handle) + tracecmd_msg_handle_close(msg_handle); + } + + return ret; +} + +static void write_guest_time_shift(struct buffer_instance *instance) +{ + struct tracecmd_output *handle; + struct iovec vector[4]; + long long *offsets; + long long *ts; + char *file; + int count; + int ret; + int fd; + + ret = tracecmd_tsync_get_offsets(&instance->tsync, &count, &ts, &offsets); + if (ret < 0 || !count || !ts || !offsets) + return; + + file = get_guest_file(TRACE_FILENAME, instance->ftrace->name); + fd = open(file, O_RDWR); + if (fd < 0) + die("error opening %s", file); + free(file); + handle = tracecmd_get_output_handle_fd(fd); + vector[0].iov_len = 8; + vector[0].iov_base = &top_instance.trace_id; + vector[1].iov_len = 4; + vector[1].iov_base = &count; + vector[2].iov_len = 8 * count; + vector[2].iov_base = ts; + vector[3].iov_len = 8 * count; + vector[3].iov_base = offsets; + tracecmd_add_option_v(handle, TRACECMD_OPTION_TIME_SHIFT, vector, 4); + tracecmd_append_options(handle); + tracecmd_output_close(handle); +#ifdef TSYNC_DEBUG + if (count > 1) + printf("Got %d timestamp synch samples for guest %s in %lld ns trace\n\r", + count, instance->ftrace->name, ts[count - 1] - ts[0]); +#endif +} + +void tracecmd_host_tsync_complete(struct buffer_instance *instance) +{ + if (!instance->tsync_thread_running) + return; + + sem_post(&instance->tsync.sem); + pthread_join(instance->tsync_thread, NULL); + write_guest_time_shift(instance); + tracecmd_tsync_free(&instance->tsync); +} + +static void *tsync_agent_thread(void *data) +{ + struct tracecmd_time_sync *tsync = NULL; + int sd; + + tsync = (struct tracecmd_time_sync *)data; + + while (true) { + sd = accept(tsync->msg_handle->fd, NULL, NULL); + if (sd < 0) { + if (errno == EINTR) + continue; + goto out; + } + break; + } + close(tsync->msg_handle->fd); + tsync->msg_handle->fd = sd; + + tracecmd_tsync_with_host(tsync); + +out: + tracecmd_msg_handle_close(tsync->msg_handle); + tracecmd_tsync_free(tsync); + free(tsync); + close(sd); + + pthread_exit(0); +} + +unsigned int tracecmd_guest_tsync(unsigned int tsync_protos, char *clock, + unsigned int *tsync_port, + pthread_t *thr_id) +{ + struct tracecmd_time_sync *tsync = NULL; + cpu_set_t *pin_mask = NULL; + pthread_attr_t attrib; + size_t mask_size = 0; + unsigned int proto; + int ret; + int fd; + + fd = -1; + proto = tracecmd_tsync_proto_select(tsync_protos); + if (!proto) + return 0; + + fd = make_vsock(VMADDR_PORT_ANY); + if (fd < 0) + goto error; + + ret = get_vsock_port(fd, tsync_port); + if (ret < 0) + goto error; + + tsync = calloc(1, sizeof(struct tracecmd_time_sync)); + tsync->msg_handle = tracecmd_msg_handle_alloc(fd, 0); + if (clock) + tsync->clock_str = strdup(clock); + + pthread_attr_init(&attrib); + tsync->sync_proto = proto; + pthread_attr_setdetachstate(&attrib, PTHREAD_CREATE_JOINABLE); + if (!get_first_cpu(&pin_mask, &mask_size)) + pthread_attr_setaffinity_np(&attrib, mask_size, pin_mask); + + ret = pthread_create(thr_id, &attrib, tsync_agent_thread, tsync); + + if (pin_mask) + CPU_FREE(pin_mask); + pthread_attr_destroy(&attrib); + + if (ret) + goto error; + + return proto; + +error: + if (tsync) { + if (tsync->msg_handle) + tracecmd_msg_handle_close(tsync->msg_handle); + if (tsync->clock_str) + free(tsync->clock_str); + free(tsync); + } + if (fd > 0) + close(fd); + return 0; +} diff --git a/tracecmd/trace-usage.c b/tracecmd/trace-usage.c index 05ec021..9fa61e1 100644 --- a/tracecmd/trace-usage.c +++ b/tracecmd/trace-usage.c @@ -60,6 +60,10 @@ static struct usage_help usage_help[] = { " --no-filter include trace-cmd threads in the trace\n" " --proc-map save the traced processes address map into the trace.dat file\n" " --user execute the specified [command ...] as given user\n" + " --tsync-interval set the loop interval, in ms, for timestamps synchronization with guests:" + " If a negative number is specified, timestamps synchronization is disabled" + " If 0 is specified, no loop is performed - timestamps offset is calculated only twice," + " at the beginnig and at the end of the trace\n" }, { "start", From patchwork Wed Nov 27 14:02:46 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264123 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 59D7113A4 for ; Wed, 27 Nov 2019 14:03:17 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 1ED0A20678 for ; Wed, 27 Nov 2019 14:03:17 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="WkWv5VaZ" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727022AbfK0ODR (ORCPT ); Wed, 27 Nov 2019 09:03:17 -0500 Received: from mail-lf1-f66.google.com ([209.85.167.66]:45919 "EHLO mail-lf1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727040AbfK0ODQ (ORCPT ); Wed, 27 Nov 2019 09:03:16 -0500 Received: by mail-lf1-f66.google.com with SMTP id 203so17228003lfa.12 for ; Wed, 27 Nov 2019 06:03:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=0+AEVUzg0rDauhLlkjJqldPszhH7MhTADeHfwROPUbQ=; b=WkWv5VaZfuNK11VUcsTbOlUOIeU+BtUz2x1yqJ70j4embpIWFttl9IdMRrjAcNXG8z UccU1aVBwvkCNMnrWQfd4nDqT9HGgn0wUUK+aO7QEx2iRnv2IOHMSgi/RdBZGn41tUoZ uABPhWMdZTM7hrrmurX1/yq5D6wQ+wuickINvkMElXSwGuvtOvp5X3X2N1a0b1Z+sS/s oYqqYh81HwFQmVxLW+nEJUHkmSqFuHTOiGsFRrBQrj3MZGfFbwWJwlTbzv8NWu5EqmE9 8v3JZ9r4iunanjA1K7v0ep+B/V+o7HCUUOU+l0JLJcRuO6l5sZ6lown88X8UnzYIc8va 0yRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=0+AEVUzg0rDauhLlkjJqldPszhH7MhTADeHfwROPUbQ=; b=nihgjxyn1PjFbILONFqbU9ah0R1D5SHWReyEkAU74ziRBWgQkU4O29LD9/y/vT9Kwt Kbn/zt6svNlgVfqIJS6EBoq+2ygh1gJkevFLcvie9/MNUO7th7iOape/YWQsRVhrWolq Lnk8XuvNtqV13q5Wyyjwxho1lC9lgnBLfPCXs4/23NpBmf5MgEzXmxhyCHTEWtWc/e4f gVHPGdCik1we1wwcrW2+qHj27qZzV5xjYTPveNLsQqqYs0EbjKbM7wgtZGXVGvgTdTpD Pji/6jUNVVrV+vSTiqancBFnCWh2fYcfoOMuqr1zljfEEQPgzOpL/N9HxINMMg3CsFf/ +pFw== X-Gm-Message-State: APjAAAXViiXStLqreHDpE1IKto+m7PQ1yZU45Qgif6leFualmErDbhKK 1MEYbdfr9UC9k9vdxyiPVQM3AkZuACI= X-Google-Smtp-Source: APXvYqwGHsxY9ZPXqKBeRntmmeBcE3SdiLekDHuieUS5x3uV//V5jedEiRnEykeZH93Z988NEqhYww== X-Received: by 2002:a19:520b:: with SMTP id m11mr28358084lfb.77.1574863390891; Wed, 27 Nov 2019 06:03:10 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:10 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 18/19] trace-cmd: [POC] PTP-like algorithm for host - guest timestamp synchronization Date: Wed, 27 Nov 2019 16:02:46 +0200 Message-Id: <20191127140247.258766-19-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org PTP protocol is designed for synchronizing clocks of machines in a local network. The same approach can be used for host - guest timestamp synchronization. This implementation uses ftrace raw markers to track trace timestamps of PTP events. The patch is a POC, two different algorithms for PTP calculations are proposed: - Choosing the sample with the fastest response time for calculating the clocks offset. - Calculating the clocks offset using the average of all PTP samples. The implementation can be tuned using those parameters: - #define FASTEST_RESPONSE - is defined, the sample with the fastest response time is used for calculating the clocks offset. Otherwise the average of all samples is used. - #define PTP_SYNC_LOOP 340 - defines the number of samples, used for one calculation. - --tsync-interval - a trace-cmd argument, choose the intervals between offset calculations, performed continuously during the trace. - #define TSYNC_DEBUG - if defined, a debug information is collected and stored in files, in the guest machine: s-cid*.txt - For each offset calculation: host and guest clocks and calculated offset. res-cid*.txt - For each tracing session: all calculated clock offsets. Signed-off-by: Tzvetomir Stoyanov (VMware) --- include/trace-cmd/trace-cmd.h | 2 + lib/trace-cmd/Makefile | 1 + lib/trace-cmd/trace-timesync-ptp.c | 668 +++++++++++++++++++++++++++++ lib/trace-cmd/trace-timesync.c | 8 + tracecmd/trace-agent.c | 2 + tracecmd/trace-record.c | 25 +- 6 files changed, 698 insertions(+), 8 deletions(-) create mode 100644 lib/trace-cmd/trace-timesync-ptp.c diff --git a/include/trace-cmd/trace-cmd.h b/include/trace-cmd/trace-cmd.h index 6abcc9f..013160a 100644 --- a/include/trace-cmd/trace-cmd.h +++ b/include/trace-cmd/trace-cmd.h @@ -427,6 +427,7 @@ int tracecmd_iterate_raw_events(struct tep_handle *tep, enum{ TRACECMD_TIME_SYNC_PROTO_NONE = 0, + TRACECMD_TIME_SYNC_PROTO_PTP = 1 << 0, }; enum{ TRACECMD_TIME_SYNC_CMD_PROBE = 1, @@ -444,6 +445,7 @@ struct tracecmd_time_sync { void *context; }; +void tracecmd_tsync_init(void); unsigned int tracecmd_tsync_proto_getall(void); unsigned int tracecmd_tsync_proto_select(unsigned int protos); void tracecmd_tsync_with_host(struct tracecmd_time_sync *tsync); diff --git a/lib/trace-cmd/Makefile b/lib/trace-cmd/Makefile index 6221b36..a2b9d08 100644 --- a/lib/trace-cmd/Makefile +++ b/lib/trace-cmd/Makefile @@ -17,6 +17,7 @@ OBJS += trace-instance.o OBJS += trace-filter-hash.o OBJS += trace-msg.o OBJS += trace-timesync.o +OBJS += trace-timesync-ptp.o # Additional util objects OBJS += trace-blk-hack.o diff --git a/lib/trace-cmd/trace-timesync-ptp.c b/lib/trace-cmd/trace-timesync-ptp.c new file mode 100644 index 0000000..500912f --- /dev/null +++ b/lib/trace-cmd/trace-timesync-ptp.c @@ -0,0 +1,668 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * Copyright (C) 2019, VMware, Tzvetomir Stoyanov tz.stoyanov@gmail.com> + * + */ + +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include "trace-cmd.h" +#include "trace-tsync-local.h" +#include "trace-msg.h" + +typedef __be32 be32; +typedef __u64 u64; +typedef __s64 s64; + +#define PTP_SYNC_LOOP 340 + +#define PTP_SYNC_PKT_START 1 +#define PTP_SYNC_PKT_PROBE 2 +#define PTP_SYNC_PKT_PROBES 3 +#define PTP_SYNC_PKT_OFFSET 4 +#define PTP_SYNC_PKT_END 5 + +#define TSYNC_DEBUG + +struct ptp_clock_sync { + struct tep_handle *tep; + int raw_id; + int marker_fd; + int series_id; + int debug_fd; + +}; + +struct ptp_clock_start_msg { + be32 series_id; +} __attribute__((packed)); + +struct ptp_clock_sample { + s64 ts; + be32 id; +} __attribute__((packed)); + +struct ptp_clock_result_msg { + be32 series_id; + be32 count; + struct ptp_clock_sample samples[2*PTP_SYNC_LOOP]; +} __attribute__((packed)); + +struct ptp_clock_offset_msg { + s64 ts; + s64 offset; +}; + +struct ptp_markers_context { + struct clock_sync_context *clock; + struct ptp_clock_sync *ptp; + int size; + struct ptp_clock_result_msg msg; +}; + +struct ptp_marker_buf { + int local_cid; + int remote_cid; + int count; + int packet_id; +} __attribute__((packed)); + +struct ptp_marker{ + int series_id; + struct ptp_marker_buf data; +} __attribute__((packed)); + +static int ptp_clock_sync_init(struct tracecmd_time_sync *tsync) +{ + const char *systems[] = { "ftrace", NULL}; + struct clock_sync_context *clock_context; + struct ptp_clock_sync *ptp; + struct tep_event *raw; + char *path; + + if (!tsync || !tsync->context) + return -1; + clock_context = (struct clock_sync_context *)tsync->context; + if (clock_context->proto_data) + return 0; + + ptp = calloc(1, sizeof(struct ptp_clock_sync)); + if (!ptp) + return -1; + + ptp->marker_fd = -1; + ptp->debug_fd = -1; + + path = tracecmd_get_instance_dir(clock_context->vinst); + if (!path) + goto error; + ptp->tep = tracecmd_local_events_system(path, systems); + tracecmd_put_tracing_file(path); + if (!ptp->tep) + goto error; + raw = tep_find_event_by_name(ptp->tep, "ftrace", "raw_data"); + if (!raw) + goto error; + + ptp->raw_id = raw->id; + tep_set_file_bigendian(ptp->tep, tracecmd_host_bigendian()); + tep_set_local_bigendian(ptp->tep, tracecmd_host_bigendian()); + + path = tracecmd_get_instance_file(clock_context->vinst, "trace_marker_raw"); + if (!path) + goto error; + ptp->marker_fd = open(path, O_WRONLY); + tracecmd_put_tracing_file(path); + + clock_context->proto_data = ptp; + +#ifdef TSYNC_DEBUG + if (clock_context->server) { + char buff[256]; + int res_fd; + + sprintf(buff, "res-cid%d.txt", clock_context->remote_cid); + + res_fd = open(buff, O_CREAT|O_WRONLY|O_TRUNC, 0644); + if (res_fd > 0) + close(res_fd); + } +#endif + + return 0; + +error: + if (ptp) { + tep_free(ptp->tep); + if (ptp->marker_fd >= 0) + close(ptp->marker_fd); + } + free(ptp); + return -1; +} + +static int ptp_clock_sync_free(struct tracecmd_time_sync *tsync) +{ + struct clock_sync_context *clock_context; + struct ptp_clock_sync *ptp; + + if (!tsync || !tsync->context) + return -1; + clock_context = (struct clock_sync_context *)tsync->context; + + if (clock_context && clock_context->proto_data) { + ptp = (struct ptp_clock_sync *)clock_context->proto_data; + tep_free(ptp->tep); + if (ptp->marker_fd >= 0) + close(ptp->marker_fd); + if (ptp->debug_fd >= 0) + close(ptp->debug_fd); + free(clock_context->proto_data); + clock_context->proto_data = NULL; + } + return 0; +} + +static int ptp_marker_find(struct tep_event *event, struct tep_record *record, + int cpu, void *context) +{ + struct ptp_markers_context *ctx; + struct tep_format_field *field; + struct tep_format_field *id; + struct ptp_marker *marker; + int index = -1; + + ctx = (struct ptp_markers_context *)context; + + /* Make sure this is our event */ + if (event->id != ctx->ptp->raw_id) + return 0; + id = tep_find_field(event, "id"); + field = tep_find_field(event, "buf"); + if (field && id && + record->size >= (id->offset + sizeof(struct ptp_marker))) { + marker = (struct ptp_marker *)(record->data + id->offset); + if (marker->data.local_cid == ctx->clock->local_cid && + marker->data.remote_cid == ctx->clock->remote_cid && + marker->series_id == ctx->ptp->series_id && + marker->data.count) { + if (marker->data.packet_id == 'r' && + marker->data.count <= ctx->size) { + index = marker->data.count - 1; + } else if (marker->data.packet_id == 's' && + marker->data.count*2 <= ctx->size){ + index = ctx->size / 2 + marker->data.count - 1; + } + } + if (index >= 0) { + ctx->msg.samples[index].id = marker->data.count; + ctx->msg.samples[index].ts = record->ts; + ctx->msg.count++; + } + } + + return 0; +} + +#define FASTEST_RESPONSE + +#ifdef FASTEST_RESPONSE +static int ptp_calc_offset(struct clock_sync_context *clock, + struct ptp_clock_result_msg *server, + struct ptp_clock_result_msg *client, + long long *offset_ret, long long *ts_ret, + int *bad_probes) +{ + struct ptp_clock_sample *sample_send; + long long delta_min = 0; + long long offset = 0; + long long delta = 0; + long long ts = 0; + int i; + + *bad_probes = 0; + sample_send = server->samples + (server->count / 2); + for (i = 0; i * 2 < server->count && i < client->count; i++) { + if (!server->samples[i].ts || + !sample_send[i].ts || + !client->samples[i].ts || + server->samples[i].id != sample_send[i].id || + server->samples[i].id != client->samples[i].id) { + (*bad_probes)++; + continue; + } + + ts = (sample_send[i].ts + server->samples[i].ts) / 2; + offset = client->samples[i].ts - ts; + + delta = server->samples[i].ts - sample_send[i].ts; + if (!delta_min || delta_min > delta) { + delta_min = delta; + *offset_ret = offset; + *ts_ret = ts; + } +#ifdef TSYNC_DEBUG + { + struct ptp_clock_sync *ptp; + + ptp = (struct ptp_clock_sync *)clock->proto_data; + if (ptp && ptp->debug_fd > 0) { + char buff[256]; + + sprintf(buff, "%lld %lld %lld\n", + ts, client->samples[i].ts, offset); + write(ptp->debug_fd, buff, strlen(buff)); + } + } +#endif + } + + return 0; +} + +#else /* average offset */ + +static int ptp_calc_offset(struct clock_sync_context *clock, + struct ptp_clock_result_msg *server, + struct ptp_clock_result_msg *client, + long long *offset_ret, long long *ts_ret, + int *bad_probes) +{ + long long timestamps[PTP_SYNC_LOOP]; + long long offsets[PTP_SYNC_LOOP]; + struct ptp_clock_sample *sample_send; + struct ptp_clock_sync *ptp; + long long offset_max = 0; + long long offset_min = 0; + long long offset_av = 0; + long long offset = 0; + long long time = 0; + long long tresch; + int i, j, k = 0; + + *bad_probes = 0; + ptp = (struct ptp_clock_sync *)clock->proto_data; + sample_send = server->samples + (server->count / 2); + for (i = 0; i * 2 < server->count && i < client->count; i++) { + if (!server->samples[i].ts || + !sample_send[i].ts || + !client->samples[i].ts || + server->samples[i].id != sample_send[i].id || + server->samples[i].id != client->samples[i].id) { + (*bad_probes)++; + continue; + } + + timestamps[k] = (sample_send[i].ts + server->samples[i].ts) / 2; + offsets[k] = client->samples[i].ts - timestamps[k]; + offset_av += offsets[k]; + if (!offset_max || offset_max < llabs(offsets[k])) + offset_max = llabs(offsets[k]); + if (!offset_min || offset_min > llabs(offsets[k])) + offset_min = llabs(offsets[k]); +#ifdef TSYNC_DEBUG + { + struct ptp_clock_sync *ptp; + + ptp = (struct ptp_clock_sync *)clock->proto_data; + + if (ptp && ptp->debug_fd > 0) { + char buff[256]; + + sprintf(buff, "%lld %lld %lld\n", + timestamps[k], + client->samples[i].ts, offsets[k]); + write(ptp->debug_fd, buff, strlen(buff)); + } + } +#endif + k++; + } + if (k) + offset_av /= (long long)k; + + offset = 0; + tresch = (long long)((offset_max - offset_min)/10); + for (i = 0, j = 0; i < k; i++) { + /* filter the offsets with deviation up to 10% */ + if (llabs(offsets[i] - offset_av) < tresch) { + offset += offsets[i]; + j++; + } else + (*bad_probes)++; + } + if (j) + offset /= (long long)j; + + tresch = 0; + for (i = 0; i < k; i++) { + if ((!tresch || tresch > llabs(offset - offsets[i]))) { + tresch = llabs(offset - offsets[i]); + time = timestamps[i]; + } + } + if (offset_ret) + *offset_ret = offset; + if (ts_ret) + *ts_ret = time; + + return 0; +} + +#endif + +static void ntoh_ptp_results(struct ptp_clock_result_msg *msg) +{ + int i; + + msg->count = ntohl(msg->count); + for (i = 0; i < msg->count; i++) { + msg->samples[i].id = ntohl(msg->samples[i].id); + msg->samples[i].ts = ntohll(msg->samples[i].ts); + } + msg->series_id = ntohl(msg->series_id); +} + + +static void hton_ptp_results(struct ptp_clock_result_msg *msg) +{ + int i; + + for (i = 0; i < msg->count; i++) { + msg->samples[i].id = htonl(msg->samples[i].id); + msg->samples[i].ts = htonll(msg->samples[i].ts); + } + msg->series_id = htonl(msg->series_id); + msg->count = htonl(msg->count); +} + +static int ptp_clock_client(struct tracecmd_time_sync *tsync, + long long *offset, long long *timestamp) +{ + struct clock_sync_context *clock_context; + struct ptp_clock_offset_msg res_offset; + unsigned int sync_proto, sync_msg; + struct ptp_clock_start_msg start; + struct ptp_markers_context ctx; + struct ptp_clock_sync *ptp; + struct ptp_marker marker; + unsigned int size; + char *msg; + int count; + int ret; + int lcount = 0; + + if (!tsync || !tsync->context || !tsync->msg_handle) + return -1; + + clock_context = (struct clock_sync_context *)tsync->context; + if (clock_context->proto_data == NULL) + return -1; + + ptp = (struct ptp_clock_sync *)clock_context->proto_data; + size = sizeof(start); + msg = (char *)&start; + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, + &size, &msg); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_START) + return -1; + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_START, sizeof(start), + (char *)&start); + marker.data.local_cid = clock_context->local_cid; + marker.data.remote_cid = clock_context->remote_cid; + marker.series_id = ntohl(start.series_id); + ptp->series_id = marker.series_id; + msg = (char *)&count; + size = sizeof(count); + while (true) { + count = 0; + lcount++; + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, &size, &msg); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_PROBE || !ntohl(count)) + break; + + marker.data.count = ntohl(count); + marker.data.packet_id = 'r'; + write(ptp->marker_fd, &marker, sizeof(marker)); + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_PROBE, + sizeof(count), (char *)&count); + if (ret) + break; + } + + if (sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_END) + return -1; + + ctx.size = PTP_SYNC_LOOP; + ctx.ptp = ptp; + ctx.clock = clock_context; + ctx.msg.count = 0; + ctx.msg.series_id = ptp->series_id; + tracecmd_iterate_raw_events(ptp->tep, clock_context->vinst, + ptp_marker_find, &ctx); + hton_ptp_results(&ctx.msg); + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_PROBES, + sizeof(ctx.msg), (char *)&ctx.msg); + + msg = (char *)&res_offset; + size = sizeof(res_offset); + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, + &size, (char **)&msg); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_OFFSET) + return -1; + + *offset = ntohll(res_offset.offset); + *timestamp = ntohll(res_offset.ts); + + return 0; +} + + +static int ptp_clock_server(struct tracecmd_time_sync *tsync, + long long *offset, long long *timestamp) +{ + struct ptp_clock_result_msg *results = NULL; + struct clock_sync_context *clock_context; + struct ptp_clock_offset_msg res_offset; + unsigned int sync_proto, sync_msg; + struct ptp_clock_start_msg start; + struct ptp_markers_context ctx; + int sync_loop = PTP_SYNC_LOOP; + struct ptp_clock_sync *ptp; + struct ptp_marker marker; + unsigned int size; + int bad_probes; + int count = 1; + int msg_count; + int msg_ret; + char *msg; + int ret; + + if (!tsync || !tsync->context || !tsync->msg_handle) + return -1; + + clock_context = (struct clock_sync_context *)tsync->context; + if (clock_context->proto_data == NULL) + return -1; + + ptp = (struct ptp_clock_sync *)clock_context->proto_data; + start.series_id = htonl(ptp->series_id + 1); + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_START, sizeof(start), + (char *)&start); + if (!ret) + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, + NULL, NULL); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_START) + return -1; + + tracecmd_write_instance_file(clock_context->vinst, "trace", "\0", NULL); + + ptp->series_id++; + marker.data.local_cid = clock_context->local_cid; + marker.data.remote_cid = clock_context->remote_cid; + marker.series_id = ptp->series_id; + msg = (char *)&msg_ret; + size = sizeof(msg_ret); + do { + marker.data.count = count++; + marker.data.packet_id = 's'; + msg_count = htonl(marker.data.count); + write(ptp->marker_fd, &marker, sizeof(marker)); + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_PROBE, + sizeof(msg_count), + (char *)&msg_count); + if (!ret) + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, + &size, &msg); + + marker.data.packet_id = 'r'; + write(ptp->marker_fd, &marker, sizeof(marker)); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_PROBE || + ntohl(msg_ret) != marker.data.count) + break; + } while (--sync_loop); + + if (sync_loop) + return -1; + + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_END, 0, NULL); + + size = 0; + ret = tracecmd_msg_recv_time_sync(tsync->msg_handle, + &sync_proto, &sync_msg, + &size, (char **)&results); + if (ret || sync_proto != TRACECMD_TIME_SYNC_PROTO_PTP || + sync_msg != PTP_SYNC_PKT_PROBES || size == 0 || results == NULL) + return -1; + + ntoh_ptp_results(results); + + ctx.size = 2*PTP_SYNC_LOOP; + ctx.ptp = ptp; + ctx.clock = clock_context; + ctx.msg.count = 0; + ctx.msg.series_id = ptp->series_id; + tracecmd_iterate_raw_events(ptp->tep, clock_context->vinst, + ptp_marker_find, &ctx); + + ptp_calc_offset(clock_context, &ctx.msg, results, offset, + timestamp, &bad_probes); + +#ifdef TSYNC_DEBUG + { + char buff[256]; + int res_fd; + + sprintf(buff, "res-cid%d.txt", clock_context->remote_cid); + + res_fd = open(buff, O_WRONLY|O_APPEND, 0644); + if (res_fd > 0) { + if (*offset && *timestamp) { + sprintf(buff, "%d %lld %lld\n", + ptp->series_id, *offset, *timestamp); + write(res_fd, buff, strlen(buff)); + } + close(res_fd); + } + + printf("\n calculated offset %d: %lld, %d probes, filtered out %d\n\r", + ptp->series_id, *offset, results->count, bad_probes); + if (ptp && ptp->debug_fd > 0) { + sprintf(buff, "%lld %lld 0\n", *offset, *timestamp); + write(ptp->debug_fd, buff, strlen(buff)); + close(ptp->debug_fd); + ptp->debug_fd = -1; + } + + } +#endif + + res_offset.offset = htonll(*offset); + res_offset.ts = htonll(*timestamp); + ret = tracecmd_msg_send_time_sync(tsync->msg_handle, + TRACECMD_TIME_SYNC_PROTO_PTP, + PTP_SYNC_PKT_OFFSET, + sizeof(res_offset), + (char *)&res_offset); + + free(results); + return 0; +} + +static int ptp_clock_sync_calc(struct tracecmd_time_sync *tsync, + long long *offset, long long *timestamp) +{ + struct clock_sync_context *clock_context; + int ret; + + if (!tsync || !tsync->context) + return -1; + clock_context = (struct clock_sync_context *)tsync->context; + +#ifdef TSYNC_DEBUG + if (clock_context->server) { + struct ptp_clock_sync *ptp; + char buff[256]; + + ptp = (struct ptp_clock_sync *)clock_context->proto_data; + if (ptp->debug_fd > 0) + close(ptp->debug_fd); + sprintf(buff, "s-cid%d_%d.txt", + clock_context->remote_cid, ptp->series_id+1); + ptp->debug_fd = open(buff, O_CREAT|O_WRONLY|O_TRUNC, 0644); + } +#endif + + + if (clock_context->server) + ret = ptp_clock_server(tsync, offset, timestamp); + else + ret = ptp_clock_client(tsync, offset, timestamp); + + return ret; +} + +int ptp_clock_sync_register(void) +{ + return tracecmd_tsync_proto_register(TRACECMD_TIME_SYNC_PROTO_PTP, + TRACECMD_TIME_SYNC_PROTO_PTP_WEIGHT, + ptp_clock_sync_init, + ptp_clock_sync_free, + ptp_clock_sync_calc); + +} + +int ptp_clock_sync_unregister(void) +{ + return tracecmd_tsync_proto_unregister(TRACECMD_TIME_SYNC_PROTO_PTP); +} diff --git a/lib/trace-cmd/trace-timesync.c b/lib/trace-cmd/trace-timesync.c index ad163c5..775f858 100644 --- a/lib/trace-cmd/trace-timesync.c +++ b/lib/trace-cmd/trace-timesync.c @@ -42,6 +42,14 @@ static struct tsync_proto *tsync_proto_get(unsigned int proto_id) return NULL; } +/** + * tracecmd_tsync_init - Initialize the global, per task, time sync data. + */ +void tracecmd_tsync_init(void) +{ + ptp_clock_sync_register(); +} + int tracecmd_tsync_proto_register(unsigned int proto_id, int weight, int (*init)(struct tracecmd_time_sync *), int (*free)(struct tracecmd_time_sync *), diff --git a/tracecmd/trace-agent.c b/tracecmd/trace-agent.c index 1581de8..46874cf 100644 --- a/tracecmd/trace-agent.c +++ b/tracecmd/trace-agent.c @@ -242,6 +242,8 @@ static void agent_serve(unsigned int port) if (sd < 0) die("Failed to open vsocket"); + tracecmd_tsync_init(); + if (!get_local_cid(&cid)) printf("listening on @%u:%u\n", cid, port); diff --git a/tracecmd/trace-record.c b/tracecmd/trace-record.c index 50f24b4..23f03c8 100644 --- a/tracecmd/trace-record.c +++ b/tracecmd/trace-record.c @@ -5945,10 +5945,7 @@ static void set_clock(struct buffer_instance *instance) tracecmd_put_tracing_file(path); } } -/* - * This function contains common code for the following commands: - * record, start, stream, profile. - */ + static void record_trace(int argc, char **argv, struct common_record_context *ctx) { @@ -6081,12 +6078,24 @@ static void record_trace(int argc, char **argv, finalize_record_trace(ctx); } +/* + * This function contains common code for the following commands: + * record, start, stream, profile. + */ +static void record_trace_command(int argc, char **argv, + struct common_record_context *ctx) +{ + tracecmd_tsync_init(); + record_trace(argc, argv, ctx); +} + + void trace_start(int argc, char **argv) { struct common_record_context ctx; parse_record_options(argc, argv, CMD_start, &ctx); - record_trace(argc, argv, &ctx); + record_trace_command(argc, argv, &ctx); exit(0); } @@ -6166,7 +6175,7 @@ void trace_stream(int argc, char **argv) struct common_record_context ctx; parse_record_options(argc, argv, CMD_stream, &ctx); - record_trace(argc, argv, &ctx); + record_trace_command(argc, argv, &ctx); exit(0); } @@ -6185,7 +6194,7 @@ void trace_profile(int argc, char **argv) if (!buffer_instances) top_instance.flags |= BUFFER_FL_PROFILE; - record_trace(argc, argv, &ctx); + record_trace_command(argc, argv, &ctx); do_trace_profile(); exit(0); } @@ -6204,7 +6213,7 @@ void trace_record(int argc, char **argv) struct common_record_context ctx; parse_record_options(argc, argv, CMD_record, &ctx); - record_trace(argc, argv, &ctx); + record_trace_command(argc, argv, &ctx); exit(0); } From patchwork Wed Nov 27 14:02:47 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "Tzvetomir Stoyanov (VMware)" X-Patchwork-Id: 11264119 Return-Path: Received: from mail.kernel.org (pdx-korg-mail-1.web.codeaurora.org [172.30.200.123]) by pdx-korg-patchwork-2.web.codeaurora.org (Postfix) with ESMTP id 67BF913A4 for ; Wed, 27 Nov 2019 14:03:15 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 3F8D1206F0 for ; Wed, 27 Nov 2019 14:03:15 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="HglfTfN3" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727080AbfK0ODP (ORCPT ); Wed, 27 Nov 2019 09:03:15 -0500 Received: from mail-lj1-f171.google.com ([209.85.208.171]:37209 "EHLO mail-lj1-f171.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727007AbfK0ODO (ORCPT ); Wed, 27 Nov 2019 09:03:14 -0500 Received: by mail-lj1-f171.google.com with SMTP id d5so24626642ljl.4 for ; Wed, 27 Nov 2019 06:03:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=gQh9/oLKZRFXepla4e/+ncwCFsvQpIPl37qcZ7uYCOk=; b=HglfTfN3fGZQkKxwN65X8BhRRUV9CM9yMbc0BSCA7caDk+ya95c1X/qmGmHVle2f/i DDXlopYixb4Yxgl7YFK3N1eAi72LniP/9TBbMxeo1dgnbmlo3GW4mM7ffh1WU8qy+vl9 mO1q9HZfwBC2HR6vu8ijHBIK95mokr57KBmJS6gR+t4IlT/AADuajl6drxg3ejHyaoLT iCddAjyAJOVhWU99EzSJvPxjnGLnFFLE0hjNUoV3NaIJQc9UEVtUk477iQtVHj+3xpy9 DFUQ5T9o5zPP8E0+NqubEaXFmLoF/SIcOxOr+lP22vWp2v66ZthGdWf49EYK6LjXMCwX Cgbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=gQh9/oLKZRFXepla4e/+ncwCFsvQpIPl37qcZ7uYCOk=; b=LQsBCI6U5blG8O/QCRJ0qo5TKLZwtb6qj33ai/jghWHqAj3FOs1MU1Ovg5GTMfYrI1 7uv4tZY+PWHHA6sGLT9HGY3i98rCrXaSDOyjOxQSGCoVf21xH6oxe6mb3RA7xd0QJ0aE Rv73j1eYE/3CSDNCUWzaF42ntQrVZRGC1n7IkkDv60rifJTLeN/2EZr646k3PRmjE8Iv tfg4RMcy18O81GbXz41AETgIOVchuvKrhu61rKV39vDR6+qANnk3IwgsTpV6e+QTODAR v2CoWt/uhY6CETkiSuMyGGRFjAx5gaoROfDDQGrAKzuuYGrRGfUdKmiJwivm2EpmAW02 yheA== X-Gm-Message-State: APjAAAXnUNvhGea12jFBCHwq+IO7MPSC7QT0LRXREB0h0pGiy/X478ji b0lCDTFfnKPD8HgzhtFjC9U= X-Google-Smtp-Source: APXvYqwPv8Q41Sgv5LK2NzLLE+u9S+nxO/ubDbCPOZ9uiYgJAXcUhii5/Vdlcf5XixrJVjEY/CBp4A== X-Received: by 2002:a05:651c:285:: with SMTP id b5mr5019043ljo.14.1574863391994; Wed, 27 Nov 2019 06:03:11 -0800 (PST) Received: from oberon.eng.vmware.com ([146.247.46.5]) by smtp.gmail.com with ESMTPSA id y18sm7268660lja.12.2019.11.27.06.03.10 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 27 Nov 2019 06:03:11 -0800 (PST) From: "Tzvetomir Stoyanov (VMware)" To: rostedt@goodmis.org Cc: linux-trace-devel@vger.kernel.org Subject: [PATCH v14 19/19] trace-cmd: Debug scripts for PTP-like algorithm for host - guest timestamp synchronization Date: Wed, 27 Nov 2019 16:02:47 +0200 Message-Id: <20191127140247.258766-20-tz.stoyanov@gmail.com> X-Mailer: git-send-email 2.23.0 In-Reply-To: <20191127140247.258766-1-tz.stoyanov@gmail.com> References: <20191127140247.258766-1-tz.stoyanov@gmail.com> MIME-Version: 1.0 Sender: linux-trace-devel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-trace-devel@vger.kernel.org These scripts can be used to visualise debug files, written when the PTP-like algorithm is compiled with TSYNC_DEBUG defined. The files are located in the guest machine: s-cid*.txt - For each offset calculation: host and guest clocks and calculated offset. res-cid*.txt - For each tracing session: all calculated clock offsets. tsync_hist.py plots a histogram, using data from a s-cid*.txt file: "python tsync_hist.py s-cid2_1.txt" tsync_res.py plots a line, using data from res-cid*.txt file: "python tsync_res.py res-cid2.txt" Signed-off-by: Tzvetomir Stoyanov (VMware) --- scripts/debug/tsync_hist.py | 57 +++++++++++++++++++++++++++++++++++++ scripts/debug/tsync_readme | 13 +++++++++ scripts/debug/tsync_res.py | 46 ++++++++++++++++++++++++++++++ 3 files changed, 116 insertions(+) create mode 100644 scripts/debug/tsync_hist.py create mode 100644 scripts/debug/tsync_readme create mode 100644 scripts/debug/tsync_res.py diff --git a/scripts/debug/tsync_hist.py b/scripts/debug/tsync_hist.py new file mode 100644 index 0000000..819d1e8 --- /dev/null +++ b/scripts/debug/tsync_hist.py @@ -0,0 +1,57 @@ +# SPDX-License-Identifier: GPL-2.0 +# +# Copyright (C) 2019, VMware Inc, Tzvetomir Stoyanov +# Copyright (C) 2019, VMware Inc, Yordan Karadzhov + + +import matplotlib.pyplot as plt +import matplotlib.lines as mlines +import numpy as np +import sys + +def newline(p1, p2): + ax = plt.gca() + xmin, xmax = ax.get_xbound() + + if(p2[0] == p1[0]): + xmin = xmax = p1[0] + ymin, ymax = ax.get_ybound() + else: + ymax = p1[1]+(p2[1]-p1[1])/(p2[0]-p1[0])*(xmax-p1[0]) + ymin = p1[1]+(p2[1]-p1[1])/(p2[0]-p1[0])*(xmin-p1[0]) + + l = mlines.Line2D([xmin,xmax], [ymin,ymax], color='red') + ax.add_line(l) + return l + + +data = np.loadtxt(fname = sys.argv[1]) +selected_ts = data[-1, 1] +selected_ofs = data[-1, 0] +data = data[:-1,:] + +x = data[:, 1] - data[:, 0] + +mean = x.mean() +std = x.std() + +num_bins = 500 +min = x.min() #+ .4 * (x.max() - x.min()) +max = x.max() #- .4 * (x.max() - x.min()) +bins = np.linspace(min, max, num_bins, endpoint = False, dtype=int) + +fig, ax = plt.subplots() + +# the histogram of the data +n, bins, patches = ax.hist(x, bins, histtype=u'step'); + +ax.set_xlabel('clock offset [$\mu$s]') +ax.set_ylabel('entries') +ax.set_title("$\sigma$=%i" % std) + +x1, y1 = [selected_ofs, min], [selected_ofs, max] +newline(x1, y1) + +# Tweak spacing to prevent clipping of ylabel +fig.tight_layout() +plt.show() diff --git a/scripts/debug/tsync_readme b/scripts/debug/tsync_readme new file mode 100644 index 0000000..7466bb3 --- /dev/null +++ b/scripts/debug/tsync_readme @@ -0,0 +1,13 @@ +PTP-like algorithm debug +======================== + +tsync_*.py scripts can be used to visualise debug files, written when the PTP-like algorithm +is compiled with TSYNC_DEBUG defined. The files are located in the guest machine: + s-cid*.txt - For each offset calculation: host and guest clocks and calculated offset. + res-cid*.txt - For each tracing session: all calculated clock offsets. + +tsync_hist.py plots a histogram, using data from a s-cid*.txt file: + "python tsync_hist.py s-cid2_1.txt" +tsync_res.py plots a line, using data from res-cid*.txt file: + "python tsync_res.py res-cid2.txt" + diff --git a/scripts/debug/tsync_res.py b/scripts/debug/tsync_res.py new file mode 100644 index 0000000..7d10986 --- /dev/null +++ b/scripts/debug/tsync_res.py @@ -0,0 +1,46 @@ +# SPDX-License-Identifier: GPL-2.0 +# +# Copyright (C) 2019, VMware Inc, Tzvetomir Stoyanov +# Copyright (C) 2019, VMware Inc, Yordan Karadzhov + + +import matplotlib.pyplot as plt +import matplotlib.lines as mlines +import numpy as np +import sys + +def newline(p1, p2): + ax = plt.gca() + xmin, xmax = ax.get_xbound() + + if(p2[0] == p1[0]): + xmin = xmax = p1[0] + ymin, ymax = ax.get_ybound() + else: + ymax = p1[1]+(p2[1]-p1[1])/(p2[0]-p1[0])*(xmax-p1[0]) + ymin = p1[1]+(p2[1]-p1[1])/(p2[0]-p1[0])*(xmin-p1[0]) + + l = mlines.Line2D([xmin,xmax], [ymin,ymax], color='red') + ax.add_line(l) + return l + +data = np.loadtxt(fname = sys.argv[1]) +x = data[:, 0] +y = data[:, 1] + +fig, ax = plt.subplots() + +ax.set_xlabel('samples (t)') +ax.set_ylabel('clock offset') +ax.set_title("$\delta$=%i ns" % (max(y) - min(y))) + +l = mlines.Line2D(x, y) +ax.add_line(l) +ax.set_xlim(min(x), max(x)) +ax.set_ylim(min(y), max(y) ) + +print(min(y), max(y), max(y) - min(y)) + +# Tweak spacing to prevent clipping of ylabel +fig.tight_layout() +plt.show()