Greeting, FYI, we noticed a 9.7% improvement of netperf.Throughput_total_tps due to commit: commit: a583ed310bb6b514e717c11a30b5a7bc3a65d1b1 ("hwrng: cctrng - introduce Arm CryptoCell driver") https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master in testcase: netperf on test machine: 72 threads Intel(R) Xeon(R) Gold 6139 CPU @ 2.30GHz with 128G memory with following parameters: ip: ipv4 runtime: 300s nr_threads: 16 cluster: cs-localhost test: TCP_CRR cpufreq_governor: performance ucode: 0x2000065 test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance. test-url: http://www.netperf.org/netperf/ Details are as below: --------------------------------------------------------------------------------------------------> To reproduce: git clone https://github.com/intel/lkp-tests.git cd lkp-tests bin/lkp install job.yaml # job file is attached in this email bin/lkp run job.yaml ========================================================================================= cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode: cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/16/debian-x86_64-20191114.cgz/300s/lkp-skl-2sp7/TCP_CRR/netperf/0x2000065 commit: ffb57daad3 ("dt-bindings: add device tree binding for Arm CryptoCell trng engine") a583ed310b ("hwrng: cctrng - introduce Arm CryptoCell driver") ffb57daad3a345a9 a583ed310bb6b514e717c11a30b ---------------- --------------------------- %stddev %change %stddev \ | \ 353918 +9.7% 388366 netperf.Throughput_total_tps 22119 +9.7% 24272 netperf.Throughput_tps 783530 +1.7% 796536 netperf.time.involuntary_context_switches 342.37 +9.9% 376.29 netperf.time.user_time 2.072e+08 +9.0% 2.258e+08 netperf.time.voluntary_context_switches 1.062e+08 +9.7% 1.165e+08 netperf.workload 449059 ± 5% +14.1% 512378 ± 4% numa-numastat.node1.numa_hit -55.63 -35.9% -35.67 sched_debug.cpu.nr_uninterruptible.min 2232264 +4.4% 2330969 vmstat.system.cs 28385482 ± 15% -26.8% 20787967 ± 23% cpuidle.C1E.usage 1.708e+08 +15.5% 1.973e+08 cpuidle.POLL.usage 373.00 ± 39% +73.5% 647.33 ± 6% numa-vmstat.node0.nr_page_table_pages 1028 ± 13% -25.9% 762.00 ± 5% numa-vmstat.node1.nr_page_table_pages 1492 ± 39% +73.7% 2592 ± 6% numa-meminfo.node0.PageTables 4112 ± 13% -25.9% 3047 ± 5% numa-meminfo.node1.PageTables 109642 ± 5% -9.3% 99427 numa-meminfo.node1.SUnreclaim 23599 +1.6% 23983 proc-vmstat.nr_slab_reclaimable 5496 ± 9% +132.5% 12778 ± 20% proc-vmstat.numa_hint_faults 3072 ± 7% +226.1% 10019 ± 24% proc-vmstat.numa_hint_faults_local 889669 +8.4% 964517 proc-vmstat.numa_hit 866345 +8.6% 941151 proc-vmstat.numa_local 16483 ± 47% +120.1% 36285 ± 9% proc-vmstat.numa_pte_updates 1219799 +14.5% 1397077 proc-vmstat.pgalloc_normal 1161729 +15.3% 1339389 proc-vmstat.pgfree 5859579 ± 4% +9.7% 6428758 softirqs.CPU36.NET_RX 363433 ± 3% +9.3% 397191 softirqs.CPU36.RCU 4912540 ± 2% +12.7% 5538675 ± 5% softirqs.CPU38.NET_RX 3899055 ± 6% +17.9% 4596745 ± 6% softirqs.CPU45.NET_RX 249671 ± 10% +15.9% 289302 ± 5% softirqs.CPU50.RCU 2758417 ± 13% +43.0% 3943296 ± 12% softirqs.CPU52.NET_RX 225780 ± 7% +25.2% 282648 ± 7% softirqs.CPU52.RCU 235672 ± 11% +15.6% 272402 ± 3% softirqs.CPU53.RCU 4125918 ± 6% +17.6% 4853596 ± 7% softirqs.CPU57.NET_RX 285348 ± 3% +13.4% 323638 ± 5% softirqs.CPU57.RCU 3227189 ± 17% +24.9% 4032084 ± 7% softirqs.CPU60.NET_RX 3073427 ± 15% +23.7% 3800576 ± 6% softirqs.CPU63.NET_RX 227535 ± 9% +15.5% 262875 ± 4% softirqs.CPU63.RCU 2724757 ± 11% +34.7% 3669429 ± 5% softirqs.CPU64.NET_RX 212958 ± 6% +21.0% 257707 ± 3% softirqs.CPU64.RCU 2568732 ± 12% +23.2% 3164017 ± 6% softirqs.CPU67.NET_RX 201693 ± 7% +15.0% 231895 ± 5% softirqs.CPU67.RCU 327318 ± 5% +12.3% 367552 ± 4% softirqs.CPU8.RCU 24164 -0.9% 23954 interrupts.CAL:Function_call_interrupts 9251 ± 4% +18.3% 10947 interrupts.CPU10.RES:Rescheduling_interrupts 9602 ± 3% +10.1% 10576 ± 3% interrupts.CPU12.RES:Rescheduling_interrupts 4694 ± 10% -34.1% 3091 ± 31% interrupts.CPU14.NMI:Non-maskable_interrupts 4694 ± 10% -34.1% 3091 ± 31% interrupts.CPU14.PMI:Performance_monitoring_interrupts 3993 ± 12% -21.7% 3128 ± 25% interrupts.CPU15.NMI:Non-maskable_interrupts 3993 ± 12% -21.7% 3128 ± 25% interrupts.CPU15.PMI:Performance_monitoring_interrupts 4945 ± 10% -23.8% 3768 ± 22% interrupts.CPU16.NMI:Non-maskable_interrupts 4945 ± 10% -23.8% 3768 ± 22% interrupts.CPU16.PMI:Performance_monitoring_interrupts 8202 ± 5% +27.5% 10458 ± 11% interrupts.CPU18.RES:Rescheduling_interrupts 8200 ± 8% +22.5% 10046 ± 10% interrupts.CPU19.RES:Rescheduling_interrupts 8225 ± 5% +13.0% 9297 ± 3% interrupts.CPU20.RES:Rescheduling_interrupts 8069 ± 6% +20.4% 9717 ± 6% interrupts.CPU26.RES:Rescheduling_interrupts 4128 ± 9% +27.5% 5262 ± 6% interrupts.CPU3.NMI:Non-maskable_interrupts 4128 ± 9% +27.5% 5262 ± 6% interrupts.CPU3.PMI:Performance_monitoring_interrupts 4005 ± 29% -32.9% 2689 ± 44% interrupts.CPU30.NMI:Non-maskable_interrupts 4005 ± 29% -32.9% 2689 ± 44% interrupts.CPU30.PMI:Performance_monitoring_interrupts 3563 ± 21% +31.4% 4681 ± 7% interrupts.CPU34.NMI:Non-maskable_interrupts 3563 ± 21% +31.4% 4681 ± 7% interrupts.CPU34.PMI:Performance_monitoring_interrupts 10009 ± 4% +7.8% 10794 ± 5% interrupts.CPU36.RES:Rescheduling_interrupts 9285 ± 4% +18.3% 10986 ± 7% interrupts.CPU37.RES:Rescheduling_interrupts 3283 ± 10% +51.3% 4966 ± 7% interrupts.CPU39.NMI:Non-maskable_interrupts 3283 ± 10% +51.3% 4966 ± 7% interrupts.CPU39.PMI:Performance_monitoring_interrupts 3128 ± 4% +26.1% 3945 ± 6% interrupts.CPU50.NMI:Non-maskable_interrupts 3128 ± 4% +26.1% 3945 ± 6% interrupts.CPU50.PMI:Performance_monitoring_interrupts 3209 ± 20% +40.6% 4511 ± 7% interrupts.CPU58.NMI:Non-maskable_interrupts 3209 ± 20% +40.6% 4511 ± 7% interrupts.CPU58.PMI:Performance_monitoring_interrupts 5958 ± 8% +11.7% 6658 ± 7% interrupts.CPU62.RES:Rescheduling_interrupts 4692 ± 7% +30.1% 6103 interrupts.CPU64.RES:Rescheduling_interrupts 4563 ± 15% +31.2% 5986 ± 6% interrupts.CPU65.RES:Rescheduling_interrupts 4015 ± 10% +27.0% 5101 ± 7% interrupts.CPU68.RES:Rescheduling_interrupts 563900 +12.2% 632944 ± 2% interrupts.RES:Rescheduling_interrupts 54.28 -2.5 51.80 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe 54.44 -2.5 51.96 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe 20.48 -1.7 18.75 ± 6% perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack 20.88 -1.7 19.15 ± 6% perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq 20.20 -1.7 18.48 ± 6% perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start 21.44 -1.7 19.73 ± 6% perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb 21.09 -1.7 19.39 ± 6% perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip 21.33 -1.7 19.64 ± 6% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output 21.42 -1.7 19.73 ± 6% perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit 21.28 -1.7 19.60 ± 6% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2 19.00 -1.5 17.53 ± 6% perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog 18.95 -1.5 17.49 ± 6% perf-profile.calltrace.cycles-pp.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core 19.07 -1.5 17.62 ± 6% perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action 18.45 -1.3 17.10 ± 6% perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver.ip_rcv 13.62 -1.2 12.45 ± 5% perf-profile.calltrace.cycles-pp.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 13.56 -1.2 12.40 ± 5% perf-profile.calltrace.cycles-pp.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64 13.77 -1.2 12.60 ± 5% perf-profile.calltrace.cycles-pp.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 13.78 -1.2 12.62 ± 5% perf-profile.calltrace.cycles-pp.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.55 -1.1 10.49 ± 6% perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.65 -1.1 10.59 ± 6% perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.68 -1.1 10.62 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe 11.31 -1.0 10.26 ± 6% perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64 13.56 -1.0 12.59 ± 6% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames 9.73 -0.9 8.79 ± 6% perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 13.41 -0.9 12.48 ± 6% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit 8.52 -0.9 7.64 ± 6% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg 8.52 -0.9 7.65 ± 6% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto 6.35 -0.7 5.65 ± 6% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked 6.52 -0.7 5.82 ± 6% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg 6.84 -0.7 6.17 ± 5% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.__inet_stream_connect.inet_stream_connect.__sys_connect 6.86 -0.7 6.20 ± 5% perf-profile.calltrace.cycles-pp.release_sock.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect 6.80 -0.7 6.14 ± 5% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.__inet_stream_connect.inet_stream_connect 5.99 -0.5 5.46 ± 5% perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.release_sock.__inet_stream_connect 5.38 -0.5 4.87 ± 4% perf-profile.calltrace.cycles-pp.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect 1.81 -0.5 1.30 ± 6% perf-profile.calltrace.cycles-pp.tcp_data_queue.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 6.56 -0.5 6.06 ± 4% perf-profile.calltrace.cycles-pp.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect 8.91 -0.5 8.44 ± 6% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release.sock_close 8.90 -0.5 8.43 ± 6% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release 4.56 -0.5 4.11 ± 4% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect 3.85 -0.4 3.42 ± 5% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect 4.28 -0.4 3.86 ± 5% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect 3.87 -0.4 3.44 ± 4% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect 5.34 -0.4 4.93 ± 5% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.release_sock 6.08 -0.4 5.68 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 6.03 -0.4 5.63 ± 6% perf-profile.calltrace.cycles-pp.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.56 -0.4 5.18 ± 6% perf-profile.calltrace.cycles-pp.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64.entry_SYSCALL_64_after_hwframe 5.54 -0.4 5.15 ± 6% perf-profile.calltrace.cycles-pp.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom.do_syscall_64 2.96 -0.4 2.59 ± 6% perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom 5.15 -0.4 4.78 ± 5% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock 5.00 -0.3 4.66 ± 5% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv 4.88 -0.3 4.57 ± 5% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process 3.70 -0.3 3.38 ± 6% perf-profile.calltrace.cycles-pp.poll_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry 1.99 -0.2 1.78 ± 5% perf-profile.calltrace.cycles-pp.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom 1.73 -0.2 1.54 ± 5% perf-profile.calltrace.cycles-pp.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg.inet_recvmsg 1.56 -0.2 1.39 ± 5% perf-profile.calltrace.cycles-pp.__sched_text_start.schedule.schedule_timeout.wait_woken.sk_wait_data 1.65 -0.2 1.48 ± 5% perf-profile.calltrace.cycles-pp.schedule.schedule_timeout.wait_woken.sk_wait_data.tcp_recvmsg 1.98 -0.1 1.83 ± 4% perf-profile.calltrace.cycles-pp.tcp_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 0.80 -0.1 0.65 ± 5% perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish 1.39 -0.1 1.27 ± 7% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg 1.45 -0.1 1.33 ± 7% perf-profile.calltrace.cycles-pp.__release_sock.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto 1.52 -0.1 1.40 ± 7% perf-profile.calltrace.cycles-pp.release_sock.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto 1.05 -0.1 0.93 ± 8% perf-profile.calltrace.cycles-pp.tcp_ack.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock 1.31 -0.1 1.20 ± 7% perf-profile.calltrace.cycles-pp.tcp_rcv_established.tcp_v4_do_rcv.__release_sock.release_sock.tcp_sendmsg 1.99 -0.1 1.88 ± 4% perf-profile.calltrace.cycles-pp.tcp_child_process.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 1.23 -0.1 1.13 ± 7% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_protocol_deliver_rcu 0.66 -0.1 0.59 ± 8% perf-profile.calltrace.cycles-pp.__inet_lookup_established.tcp_v4_rcv.ip_protocol_deliver_rcu.ip_local_deliver_finish.ip_local_deliver 0.74 ± 3% -0.1 0.68 ± 5% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout.wait_woken 0.70 -0.1 0.65 ± 7% perf-profile.calltrace.cycles-pp.set_next_entity.pick_next_task_fair.__sched_text_start.schedule_idle.do_idle 0.62 ± 2% -0.1 0.57 ± 5% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__sched_text_start.schedule.schedule_timeout 54.36 -2.5 51.86 ± 6% perf-profile.children.cycles-pp.do_syscall_64 54.50 -2.5 52.01 ± 6% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe 26.27 -2.1 24.15 ± 6% perf-profile.children.cycles-pp.__tcp_transmit_skb 24.70 -1.9 22.76 ± 5% perf-profile.children.cycles-pp.__ip_queue_xmit 23.82 -1.8 22.00 ± 6% perf-profile.children.cycles-pp.ip_output 20.69 -1.8 18.91 ± 6% perf-profile.children.cycles-pp.__netif_receive_skb_one_core 20.41 -1.8 18.63 ± 6% perf-profile.children.cycles-pp.ip_rcv 21.08 -1.8 19.31 ± 6% perf-profile.children.cycles-pp.process_backlog 21.66 -1.8 19.91 ± 6% perf-profile.children.cycles-pp.do_softirq 21.81 -1.8 20.06 ± 6% perf-profile.children.cycles-pp.__local_bh_enable_ip 21.55 -1.7 19.80 ± 6% perf-profile.children.cycles-pp.do_softirq_own_stack 21.31 -1.7 19.57 ± 6% perf-profile.children.cycles-pp.net_rx_action 21.88 -1.7 20.14 ± 6% perf-profile.children.cycles-pp.__softirqentry_text_start 23.17 -1.7 21.45 ± 6% perf-profile.children.cycles-pp.ip_finish_output2 19.14 -1.5 17.63 ± 6% perf-profile.children.cycles-pp.ip_protocol_deliver_rcu 19.17 -1.5 17.67 ± 6% perf-profile.children.cycles-pp.ip_local_deliver_finish 19.26 -1.5 17.76 ± 6% perf-profile.children.cycles-pp.ip_local_deliver 18.64 -1.4 17.26 ± 6% perf-profile.children.cycles-pp.tcp_v4_rcv 17.43 -1.3 16.09 ± 6% perf-profile.children.cycles-pp.__tcp_push_pending_frames 17.42 -1.3 16.08 ± 6% perf-profile.children.cycles-pp.tcp_write_xmit 20.02 -1.2 18.78 ± 6% perf-profile.children.cycles-pp.tcp_v4_do_rcv 13.62 -1.2 12.45 ± 5% perf-profile.children.cycles-pp.inet_stream_connect 13.56 -1.2 12.40 ± 5% perf-profile.children.cycles-pp.__inet_stream_connect 13.78 -1.2 12.62 ± 5% perf-profile.children.cycles-pp.__x64_sys_connect 13.77 -1.2 12.61 ± 5% perf-profile.children.cycles-pp.__sys_connect 11.55 -1.1 10.49 ± 6% perf-profile.children.cycles-pp.sock_sendmsg 11.68 -1.1 10.62 ± 6% perf-profile.children.cycles-pp.__x64_sys_sendto 11.65 -1.1 10.59 ± 6% perf-profile.children.cycles-pp.__sys_sendto 11.31 -1.0 10.26 ± 6% perf-profile.children.cycles-pp.tcp_sendmsg 9.73 -0.9 8.80 ± 6% perf-profile.children.cycles-pp.tcp_sendmsg_locked 10.07 -0.9 9.16 ± 6% perf-profile.children.cycles-pp.__release_sock 13.09 -0.9 12.23 ± 5% perf-profile.children.cycles-pp.tcp_rcv_state_process 9.11 -0.9 8.25 ± 5% perf-profile.children.cycles-pp.release_sock 5.38 -0.5 4.88 ± 4% perf-profile.children.cycles-pp.tcp_connect 6.56 -0.5 6.06 ± 4% perf-profile.children.cycles-pp.tcp_v4_connect 6.09 -0.4 5.68 ± 6% perf-profile.children.cycles-pp.__x64_sys_recvfrom 6.03 -0.4 5.63 ± 6% perf-profile.children.cycles-pp.__sys_recvfrom 5.56 -0.4 5.18 ± 6% perf-profile.children.cycles-pp.inet_recvmsg 5.55 -0.4 5.16 ± 6% perf-profile.children.cycles-pp.tcp_recvmsg 2.96 -0.4 2.59 ± 6% perf-profile.children.cycles-pp.sk_wait_data 6.73 -0.4 6.37 ± 6% perf-profile.children.cycles-pp.tcp_rcv_established 2.83 -0.3 2.49 ± 7% perf-profile.children.cycles-pp.tcp_ack 3.72 -0.3 3.41 ± 5% perf-profile.children.cycles-pp.poll_idle 0.83 ± 2% -0.3 0.56 ± 9% perf-profile.children.cycles-pp.inet_ehashfn 4.18 -0.3 3.92 ± 6% perf-profile.children.cycles-pp.__sched_text_start 2.01 -0.2 1.80 ± 5% perf-profile.children.cycles-pp.wait_woken 0.38 ± 2% -0.2 0.17 ± 9% perf-profile.children.cycles-pp.__tcp_select_window 1.67 -0.2 1.47 ± 7% perf-profile.children.cycles-pp.__inet_lookup_established 0.65 ± 3% -0.2 0.45 ± 6% perf-profile.children.cycles-pp.ip_rcv_finish 0.62 ± 3% -0.2 0.42 ± 5% perf-profile.children.cycles-pp.ip_rcv_finish_core 0.90 -0.2 0.71 ± 7% perf-profile.children.cycles-pp.tcp_init_transfer 2.54 -0.2 2.37 ± 5% perf-profile.children.cycles-pp.schedule_timeout 0.33 ± 4% -0.2 0.16 ± 5% perf-profile.children.cycles-pp.tcp_sync_mss 2.43 -0.2 2.27 ± 5% perf-profile.children.cycles-pp.schedule 1.98 -0.1 1.84 ± 4% perf-profile.children.cycles-pp.tcp_conn_request 0.23 ± 3% -0.1 0.10 ± 4% perf-profile.children.cycles-pp.tcp_rack_update_reo_wnd 1.99 -0.1 1.88 ± 4% perf-profile.children.cycles-pp.tcp_child_process 0.51 -0.1 0.40 ± 9% perf-profile.children.cycles-pp.tcp_finish_connect 0.71 ± 2% -0.1 0.61 ± 7% perf-profile.children.cycles-pp.ipv4_dst_check 0.41 ± 5% -0.1 0.32 ± 6% perf-profile.children.cycles-pp.__ip_finish_output 0.17 ± 2% -0.1 0.09 ± 5% perf-profile.children.cycles-pp.tcp_mtup_init 1.25 -0.1 1.17 ± 7% perf-profile.children.cycles-pp.pick_next_task_fair 0.81 ± 3% -0.1 0.73 ± 8% perf-profile.children.cycles-pp.apic_timer_interrupt 0.75 ± 3% -0.1 0.67 ± 8% perf-profile.children.cycles-pp.smp_apic_timer_interrupt 0.46 ± 3% -0.1 0.38 ± 7% perf-profile.children.cycles-pp.ip_rcv_core 0.32 -0.1 0.25 ± 11% perf-profile.children.cycles-pp.tcp_ack_update_rtt 0.82 -0.1 0.75 ± 8% perf-profile.children.cycles-pp.ip_route_output_flow 0.44 ± 2% -0.1 0.37 ± 7% perf-profile.children.cycles-pp.tcp_init_metrics 0.48 ± 6% -0.1 0.42 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt 0.23 ± 2% -0.1 0.17 ± 5% perf-profile.children.cycles-pp.tcp_update_pacing_rate 0.18 ± 2% -0.1 0.13 ± 3% perf-profile.children.cycles-pp.tcp_init_buffer_space 0.21 ± 6% -0.1 0.16 ± 7% perf-profile.children.cycles-pp.__ip_dev_find 0.20 ± 7% -0.1 0.14 ± 10% perf-profile.children.cycles-pp.inet_lookup_ifaddr_rcu 0.09 ± 7% -0.1 0.03 ± 70% perf-profile.children.cycles-pp.tcp_push 0.72 -0.1 0.66 ± 6% perf-profile.children.cycles-pp.set_next_entity 0.62 -0.1 0.57 ± 6% perf-profile.children.cycles-pp.__sk_dst_check 0.23 ± 5% -0.0 0.18 ± 12% perf-profile.children.cycles-pp.tcp_newly_delivered 0.33 -0.0 0.28 ± 5% perf-profile.children.cycles-pp.tcp_schedule_loss_probe 0.11 ± 4% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.tcp_select_initial_window 0.32 -0.0 0.27 ± 6% perf-profile.children.cycles-pp.tick_nohz_idle_exit 0.14 ± 3% -0.0 0.09 ± 5% perf-profile.children.cycles-pp.sock_prot_inuse_add 0.16 ± 13% -0.0 0.12 ± 11% perf-profile.children.cycles-pp.clockevents_program_event 0.22 ± 3% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.nr_iowait_cpu 0.19 ± 5% -0.0 0.15 ± 10% perf-profile.children.cycles-pp.tcp_parse_options 0.21 ± 3% -0.0 0.17 ± 5% perf-profile.children.cycles-pp.update_ts_time_stats 0.62 -0.0 0.58 ± 5% perf-profile.children.cycles-pp.tcp_event_new_data_sent 0.47 -0.0 0.43 ± 6% perf-profile.children.cycles-pp.dst_release 0.17 ± 4% -0.0 0.14 ± 9% perf-profile.children.cycles-pp.__inet_lookup_listener 0.14 ± 3% -0.0 0.10 perf-profile.children.cycles-pp.tcp_openreq_init_rwin 0.14 ± 5% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.skb_entail 0.13 -0.0 0.10 ± 9% perf-profile.children.cycles-pp.tcp_assign_congestion_control 0.11 ± 9% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__sk_free 0.42 -0.0 0.39 ± 6% perf-profile.children.cycles-pp.__inet_hash_connect 0.12 ± 4% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.inet_sock_destruct 0.10 ± 10% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.inet_lhash2_lookup 0.08 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.ip_build_and_send_pkt 0.09 ± 4% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.menu_reflect 0.20 ± 2% -0.0 0.18 ± 7% perf-profile.children.cycles-pp.security_socket_sendmsg 0.19 ± 8% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.newidle_balance 0.11 ± 7% -0.0 0.09 ± 14% perf-profile.children.cycles-pp.tcp_synack_rtt_meas 0.12 -0.0 0.10 ± 9% perf-profile.children.cycles-pp.secure_tcp_ts_off 0.08 ± 5% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.tcp_ca_openreq_child 0.08 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.tcp_cleanup_rbuf 0.05 +0.0 0.06 ± 7% perf-profile.children.cycles-pp.apparmor_ipv4_postroute 0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.bictcp_acked 0.13 ± 3% +0.0 0.15 ± 8% perf-profile.children.cycles-pp.__might_fault 0.15 ± 2% +0.0 0.17 ± 4% perf-profile.children.cycles-pp.destroy_inode 0.04 ± 57% +0.0 0.06 perf-profile.children.cycles-pp.tcp_v4_inbound_md5_hash 0.19 ± 3% +0.0 0.21 ± 4% perf-profile.children.cycles-pp.tcp_write_queue_purge 0.14 +0.0 0.17 ± 2% perf-profile.children.cycles-pp.__destroy_inode 0.11 ± 3% +0.0 0.14 ± 10% perf-profile.children.cycles-pp.sk_filter_trim_cap 0.41 +0.0 0.44 ± 5% perf-profile.children.cycles-pp.__sys_getsockopt 0.32 ± 3% +0.0 0.35 ± 4% perf-profile.children.cycles-pp.apparmor_file_free_security 0.33 ± 2% +0.0 0.37 ± 5% perf-profile.children.cycles-pp.security_file_free 0.01 ±173% +0.0 0.06 ± 8% perf-profile.children.cycles-pp.bictcp_cong_avoid 0.00 +0.1 0.05 perf-profile.children.cycles-pp.tcp_v4_md5_lookup 0.00 +0.1 0.05 perf-profile.children.cycles-pp.__tcp_v4_send_check 0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.ip_queue_xmit 0.69 +0.1 0.77 ± 6% perf-profile.children.cycles-pp.__dentry_kill 0.50 ± 3% +0.1 0.59 ± 7% perf-profile.children.cycles-pp.percpu_counter_add_batch 3.64 -0.3 3.33 ± 5% perf-profile.self.cycles-pp.poll_idle 0.83 ± 2% -0.3 0.56 ± 8% perf-profile.self.cycles-pp.inet_ehashfn 0.62 ± 3% -0.2 0.41 ± 5% perf-profile.self.cycles-pp.ip_rcv_finish_core 0.38 ± 2% -0.2 0.17 ± 12% perf-profile.self.cycles-pp.__tcp_select_window 0.32 ± 5% -0.2 0.16 ± 5% perf-profile.self.cycles-pp.tcp_sync_mss 0.64 ± 3% -0.1 0.50 ± 6% perf-profile.self.cycles-pp.__ip_queue_xmit 0.23 ± 3% -0.1 0.10 ± 4% perf-profile.self.cycles-pp.tcp_rack_update_reo_wnd 0.45 -0.1 0.33 ± 6% perf-profile.self.cycles-pp.ip_protocol_deliver_rcu 1.07 -0.1 0.96 ± 5% perf-profile.self.cycles-pp.__tcp_transmit_skb 0.30 ± 6% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.__ip_finish_output 0.69 ± 2% -0.1 0.60 ± 7% perf-profile.self.cycles-pp.ipv4_dst_check 0.17 ± 4% -0.1 0.08 ± 11% perf-profile.self.cycles-pp.tcp_mtup_init 0.40 ± 3% -0.1 0.32 ± 6% perf-profile.self.cycles-pp.tcp_write_xmit 0.44 ± 2% -0.1 0.36 ± 5% perf-profile.self.cycles-pp.ip_output 0.25 ± 3% -0.1 0.17 ± 14% perf-profile.self.cycles-pp.tcp_ack_update_rtt 0.45 ± 3% -0.1 0.38 ± 7% perf-profile.self.cycles-pp.ip_rcv_core 0.23 ± 3% -0.1 0.17 ± 8% perf-profile.self.cycles-pp.tcp_update_pacing_rate 0.20 ± 7% -0.1 0.14 ± 10% perf-profile.self.cycles-pp.inet_lookup_ifaddr_rcu 0.13 ± 8% -0.1 0.07 ± 11% perf-profile.self.cycles-pp.tcp_init_metrics 0.23 ± 6% -0.1 0.17 ± 8% perf-profile.self.cycles-pp.tcp_newly_delivered 0.60 ± 2% -0.1 0.54 ± 5% perf-profile.self.cycles-pp.tcp_v4_rcv 0.09 ± 7% -0.1 0.03 ± 70% perf-profile.self.cycles-pp.tcp_push 0.20 ± 4% -0.1 0.14 ± 5% perf-profile.self.cycles-pp.tcp_set_state 0.23 ± 3% -0.1 0.17 ± 9% perf-profile.self.cycles-pp.tcp_get_metrics 0.33 ± 4% -0.1 0.28 ± 8% perf-profile.self.cycles-pp.ktime_get 0.24 ± 4% -0.1 0.19 ± 2% perf-profile.self.cycles-pp.tcp_conn_request 0.16 ± 5% -0.0 0.11 ± 14% perf-profile.self.cycles-pp.tcp_update_metrics 0.29 -0.0 0.24 ± 8% perf-profile.self.cycles-pp.tcp_schedule_loss_probe 0.66 -0.0 0.61 ± 5% perf-profile.self.cycles-pp.tcp_ack 0.14 ± 3% -0.0 0.09 perf-profile.self.cycles-pp.sock_prot_inuse_add 0.11 ± 4% -0.0 0.06 ± 14% perf-profile.self.cycles-pp.tcp_select_initial_window 0.19 ± 5% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.tcp_parse_options 0.22 ± 3% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.nr_iowait_cpu 0.24 ± 2% -0.0 0.20 ± 4% perf-profile.self.cycles-pp.tcp_connect 0.19 ± 6% -0.0 0.15 ± 6% perf-profile.self.cycles-pp.tcp_event_new_data_sent 0.46 -0.0 0.42 ± 5% perf-profile.self.cycles-pp.dst_release 0.13 ± 5% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.__inet_bind 0.13 ± 6% -0.0 0.10 perf-profile.self.cycles-pp.skb_entail 0.35 ± 3% -0.0 0.32 ± 6% perf-profile.self.cycles-pp.set_next_entity 0.28 ± 2% -0.0 0.25 ± 8% perf-profile.self.cycles-pp.wait_woken 0.06 ± 6% -0.0 0.03 ± 70% perf-profile.self.cycles-pp.update_min_vruntime 0.12 ± 4% -0.0 0.10 ± 9% perf-profile.self.cycles-pp.tcp_assign_congestion_control 0.11 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.__inet_hash_connect 0.10 ± 8% -0.0 0.07 ± 11% perf-profile.self.cycles-pp.__sk_free 0.12 ± 5% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.tcp_make_synack 0.10 ± 10% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.inet_lhash2_lookup 0.35 ± 2% -0.0 0.32 ± 5% perf-profile.self.cycles-pp.__switch_to 0.08 ± 5% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.ip_build_and_send_pkt 0.12 -0.0 0.10 ± 12% perf-profile.self.cycles-pp.tcp_create_openreq_child 0.08 ± 5% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.secure_tcp_ts_off 0.11 ± 4% -0.0 0.09 ± 14% perf-profile.self.cycles-pp.tcp_stream_memory_free 0.19 ± 3% -0.0 0.17 ± 2% perf-profile.self.cycles-pp.enqueue_task_fair 0.07 ± 6% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.__inet_inherit_port 0.08 -0.0 0.07 ± 7% perf-profile.self.cycles-pp.tcp_cleanup_rbuf 0.07 ± 7% -0.0 0.05 ± 8% perf-profile.self.cycles-pp.tcp_openreq_init_rwin 0.07 ± 6% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.bictcp_acked 0.36 +0.0 0.40 ± 4% perf-profile.self.cycles-pp.__sk_destruct 0.00 +0.1 0.05 perf-profile.self.cycles-pp.tcp_add_backlog 0.00 +0.1 0.05 perf-profile.self.cycles-pp.__tcp_v4_send_check 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.task_work_run 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.bictcp_cong_avoid 0.00 +0.1 0.05 ± 8% perf-profile.self.cycles-pp.ip_queue_xmit 0.50 ± 2% +0.1 0.58 ± 7% perf-profile.self.cycles-pp.percpu_counter_add_batch netperf.Throughput_tps 25000 +-------------------------------------------------------------------+ | .+.+ +.. | | +.+..+ + : : +.+..+.+.+..+.+..+.+..+.+.+..+.+ | 20000 |-+ : : : : : | | : : : : : | |: : : : : : | 15000 |:+ : : : : : | |: : : : : : | 10000 |:+ : : : : : | |: : : : : : | |: : : : : : | 5000 |-:: :: :: | | :: :: : | | : : : | 0 +-------------------------------------------------------------------+ [*] bisect-good sample [O] bisect-bad sample Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Rong Chen