Re: [PATCH] anobjrmap 9 priority mjb tree

["Martin J. Bligh" <mbligh@aracnet.com>]

[-- Attachment #1: Type: text/plain, Size: 1805 bytes --]

>> I applied Andrew's high sophisticated proprietary semtrace technology.
> 
> Thanks a lot, Martin, this seems pretty important.
> 
> So, i_shared_sem, as you supposed.
> 
> Do you still have the two profiles input to diffprofile?
> I wonder if they'd have clues to help us understand it better.

Yup. Attatched.

> Any chance of you doing the same comparison between 2.6.5-aa5 
> 2.6.5-aa5 minus prio-tree?  (Well, needn't be -aa5, whatever comes to
> hand.  Looks like "patch -p1 -R < prio-tree" mostly works, just some
> rejects in mm/mmap.c itself, let me know if I can help out on that.)
> 
> If -aa is okay, I hope so, then it's surely some stupidity from me.

Good idea. Not sure how easy it'll be to back prio_tree out, but I can 
surely do aa5, which would give us a good clue still. Might not be until 
this time tommorow though.

> We're not at all surprised that vma linking and unlinking should take
> rather longer; but the rise in __down, __wake_up, finish_task_switch
> is horrifying.  Or is that how it usually looks, when a semaphore is
> well contended - thundering herd?

I think there's just a locking cliff you fall off after a certain level
of contention ... i_shared_sem has always been bad for SDET, to be fair.
But I hate making it worse ;-) I did more investigation of it a year or
so ago ... something does horrible things to it (which is why akpm turned
it into a sem in the first place) ... maybe holding it over proess teardown
for eons or something. Bah, I want lockmeter for sems ;-) 

Maybe I can dig out my old analysis ... I'll take a look. I suppose I could
always turn it back into a spinlock to look at it ;-) On the other hand, if
we can fix that problem, I think my "list of lists" was simpler than prio
tree (and is probably much more susceptible to RCU).

M.



[-- Attachment #2: mjb1 --]
[-- Type: application/octet-stream, Size: 17226 bytes --]

783079 total
519748 default_idle
18229 copy_page_range
13878 zap_pte_range
11235 __d_lookup
11135 find_get_page
9775 page_remove_rmap
8904 do_wp_page
8460 release_pages
7232 atomic_dec_and_lock
6488 __copy_to_user_ll
6212 path_lookup
6143 .text.lock.filemap
4651 __down
4264 do_anonymous_page
3921 do_no_page
3439 clear_page_tables
3056 free_pages_and_swap_cache
3055 copy_mm
2961 do_page_fault
2926 .text.lock.dec_and_lock
2548 remove_shared_vm_struct
2302 link_path_walk
2288 filemap_nopage
2286 follow_mount
2242 file_move
2208 copy_process
2205 path_release
2191 finish_task_switch
2082 grab_block
1975 __copy_user_intel
1887 __wake_up
1801 proc_pid_stat
1772 kmem_cache_free
1765 .text.lock.file_table
1752 ext2_new_inode
1746 __block_prepare_write
1689 pte_alloc_one
1652 .text.lock.dcache
1584 __fput
1573 __find_get_block
1571 lookup_mnt
1563 buffered_rmqueue
1556 number
1543 page_add_obj_rmap
1491 free_hot_cold_page
1485 release_task
1413 .text.lock.highmem
1324 generic_file_open
1314 page_address
1295 current_kernel_time
1295 __brelse
1276 file_kill
1212 task_mem
1083 kmap_high
1079 do_generic_mapping_read
1034 alloc_inode
1014 __mark_inode_dirty
990 system_call
988 d_alloc
979 vsnprintf
958 update_atime
957 kmap_atomic
940 __read_lock_failed
910 exit_notify
891 proc_check_root
874 handle_mm_fault
861 ext2_new_block
826 dput
819 proc_root_link
816 proc_pid_status
795 __copy_from_user_ll
788 generic_fillattr
774 dnotify_parent
770 new_inode
726 __find_get_block_slow
716 fd_install
694 .text.lock.base
671 __generic_file_aio_write_nolock
663 do_mmap_pgoff
659 fput
650 mmgrab
641 radix_tree_lookup
610 ext2_update_inode
602 find_vma
586 vfs_read
584 kunmap_high
567 d_instantiate
560 render_sigset_t
541 set_page_address
530 vma_link
516 generic_delete_inode
506 del_timer_sync
503 read_block_bitmap
503 do_page_cache_readahead
499 dentry_open
498 set_page_dirty
486 pid_revalidate
472 prune_dcache
440 block_invalidatepage
436 d_path
420 deny_write_access
415 pte_alloc_map
414 may_open
396 mark_page_accessed
394 kmem_ptr_validate
379 copy_files
373 ext2_free_blocks
352 __blk_queue_bounce
351 .text.lock.inode
350 __alloc_pages
342 group_reserve_blocks
342 get_tgid_list
338 exec_mmap
337 __generic_file_aio_read
332 select_parent
327 ext2_find_entry
325 real_lookup
325 page_add_anon_rmap
322 ext2_get_group_desc
316 ext2_add_link
313 find_group_other
307 file_ra_state_init
307 ext2_preread_inode
294 filp_close
293 unlock_page
292 ext2_get_block
283 dup_task_struct
279 __pagevec_lru_add_active
269 open_namei
267 exit_mmap
265 d_delete
264 ext2_get_inode
261 task_dumpable
261 flush_signal_handlers
256 proc_fd_link
256 do_lookup
256 __insert_inode_hash
248 .text.lock.namespace
244 copy_strings
239 direct_strncpy_from_user
233 group_release_blocks
231 vfs_unlink
230 is_subdir
230 flush_tlb_page
229 kunmap_atomic
228 split_vma
226 get_empty_filp
223 find_get_pages
222 direct_strnlen_user
221 tid_fd_revalidate
218 do_sigaction
217 proc_pid_readlink
217 do_exit
215 create_buffers
214 in_group_p
206 truncate_inode_pages
191 file_read_actor
185 vfs_getattr
185 generic_file_write
184 vfs_write
183 unmap_vmas
178 ext2_discard_prealloc
175 get_unused_fd
173 read_inode_bitmap
172 iput
168 rb_insert_color
168 load_elf_binary
168 d_lookup
167 sys_wait4
167 flush_tlb_mm
166 __block_commit_write
163 percpu_counter_mod
160 dnotify_flush
159 ext2_block_to_path
155 profile_exit_mmap
155 generic_file_read
155 fget_light
155 __d_path
154 get_wchan
151 syscall_exit
147 fget
147 ext2_truncate
146 proc_delete_inode
145 locks_remove_flock
145 __free_pages
141 sys_close
137 proc_info_read
134 sys_unlink
134 reap_timer_fnc
134 __lookup
131 try_to_free_buffers
130 call_rcu
129 sigprocmask
128 __pagevec_lru_add
127 ext2_inode_by_name
125 bad_range
123 inode_times_differ
123 ext2_commit_chunk
120 schedule
120 lru_cache_add_active
119 rcu_do_batch
117 page_update_anon_rmap
116 ext2_delete_entry
114 vfs_permission
113 vm_acct_memory
112 page_cache_readahead
111 ext2_readdir
109 find_vma_prepare
108 cp_new_stat64
106 put_files_struct
106 ext2_free_inode
105 pid_alive
102 alloc_pidmap
101 try_to_unmap_one
100 sys_read
100 find_lock_page
99 flush_old_exec
97 profile_exec_unmap
97 generic_file_llseek
96 set_fs_pwd
95 locks_remove_posix
94 kmem_cache_alloc
92 mm_alloc
92 get_signal_to_deliver
89 proc_lookup
89 inode_update_time
86 wake_up_inode
85 getname
85 .text.lock.readahead
82 wait_task_zombie
79 vma_merge
79 search_binary_handler
79 inode_init_once
78 __vma_link
77 permission
76 unlock_buffer
76 generic_file_mmap
76 find_vma_prev
75 sys_newuname
75 setup_arg_pages
73 get_offset_pit
73 ext2_release_inode
73 cap_vm_enough_memory
72 d_rehash
72 .text.lock.namei
71 generic_commit_write
70 __copy_user_zeroing_intel
68 kpmd_ctor
67 create_empty_buffers
66 mark_buffer_dirty
66 inode_sub_bytes
65 vfs_readdir
65 sys_brk
65 load_elf_interp
64 sched_clock
63 copy_namespace
62 show_stat
62 lru_cache_add
61 unmap_vma
61 proc_pid_lookup
61 old_mmap
61 eligible_child
60 find_trylock_page
60 ext2_free_branches
60 chown_common
59 do_munmap
58 prep_new_page
58 add_to_page_cache
57 ret_from_intr
56 __remove_from_page_cache
55 prepare_binprm
54 inode_has_buffers
53 drop_buffers
53 do_brk
53 __put_task_struct
52 wake_up_forked_process
51 pgd_alloc
50 find_group_orlov
48 error_code
48 do_gettimeofday
48 __vma_link_rb
46 zap_pmd_range
46 sched_fork
46 pipe_aio_readv
46 open_exec
46 ext2_get_page
46 ext2_alloc_branch
46 __get_page_state
46 .text.lock.generic
45 try_to_wake_up
45 task_vsize
45 create_elf_tables
45 .text.lock.fs_writeback
45 .text.lock.balloc
44 sys_utime
44 profile_exit_task
44 mmput
44 get_unmapped_area
44 exit_rmap
44 __clear_page_buffers
43 pipe_aio_writev
43 filldir64
43 .text.lock.fork
42 unmap_page_range
42 proc_pid_unhash
42 page_waitqueue
42 __user_walk
42 __set_page_dirty_nobuffers
41 sys_open
41 direct_clear_user
41 .text.lock.ioctl
40 unmap_region
40 mm_init
39 sys_chmod
38 sys_ioctl
38 free_percpu
38 filp_open
38 complete
38 clear_inode
38 __rb_rotate_left
37 truncate_complete_page
37 get_jiffies_64
37 eventpoll_release_file
37 __sync_single_inode
37 .text.lock.swap
36 setup_sigcontext
36 proc_pid_readdir
36 destroy_inode
36 cached_lookup
35 ext2_alloc_block
35 __rb_erase_color
33 proc_pid_make_inode
33 exit_aio
33 dup_rmap
33 __generic_file_write_nolock
32 proc_lookupfd
32 find_pid
32 .text.lock.root
31 sys_write
31 skip_atoi
31 radix_tree_insert
31 mm_release
31 ext2_create
31 do_fork
31 default_wake_function
31 cache_grow
31 __get_free_pages
30 do_group_exit
30 d_free
29 wake_up_buffer
29 vfs_follow_link
29 ext2_count_free_blocks
29 count_open_files
29 block_prepare_write
28 sys_rt_sigprocmask
28 sys_mmap2
28 rb_erase
28 notify_change
28 elf_map
28 d_invalidate
27 remove_suid
27 radix_tree_preload
27 __do_softirq
26 copy_thread
26 add_wait_queue
26 __rb_rotate_right
25 unshare_files
25 setup_frame
25 radix_tree_delete
25 proc_root_lookup
25 proc_readfd
25 proc_pident_lookup
25 lru_add_drain
25 get_write_access
25 ext2_empty_dir
24 inode_change_ok
24 __pagevec_free
23 sys_rt_sigaction
22 vfs_stat
22 test_clear_page_dirty
22 kmap_atomic_to_page
22 inode_setattr
22 inode_add_bytes
22 flush_tlb_others
22 do_pipe
22 compute_creds
22 __lookup_hash
22 .text.lock.dnotify
21 task_nice
21 reserve_blocks
21 read_cache_page
21 __kmalloc
20 scsi_request_fn
20 pipe_wait
20 mpage_writepage
20 ext2_group_sparse
20 ext2_get_branch
20 can_share_swap_page
20 bh_lru_install
20 __getblk
20 .text.lock.ialloc
19 try_hugetlb_get_unmapped_area
19 sys_stat64
19 ll_rw_block
19 chrdev_open
19 balance_dirty_pages_ratelimited
19 bad_page
19 __make_request
18 sys_llseek
18 set_bh_page
18 get_zone_counts
18 follow_down
18 flush_thread
18 cap_bprm_compute_creds
18 can_vma_merge_after
17 write_inode
17 sys_access
17 sched_balance_exec
17 pid_delete_dentry
17 fasync_helper
17 ext2_check_page
17 end_page_writeback
17 d_unhash
17 cpu_idle
16 vsprintf
16 scsi_end_request
16 recalc_bh_state
16 next_thread
16 init_new_context
16 flush_all_zero_pkmaps
16 ext2_prepare_write
16 __bread
15 vfs_create
15 sys_dup2
15 put_dirty_page
15 pid_base_iput
15 nr_blockdev_pages
15 ext2_lookup
15 ext2_delete_inode
15 __page_cache_release
14 generic_forget_inode
14 ext2_setattr
14 eventpoll_init_file
13 sys_set_thread_area
13 sync_sb_inodes
13 proc_root_readdir
13 kunmap
13 inode_needs_sync
13 free_pgtables
13 expand_stack
13 __get_user_4
12 sys_munmap
12 sys_lstat64
12 sprintf
12 remove_from_page_cache
12 posix_block_lock
12 memcpy
12 invalidate_inode_buffers
12 free_task
12 fcntl_dirnotify
12 do_signal
12 do_execve
12 can_vma_merge_before
12 __set_page_buffers
12 __insert_vm_struct
11 setattr_mask
11 save_i387
11 prepare_to_wait
11 mpage_writepages
11 free_pages
11 ext2_unlink
11 convert_fxsr_to_user
11 alloc_buffer_head
10 vfs_rmdir
10 sys_mkdir
10 sys_fstat64
10 sys_execve
10 kfree
10 groups_search
10 expand_fd_array
10 exit_itimers
10 detach_vmas_to_be_unmapped
9 vfs_lstat
9 release_blocks
9 put_filp
9 mempool_alloc
9 is_bad_inode
9 ext2_set_inode_flags
9 destroy_context
9 .text.lock.commoncap
8 vfs_fstat
8 syscall_call
8 sys_time
8 sys_readlink
8 resume_userspace
8 pgd_free
8 get_vmalloc_info
8 get_new_inode_fast
8 ext2_put_inode
8 ext2_last_byte
8 ext2_find_near
8 count
8 cache_init_objs
8 block_truncate_page
8 block_commit_write
8 __mmdrop
8 __iget
8 __down_failed_interruptible
7 write_profile
7 pipe_new
7 pagevec_lookup
7 kill_fasync
7 get_pipe_inode
7 finish_wait
7 ext2_release_file
7 ext2_alloc_inode
7 do_proc_readlink
7 do_mpage_readpage
7 check_tty_count
7 bad_get_user
7 autoremove_wake_function
7 .text.lock.locks
6 unmap_vma_list
6 unmap_underlying_metadata
6 unix_create1
6 scsi_dispatch_cmd
6 release_x86_irqs
6 radix_tree_gang_lookup
6 pipe_release
6 page_slot
6 kmap
6 init_fpu
6 init_buffer_head
6 group_send_sig_info
6 free_buffer_head
6 ext2_make_empty
6 dget_locked
6 __posix_lock_file
6 .text.lock.exec
6 .text.lock.char_dev
6 .text.lock.buffer
5 try_to_release_page
5 sys_sigreturn
5 si_swapinfo
5 rwsem_wake
5 rwsem_down_read_failed
5 restore_sigcontext
5 restore_all
5 put_unused_fd
5 pte_alloc_kernel
5 insert_vm_struct
5 iget_locked
5 filemap_getpage
5 ext2_statfs
5 exit_sem
5 do_sync_write
5 do_fcntl
5 de_put
5 cdev_get
5 bio_alloc
5 __pmd_alloc
5 __block_write_full_page
5 .text.lock.tty_io
4 writeback_inodes
4 up_tty_sem
4 sys_getdents64
4 sys_chown
4 sock_alloc
4 smp_call_function
4 slab_destroy
4 set_close_on_exec
4 send_IPI_mask_sequence
4 schedule_tail
4 proc_get_inode
4 proc_alloc_inode
4 pipe_write_fasync
4 path_walk
4 padzero
4 nr_free_pages
4 lock_rename
4 kobject_get
4 generic_drop_inode
4 free_hot_page
4 do_invalidatepage
4 __pagevec_release
4 __mod_timer
3 work_resched
3 tty_open
3 sys_setpgid
3 sys_getcwd
3 sys_fcntl64
3 sock_map_fd
3 sock_create
3 set_brk
3 remove_inode_buffers
3 proc_file_read
3 proc_destroy_inode
3 nr_iowait
3 notifier_call_chain
3 name_to_int
3 locate_fd
3 kernel_read
3 get_request
3 get_node
3 get_free_idx
3 find_or_create_page
3 fcntl_setlk
3 ext2_writepages
3 ext2_mkdir
3 ext2_ioctl
3 ext2_destroy_inode
3 exec_rmap
3 del_timer
3 d_alloc_root
3 copy_semundo
3 check_mnt
3 bounce_copy_vec
3 block_read_full_page
3 background_writeout
3 __put_ioctx
2 writeback_acquire
2 wake_up_process
2 wait_for_completion
2 vsscanf
2 vfs_statfs
2 vfs_mkdir
2 unix_release_sock
2 sys_waitpid
2 sys_vhangup
2 sys_setrlimit
2 sys_getrlimit
2 sys_getpid
2 sys_creat
2 sys_chdir
2 steal_locks
2 sk_alloc
2 scsi_single_lun_run
2 restore_fpu
2 remove_exclusive_swap_page
2 release_thread
2 release_dev
2 rb_first
2 radix_tree_extend
2 pty_open
2 proc_tgid_base_lookup
2 proc_permission
2 kobject_put
2 i_waitq_head
2 handle_signal
2 handle_ra_miss
2 grow_dev_page
2 generic_make_request
2 free_uid
2 find_inode_fast
2 file_ioctl
2 ext2_set_link
2 ext2_rmdir
2 ext2_follow_link
2 ext2_count_free_inodes
2 ext2_bg_num_gdb
2 expand_files
2 exit_thread
2 exit_fs
2 down_tty_sem
2 do_writepages
2 do_flush_tlb_all
2 dispose_list
2 d_move
2 copy_strings_kernel
2 check_ttfb_buffer
2 bounce_end_io
2 as_set_request
2 activate_page
2 __up
2 __rmqueue
2 __cond_resched
2 __breadahead
2 .text.lock.open
2 .text.lock.array
1 wait_on_page_bit_wq
1 vscnprintf
1 vfs_statfs_native
1 unix_stream_connect
1 unix_sock_destructor
1 task_rq_lock
1 task_prio
1 sys_statfs
1 sys_socketcall
1 sys_set_tid_address
1 sys_rmdir
1 sys_gettimeofday
1 sys_getppid
1 sys_fchdir
1 sys_exit_group
1 sys_dup
1 sys_clone
1 sock_init_data
1 sock_fasync
1 shrink_dcache_parent
1 show_tty_driver
1 set_binfmt
1 seq_read
1 seq_printf
1 scsi_put_command
1 scsi_io_completion
1 save_i387_fxsave
1 remove_wait_queue
1 read_pages
1 radix_tree_node_alloc
1 put_io_context
1 put_fs_struct
1 proc_readdir
1 proc_read_inode
1 pipe_write
1 pipe_read
1 nr_running
1 mempool_free
1 memory_open
1 meminfo_read_proc
1 may_ptrace_attach
1 math_state_restore
1 lookup_hash
1 lookup_create
1 locks_wake_up_blocks
1 ksoftirqd
1 invalidate_mmap_range
1 invalidate_complete_page
1 init_special_inode
1 init_dev
1 getrusage
1 flock_to_posix_lock
1 ext2_nobh_prepare_write
1 ext2_mknod
1 ext2_get_parent
1 ext2_bg_has_super
1 exit_files
1 end_buffer_read_sync
1 end_buffer_read_nobh
1 dupfd
1 do_setitimer
1 do_getitimer
1 do_file_page
1 device_not_available
1 d_genocide
1 chroot_fs_refs
1 cap_bprm_set_security
1 cap_bprm_secureexec
1 bmap
1 bio_put
1 bh_waitq_head
1 alloc_skb
1 add_to_page_cache_lru
1 __end_that_request_first
1 __down_failed
1 __bforget
1 .text.lock.time
1 .text.lock.mmap
1 .text.lock.exit
0 zap_page_range
0 yield
0 writeback_in_progress
0 wb_kupdate
0 vmtruncate
0 vfs_rename_other
0 vfs_rename
0 vfs_link
0 uptime_read_proc
0 unlock_rename
0 unix_stream_recvmsg
0 unix_poll
0 unix_mkname
0 unix_find_other
0 tty_write
0 tty_release
0 tty_ioctl
0 tty_fasync
0 t_next
0 sys_vfork
0 sys_umask
0 sys_times
0 sys_stime
0 sys_socket
0 sys_sethostname
0 sys_pread64
0 sys_prctl
0 sys_pipe
0 sys_old_getrlimit
0 sys_mprotect
0 sys_getrusage
0 sys_getpgrp
0 sys_getpgid
0 sys_geteuid
0 sys_fcntl
0 sys_connect
0 sys_clock_gettime
0 sys_alarm
0 sync_dirty_buffer
0 submit_bio
0 submit_bh
0 sockfd_lookup
0 sock_wmalloc
0 sock_wfree
0 sock_release
0 sock_destroy_inode
0 sock_close
0 sock_alloc_inode
0 skb_release_data
0 sk_free
0 single_open
0 show_vfsmnt
0 show_tty_range
0 setup_rt_frame
0 set_current_groups
0 seq_open
0 seq_escape
0 sd_rw_intr
0 scsi_softirq
0 scsi_init_cmd_errh
0 scsi_free_sgtable
0 scsi_finish_command
0 scsi_decide_disposition
0 scsi_add_timer
0 schedule_timeout
0 rwsem_down_write_failed
0 run_timer_softirq
0 ret_from_fork
0 restore_i387_fxsave
0 restore_i387
0 remove_inode_hash
0 remove_arg_zero
0 remote_llseek
0 release_sock
0 register_reboot_notifier
0 rcu_process_callbacks
0 rcu_check_quiescent_state
0 pty_unthrottle
0 pty_close
0 process_backlog
0 proc_self_follow_link
0 proc_pid_statm
0 proc_pid_flush
0 proc_file_lseek
0 proc_exe_link
0 proc_calc_metrics
0 prepare_to_wait_exclusive
0 prepare_to_copy
0 pmd_ctor
0 pipefs_delete_dentry
0 pipe_write_release
0 pipe_read_release
0 pipe_read_fasync
0 pagevec_strip
0 page_pool_free
0 page_pool_alloc
0 osync_buffers_list
0 operate_on_page_range
0 open_private_file
0 nr_free_highpages
0 netif_rx
0 mwait_idle
0 mprotect_fixup
0 mpage_readpages
0 mpage_end_io_write
0 mpage_alloc
0 move_addr_to_kernel
0 mmap_hugetlb_implicit
0 migration_thread
0 memset
0 mempool_alloc_slab
0 mark_offset_tsc
0 mark_buffer_dirty_inode
0 maps_open
0 lookup_swap_cache
0 lookup_one_len
0 locks_insert_lock
0 locks_delete_lock
0 locks_copy_lock
0 locks_alloc_lock
0 lock_sock
0 local_bh_enable
0 load_script
0 kmem_flagcheck
0 kfree_skbmem
0 ip_route_input_slow
0 io_schedule_timeout
0 invalidate_mmap_range_list
0 invalidate_bh_lru
0 intr_handler
0 interruptible_sleep_on
0 inode_get_bytes
0 init_page_buffers
0 init_once
0 in_egroup_p
0 idle_cpu
0 handle_IRQ_event
0 grab_cache_page_nowait
0 get_page_state
0 get_io_context
0 get_dirty_limits
0 generic_file_aio_write_nolock
0 fs_may_remount_ro
0 free_fd_array
0 free_cold_page
0 free_anonmm
0 follow_up
0 find_task_by_pid
0 filp_ctor
0 file_send_actor
0 ext3_count_free_blocks
0 ext2_write_inode
0 ext2_rename
0 ext2_dotdot
0 end_buffer_async_write
0 double_lock_balance
0 do_vm86_irq_handling
0 do_truncate
0 do_softirq
0 do_sigaltstack
0 do_proc_dointvec_conv
0 do_proc_dointvec
0 do_posix_gettime
0 do_posix_clock_monotonic_gettime_parts
0 do_notify_resume
0 devpts_get_tty
0 copy_io_context
0 convert_fxsr_from_user
0 check_kill_permission
0 change_protection
0 cascade
0 cap_inode_setxattr
0 buffer_insert_list
0 bounce_end_io_write
0 block_sync_page
0 blk_run_queues
0 blk_recount_segments
0 blk_queue_bounce
0 blk_congestion_wait
0 bio_get_nr_vecs
0 bio_endio
0 bio_destructor
0 balance_dirty_pages
0 bad_follow_link
0 arp_process
0 alloc_uid
0 alloc_fd_array
0 add_wait_queue_exclusive
0 add_disk_randomness
0 __writeback_single_inode
0 __write_lock_failed
0 __wake_up_sync
0 __wait_on_buffer
0 __up_wakeup
0 __unix_remove_socket
0 __unix_insert_socket
0 __lock_page_wq
0 __kfree_skb
0 __getblk_slow
0 __bio_add_page
0 .text.lock.timer_pit
0 .text.lock.smp
0 .text.lock.signal
0 .text.lock.readdir
0 .text.lock.page_writeback
0 .text.lock.fcntl
0 .text.lock.block_dev
0 .text.lock.binfmt_elf

[-- Attachment #3: mjb1-prio --]
[-- Type: application/octet-stream, Size: 17871 bytes --]

901551 total
534689 default_idle
49715 __down
22305 copy_page_range
16684 zap_pte_range
16014 do_wp_page
14300 __wake_up
14120 finish_task_switch
10865 find_get_page
10741 page_remove_rmap
10175 __d_lookup
8971 release_pages
7559 __copy_to_user_ll
6609 do_anonymous_page
5477 do_no_page
5428 copy_mm
4940 atomic_dec_and_lock
4887 clear_page_tables
4886 path_lookup
4510 do_page_fault
4404 remove_shared_vm_struct
3789 .text.lock.filemap
3509 pte_alloc_one
3303 __copy_user_intel
3160 free_pages_and_swap_cache
2988 copy_process
2620 __block_prepare_write
2533 filemap_nopage
2319 buffered_rmqueue
2264 free_hot_cold_page
2206 link_path_walk
2042 release_task
1844 .text.lock.dec_and_lock
1820 file_move
1715 path_release
1651 kmem_cache_free
1624 __find_get_block
1573 ext2_new_inode
1555 page_add_obj_rmap
1554 proc_pid_stat
1516 page_address
1516 follow_mount
1495 exit_notify
1417 current_kernel_time
1347 number
1303 __fput
1276 task_mem
1266 .text.lock.highmem
1236 __brelse
1216 __read_lock_failed
1199 vma_link
1198 generic_file_open
1165 __copy_from_user_ll
1115 kmap_atomic
1100 system_call
1089 fput
1081 do_generic_mapping_read
1053 find_vma
1046 kmap_high
1037 .text.lock.dcache
1031 file_kill
1023 alloc_inode
996 __mark_inode_dirty
989 do_mmap_pgoff
988 d_alloc
980 .text.lock.file_table
972 lookup_mnt
949 handle_mm_fault
948 set_page_dirty
888 vsnprintf
824 dnotify_parent
817 grab_block
815 new_inode
790 split_vma
786 generic_fillattr
777 __vma_prio_tree_remove
775 dput
761 update_atime
730 ext2_update_inode
707 flush_signal_handlers
677 sched_clock
666 pte_alloc_map
661 proc_pid_status
661 __find_get_block_slow
649 schedule
643 set_page_address
641 __vma_prio_tree_insert
630 block_invalidatepage
619 radix_tree_lookup
614 del_timer_sync
610 generic_file_aio_write_nolock
585 prio_tree_insert
566 vfs_read
562 copy_files
548 mmgrab
543 kunmap_high
543 dentry_open
533 fd_install
532 proc_root_link
526 exit_mmap
522 ext2_new_block
511 generic_delete_inode
494 do_page_cache_readahead
485 get_tgid_list
474 render_sigset_t
468 dup_task_struct
467 mark_page_accessed
465 __generic_file_aio_read
460 d_instantiate
460 __blk_queue_bounce
431 rb_insert_color
428 __alloc_pages
427 deny_write_access
423 prune_dcache
414 proc_check_root
412 read_block_bitmap
410 pid_revalidate
407 kmem_ptr_validate
404 find_vma_prepare
401 page_add_anon_rmap
400 filp_close
396 flush_tlb_page
378 may_open
371 vfs_unlink
369 direct_strnlen_user
365 do_sigaction
350 get_empty_filp
349 exec_mmap
348 __pagevec_lru_add_active
343 file_ra_state_init
338 ext2_find_entry
334 real_lookup
333 find_get_pages
329 sys_close
323 unlock_page
318 truncate_inode_pages
313 unmap_vmas
311 copy_strings
305 ext2_add_link
304 ext2_free_blocks
300 select_parent
297 do_exit
292 load_elf_binary
291 dnotify_flush
284 sigprocmask
282 ext2_get_group_desc
271 create_buffers
270 d_path
269 task_dumpable
268 .text.lock.inode
263 ext2_preread_inode
259 ext2_get_inode
255 ext2_get_block
250 sys_wait4
247 find_group_other
246 group_release_blocks
241 group_reserve_blocks
237 syscall_exit
233 kunmap_atomic
233 direct_strncpy_from_user
232 try_to_wake_up
232 get_unused_fd
231 d_delete
228 proc_fd_link
225 open_namei
222 put_files_struct
222 fget
220 page_update_anon_rmap
218 __insert_inode_hash
217 __do_softirq
217 .text.lock.base
215 vfs_getattr
213 default_wake_function
211 try_to_free_buffers
207 old_mmap
204 call_rcu
197 exit_rmap
195 profile_exit_mmap
195 lru_cache_add_active
194 ext2_discard_prealloc
194 __vma_link
193 ext2_truncate
192 vfs_write
192 file_read_actor
187 tid_fd_revalidate
187 page_cache_readahead
187 fget_light
185 do_lookup
183 flush_old_exec
182 get_wchan
182 generic_file_write
181 in_group_p
177 sys_unlink
174 locks_remove_flock
170 iput
170 do_munmap
169 flush_tlb_mm
166 find_vma_prev
165 pid_alive
165 __pagevec_lru_add
164 __block_commit_write
163 ext2_commit_chunk
163 bad_range
160 mm_alloc
157 is_subdir
157 __vma_link_rb
153 d_lookup
152 vm_acct_memory
151 percpu_counter_mod
151 ext2_readdir
148 locks_remove_posix
147 __lookup
143 alloc_pidmap
141 unmap_vma
141 reap_timer_fnc
139 get_signal_to_deliver
137 proc_delete_inode
134 ext2_block_to_path
133 rcu_do_batch
133 proc_pid_readlink
133 pgd_alloc
132 proc_lookup
129 __free_pages
128 setup_arg_pages
128 __insert_vm_struct
126 profile_exec_unmap
125 read_inode_bitmap
123 generic_file_mmap
123 __d_path
122 ext2_delete_entry
121 wait_task_zombie
114 cap_vm_enough_memory
113 proc_info_read
113 generic_file_read
112 vfs_permission
111 find_lock_page
104 cp_new_stat64
103 try_to_unmap_one
102 kmem_cache_alloc
100 generic_file_llseek
100 ext2_free_inode
99 wake_up_forked_process
98 unlock_buffer
98 inode_times_differ
97 getname
93 .text.lock.namespace
91 eligible_child
89 sys_read
89 search_binary_handler
89 inode_sub_bytes
88 inode_update_time
87 cpu_idle
86 get_offset_pit
86 copy_namespace
85 vfs_readdir
85 unmap_region
85 __rb_rotate_left
84 ext2_inode_by_name
83 ext2_free_branches
82 inode_init_once
81 mmput
80 vma_merge
80 permission
78 set_fs_pwd
78 create_elf_tables
75 truncate_complete_page
75 proc_pid_lookup
74 sys_newuname
74 load_elf_interp
74 __copy_user_zeroing_intel
73 pipe_writev
73 pipe_readv
71 sched_fork
71 do_brk
70 sys_brk
70 eventpoll_release_file
70 create_empty_buffers
69 add_to_page_cache
69 __put_task_struct
68 __remove_from_page_cache
67 inode_has_buffers
67 generic_commit_write
67 __rb_erase_color
66 setup_sigcontext
65 show_stat
65 prep_new_page
65 drop_buffers
65 copy_thread
64 mm_init
62 prepare_binprm
62 exit_aio
62 do_group_exit
61 dup_rmap
60 wake_up_inode
60 __rb_rotate_right
59 kpmd_ctor
58 __clear_page_buffers
57 profile_exit_task
57 mark_buffer_dirty
56 do_fork
56 can_vma_merge_after
56 add_wait_queue
55 .text.lock.fork
54 rb_erase
54 d_rehash
53 page_waitqueue
53 lru_add_drain
53 flush_tlb_others
53 ext2_release_inode
52 ret_from_intr
52 proc_pid_make_inode
52 ext2_get_page
51 flush_thread
51 find_group_orlov
50 get_unmapped_area
50 get_jiffies_64
50 find_trylock_page
50 do_gettimeofday
49 find_pid
49 complete
49 __set_page_dirty_nobuffers
49 .text.lock.namei
48 proc_pid_readdir
48 filldir64
47 __get_page_state
46 try_hugetlb_get_unmapped_area
46 sys_ioctl
46 mm_release
46 lru_cache_add
46 ext2_count_free_blocks
46 __sync_single_inode
45 ext2_alloc_branch
45 ext2_alloc_block
45 count_open_files
45 can_vma_merge_before
45 .text.lock.readahead
44 proc_readfd
44 filp_open
44 error_code
43 setup_frame
43 d_free
43 cap_bprm_compute_creds
43 bad_page
43 __page_cache_release
43 __down_failed_interruptible
42 sys_set_thread_area
42 proc_pid_unhash
42 free_percpu
42 ext2_empty_dir
41 direct_clear_user
40 zap_pmd_range
40 chown_common
39 sys_mmap2
39 sched_balance_exec
39 destroy_context
39 __user_walk
38 unshare_files
38 unmap_page_range
38 sys_open
38 open_exec
37 compute_creds
37 cached_lookup
37 .text.lock.balloc
36 rwsem_wake
36 radix_tree_insert
36 proc_root_lookup
36 .text.lock.generic
36 .text.lock.fs_writeback
35 task_vsize
35 destroy_inode
35 clear_inode
34 sys_utime
34 scsi_request_fn
34 radix_tree_preload
34 next_thread
34 do_execve
33 inode_add_bytes
33 get_write_access
32 elf_map
32 cache_grow
31 wake_up_buffer
31 remove_suid
31 put_dirty_page
31 ext2_lookup
31 __make_request
31 .text.lock.mmap
30 proc_lookupfd
30 __get_free_pages
29 vfs_follow_link
29 sys_access
29 block_prepare_write
28 skip_atoi
28 proc_pident_lookup
28 exit_itimers
27 rwsem_down_read_failed
27 prio_tree_remove
27 __kmalloc
26 work_resched
26 sys_write
26 sys_chmod
26 pgd_free
26 notify_change
26 inode_setattr
26 .text.lock.ialloc
25 test_clear_page_dirty
25 sys_dup2
25 memcpy
25 ext2_create
25 exit_sem
25 __lookup_hash
24 sys_rt_sigaction
24 inode_change_ok
24 ext2_group_sparse
24 .text.lock.dnotify
23 vfs_stat
23 sys_rt_sigprocmask
23 ext2_get_branch
23 __getblk
22 read_cache_page
22 radix_tree_delete
22 mpage_writepage
22 generic_file_write_nolock
22 fasync_helper
22 can_share_swap_page
21 vfs_rmdir
21 kmap_atomic_to_page
21 bh_lru_install
20 reserve_blocks
20 invalidate_inode_buffers
20 ext2_prepare_write
20 do_pipe
20 __pagevec_free
19 vfs_create
19 sys_llseek
19 init_new_context
19 end_page_writeback
19 d_invalidate
18 recalc_bh_state
18 pid_delete_dentry
18 pid_base_iput
18 get_zone_counts
18 free_pgtables
18 follow_down
18 expand_stack
18 chrdev_open
17 write_inode
17 __set_page_buffers
16 sys_stat64
16 set_bh_page
16 save_i387
16 ll_rw_block
16 generic_forget_inode
16 free_task
16 flush_all_zero_pkmaps
16 ext2_check_page
16 balance_dirty_pages_ratelimited
16 bad_get_user
16 alloc_buffer_head
15 scsi_end_request
15 ext2_delete_inode
15 convert_fxsr_to_user
15 __get_user_4
14 write_profile
14 sys_readlink
14 sys_munmap
14 smp_call_function
14 init_fpu
14 expand_fd_array
14 eventpoll_init_file
14 do_signal
14 .text.lock.ioctl
13 proc_root_readdir
13 kunmap
13 free_pages
13 finish_wait
13 ext2_setattr
13 __bread
12 vsprintf
12 sync_sb_inodes
12 steal_locks
12 run_timer_softirq
12 prepare_to_wait
12 pipe_wait
12 insert_vm_struct
12 detach_vmas_to_be_unmapped
12 d_alloc_root
11 setattr_mask
11 remove_from_page_cache
11 page_slot
11 kmap
11 kfree
11 is_bad_inode
11 ext2_unlink
10 pipe_release
10 nr_blockdev_pages
10 kill_fasync
10 groups_search
10 ext2_release_file
10 ext2_find_near
10 bio_alloc
10 .text.lock.commoncap
9 sys_mkdir
9 sys_lstat64
9 sys_execve
9 posix_block_lock
9 mpage_writepages
9 free_buffer_head
9 ext2_set_inode_flags
9 ext2_put_inode
9 ext2_alloc_inode
9 dget_locked
9 d_unhash
9 __mmdrop
8 vfs_fstat
8 try_to_release_page
8 sys_sigreturn
8 sys_fstat64
8 sprintf
8 resume_userspace
8 restore_all
8 release_x86_irqs
8 put_filp
8 padzero
8 inode_needs_sync
8 do_mpage_readpage
8 block_truncate_page
8 .text.lock.root
7 wait_for_completion
7 unmap_vma_list
7 unmap_underlying_metadata
7 syscall_call
7 sys_getdents64
7 sys_chown
7 restore_fpu
7 prepare_to_wait_exclusive
7 pagevec_lookup
7 init_buffer_head
7 group_send_sig_info
7 get_vmalloc_info
7 get_pipe_inode
7 ext2_last_byte
7 do_sync_write
7 count
7 cache_init_objs
7 __cond_resched
7 .text.lock.swap
7 .text.lock.array
6 vfs_lstat
6 sys_prctl
6 slab_destroy
6 scsi_dispatch_cmd
6 rwsem_down_write_failed
6 release_blocks
6 mempool_alloc
6 lock_rename
6 kernel_read
6 get_new_inode_fast
6 block_commit_write
6 __posix_lock_file
6 __iget
6 __down_failed
6 __block_write_full_page
5 writeback_inodes
5 up_tty_sem
5 unix_create1
5 sys_time
5 sock_map_fd
5 si_swapinfo
5 schedule_tail
5 restore_sigcontext
5 rcu_check_quiescent_state
5 radix_tree_gang_lookup
5 put_unused_fd
5 pte_alloc_kernel
5 proc_get_inode
5 proc_alloc_inode
5 pipe_new
5 nr_iowait
5 generic_drop_inode
5 free_hot_page
5 filemap_getpage
5 ext2_mkdir
5 ext2_make_empty
5 ext2_destroy_inode
5 do_proc_readlink
5 do_fcntl
5 del_timer
5 check_tty_count
5 __put_ioctx
5 __pmd_alloc
5 .text.lock.exec
5 .text.lock.buffer
4 sys_fcntl64
4 sys_chdir
4 proc_tgid_base_lookup
4 pipe_write_fasync
4 pipe_read_fasync
4 path_walk
4 kobject_get
4 iget_locked
4 handle_signal
4 get_node
4 fcntl_dirnotify
4 exec_rmap
4 de_put
4 check_mnt
4 cdev_get
4 bounce_end_io
4 block_read_full_page
4 background_writeout
4 .text.lock.open
4 .text.lock.locks
3 vfs_mkdir
3 sys_exit_group
3 sock_create
3 sock_alloc
3 save_i387_fxsave
3 rt_run_flush
3 put_fs_struct
3 proc_file_read
3 proc_destroy_inode
3 notifier_call_chain
3 name_to_int
3 kobject_put
3 grow_dev_page
3 find_or_create_page
3 find_inode_fast
3 ext2_writepages
3 ext2_statfs
3 ext2_rmdir
3 ext2_follow_link
3 ext2_count_free_inodes
3 ext2_bg_has_super
3 d_move
3 __write_lock_failed
3 __rmqueue
3 .text.lock.exit
2 wake_up_process
2 wait_on_page_bit
2 vsscanf
2 vfs_statfs_native
2 vfs_statfs
2 task_rq_lock
2 task_nice
2 sys_waitpid
2 sys_vhangup
2 sys_vfork
2 sys_setrlimit
2 sys_rmdir
2 sys_getrlimit
2 sys_getcwd
2 sys_fchdir
2 sys_creat
2 sys_clone
2 sk_alloc
2 set_close_on_exec
2 set_brk
2 set_binfmt
2 send_IPI_mask_sequence
2 scsi_single_lun_run
2 remove_wait_queue
2 remove_inode_buffers
2 release_thread
2 release_dev
2 rb_first
2 radix_tree_node_alloc
2 radix_tree_extend
2 proc_read_inode
2 proc_permission
2 nr_free_pages
2 mempool_free
2 lookup_create
2 locate_fd
2 invalidate_mmap_range
2 invalidate_complete_page
2 invalidate_bh_lru
2 i_waitq_head
2 handle_ra_miss
2 getrusage
2 get_request
2 get_free_idx
2 file_ioctl
2 fcntl_setlk
2 ext2_set_link
2 ext2_get_parent
2 ext2_bg_num_gdb
2 exit_thread
2 exit_fs
2 do_truncate
2 do_invalidatepage
2 do_flush_tlb_all
2 dispose_list
2 copy_strings_kernel
2 copy_semundo
2 cap_bprm_set_security
2 bounce_copy_vec
2 bmap
2 bh_waitq_head
2 as_set_request
2 __up_wakeup
2 __pagevec_release
2 __mod_timer
2 __breadahead
2 .text.lock.char_dev
1 writeback_acquire
1 unlock_rename
1 unix_release_sock
1 tty_open
1 tty_fasync
1 task_prio
1 sys_statfs
1 sys_setpgid
1 sys_gettimeofday
1 sys_getrusage
1 sys_getppid
1 sys_getpid
1 sys_fcntl
1 submit_bio
1 sock_init_data
1 scsi_run_queue
1 scsi_put_command
1 scsi_init_cmd_errh
1 scsi_finish_command
1 schedule_timeout
1 remove_exclusive_swap_page
1 read_zero
1 rcu_process_callbacks
1 proc_readdir
1 proc_pid_flush
1 prio_tree_expand
1 prepare_to_copy
1 pipe_write
1 open_private_file
1 nr_running
1 memory_open
1 meminfo_read_proc
1 math_state_restore
1 lookup_hash
1 locks_init_lock
1 local_bh_enable
1 kmem_flagcheck
1 inode_get_bytes
1 init_dev
1 grab_cache_page_nowait
1 get_io_context
1 generic_make_request
1 free_uid
1 follow_up
1 flock_to_posix_lock
1 ext2_nobh_prepare_write
1 ext2_ioctl
1 expand_files
1 dupfd
1 down_tty_sem
1 do_writepages
1 do_sigaltstack
1 do_setitimer
1 do_getitimer
1 convert_fxsr_from_user
1 chroot_fs_refs
1 check_ttfb_buffer
1 change_protection
1 buffer_insert_list
1 blk_run_queues
1 bio_endio
1 bad_follow_link
1 alloc_skb
1 add_disk_randomness
1 activate_page
1 __up
1 __getblk_slow
1 __end_that_request_first
1 __bforget
1 .text.lock.tty_io
1 .text.lock.task_mmu
1 .text.lock.sys_i386
1 .text.lock.page_writeback
0 zap_page_range
0 yield
0 writeback_release
0 writeback_in_progress
0 wb_kupdate
0 vscnprintf
0 vmtruncate
0 vfs_symlink
0 vfs_rename_other
0 vfs_rename
0 vfs_mknod
0 uptime_read_proc
0 unlock_new_inode
0 unix_stream_recvmsg
0 unix_stream_connect
0 unix_sock_destructor
0 unix_mkname
0 unix_find_other
0 unix_create
0 udp_rcv
0 tty_release
0 tty_ioctl
0 tty_drivers_open
0 test_perm
0 tcp_transmit_skb
0 tasklet_action
0 t_start
0 t_next
0 sys_umask
0 sys_times
0 sys_stime
0 sys_socketcall
0 sys_set_tid_address
0 sys_select
0 sys_rt_sigreturn
0 sys_rename
0 sys_pread64
0 sys_pipe
0 sys_pause
0 sys_old_getrlimit
0 sys_kill
0 sys_getpgrp
0 sys_geteuid
0 sys_dup
0 sys_connect
0 sys_clock_gettime
0 sys_alarm
0 sync_dirty_buffer
0 submit_bh
0 stat_open
0 sock_wmalloc
0 sock_release
0 sock_poll
0 sock_fasync
0 sock_alloc_inode
0 skb_release_data
0 single_open
0 si_meminfo
0 shrink_dcache_parent
0 show_tty_range
0 show_tty_driver
0 setfl
0 seq_read
0 seq_printf
0 seq_open
0 send_sigio_to_task
0 sd_rw_intr
0 scsi_softirq
0 scsi_next_command
0 scsi_io_completion
0 scsi_decide_disposition
0 scsi_add_timer
0 run_local_timers
0 rt_set_nexthop
0 ret_from_fork
0 restore_i387_fxsave
0 restore_i387
0 remove_inode_hash
0 remove_arg_zero
0 remote_llseek
0 release_sock
0 register_reboot_notifier
0 read_cache_pages
0 raise_softirq
0 put_io_context
0 put_device
0 pty_unthrottle
0 pty_open
0 pty_close
0 profile_event_register
0 proc_self_follow_link
0 proc_readsys
0 proc_opensys
0 proc_file_lseek
0 proc_dointvec
0 proc_calc_metrics
0 prio_tree_first
0 pmd_ctor
0 pipefs_delete_dentry
0 pipe_write_release
0 pipe_read_release
0 pipe_read
0 pagevec_strip
0 page_pool_alloc
0 page_getlink
0 osync_buffers_list
0 nr_free_highpages
0 nr_context_switches
0 netif_rx
0 mprotect_fixup
0 mpage_readpages
0 mpage_end_io_write
0 mpage_alloc
0 move_addr_to_kernel
0 mounts_open
0 mod_timer
0 mmap_hugetlb_implicit
0 migration_thread
0 memset
0 mempool_free_slab
0 mempool_alloc_slab
0 mem_open
0 media_not_present
0 math_emulate
0 mark_offset_tsc
0 maps_open
0 lookup_swap_cache
0 lookup_one_len
0 locks_wake_up_blocks
0 locks_insert_lock
0 locks_delete_lock
0 load_script
0 kthread_should_stop
0 ksoftirqd
0 kill_something_info
0 kill_proc_info
0 kfree_skbmem
0 io_schedule_timeout
0 invalidate_mmap_range_list
0 intr_handler
0 interruptible_sleep_on
0 init_special_inode
0 init_page_buffers
0 init_once
0 inet_addr_type
0 in_egroup_p
0 idle_cpu
0 hash_futex
0 get_zeroed_page
0 get_page_state
0 get_dirty_limits
0 generic_file_readv
0 fs_may_remount_ro
0 free_fd_array
0 free_cold_page
0 free_anonmm
0 format_corename
0 find_task_by_pid
0 filp_ctor
0 ext3_bg_has_super
0 ext2_writepage
0 ext2_write_inode
0 ext2_rename
0 ext2_read_inode
0 ext2_mknod
0 ext2_find_shared
0 exit_files
0 end_buffer_write_sync
0 end_buffer_read_sync
0 end_buffer_read_nobh
0 end_buffer_async_write
0 end_bio_bh_io_sync
0 do_select
0 do_rw_proc
0 do_proc_dointvec_conv
0 do_proc_dointvec
0 do_posix_gettime
0 do_posix_clock_monotonic_gettime_parts
0 do_file_page
0 devpts_get_tty
0 device_not_available
0 d_genocide
0 collect_sigign_sigcatch
0 check_kill_permission
0 cdev_put
0 cascade
0 cap_inode_setxattr
0 cap_bprm_secureexec
0 bounce_end_io_write
0 block_write_full_page
0 block_sync_page
0 blk_run_queue
0 blk_recount_segments
0 blk_congestion_wait
0 bio_put
0 bio_get_nr_vecs
0 bio_destructor
0 bio_add_page
0 balance_dirty_pages
0 bad_pipe_r
0 autoremove_wake_function
0 assign_type
0 arp_process
0 arch_get_unmapped_area
0 alloc_uid
0 alloc_fd_array
0 add_wait_queue_exclusive
0 add_to_page_cache_lru
0 __writeback_single_inode
0 __wake_up_locked
0 __wait_on_buffer
0 __unix_insert_socket
0 __netdev_rx
0 __kfree_skb
0 __down_interruptible
0 __direct_clear_user
0 __bread_slow
0 __bio_add_page
0 __alloc_percpu
0 .text.lock.timer_pit
0 .text.lock.time
0 .text.lock.signal
0 .text.lock.rwsem
0 .text.lock.rmap
0 .text.lock.readdir
0 .text.lock.rcupdate
0 .text.lock.fcntl