1*fdd8201dSApple OSS DistributionsTask References 2*fdd8201dSApple OSS Distributions=============== 3*fdd8201dSApple OSS Distributions 4*fdd8201dSApple OSS DistributionsBackground 5*fdd8201dSApple OSS Distributions---------- 6*fdd8201dSApple OSS Distributions 7*fdd8201dSApple OSS DistributionsTasks in XNU are reference counted. When a task is created it starts with two 8*fdd8201dSApple OSS Distributionsreferences - one for the caller and one for the task itself. Over the lifetime 9*fdd8201dSApple OSS Distributionsof the task this reference count is modified, for example when a thread is 10*fdd8201dSApple OSS Distributionscreated it increments the reference count and when it exits that count drops. 11*fdd8201dSApple OSS DistributionsWhen a reference count reaches zero, the task is freed. 12*fdd8201dSApple OSS Distributions 13*fdd8201dSApple OSS DistributionsTo grab a reference: 14*fdd8201dSApple OSS Distributions```c 15*fdd8201dSApple OSS Distributionstask_reference() 16*fdd8201dSApple OSS Distributions``` 17*fdd8201dSApple OSS Distributions 18*fdd8201dSApple OSS DistributionsTo release a reference: 19*fdd8201dSApple OSS Distributions```c 20*fdd8201dSApple OSS Distributionstask_deallocate() 21*fdd8201dSApple OSS Distributions``` 22*fdd8201dSApple OSS Distributions 23*fdd8201dSApple OSS DistributionsOne of the big problems seen with task references is that difficult to debug 24*fdd8201dSApple OSS Distributions_leaks_ commonly occur. This happens when a reference is taken but never 25*fdd8201dSApple OSS Distributionsreleased. The task is kept around indefinitely and eventually the system runs 26*fdd8201dSApple OSS Distributionsout of a finite resource (for example ASIDs). At this point there is very little 27*fdd8201dSApple OSS Distributionsinformation to determine what code was responsible for the leak. 28*fdd8201dSApple OSS Distributions 29*fdd8201dSApple OSS Distributions 30*fdd8201dSApple OSS DistributionsTask Reference Groups 31*fdd8201dSApple OSS Distributions-------------------- 32*fdd8201dSApple OSS Distributions 33*fdd8201dSApple OSS DistributionsReference groups are a feature which keep track of statistics (and when 34*fdd8201dSApple OSS Distributionsconfigured backtrace information) for a set of references. Reference groups are 35*fdd8201dSApple OSS Distributionshierarchical. To help with debugging the following task reference group 36*fdd8201dSApple OSS Distributionshierarchy is used: 37*fdd8201dSApple OSS Distributions 38*fdd8201dSApple OSS Distributions``` 39*fdd8201dSApple OSS Distributionstask 40*fdd8201dSApple OSS Distributions -> task_internal 41*fdd8201dSApple OSS Distributions -> task_local_internal 42*fdd8201dSApple OSS Distributions -> task_kernel 43*fdd8201dSApple OSS Distributions -> task_local_internal 44*fdd8201dSApple OSS Distributions -> task_mig 45*fdd8201dSApple OSS Distributions -> task_local_internal 46*fdd8201dSApple OSS Distributions -> task_external 47*fdd8201dSApple OSS Distributions -> task_local_external 48*fdd8201dSApple OSS Distributions -> task_com.apple.security.sandbox 49*fdd8201dSApple OSS Distributions -> task_com.apple.security.sandbox 50*fdd8201dSApple OSS Distributions -> task_com.apple.driver.AppleHV 51*fdd8201dSApple OSS Distributions -> task_com.apple.driver.AppleHV 52*fdd8201dSApple OSS Distributions ... 53*fdd8201dSApple OSS Distributions``` 54*fdd8201dSApple OSS Distributions 55*fdd8201dSApple OSS DistributionsThe `task` group contains a count of all task references in the system. The 56*fdd8201dSApple OSS Distributionsfirst-level groups are static and sub-divide task references based on the 57*fdd8201dSApple OSS Distributionssub-system they come from. `task_external` is used for kext references and each 58*fdd8201dSApple OSS Distributionskext will be dynamically assigned a reference group as needed (if there's 59*fdd8201dSApple OSS Distributionsone available). At the bottom level, there's a per-task (local) ref group under 60*fdd8201dSApple OSS Distributionseach global group. 61*fdd8201dSApple OSS DistributionsThe exact hierarchy of task references (specifically what per-task reference 62*fdd8201dSApple OSS Distributionsgroups are created) changes depending on the 'task_refgrp' boot arg. 63*fdd8201dSApple OSS Distributions 64*fdd8201dSApple OSS DistributionsTask reference groups can be explored in `lldb` as follows: 65*fdd8201dSApple OSS Distributions 66*fdd8201dSApple OSS Distributions``` 67*fdd8201dSApple OSS Distributions(lldb) showglobaltaskrefgrps 68*fdd8201dSApple OSS Distributionsos_refgrp name count retain release log 69*fdd8201dSApple OSS Distributions0xffffff801ace9250 task_kernel 68 367663 367595 0x0 70*fdd8201dSApple OSS Distributions0xffffff801ace9288 task_internal 974 4953 3979 0x0 71*fdd8201dSApple OSS Distributions0xffffff801ace92c0 task_mig 0 3670 3670 0x0 72*fdd8201dSApple OSS Distributions0xffffff801ace9218 task_external 35 108 73 0x0 73*fdd8201dSApple OSS Distributions0xffffff9369dc7b20 task_com.apple.iokit.IOAcceleratorFamily2 29 77 48 0x0 74*fdd8201dSApple OSS Distributions0xffffff936a3f0a20 task_com.apple.iokit.CoreAnalyticsFamily 1 1 0 0x0 75*fdd8201dSApple OSS Distributions0xffffff936a22cb20 task_com.apple.iokit.EndpointSecurity 0 1 1 0x0 76*fdd8201dSApple OSS Distributions0xffffff936a283f60 task_com.apple.iokit.IOSurface 5 5 0 0x0 77*fdd8201dSApple OSS Distributions0xffffff936a3f08a0 task_com.apple.security.sandbox 0 24 24 0x0 78*fdd8201dSApple OSS Distributions 79*fdd8201dSApple OSS Distributions``` 80*fdd8201dSApple OSS Distributions 81*fdd8201dSApple OSS DistributionsDisplay a task's reference groups: 82*fdd8201dSApple OSS Distributions 83*fdd8201dSApple OSS Distributions``` 84*fdd8201dSApple OSS Distributions(lldb) showtaskrefgrps kernel_task 85*fdd8201dSApple OSS Distributionsos_refgrp name count retain release log 86*fdd8201dSApple OSS Distributions0xffffff936a4b9200 task_local_kernel 1 6 5 0x0 87*fdd8201dSApple OSS Distributions0xffffff936a4b9238 task_local_internal 132 619 487 0x0 88*fdd8201dSApple OSS Distributions``` 89*fdd8201dSApple OSS Distributions 90*fdd8201dSApple OSS DistributionsThe reference group hierarchy for a specific group can be displayed as follows: 91*fdd8201dSApple OSS Distributions 92*fdd8201dSApple OSS Distributions``` 93*fdd8201dSApple OSS Distributions(lldb) showosrefgrphierarchy 0xffffff936a3f08a0 94*fdd8201dSApple OSS Distributions0xffffff801ace9988 all 1121 377740 376619 0x0 95*fdd8201dSApple OSS Distributions0xffffff801ace91e0 task 1077 376394 375317 0x0 96*fdd8201dSApple OSS Distributions0xffffff801ace9218 task_external 35 108 73 0x0 97*fdd8201dSApple OSS Distributions0xffffff936a3f08a0 task_com.apple.security.sandbox 0 24 24 0x0 98*fdd8201dSApple OSS Distributions``` 99*fdd8201dSApple OSS Distributions 100*fdd8201dSApple OSS DistributionsReference groups are normally disabled, but task reference group statistics 101*fdd8201dSApple OSS Distributions*are* enabled by default (for `RELEASE` builds, reference groups are not available 102*fdd8201dSApple OSS Distributionsat all). Backtrace logging for all groups is disabled, including task reference 103*fdd8201dSApple OSS Distributionsgroups. To enable backtrace logging and reference group statistics, the `rlog` 104*fdd8201dSApple OSS Distributionsboot-arg must be used. Backtrace logging for task reference groups is only 105*fdd8201dSApple OSS Distributionsenabled when `rlog` has been set to a suitable value. 106*fdd8201dSApple OSS Distributions 107*fdd8201dSApple OSS DistributionsFor example 108*fdd8201dSApple OSS Distributions 109*fdd8201dSApple OSS DistributionsTo enable statistics for all reference groups and backtrace logging for the 110*fdd8201dSApple OSS Distributions*task_external* reference group in particular: 111*fdd8201dSApple OSS Distributions 112*fdd8201dSApple OSS Distributions``` 113*fdd8201dSApple OSS Distributionsnvram boot-args="rlog=task_external ..." 114*fdd8201dSApple OSS Distributions``` 115*fdd8201dSApple OSS Distributions 116*fdd8201dSApple OSS Distributions``` 117*fdd8201dSApple OSS Distributions(lldb) showglobaltaskrefgrps 118*fdd8201dSApple OSS Distributionsos_refgrp name count retain release log 119*fdd8201dSApple OSS Distributions0xffffff801e0e9250 task_kernel 1259 132739 131480 0x0 120*fdd8201dSApple OSS Distributions0xffffff801e0e9218 task_external 35 100 65 0xffffffa05b3fc000 121*fdd8201dSApple OSS Distributions0xffffff936d117be0 task_com.apple.iokit.IOAcceleratorFamily2 29 77 48 0x0 122*fdd8201dSApple OSS Distributions0xffffff936db9fa20 task_com.apple.iokit.CoreAnalyticsFamily 1 1 0 0x0 123*fdd8201dSApple OSS Distributions0xffffff936d9dbb20 task_com.apple.iokit.EndpointSecurity 0 1 1 0x0 124*fdd8201dSApple OSS Distributions0xffffff936da324e0 task_com.apple.iokit.IOSurface 5 5 0 0x0 125*fdd8201dSApple OSS Distributions0xffffff936db9f8a0 task_com.apple.security.sandbox 0 16 16 0x0 126*fdd8201dSApple OSS Distributions 127*fdd8201dSApple OSS Distributions 128*fdd8201dSApple OSS Distributions(lldb) showbtlogrecords 0xffffffa05b3fc000 129*fdd8201dSApple OSS Distributions-------- OP 1 Stack Index 0 with active refs 1 of 165 -------- 130*fdd8201dSApple OSS Distributions0xffffff801da7c1cb <kernel.development`ref_log_op at refcnt.c:107> 131*fdd8201dSApple OSS Distributions0xffffff801d27c35d <kernel.development`task_reference_grp at task_ref.c:274> 132*fdd8201dSApple OSS Distributions0xffffff801ecc014e <EndpointSecurity`VMMap::taskSelf()> 133*fdd8201dSApple OSS Distributions0xffffff801eccc845 <EndpointSecurity`EndpointSecurityClient::create(ScopedPointer<MachSendWrapper> const&, proc*, ScopedPointer<EndpointSecurityExternalClient> const&, es_client_config_t const&)> 134*fdd8201dSApple OSS Distributions... 135*fdd8201dSApple OSS Distributions``` 136