xref: /xnu-11215.41.3/doc/debugging/task_ref.md (revision 33de042d024d46de5ff4e89f2471de6608e37fa4) !
1*33de042dSApple OSS DistributionsTask References
2*33de042dSApple OSS Distributions===============
3*33de042dSApple OSS Distributions
4*33de042dSApple OSS DistributionsFinding the source of task reference count leaks.
5*33de042dSApple OSS Distributions
6*33de042dSApple OSS DistributionsBackground
7*33de042dSApple OSS Distributions----------
8*33de042dSApple OSS Distributions
9*33de042dSApple OSS DistributionsTasks in XNU are reference counted. When a task is created it starts with two
10*33de042dSApple OSS Distributionsreferences - one for the caller and one for the task itself. Over the lifetime
11*33de042dSApple OSS Distributionsof the task this reference count is modified, for example when a thread is
12*33de042dSApple OSS Distributionscreated it increments the reference count and when it exits that count drops.
13*33de042dSApple OSS DistributionsWhen a reference count reaches zero, the task is freed.
14*33de042dSApple OSS Distributions
15*33de042dSApple OSS DistributionsTo grab a reference:
16*33de042dSApple OSS Distributions```c
17*33de042dSApple OSS Distributionstask_reference()
18*33de042dSApple OSS Distributions```
19*33de042dSApple OSS Distributions
20*33de042dSApple OSS DistributionsTo release a reference:
21*33de042dSApple OSS Distributions```c
22*33de042dSApple OSS Distributionstask_deallocate()
23*33de042dSApple OSS Distributions```
24*33de042dSApple OSS Distributions
25*33de042dSApple OSS DistributionsOne of the big problems seen with task references is that difficult to debug
26*33de042dSApple OSS Distributions_leaks_ commonly occur. This happens when a reference is taken but never
27*33de042dSApple OSS Distributionsreleased. The task is kept around indefinitely and eventually the system runs
28*33de042dSApple OSS Distributionsout of a finite resource (for example ASIDs). At this point there is very little
29*33de042dSApple OSS Distributionsinformation to determine what code was responsible for the leak.
30*33de042dSApple OSS Distributions
31*33de042dSApple OSS Distributions
32*33de042dSApple OSS DistributionsTask Reference Groups
33*33de042dSApple OSS Distributions--------------------
34*33de042dSApple OSS Distributions
35*33de042dSApple OSS DistributionsReference groups are a feature which keep track of statistics (and when
36*33de042dSApple OSS Distributionsconfigured backtrace information) for a set of references. Reference groups are
37*33de042dSApple OSS Distributionshierarchical. To help with debugging the following task reference group
38*33de042dSApple OSS Distributionshierarchy is used:
39*33de042dSApple OSS Distributions
40*33de042dSApple OSS Distributions```
41*33de042dSApple OSS Distributionstask
42*33de042dSApple OSS Distributions   -> task_internal
43*33de042dSApple OSS Distributions      -> task_local_internal
44*33de042dSApple OSS Distributions   -> task_kernel
45*33de042dSApple OSS Distributions      -> task_local_internal
46*33de042dSApple OSS Distributions   -> task_mig
47*33de042dSApple OSS Distributions      -> task_local_internal
48*33de042dSApple OSS Distributions   -> task_external
49*33de042dSApple OSS Distributions      -> task_local_external
50*33de042dSApple OSS Distributions      -> task_com.apple.security.sandbox
51*33de042dSApple OSS Distributions          -> task_com.apple.security.sandbox
52*33de042dSApple OSS Distributions      -> task_com.apple.driver.AppleHV
53*33de042dSApple OSS Distributions          -> task_com.apple.driver.AppleHV
54*33de042dSApple OSS Distributions      ...
55*33de042dSApple OSS Distributions```
56*33de042dSApple OSS Distributions
57*33de042dSApple OSS DistributionsThe `task` group contains a count of all task references in the system. The
58*33de042dSApple OSS Distributionsfirst-level groups are static and sub-divide task references based on the
59*33de042dSApple OSS Distributionssub-system they come from. `task_external` is used for kext references and each
60*33de042dSApple OSS Distributionskext will be dynamically assigned a reference group as needed (if there's
61*33de042dSApple OSS Distributionsone available). At the bottom level, there's a per-task (local) ref group under
62*33de042dSApple OSS Distributionseach global group.
63*33de042dSApple OSS DistributionsThe exact hierarchy of task references (specifically what per-task reference
64*33de042dSApple OSS Distributionsgroups are created) changes depending on the 'task_refgrp' boot arg.
65*33de042dSApple OSS Distributions
66*33de042dSApple OSS DistributionsTask reference groups can be explored in `lldb` as follows:
67*33de042dSApple OSS Distributions
68*33de042dSApple OSS Distributions```
69*33de042dSApple OSS Distributions(lldb) showglobaltaskrefgrps
70*33de042dSApple OSS Distributionsos_refgrp          name                                           count     retain    release   log
71*33de042dSApple OSS Distributions0xffffff801ace9250 task_kernel                                    68        367663    367595    0x0
72*33de042dSApple OSS Distributions0xffffff801ace9288 task_internal                                  974       4953      3979      0x0
73*33de042dSApple OSS Distributions0xffffff801ace92c0 task_mig                                       0         3670      3670      0x0
74*33de042dSApple OSS Distributions0xffffff801ace9218 task_external                                  35        108       73        0x0
75*33de042dSApple OSS Distributions0xffffff9369dc7b20 task_com.apple.iokit.IOAcceleratorFamily2      29        77        48        0x0
76*33de042dSApple OSS Distributions0xffffff936a3f0a20 task_com.apple.iokit.CoreAnalyticsFamily       1         1         0         0x0
77*33de042dSApple OSS Distributions0xffffff936a22cb20 task_com.apple.iokit.EndpointSecurity          0         1         1         0x0
78*33de042dSApple OSS Distributions0xffffff936a283f60 task_com.apple.iokit.IOSurface                 5         5         0         0x0
79*33de042dSApple OSS Distributions0xffffff936a3f08a0 task_com.apple.security.sandbox                0         24        24        0x0
80*33de042dSApple OSS Distributions
81*33de042dSApple OSS Distributions```
82*33de042dSApple OSS Distributions
83*33de042dSApple OSS DistributionsDisplay a task's reference groups:
84*33de042dSApple OSS Distributions
85*33de042dSApple OSS Distributions```
86*33de042dSApple OSS Distributions(lldb) showtaskrefgrps kernel_task
87*33de042dSApple OSS Distributionsos_refgrp          name                                           count     retain    release   log
88*33de042dSApple OSS Distributions0xffffff936a4b9200 task_local_kernel                              1         6         5         0x0
89*33de042dSApple OSS Distributions0xffffff936a4b9238 task_local_internal                            132       619       487       0x0
90*33de042dSApple OSS Distributions```
91*33de042dSApple OSS Distributions
92*33de042dSApple OSS DistributionsThe reference group hierarchy for a specific group can be displayed as follows:
93*33de042dSApple OSS Distributions
94*33de042dSApple OSS Distributions```
95*33de042dSApple OSS Distributions(lldb) showosrefgrphierarchy 0xffffff936a3f08a0
96*33de042dSApple OSS Distributions0xffffff801ace9988 all                                            1121      377740    376619    0x0
97*33de042dSApple OSS Distributions0xffffff801ace91e0 task                                           1077      376394    375317    0x0
98*33de042dSApple OSS Distributions0xffffff801ace9218 task_external                                  35        108       73        0x0
99*33de042dSApple OSS Distributions0xffffff936a3f08a0 task_com.apple.security.sandbox                0         24        24        0x0
100*33de042dSApple OSS Distributions```
101*33de042dSApple OSS Distributions
102*33de042dSApple OSS DistributionsReference groups are normally disabled, but task reference group statistics
103*33de042dSApple OSS Distributions*are* enabled by default (for `RELEASE` builds, reference groups are not available
104*33de042dSApple OSS Distributionsat all). Backtrace logging for all groups is disabled, including task reference
105*33de042dSApple OSS Distributionsgroups. To enable backtrace logging and reference group statistics, the `rlog`
106*33de042dSApple OSS Distributionsboot-arg must be used. Backtrace logging for task reference groups is only
107*33de042dSApple OSS Distributionsenabled when `rlog` has been set to a suitable value.
108*33de042dSApple OSS Distributions
109*33de042dSApple OSS DistributionsFor example
110*33de042dSApple OSS Distributions
111*33de042dSApple OSS DistributionsTo enable statistics for all reference groups and backtrace logging for the
112*33de042dSApple OSS Distributions*task_external* reference group in particular:
113*33de042dSApple OSS Distributions
114*33de042dSApple OSS Distributions```
115*33de042dSApple OSS Distributionsnvram boot-args="rlog=task_external ..."
116*33de042dSApple OSS Distributions```
117*33de042dSApple OSS Distributions
118*33de042dSApple OSS Distributions```
119*33de042dSApple OSS Distributions(lldb) showglobaltaskrefgrps
120*33de042dSApple OSS Distributionsos_refgrp          name                                           count     retain    release   log
121*33de042dSApple OSS Distributions0xffffff801e0e9250 task_kernel                                    1259      132739    131480    0x0
122*33de042dSApple OSS Distributions0xffffff801e0e9218 task_external                                  35        100       65        0xffffffa05b3fc000
123*33de042dSApple OSS Distributions0xffffff936d117be0 task_com.apple.iokit.IOAcceleratorFamily2      29        77        48        0x0
124*33de042dSApple OSS Distributions0xffffff936db9fa20 task_com.apple.iokit.CoreAnalyticsFamily       1         1         0         0x0
125*33de042dSApple OSS Distributions0xffffff936d9dbb20 task_com.apple.iokit.EndpointSecurity          0         1         1         0x0
126*33de042dSApple OSS Distributions0xffffff936da324e0 task_com.apple.iokit.IOSurface                 5         5         0         0x0
127*33de042dSApple OSS Distributions0xffffff936db9f8a0 task_com.apple.security.sandbox                0         16        16        0x0
128*33de042dSApple OSS Distributions
129*33de042dSApple OSS Distributions
130*33de042dSApple OSS Distributions(lldb) showbtlogrecords 0xffffffa05b3fc000
131*33de042dSApple OSS Distributions-------- OP 1 Stack Index 0 with active refs 1 of 165 --------
132*33de042dSApple OSS Distributions0xffffff801da7c1cb <kernel.development`ref_log_op at refcnt.c:107>
133*33de042dSApple OSS Distributions0xffffff801d27c35d <kernel.development`task_reference_grp at task_ref.c:274>
134*33de042dSApple OSS Distributions0xffffff801ecc014e <EndpointSecurity`VMMap::taskSelf()>
135*33de042dSApple OSS Distributions0xffffff801eccc845 <EndpointSecurity`EndpointSecurityClient::create(ScopedPointer<MachSendWrapper> const&, proc*, ScopedPointer<EndpointSecurityExternalClient> const&, es_client_config_t const&)>
136*33de042dSApple OSS Distributions...
137*33de042dSApple OSS Distributions```
138