ConsideredURFieldsStorage
Version 2 (Jon Kerr Nilsen, 08/08/2012 05:32 AM)
1 | 1 | Jon Kerr Nilsen | h1. List of fields under consideration for recording storage usage |
---|---|---|---|
2 | 1 | Jon Kerr Nilsen | |
3 | 1 | Jon Kerr Nilsen | |
4 | 1 | Jon Kerr Nilsen | |
5 | 1 | Jon Kerr Nilsen | h2. ValidDuration or TimeDuration or none of the two |
6 | 1 | Jon Kerr Nilsen | |
7 | 1 | Jon Kerr Nilsen | None of the two, using StartTime and EndTime instead |
8 | 1 | Jon Kerr Nilsen | |
9 | 1 | Jon Kerr Nilsen | ---- |
10 | 1 | Jon Kerr Nilsen | |
11 | 1 | Jon Kerr Nilsen | |
12 | 1 | Jon Kerr Nilsen | h2. Fields that are needed by the storage accounting in the other blocks: |
13 | 1 | Jon Kerr Nilsen | |
14 | 1 | Jon Kerr Nilsen | * local user |
15 | 1 | Jon Kerr Nilsen | * local group |
16 | 1 | Jon Kerr Nilsen | * measurement time |
17 | 1 | Jon Kerr Nilsen | * start time |
18 | 1 | Jon Kerr Nilsen | * end time |
19 | 1 | Jon Kerr Nilsen | * sitename (label for set of resources that have some kind of logical grouping) (Admin domain on GLUE) |
20 | 1 | Jon Kerr Nilsen | |
21 | 1 | Jon Kerr Nilsen | |
22 | 1 | Jon Kerr Nilsen | --- |
23 | 1 | Jon Kerr Nilsen | |
24 | 1 | Jon Kerr Nilsen | |
25 | 1 | Jon Kerr Nilsen | * (global) user identity |
26 | 1 | Jon Kerr Nilsen | * (global) group and subgroups (group attribute) |
27 | 1 | Jon Kerr Nilsen | |
28 | 1 | Jon Kerr Nilsen | |
29 | 1 | Jon Kerr Nilsen | |
30 | 1 | Jon Kerr Nilsen | ---- |
31 | 1 | Jon Kerr Nilsen | |
32 | 1 | Jon Kerr Nilsen | ALL OK |
33 | 1 | Jon Kerr Nilsen | |
34 | 1 | Jon Kerr Nilsen | ---- |
35 | 1 | Jon Kerr Nilsen | |
36 | 1 | Jon Kerr Nilsen | |
37 | 1 | Jon Kerr Nilsen | h2. StorageUsageBlock |
38 | 1 | Jon Kerr Nilsen | |
39 | 1 | Jon Kerr Nilsen | This is the block property of the storage usage fields. Similar blocks for compute and other resources should also be added. |
40 | 1 | Jon Kerr Nilsen | |
41 | 1 | Jon Kerr Nilsen | Example |
42 | 1 | Jon Kerr Nilsen | <pre> |
43 | 1 | Jon Kerr Nilsen | <ur:StorageUsageBlock> |
44 | 1 | Jon Kerr Nilsen | <!—Storage Record properties go in here --> |
45 | 1 | Jon Kerr Nilsen | </ur:StorageUsageBlock> |
46 | 2 | Jon Kerr Nilsen | </pre> |
47 | 1 | Jon Kerr Nilsen | |
48 | 1 | Jon Kerr Nilsen | h3. Comments: |
49 | 1 | Jon Kerr Nilsen | |
50 | 1 | Jon Kerr Nilsen | Ralph: ok |
51 | 1 | Jon Kerr Nilsen | |
52 | 1 | Jon Kerr Nilsen | ---- |
53 | 1 | Jon Kerr Nilsen | |
54 | 1 | Jon Kerr Nilsen | h2. StorageSystem or ~Host |
55 | 1 | Jon Kerr Nilsen | |
56 | 1 | Jon Kerr Nilsen | This property is part of the StorageUsageBlock and describes the storage system on which the resources have been consumed. This value should be chosen in such a way that it globally identifies the storage system, on which resources are being consumed (eg., the FQDN of the storage system could be used). |
57 | 1 | Jon Kerr Nilsen | |
58 | 1 | Jon Kerr Nilsen | Example |
59 | 1 | Jon Kerr Nilsen | <pre> |
60 | 1 | Jon Kerr Nilsen | <ur:StorageSystem>host.example.org</ur:StorageSystem> |
61 | 1 | Jon Kerr Nilsen | </pre> |
62 | 1 | Jon Kerr Nilsen | |
63 | 1 | Jon Kerr Nilsen | *The StorageSystem property MUST be present in the record. |
64 | 1 | Jon Kerr Nilsen | *The StorageSystem field MUST have the type string. |
65 | 1 | Jon Kerr Nilsen | *The StorageSystem value SHOULD be constructed in such a way, that it globally identifies the storage system. |
66 | 1 | Jon Kerr Nilsen | |
67 | 1 | Jon Kerr Nilsen | h3. Comments: |
68 | 1 | Jon Kerr Nilsen | |
69 | 1 | Jon Kerr Nilsen | Ralph: ok |
70 | 1 | Jon Kerr Nilsen | |
71 | 1 | Jon Kerr Nilsen | ---- |
72 | 1 | Jon Kerr Nilsen | |
73 | 1 | Jon Kerr Nilsen | h2. StorageShare |
74 | 1 | Jon Kerr Nilsen | |
75 | 1 | Jon Kerr Nilsen | This property describes the part of of the storage system which is accounted for in the record. For a storage system, which is split into several logical parts, this can be used to account for consumption on each of these parts. The value should be able to identity the share of the storage system, given the storage system property. |
76 | 1 | Jon Kerr Nilsen | |
77 | 1 | Jon Kerr Nilsen | *The StorageShare field type MUST be a string |
78 | 1 | Jon Kerr Nilsen | |
79 | 1 | Jon Kerr Nilsen | Example |
80 | 1 | Jon Kerr Nilsen | <pre> |
81 | 1 | Jon Kerr Nilsen | <sr:StorageShare>pool-003</sr:StorageShare> |
82 | 1 | Jon Kerr Nilsen | </pre> |
83 | 1 | Jon Kerr Nilsen | |
84 | 1 | Jon Kerr Nilsen | h3. Comments: |
85 | 1 | Jon Kerr Nilsen | |
86 | 1 | Jon Kerr Nilsen | Ralph: ok |
87 | 1 | Jon Kerr Nilsen | |
88 | 1 | Jon Kerr Nilsen | ---- |
89 | 1 | Jon Kerr Nilsen | |
90 | 1 | Jon Kerr Nilsen | h2. StorageMedia |
91 | 1 | Jon Kerr Nilsen | |
92 | 1 | Jon Kerr Nilsen | This property describes the media type of storage that is accounted for in the record, e.g. “disk” or “tape”. This allows for accounting of different backend storage types. |
93 | 1 | Jon Kerr Nilsen | |
94 | 1 | Jon Kerr Nilsen | *The StorageMedia field type MUST be a string. |
95 | 1 | Jon Kerr Nilsen | |
96 | 1 | Jon Kerr Nilsen | Example |
97 | 1 | Jon Kerr Nilsen | <pre> |
98 | 1 | Jon Kerr Nilsen | <sr:StorageMedia>disk</sr:StorageMedia> |
99 | 1 | Jon Kerr Nilsen | </pre> |
100 | 1 | Jon Kerr Nilsen | |
101 | 1 | Jon Kerr Nilsen | h3. Comments: |
102 | 1 | Jon Kerr Nilsen | |
103 | 1 | Jon Kerr Nilsen | Ralph: ok |
104 | 1 | Jon Kerr Nilsen | |
105 | 1 | Jon Kerr Nilsen | ---- |
106 | 1 | Jon Kerr Nilsen | |
107 | 1 | Jon Kerr Nilsen | h2. StorageMedia or StorageType |
108 | 1 | Jon Kerr Nilsen | |
109 | 1 | Jon Kerr Nilsen | This property is part of the StorageUsageBlock and describes the media type of storage that is accounted for in the record (eg.: “disk” or “tape”. This allows for accounting of different backend storage types). |
110 | 1 | Jon Kerr Nilsen | |
111 | 1 | Jon Kerr Nilsen | *The StorageMedia field type MUST be a string. |
112 | 1 | Jon Kerr Nilsen | |
113 | 1 | Jon Kerr Nilsen | Example |
114 | 1 | Jon Kerr Nilsen | <pre> |
115 | 1 | Jon Kerr Nilsen | <ur:StorageMedia>disk</ur:StorageMedia> |
116 | 1 | Jon Kerr Nilsen | </pre> |
117 | 1 | Jon Kerr Nilsen | |
118 | 1 | Jon Kerr Nilsen | h3. Comments: |
119 | 1 | Jon Kerr Nilsen | |
120 | 1 | Jon Kerr Nilsen | Ralph: ok |
121 | 1 | Jon Kerr Nilsen | |
122 | 1 | Jon Kerr Nilsen | ---- |
123 | 1 | Jon Kerr Nilsen | |
124 | 1 | Jon Kerr Nilsen | h2. StorageClass |
125 | 1 | Jon Kerr Nilsen | |
126 | 1 | Jon Kerr Nilsen | This property describes the class of the stored data, e.g. ”pinned”, ”replicated”, ”precious”. This is a |
127 | 1 | Jon Kerr Nilsen | descriptive value, which allows the storage system to provide details about the stored data. |
128 | 1 | Jon Kerr Nilsen | |
129 | 1 | Jon Kerr Nilsen | *The StorageClass field type MUST be a string. |
130 | 1 | Jon Kerr Nilsen | |
131 | 1 | Jon Kerr Nilsen | Example |
132 | 1 | Jon Kerr Nilsen | <pre> |
133 | 1 | Jon Kerr Nilsen | <sr:StorageClass>replicated</sr:StorageClass> |
134 | 1 | Jon Kerr Nilsen | </pre> |
135 | 1 | Jon Kerr Nilsen | |
136 | 1 | Jon Kerr Nilsen | h3. Comments: |
137 | 1 | Jon Kerr Nilsen | |
138 | 1 | Jon Kerr Nilsen | Ralph: ok |
139 | 1 | Jon Kerr Nilsen | |
140 | 1 | Jon Kerr Nilsen | ---- |
141 | 1 | Jon Kerr Nilsen | |
142 | 1 | Jon Kerr Nilsen | h2. DirectoryPath |
143 | 1 | Jon Kerr Nilsen | |
144 | 1 | Jon Kerr Nilsen | This property describes the directory path being accounted for. If the property is included in the |
145 | 1 | Jon Kerr Nilsen | record, the record should account for all usage in the directory and only that directory. |
146 | 1 | Jon Kerr Nilsen | |
147 | 1 | Jon Kerr Nilsen | *The DirectoryPath field type MUST be a string. |
148 | 1 | Jon Kerr Nilsen | |
149 | 1 | Jon Kerr Nilsen | Example |
150 | 1 | Jon Kerr Nilsen | <pre> |
151 | 1 | Jon Kerr Nilsen | <sr:DirectoryPath>/projectA</sr:DirectoryPath> |
152 | 1 | Jon Kerr Nilsen | </pre> |
153 | 1 | Jon Kerr Nilsen | |
154 | 1 | Jon Kerr Nilsen | h3. Comments: |
155 | 1 | Jon Kerr Nilsen | |
156 | 1 | Jon Kerr Nilsen | Ralph: ok |
157 | 1 | Jon Kerr Nilsen | |
158 | 1 | Jon Kerr Nilsen | ---- |
159 | 1 | Jon Kerr Nilsen | |
160 | 1 | Jon Kerr Nilsen | h2. FileCount |
161 | 1 | Jon Kerr Nilsen | |
162 | 1 | Jon Kerr Nilsen | This property describes the number of files which are accounted for in the record. |
163 | 1 | Jon Kerr Nilsen | |
164 | 1 | Jon Kerr Nilsen | *The FileCount field type MUST be a positive non-zero integer. |
165 | 1 | Jon Kerr Nilsen | |
166 | 1 | Jon Kerr Nilsen | Example |
167 | 1 | Jon Kerr Nilsen | <pre> |
168 | 1 | Jon Kerr Nilsen | <sr:FileCount>42</sr:FileCount> |
169 | 1 | Jon Kerr Nilsen | </pre> |
170 | 1 | Jon Kerr Nilsen | |
171 | 1 | Jon Kerr Nilsen | h3. Comments: |
172 | 1 | Jon Kerr Nilsen | |
173 | 1 | Jon Kerr Nilsen | Ralph: ok |
174 | 1 | Jon Kerr Nilsen | |
175 | 1 | Jon Kerr Nilsen | ---- |
176 | 1 | Jon Kerr Nilsen | |
177 | 1 | Jon Kerr Nilsen | h2. StorageResourceCapacityUsed |
178 | 1 | Jon Kerr Nilsen | |
179 | 1 | Jon Kerr Nilsen | This property is part of the StorageUsageBlock and describes the number of physical bytes used on the storage system. This is the main metric for measuring resource consumption. It should include all resources for which the identity of the record is accountable for. |
180 | 1 | Jon Kerr Nilsen | |
181 | 1 | Jon Kerr Nilsen | *The ResourceCapacityUsed property MUST be present in the record. |
182 | 1 | Jon Kerr Nilsen | *The ResourceCapacityUsed field type MUST be a nonnegative integer. |
183 | 1 | Jon Kerr Nilsen | * ResourceCapacityUsed SHOULD include all resources that are used to store the files. The value MAY also include resources that are no longer in use but are unavailable for reuse, as documented in the appropriate SLA or usage policy documents. |
184 | 1 | Jon Kerr Nilsen | |
185 | 1 | Jon Kerr Nilsen | Example |
186 | 1 | Jon Kerr Nilsen | <pre> |
187 | 1 | Jon Kerr Nilsen | <ur:StorageResourceCapacityUsed>14728</ur:StorageResourceCapacityUsed> |
188 | 1 | Jon Kerr Nilsen | </pre> |
189 | 1 | Jon Kerr Nilsen | |
190 | 1 | Jon Kerr Nilsen | h3. Comments: |
191 | 1 | Jon Kerr Nilsen | |
192 | 1 | Jon Kerr Nilsen | Ralph: ok |
193 | 1 | Jon Kerr Nilsen | |
194 | 1 | Jon Kerr Nilsen | ---- |
195 | 1 | Jon Kerr Nilsen | |
196 | 1 | Jon Kerr Nilsen | |
197 | 1 | Jon Kerr Nilsen | h2. StorageLogicalCapacityUsed |
198 | 1 | Jon Kerr Nilsen | |
199 | 1 | Jon Kerr Nilsen | This property is part of the StorageUsageBlock and describes the number of logical bytes used on the storage system. This is the main metric for measuring resource allocation. It should include all resources for which the identity of the record is accountable for. |
200 | 1 | Jon Kerr Nilsen | |
201 | 1 | Jon Kerr Nilsen | *The LogicalCapacityUsed field type MUST be a nonnegative integer. |
202 | 1 | Jon Kerr Nilsen | |
203 | 1 | Jon Kerr Nilsen | Example |
204 | 1 | Jon Kerr Nilsen | <pre> |
205 | 1 | Jon Kerr Nilsen | <ur:StorageLogicalCapacityUsed>54636</ur:StorageLogicalCapacityUsed> |
206 | 1 | Jon Kerr Nilsen | </pre> |
207 | 1 | Jon Kerr Nilsen | |
208 | 1 | Jon Kerr Nilsen | h3. Comments: |
209 | 1 | Jon Kerr Nilsen | |
210 | 1 | Jon Kerr Nilsen | Ralph: ok |
211 | 1 | Jon Kerr Nilsen | |
212 | 1 | Jon Kerr Nilsen | ---- |