[Bio] / Sprout / CustomAttributes.pm Repository:
ViewVC logotype

Annotation of /Sprout/CustomAttributes.pm

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1.24 - (view) (download) (as text)

1 : parrello 1.1 #!/usr/bin/perl -w
2 :    
3 :     package CustomAttributes;
4 :    
5 :     require Exporter;
6 :     use ERDB;
7 : parrello 1.4 @ISA = qw(ERDB);
8 : parrello 1.1 use strict;
9 :     use Tracer;
10 :     use ERDBLoad;
11 : parrello 1.13 use Stats;
12 : parrello 1.1
13 :     =head1 Custom SEED Attribute Manager
14 :    
15 :     =head2 Introduction
16 :    
17 :     The Custom SEED Attributes Manager allows the user to upload and retrieve
18 :     custom data for SEED objects. It uses the B<ERDB> database system to
19 : parrello 1.10 store the attributes.
20 :    
21 :     Attributes are organized by I<attribute key>. Attribute values are
22 :     assigned to I<objects>. In the real world, objects have types and IDs;
23 :     however, to the attribute database only the ID matters. This will create
24 :     a problem if we have a single ID that applies to two objects of different
25 :     types, but it is more consistent with the original attribute implementation
26 : parrello 1.11 in the SEED (which this implementation replaces).
27 : parrello 1.10
28 : parrello 1.11 The actual attribute values are stored as a relationship between the attribute
29 :     keys and the objects. There can be multiple values for a single key/object pair.
30 : parrello 1.1
31 : parrello 1.19 =head3 Object IDs
32 :    
33 :     The object ID is normally represented as
34 :    
35 :     I<type>:I<id>
36 :    
37 :     where I<type> is the object type (C<Role>, C<Coupling>, etc.) and I<id> is
38 :     the actual object ID. Note that the object type must consist of only upper- and
39 :     lower-case letters! Thus, C<GenomeGroup> is a valid object type, but
40 :     C<genome_group> is not. Given that restriction, the object ID
41 :    
42 :     Family:aclame|cluster10
43 :    
44 :     would represent the FIG family C<aclame|cluster10>. For historical reasons,
45 :     there are three exceptions: subsystems, genomes, and features do not need
46 :     a type. So, for PEG 3361 of Streptomyces coelicolor A3(2), you simply code
47 :    
48 :     fig|100226.1.peg.3361
49 :    
50 :     The methods L</ParseID> and L</FormID> can be used to make this all seem
51 :     more consistent. Given any object ID string, L</ParseID> will convert it to an
52 :     object type and ID, and given any object type and ID, L</FormID> will
53 :     convert it to an object ID string. The attribute database is pretty
54 :     freewheeling about what it will allow for an ID; however, for best
55 :     results, the type should match an entity type from a Sprout genetics
56 :     database. If this rule is followed, then the database object
57 :     corresponding to an ID in the attribute database could be retrieved using
58 :     L</GetTargetObject> method.
59 :    
60 :     my $object = CustomAttributes::GetTargetObject($sprout, $idValue);
61 :    
62 :     =head3 Retrieval and Logging
63 :    
64 : parrello 1.1 The full suite of ERDB retrieval capabilities is provided. In addition,
65 :     custom methods are provided specific to this application. To get all
66 : parrello 1.6 the values of the attribute C<essential> in a specified B<Feature>, you
67 : parrello 1.1 would code
68 :    
69 : parrello 1.10 my @values = $attrDB->GetAttributes($fid, 'essential');
70 : parrello 1.1
71 : parrello 1.10 where I<$fid> contains the ID of the desired feature.
72 : parrello 1.1
73 : parrello 1.20 Keys can be split into two pieces using the splitter value defined in the
74 :     constructor (the default is C<::>). The first piece of the key is called
75 :     the I<real key>. This portion of the key must be defined using the
76 :     web interface (C<Attributes.cgi>). The second portion of the key is called
77 :     the I<sub key>, and can take any value.
78 : parrello 1.1
79 : parrello 1.18 Major attribute activity is recorded in a log (C<attributes.log>) in the
80 :     C<$FIG_Config::var> directory. The log reports the user name, time, and
81 :     the details of the operation. The user name will almost always be unknown,
82 : parrello 1.20 the exception being when it is specified in this object's constructor
83 :     (see L</new>).
84 : parrello 1.18
85 : parrello 1.1 =head2 FIG_Config Parameters
86 :    
87 :     The following configuration parameters are used to manage custom attributes.
88 :    
89 :     =over 4
90 :    
91 :     =item attrDbms
92 :    
93 :     Type of database manager used: C<mysql> for MySQL or C<pg> for PostGres.
94 :    
95 :     =item attrDbName
96 :    
97 :     Name of the attribute database.
98 :    
99 :     =item attrHost
100 :    
101 :     Name of the host server for the database. If omitted, the current host
102 :     is used.
103 :    
104 :     =item attrUser
105 :    
106 :     User name for logging in to the database.
107 :    
108 :     =item attrPass
109 :    
110 :     Password for logging in to the database.
111 :    
112 :     =item attrPort
113 :    
114 :     TCP/IP port for accessing the database.
115 :    
116 :     =item attrSock
117 :    
118 :     Socket name used to access the database. If omitted, the default socket
119 :     will be used.
120 :    
121 :     =item attrDBD
122 :    
123 :     Fully-qualified file name for the database definition XML file. This file
124 :     functions as data to the attribute management process, so if the data is
125 :     moved, this file must go with it.
126 :    
127 :     =back
128 :    
129 :     =head2 Public Methods
130 :    
131 :     =head3 new
132 :    
133 : parrello 1.18 C<< my $attrDB = CustomAttributes->new(%options); >>
134 : parrello 1.1
135 : parrello 1.18 Construct a new CustomAttributes object. The following options are
136 :     supported.
137 : parrello 1.3
138 :     =over 4
139 :    
140 :     =item splitter
141 :    
142 :     Value to be used to split attribute values into sections in the
143 : parrello 1.18 L</Fig Replacement Methods>. The default is a double colon C<::>,
144 :     and should only be overridden in extreme circumstances.
145 :    
146 :     =item user
147 :    
148 :     Name of the current user. This will appear in the attribute log.
149 : parrello 1.3
150 :     =back
151 : parrello 1.1
152 :     =cut
153 :    
154 :     sub new {
155 :     # Get the parameters.
156 : parrello 1.18 my ($class, %options) = @_;
157 : parrello 1.1 # Connect to the database.
158 :     my $dbh = DBKernel->new($FIG_Config::attrDbms, $FIG_Config::attrDbName,
159 :     $FIG_Config::attrUser, $FIG_Config::attrPass,
160 :     $FIG_Config::attrPort, $FIG_Config::attrHost,
161 :     $FIG_Config::attrSock);
162 :     # Create the ERDB object.
163 :     my $xmlFileName = $FIG_Config::attrDBD;
164 :     my $retVal = ERDB::new($class, $dbh, $xmlFileName);
165 : parrello 1.3 # Store the splitter value.
166 : parrello 1.18 $retVal->{splitter} = $options{splitter} || '::';
167 :     # Store the user name.
168 :     $retVal->{user} = $options{user} || '<unknown>';
169 :     Trace("User $retVal->{user} selected for attribute object.") if T(3);
170 : parrello 1.1 # Return the result.
171 :     return $retVal;
172 :     }
173 :    
174 : parrello 1.10 =head3 StoreAttributeKey
175 :    
176 :     C<< $attrDB->StoreAttributeKey($attributeName, $type, $notes, \@groups); >>
177 :    
178 :     Create or update an attribute for the database.
179 :    
180 :     =over 4
181 : parrello 1.1
182 :     =item attributeName
183 :    
184 : parrello 1.20 Name of the attribute (the real key). If it does not exist already, it will be created.
185 : parrello 1.1
186 :     =item type
187 :    
188 :     Data type of the attribute. This must be a valid ERDB data type name.
189 :    
190 :     =item notes
191 :    
192 :     Descriptive notes about the attribute. It is presumed to be raw text, not HTML.
193 :    
194 : parrello 1.10 =item groups
195 : parrello 1.1
196 : parrello 1.10 Reference to a list of the groups to which the attribute should be associated.
197 :     This will replace any groups to which the attribute is currently attached.
198 : parrello 1.1
199 :     =back
200 :    
201 :     =cut
202 :    
203 : parrello 1.3 sub StoreAttributeKey {
204 : parrello 1.1 # Get the parameters.
205 : parrello 1.10 my ($self, $attributeName, $type, $notes, $groups) = @_;
206 : parrello 1.8 # Declare the return variable.
207 :     my $retVal;
208 : parrello 1.1 # Get the data type hash.
209 :     my %types = ERDB::GetDataTypes();
210 :     # Validate the initial input values.
211 : parrello 1.20 if ($attributeName =~ /$self->{splitter}/) {
212 : parrello 1.1 Confess("Invalid attribute name \"$attributeName\" specified.");
213 :     } elsif (! $notes || length($notes) < 25) {
214 :     Confess("Missing or incomplete description for $attributeName.");
215 :     } elsif (! exists $types{$type}) {
216 :     Confess("Invalid data type \"$type\" for $attributeName.");
217 :     } else {
218 : parrello 1.18 # Create a variable to hold the action to be displayed for the log (Add or Update).
219 :     my $action;
220 : parrello 1.10 # Okay, we're ready to begin. See if this key exists.
221 :     my $attribute = $self->GetEntity('AttributeKey', $attributeName);
222 :     if (defined($attribute)) {
223 :     # It does, so we do an update.
224 : parrello 1.18 $action = "Update Key";
225 : parrello 1.10 $self->UpdateEntity('AttributeKey', $attributeName,
226 :     { description => $notes, 'data-type' => $type });
227 :     # Detach the key from its current groups.
228 :     $self->Disconnect('IsInGroup', 'AttributeKey', $attributeName);
229 :     } else {
230 :     # It doesn't, so we do an insert.
231 : parrello 1.18 $action = "Insert Key";
232 : parrello 1.10 $self->InsertObject('AttributeKey', { id => $attributeName,
233 :     description => $notes, 'data-type' => $type });
234 : parrello 1.8 }
235 : parrello 1.10 # Attach the key to the specified groups. (We presume the groups already
236 :     # exist.)
237 :     for my $group (@{$groups}) {
238 :     $self->InsertObject('IsInGroup', { 'from-link' => $attributeName,
239 :     'to-link' => $group });
240 : parrello 1.1 }
241 : parrello 1.18 # Log the operation.
242 :     $self->LogOperation($action, $attributeName, "Group list is " . join(" ", @{$groups}));
243 : parrello 1.1 }
244 :     }
245 :    
246 :    
247 : parrello 1.3 =head3 DeleteAttributeKey
248 :    
249 : parrello 1.10 C<< my $stats = $attrDB->DeleteAttributeKey($attributeName); >>
250 : parrello 1.1
251 :     Delete an attribute from the custom attributes database.
252 :    
253 :     =over 4
254 :    
255 : parrello 1.10 =item attributeName
256 : parrello 1.1
257 : parrello 1.10 Name of the attribute to delete.
258 : parrello 1.1
259 : parrello 1.10 =item RETURN
260 : parrello 1.1
261 : parrello 1.10 Returns a statistics object describing the effects of the deletion.
262 : parrello 1.1
263 :     =back
264 :    
265 :     =cut
266 :    
267 : parrello 1.3 sub DeleteAttributeKey {
268 : parrello 1.1 # Get the parameters.
269 : parrello 1.10 my ($self, $attributeName) = @_;
270 :     # Delete the attribute key.
271 :     my $retVal = $self->Delete('AttributeKey', $attributeName);
272 : parrello 1.18 # Log this operation.
273 :     $self->LogOperation("Delete Key", $attributeName, "Key will no longer be available for use by anyone.");
274 : parrello 1.10 # Return the result.
275 :     return $retVal;
276 :    
277 :     }
278 :    
279 :     =head3 NewName
280 :    
281 :     C<< my $text = CustomAttributes::NewName(); >>
282 :    
283 :     Return the string used to indicate the user wants to add a new attribute.
284 :    
285 :     =cut
286 :    
287 :     sub NewName {
288 :     return "(new)";
289 : parrello 1.1 }
290 :    
291 :     =head3 ControlForm
292 :    
293 : parrello 1.10 C<< my $formHtml = $attrDB->ControlForm($cgi, $name, \%keys); >>
294 : parrello 1.1
295 :     Return a form that can be used to control the creation and modification of
296 : parrello 1.10 attributes. Only a subset of the attribute keys will be displayed, as
297 :     determined by the incoming list.
298 : parrello 1.1
299 :     =over 4
300 :    
301 :     =item cgi
302 :    
303 :     CGI query object used to create HTML.
304 :    
305 :     =item name
306 :    
307 :     Name to give to the form. This should be unique for the web page.
308 :    
309 : parrello 1.10 =item keys
310 :    
311 :     Reference to a hash mapping attribute keys to n-tuples. Each tuple will contain the
312 :     attribute's data type, its description, and a list of the groups in which it participates.
313 :    
314 : parrello 1.1 =item RETURN
315 :    
316 : parrello 1.10 Returns the HTML for a form that can be used to submit instructions to the C<Attributes.cgi> script
317 :     for loading, creating, displaying, changing, or deleting an attribute. Note that only the form
318 :     controls are generated. The form tags are left to the caller.
319 : parrello 1.1
320 :     =back
321 :    
322 :     =cut
323 :    
324 :     sub ControlForm {
325 :     # Get the parameters.
326 : parrello 1.10 my ($self, $cgi, $name, $keys) = @_;
327 : parrello 1.1 # Declare the return list.
328 :     my @retVal = ();
329 :     # We'll put the controls in a table. Nothing else ever seems to look nice.
330 :     push @retVal, $cgi->start_table({ border => 2, cellpadding => 2 });
331 :     # The first row is for selecting the field name.
332 :     push @retVal, $cgi->Tr($cgi->th("Select a Field"),
333 : parrello 1.10 $cgi->td($self->FieldMenu($cgi, 10, 'fieldName', $keys,
334 :     new => 1,
335 :     notes => "document.$name.notes.value",
336 :     type => "document.$name.dataType.value",
337 :     groups => "document.$name.groups")));
338 : parrello 1.1 # Now we set up a dropdown for the data types. The values will be the
339 :     # data type names, and the labels will be the descriptions.
340 :     my %types = ERDB::GetDataTypes();
341 :     my %labelMap = map { $_ => $types{$_}->{notes} } keys %types;
342 :     my $typeMenu = $cgi->popup_menu(-name => 'dataType',
343 :     -values => [sort keys %types],
344 : parrello 1.10 -labels => \%labelMap,
345 :     -default => 'string');
346 :     # Allow the user to specify a new field name. This is required if the
347 :     # user has selected the "(new)" marker. We put a little scriptlet in here that
348 :     # selects the (new) marker when the user enters the field.
349 :     push @retVal, "<script language=\"javaScript\">";
350 :     my $fieldField = "document.$name.fieldName";
351 :     my $newName = "\"" . NewName() . "\"";
352 :     push @retVal, $cgi->Tr($cgi->th("New Field Name"),
353 :     $cgi->td($cgi->textfield(-name => 'newName',
354 :     -size => 30,
355 :     -value => "",
356 :     -onFocus => "setIfEmpty($fieldField, $newName);")),
357 :     );
358 : parrello 1.1 push @retVal, $cgi->Tr($cgi->th("Data type"),
359 :     $cgi->td($typeMenu));
360 :     # The next row is for the notes.
361 :     push @retVal, $cgi->Tr($cgi->th("Description"),
362 :     $cgi->td($cgi->textarea(-name => 'notes',
363 :     -rows => 6,
364 :     -columns => 80))
365 :     );
366 : parrello 1.10 # Now we have the groups, which are implemented as a checkbox group.
367 :     my @groups = $self->GetGroups();
368 :     push @retVal, $cgi->Tr($cgi->th("Groups"),
369 :     $cgi->td($cgi->checkbox_group(-name=>'groups',
370 :     -values=> \@groups))
371 :     );
372 : parrello 1.20 # Now the four buttons: STORE, SHOW, ERASE, and DELETE.
373 : parrello 1.1 push @retVal, $cgi->Tr($cgi->th("&nbsp;"),
374 : parrello 1.20 $cgi->td({align => 'center'}, join(" ",
375 :     $cgi->submit(-name => 'Delete', -value => 'DELETE'),
376 :     $cgi->submit(-name => 'Store', -value => 'STORE'),
377 :     $cgi->submit(-name => 'Erase', -value => 'ERASE'),
378 : parrello 1.7 $cgi->submit(-name => 'Show', -value => 'SHOW')
379 : parrello 1.20 ))
380 : parrello 1.1 );
381 :     # Close the table and the form.
382 :     push @retVal, $cgi->end_table();
383 :     # Return the assembled HTML.
384 :     return join("\n", @retVal, "");
385 :     }
386 :    
387 : parrello 1.11 =head3 LoadAttributesFrom
388 :    
389 :     C<< my $stats = $attrDB->LoadAttributesFrom($fileName, %options); >>
390 : parrello 1.24 s
391 : parrello 1.11 Load attributes from the specified tab-delimited file. Each line of the file must
392 :     contain an object ID in the first column, an attribute key name in the second
393 :     column, and attribute values in the remaining columns. The attribute values will
394 : parrello 1.20 be assembled into a single value using the splitter code. In addition, the key names may
395 :     contain a splitter. If this is the case, the portion of the key after the splitter is
396 :     treated as a subkey.
397 : parrello 1.11
398 :     =over 4
399 :    
400 :     =item fileName
401 :    
402 : parrello 1.20 Name of the file from which to load the attributes, or an open handle for the file.
403 :     (This last enables the method to be used in conjunction with the CGI form upload
404 :     control.)
405 : parrello 1.11
406 :     =item options
407 :    
408 :     Hash of options for modifying the load process.
409 :    
410 :     =item RETURN
411 :    
412 :     Returns a statistics object describing the load.
413 :    
414 :     =back
415 :    
416 :     Permissible option values are as follows.
417 :    
418 :     =over 4
419 :    
420 :     =item append
421 :    
422 :     If TRUE, then the attributes will be appended to existing data; otherwise, the
423 :     first time a key name is encountered, it will be erased.
424 :    
425 : parrello 1.20 =item archive
426 :    
427 :     If specified, the name of a file into which the incoming data file should be saved.
428 :    
429 :     =item objectType
430 :    
431 :     If specified, the specified object type will be prefixed to each object ID.
432 :    
433 : parrello 1.11 =back
434 :    
435 :     =cut
436 :    
437 :     sub LoadAttributesFrom {
438 :     # Get the parameters.
439 :     my ($self, $fileName, %options) = @_;
440 :     # Declare the return variable.
441 :     my $retVal = Stats->new('keys', 'values');
442 :     # Check for append mode.
443 :     my $append = ($options{append} ? 1 : 0);
444 :     # Create a hash of key names found.
445 :     my %keyHash = ();
446 : parrello 1.20 # Open the file for input. Note we must anticipate the possibility of an
447 :     # open filehandle being passed in.
448 :     my $fh;
449 : parrello 1.21 if (ref $fileName) {
450 : parrello 1.20 Trace("Using file opened by caller.") if T(3);
451 :     $fh = $fileName;
452 :     } else {
453 :     Trace("Attributes will be loaded from $fileName.") if T(3);
454 :     $fh = Open(undef, "<$fileName");
455 :     }
456 :     # Now check to see if we need to archive.
457 :     my $ah;
458 :     if ($options{archive}) {
459 :     $ah = Open(undef, ">$options{archive}");
460 :     Trace("Load file will be archived to $options{archive}.") if T(3);
461 :     }
462 :     # Finally, open a database transaction.
463 :     $self->BeginTran();
464 :     # Insure we recover from errors. If an error occurs, we will delete the archive file and
465 :     # roll back the updates.
466 :     eval {
467 :     # Loop through the file.
468 :     while (! eof $fh) {
469 :     # Read the current line.
470 :     my ($id, $key, @values) = Tracer::GetLine($fh);
471 :     $retVal->Add(linesIn => 1);
472 :     # Check to see if we need to fix up the object ID.
473 :     if ($options{objectType}) {
474 :     $id = "$options{objectType}:$id";
475 :     }
476 :     # Archive the line (if necessary).
477 :     if (defined $ah) {
478 :     Tracer::PutLine($ah, [$id, $key, @values]);
479 :     }
480 :     # Do some validation.
481 :     if (! $id) {
482 :     # We ignore blank lines.
483 :     $retVal->Add(blankLines => 1);
484 :     } elsif (substr($id, 0, 1) eq '#') {
485 :     # A line beginning with a pound sign is a comment.
486 :     $retVal->Add(comments => 1);
487 :     } elsif (! defined($key)) {
488 :     # An ID without a key is a serious error.
489 :     my $lines = $retVal->Ask('linesIn');
490 :     Confess("Line $lines in $fileName has no attribute key.");
491 : parrello 1.23 } elsif (! @values) {
492 :     # A line with no values is not allowed.
493 :     my $lines = $retVal->Ask('linesIn');
494 :     Trace("Line $lines for key $key has no attribute values.") if T(1);
495 :     $retVal->Add(skipped => 1);
496 : parrello 1.20 } else {
497 :     # The key contains a real part and an optional sub-part. We need the real part.
498 :     my ($realKey, $subKey) = $self->SplitKey($key);
499 :     # Now we need to check for a new key.
500 :     if (! exists $keyHash{$realKey}) {
501 :     if (! $self->Exists('AttributeKey', $realKey)) {
502 :     my $line = $retVal->Ask('linesIn');
503 :     Confess("Attribute \"$realKey\" on line $line of $fileName not found in database.");
504 :     } else {
505 :     # Make sure we know this is no longer a new key.
506 :     $keyHash{$realKey} = 1;
507 :     $retVal->Add(keys => 1);
508 :     # If this is NOT append mode, erase the key.
509 :     if (! $append) {
510 :     $self->EraseAttribute($realKey);
511 :     }
512 : parrello 1.11 }
513 : parrello 1.20 Trace("Key $realKey found.") if T(3);
514 : parrello 1.11 }
515 : parrello 1.20 # Everything is all set up, so add the value.
516 :     $self->AddAttribute($id, $key, @values);
517 :     my $progress = $retVal->Add(values => 1);
518 :     Trace("$progress values loaded.") if T(3) && ($progress % 1000 == 0);
519 : parrello 1.11 }
520 : parrello 1.20 }
521 :     };
522 :     # Check for an error.
523 :     if ($@) {
524 :     # Here we have an error. Roll back the transaction and delete the archive file.
525 :     my $message = $@;
526 :     Trace("Rolling back attribute updates due to error.") if T(1);
527 :     $self->RollbackTran();
528 :     if (defined $ah) {
529 :     Trace("Deleting archive file $options{archive}.") if T(1);
530 :     close $ah;
531 :     unlink $options{archive};
532 :     }
533 :     Confess("Error during attribute load: $message");
534 :     } else {
535 :     # Here the load worked. Commit the transaction and close the archive file.
536 :     Trace("Committing attribute upload.") if T(2);
537 :     $self->CommitTran();
538 :     if (defined $ah) {
539 :     Trace("Closing archive file $options{archive}.") if T(2);
540 :     close $ah;
541 : parrello 1.11 }
542 :     }
543 :     # Return the result.
544 :     return $retVal;
545 :     }
546 :    
547 : parrello 1.13 =head3 BackupKeys
548 :    
549 :     C<< my $stats = $attrDB->BackupKeys($fileName, %options); >>
550 :    
551 :     Backup the attribute key information from the attribute database.
552 :    
553 :     =over 4
554 :    
555 :     =item fileName
556 :    
557 :     Name of the output file.
558 :    
559 :     =item options
560 :    
561 :     Options for modifying the backup process.
562 :    
563 :     =item RETURN
564 :    
565 :     Returns a statistics object for the backup.
566 :    
567 :     =back
568 :    
569 :     Currently there are no options. The backup is straight to a text file in
570 :     tab-delimited format. Each key is backup up to two lines. The first line
571 :     is all of the data from the B<AttributeKey> table. The second is a
572 :     tab-delimited list of all the groups.
573 :    
574 :     =cut
575 :    
576 :     sub BackupKeys {
577 :     # Get the parameters.
578 :     my ($self, $fileName, %options) = @_;
579 :     # Declare the return variable.
580 :     my $retVal = Stats->new();
581 :     # Open the output file.
582 :     my $fh = Open(undef, ">$fileName");
583 :     # Set up to read the keys.
584 :     my $keyQuery = $self->Get(['AttributeKey'], "", []);
585 :     # Loop through the keys.
586 :     while (my $keyData = $keyQuery->Fetch()) {
587 :     $retVal->Add(key => 1);
588 :     # Get the fields.
589 :     my ($id, $type, $description) = $keyData->Values(['AttributeKey(id)', 'AttributeKey(data-type)',
590 :     'AttributeKey(description)']);
591 :     # Escape any tabs or new-lines in the description.
592 :     my $escapedDescription = Tracer::Escape($description);
593 :     # Write the key data to the output.
594 :     Tracer::PutLine($fh, [$id, $type, $escapedDescription]);
595 :     # Get the key's groups.
596 :     my @groups = $self->GetFlat(['IsInGroup'], "IsInGroup(from-link) = ?", [$id],
597 :     'IsInGroup(to-link)');
598 :     $retVal->Add(memberships => scalar(@groups));
599 :     # Write them to the output. Note we put a marker at the beginning to insure the line
600 :     # is nonempty.
601 :     Tracer::PutLine($fh, ['#GROUPS', @groups]);
602 :     }
603 : parrello 1.18 # Log the operation.
604 :     $self->LogOperation("Backup Keys", $fileName, $retVal->Display());
605 : parrello 1.13 # Return the result.
606 :     return $retVal;
607 :     }
608 :    
609 :     =head3 RestoreKeys
610 :    
611 :     C<< my $stats = $attrDB->RestoreKeys($fileName, %options); >>
612 :    
613 :     Restore the attribute keys and groups from a backup file.
614 :    
615 :     =over 4
616 :    
617 :     =item fileName
618 :    
619 :     Name of the file containing the backed-up keys. Each key has a pair of lines,
620 :     one containing the key data and one listing its groups.
621 :    
622 :     =back
623 :    
624 :     =cut
625 :    
626 :     sub RestoreKeys {
627 :     # Get the parameters.
628 :     my ($self, $fileName, %options) = @_;
629 :     # Declare the return variable.
630 :     my $retVal = Stats->new();
631 :     # Set up a hash to hold the group IDs.
632 :     my %groups = ();
633 :     # Open the file.
634 :     my $fh = Open(undef, "<$fileName");
635 :     # Loop until we're done.
636 :     while (! eof $fh) {
637 :     # Get a key record.
638 :     my ($id, $dataType, $description) = Tracer::GetLine($fh);
639 :     if ($id eq '#GROUPS') {
640 :     Confess("Group record found when key record expected.");
641 :     } elsif (! defined($description)) {
642 :     Confess("Invalid format found for key record.");
643 :     } else {
644 :     $retVal->Add("keyIn" => 1);
645 :     # Add this key to the database.
646 :     $self->InsertObject('AttributeKey', { id => $id, 'data-type' => $dataType,
647 :     description => Tracer::UnEscape($description) });
648 :     Trace("Attribute $id stored.") if T(3);
649 :     # Get the group line.
650 :     my ($marker, @groups) = Tracer::GetLine($fh);
651 :     if (! defined($marker)) {
652 :     Confess("End of file found where group record expected.");
653 :     } elsif ($marker ne '#GROUPS') {
654 :     Confess("Group record not found after key record.");
655 :     } else {
656 :     $retVal->Add(memberships => scalar(@groups));
657 :     # Connect the groups.
658 :     for my $group (@groups) {
659 :     # Find out if this is a new group.
660 :     if (! $groups{$group}) {
661 :     $retVal->Add(newGroup => 1);
662 :     # Add the group.
663 :     $self->InsertObject('AttributeGroup', { id => $group });
664 :     Trace("Group $group created.") if T(3);
665 :     # Make sure we know it's not new.
666 :     $groups{$group} = 1;
667 :     }
668 :     # Connect the group to our key.
669 :     $self->InsertObject('IsInGroup', { 'from-link' => $id, 'to-link' => $group });
670 :     }
671 :     Trace("$id added to " . scalar(@groups) . " groups.") if T(3);
672 :     }
673 :     }
674 :     }
675 : parrello 1.18 # Log the operation.
676 :     $self->LogOperation("Backup Keys", $fileName, $retVal->Display());
677 : parrello 1.13 # Return the result.
678 :     return $retVal;
679 :     }
680 :    
681 : parrello 1.20 =head3 ArchiveFileName
682 :    
683 :     C<< my $fileName = $ca->ArchiveFileName(); >>
684 :    
685 :     Compute a file name for archiving attribute input data. The file will be in the attribute log directory
686 :    
687 :     =cut
688 :    
689 :     sub ArchiveFileName {
690 :     # Get the parameters.
691 :     my ($self) = @_;
692 :     # Declare the return variable.
693 :     my $retVal;
694 :     # We start by turning the timestamp into something usable as a file name.
695 :     my $now = Tracer::Now();
696 :     $now =~ tr/ :\//___/;
697 :     # Next we get the directory name.
698 :     my $dir = "$FIG_Config::var/attributes";
699 :     if (! -e $dir) {
700 :     Trace("Creating attribute file directory $dir.") if T(1);
701 :     mkdir $dir;
702 :     }
703 :     # Put it together with the field name and the time stamp.
704 :     $retVal = "$dir/upload.$now";
705 :     # Modify the file name to insure it's unique.
706 :     my $seq = 0;
707 :     while (-e "$retVal.$seq.tbl") { $seq++ }
708 :     # Use the computed sequence number to get the correct file name.
709 :     $retVal .= ".$seq.tbl";
710 :     # Return the result.
711 :     return $retVal;
712 :     }
713 : parrello 1.13
714 : parrello 1.11 =head3 BackupAllAttributes
715 :    
716 :     C<< my $stats = $attrDB->BackupAllAttributes($fileName, %options); >>
717 :    
718 :     Backup all of the attributes to a file. The attributes will be stored in a
719 :     tab-delimited file suitable for reloading via L</LoadAttributesFrom>.
720 :    
721 :     =over 4
722 :    
723 :     =item fileName
724 :    
725 :     Name of the file to which the attribute data should be backed up.
726 :    
727 :     =item options
728 :    
729 :     Hash of options for the backup.
730 :    
731 :     =item RETURN
732 :    
733 :     Returns a statistics object describing the backup.
734 :    
735 :     =back
736 :    
737 :     Currently there are no options defined.
738 :    
739 :     =cut
740 :    
741 :     sub BackupAllAttributes {
742 :     # Get the parameters.
743 :     my ($self, $fileName, %options) = @_;
744 :     # Declare the return variable.
745 :     my $retVal = Stats->new();
746 :     # Get a list of the keys.
747 :     my @keys = $self->GetFlat(['AttributeKey'], "", [], 'AttributeKey(id)');
748 :     Trace(scalar(@keys) . " keys found during backup.") if T(2);
749 :     # Open the file for output.
750 : parrello 1.12 my $fh = Open(undef, ">$fileName");
751 : parrello 1.11 # Loop through the keys.
752 :     for my $key (@keys) {
753 :     Trace("Backing up attribute $key.") if T(3);
754 :     $retVal->Add(keys => 1);
755 :     # Loop through this key's values.
756 : parrello 1.12 my $query = $self->Get(['HasValueFor'], "HasValueFor(from-link) = ?", [$key]);
757 : parrello 1.11 my $valuesFound = 0;
758 :     while (my $line = $query->Fetch()) {
759 :     $valuesFound++;
760 :     # Get this row's data.
761 : parrello 1.20 my ($id, $key, $subKey, $value) = $line->Values(['HasValueFor(to-link)',
762 :     'HasValueFor(from-link)',
763 :     'HasValueFor(subkey)',
764 :     'HasValueFor(value)']);
765 :     # Check for a subkey.
766 :     if ($subKey ne '') {
767 :     $key = "$key$self->{splitter}$subKey";
768 :     }
769 : parrello 1.11 # Write it to the file.
770 : parrello 1.20 Tracer::PutLine($fh, [$id, $key, $value]);
771 : parrello 1.11 }
772 :     Trace("$valuesFound values backed up for key $key.") if T(3);
773 :     $retVal->Add(values => $valuesFound);
774 :     }
775 : parrello 1.18 # Log the operation.
776 :     $self->LogOperation("Backup Data", $fileName, $retVal->Display());
777 : parrello 1.11 # Return the result.
778 :     return $retVal;
779 :     }
780 :    
781 : parrello 1.1 =head3 FieldMenu
782 :    
783 : parrello 1.10 C<< my $menuHtml = $attrDB->FieldMenu($cgi, $height, $name, $keys, %options); >>
784 : parrello 1.1
785 :     Return the HTML for a menu to select an attribute field. The menu will
786 :     be a standard SELECT/OPTION thing which is called "popup menu" in the
787 :     CGI package, but actually looks like a list. The list will contain
788 : parrello 1.10 one selectable row per field.
789 : parrello 1.1
790 :     =over 4
791 :    
792 :     =item cgi
793 :    
794 :     CGI query object used to generate HTML.
795 :    
796 :     =item height
797 :    
798 :     Number of lines to display in the list.
799 :    
800 :     =item name
801 :    
802 :     Name to give to the menu. This is the name under which the value will
803 :     appear when the form is submitted.
804 :    
805 : parrello 1.10 =item keys
806 :    
807 :     Reference to a hash mapping each attribute key name to a list reference,
808 :     the list itself consisting of the attribute data type, its description,
809 :     and a list of its groups.
810 :    
811 :     =item options
812 :    
813 :     Hash containing options that modify the generation of the menu.
814 :    
815 :     =item RETURN
816 :    
817 :     Returns the HTML to create a form field that can be used to select an
818 :     attribute from the custom attributes system.
819 :    
820 :     =back
821 :    
822 :     The permissible options are as follows.
823 :    
824 :     =over 4
825 :    
826 :     =item new
827 : parrello 1.1
828 :     If TRUE, then extra rows will be provided to allow the user to select
829 :     a new attribute. In other words, the user can select an existing
830 :     attribute, or can choose a C<(new)> marker to indicate a field to
831 :     be created in the parent entity.
832 :    
833 : parrello 1.10 =item notes
834 : parrello 1.1
835 :     If specified, the name of a variable for displaying the notes attached
836 :     to the field. This must be in Javascript form ready for assignment.
837 :     So, for example, if you have a variable called C<notes> that
838 :     represents a paragraph element, you should code C<notes.innerHTML>.
839 :     If it actually represents a form field you should code C<notes.value>.
840 :     If an C<innerHTML> coding is used, the text will be HTML-escaped before
841 :     it is copied in. Specifying this parameter generates Javascript for
842 :     displaying the field description when a field is selected.
843 :    
844 : parrello 1.10 =item type
845 : parrello 1.1
846 :     If specified, the name of a variable for displaying the field's
847 :     data type. Data types are a much more controlled vocabulary than
848 :     notes, so there is no worry about HTML translation. Instead, the
849 :     raw value is put into the specified variable. Otherwise, the same
850 :     rules apply to this value that apply to I<$noteControl>.
851 :    
852 : parrello 1.10 =item groups
853 : parrello 1.1
854 : parrello 1.10 If specified, the name of a multiple-selection list control (also called
855 :     a popup menu) which shall be used to display the selected groups.
856 : parrello 1.1
857 :     =back
858 :    
859 :     =cut
860 :    
861 :     sub FieldMenu {
862 :     # Get the parameters.
863 : parrello 1.10 my ($self, $cgi, $height, $name, $keys, %options) = @_;
864 :     # Reformat the list of keys.
865 :     my %keys = %{$keys};
866 :     # Add the (new) key, if needed.
867 :     if ($options{new}) {
868 :     $keys{NewName()} = ["string", ""];
869 : parrello 1.1 }
870 : parrello 1.10 # Get a sorted list of key.
871 :     my @keys = sort keys %keys;
872 :     # We need to create the name for the onChange function. This function
873 : parrello 1.1 # may not do anything, but we need to know the name to generate the HTML
874 :     # for the menu.
875 :     my $changeName = "${name}_setNotes";
876 :     my $retVal = $cgi->popup_menu({name => $name,
877 :     size => $height,
878 :     onChange => "$changeName(this.value)",
879 : parrello 1.10 values => \@keys,
880 :     });
881 : parrello 1.1 # Create the change function.
882 :     $retVal .= "\n<script language=\"javascript\">\n";
883 :     $retVal .= " function $changeName(fieldValue) {\n";
884 : parrello 1.10 # The function only has a body if we have a control to store data about the
885 :     # attribute.
886 :     if ($options{notes} || $options{type} || $options{groups}) {
887 : parrello 1.1 # Check to see if we're storing HTML or text into the note control.
888 : parrello 1.10 my $noteControl = $options{notes};
889 : parrello 1.1 my $htmlMode = ($noteControl && $noteControl =~ /innerHTML$/);
890 :     # We use a CASE statement based on the newly-selected field value. The
891 :     # field description will be stored in the JavaScript variable "myText"
892 :     # and the data type in "myType". Note the default data type is a normal
893 :     # string, but the default notes is an empty string.
894 :     $retVal .= " var myText = \"\";\n";
895 :     $retVal .= " var myType = \"string\";\n";
896 :     $retVal .= " switch (fieldValue) {\n";
897 : parrello 1.10 # Loop through the keys.
898 :     for my $key (@keys) {
899 :     # Generate this case.
900 :     $retVal .= " case \"$key\" :\n";
901 :     # Here we either want to update the note display, the
902 :     # type display, the group list, or a combination of them.
903 :     my ($type, $notes, @groups) = @{$keys{$key}};
904 :     if ($noteControl) {
905 :     # Insure it's in the proper form.
906 :     if ($htmlMode) {
907 :     $notes = ERDB::HTMLNote($notes);
908 : parrello 1.1 }
909 : parrello 1.10 # Escape it for use as a string literal.
910 :     $notes =~ s/\n/\\n/g;
911 :     $notes =~ s/"/\\"/g;
912 :     $retVal .= " myText = \"$notes\";\n";
913 :     }
914 :     if ($options{type}) {
915 :     # Here we want the type updated.
916 :     $retVal .= " myType = \"$type\";\n";
917 :     }
918 :     if ($options{groups}) {
919 :     # Here we want the groups shown. Get a list of this attribute's groups.
920 :     # We'll search through this list for each group to see if it belongs with
921 :     # our attribute.
922 :     my $groupLiteral = "=" . join("=", @groups) . "=";
923 :     # Now we need some variables containing useful code for the javascript. It's
924 :     # worth knowing we go through a bit of pain to insure $groupField[i] isn't
925 :     # parsed as an array element.
926 :     my $groupField = $options{groups};
927 :     my $currentField = $groupField . "[i]";
928 :     # Do the javascript.
929 :     $retVal .= " var groupList = \"$groupLiteral\";\n";
930 :     $retVal .= " for (var i = 0; i < $groupField.length; i++) {\n";
931 :     $retVal .= " var srchString = \"=\" + $currentField.value + \"=\";\n";
932 :     $retVal .= " var srchLoc = groupList.indexOf(srchString);\n";
933 :     $retVal .= " $currentField.checked = (srchLoc >= 0);\n";
934 :     $retVal .= " }\n";
935 : parrello 1.1 }
936 : parrello 1.10 # Close this case.
937 :     $retVal .= " break;\n";
938 : parrello 1.1 }
939 :     # Close the CASE statement and make the appropriate assignments.
940 :     $retVal .= " }\n";
941 :     if ($noteControl) {
942 :     $retVal .= " $noteControl = myText;\n";
943 :     }
944 : parrello 1.10 if ($options{type}) {
945 :     $retVal .= " $options{type} = myType;\n";
946 : parrello 1.1 }
947 :     }
948 :     # Terminate the change function.
949 :     $retVal .= " }\n";
950 :     $retVal .= "</script>\n";
951 :     # Return the result.
952 :     return $retVal;
953 :     }
954 :    
955 : parrello 1.10 =head3 GetGroups
956 : parrello 1.3
957 : parrello 1.10 C<< my @groups = $attrDB->GetGroups(); >>
958 : parrello 1.3
959 : parrello 1.10 Return a list of the available groups.
960 : parrello 1.3
961 :     =cut
962 :    
963 : parrello 1.10 sub GetGroups {
964 : parrello 1.3 # Get the parameters.
965 : parrello 1.10 my ($self) = @_;
966 :     # Get the groups.
967 :     my @retVal = $self->GetFlat(['AttributeGroup'], "", [], 'AttributeGroup(id)');
968 :     # Return them.
969 :     return @retVal;
970 : parrello 1.3 }
971 :    
972 : parrello 1.10 =head3 GetAttributeData
973 : parrello 1.3
974 : parrello 1.10 C<< my %keys = $attrDB->GetAttributeData($type, @list); >>
975 : parrello 1.3
976 : parrello 1.10 Return attribute data for the selected attributes. The attribute
977 :     data is a hash mapping each attribute key name to a n-tuple containing the
978 :     data type, the description, and the groups. This is the same format expected in
979 :     the L</FieldMenu> and L</ControlForm> methods for the list of attributes to display.
980 : parrello 1.3
981 :     =over 4
982 :    
983 : parrello 1.10 =item type
984 : parrello 1.4
985 : parrello 1.10 Type of attribute criterion: C<name> for attributes whose names begin with the
986 :     specified string, or C<group> for attributes in the specified group.
987 : parrello 1.4
988 : parrello 1.10 =item list
989 : parrello 1.4
990 : parrello 1.10 List containing the names of the groups or keys for the desired attributes.
991 : parrello 1.4
992 :     =item RETURN
993 :    
994 : parrello 1.10 Returns a hash mapping each attribute key name to its data type, description, and
995 :     parent groups.
996 : parrello 1.4
997 :     =back
998 :    
999 :     =cut
1000 :    
1001 : parrello 1.10 sub GetAttributeData {
1002 : parrello 1.4 # Get the parameters.
1003 : parrello 1.10 my ($self, $type, @list) = @_;
1004 :     # Set up a hash to store the attribute data.
1005 :     my %retVal = ();
1006 :     # Loop through the list items.
1007 :     for my $item (@list) {
1008 :     # Set up a query for the desired attributes.
1009 :     my $query;
1010 :     if ($type eq 'name') {
1011 :     # Here we're doing a generic name search. We need to escape it and then tack
1012 :     # on a %.
1013 :     my $parm = $item;
1014 :     $parm =~ s/_/\\_/g;
1015 :     $parm =~ s/%/\\%/g;
1016 :     $parm .= "%";
1017 :     # Ask for matching attributes. (Note that if the user passed in a null string
1018 :     # he'll get everything.)
1019 :     $query = $self->Get(['AttributeKey'], "AttributeKey(id) LIKE ?", [$parm]);
1020 :     } elsif ($type eq 'group') {
1021 :     $query = $self->Get(['IsInGroup', 'AttributeKey'], "IsInGroup(to-link) = ?", [$item]);
1022 : parrello 1.4 } else {
1023 : parrello 1.10 Confess("Unknown attribute query type \"$type\".");
1024 :     }
1025 :     while (my $row = $query->Fetch()) {
1026 :     # Get this attribute's data.
1027 :     my ($key, $type, $notes) = $row->Values(['AttributeKey(id)', 'AttributeKey(data-type)',
1028 :     'AttributeKey(description)']);
1029 :     # If it's new, get its groups and add it to the return hash.
1030 :     if (! exists $retVal{$key}) {
1031 :     my @groups = $self->GetFlat(['IsInGroup'], "IsInGroup(from-link) = ?",
1032 :     [$key], 'IsInGroup(to-link)');
1033 :     $retVal{$key} = [$type, $notes, @groups];
1034 : parrello 1.4 }
1035 :     }
1036 :     }
1037 :     # Return the result.
1038 : parrello 1.10 return %retVal;
1039 : parrello 1.4 }
1040 :    
1041 : parrello 1.18 =head3 LogOperation
1042 :    
1043 :     C<< $ca->LogOperation($action, $target, $description); >>
1044 :    
1045 :     Write an operation description to the attribute activity log (C<$FIG_Config::var/attributes.log>).
1046 :    
1047 :     =over 4
1048 :    
1049 :     =item action
1050 :    
1051 :     Action being logged (e.g. C<Delete Group> or C<Load Key>).
1052 :    
1053 :     =item target
1054 :    
1055 :     ID of the key or group affected.
1056 :    
1057 :     =item description
1058 :    
1059 :     Short description of the action.
1060 :    
1061 :     =back
1062 :    
1063 :     =cut
1064 :    
1065 :     sub LogOperation {
1066 :     # Get the parameters.
1067 :     my ($self, $action, $target, $description) = @_;
1068 :     # Get the user ID.
1069 :     my $user = $self->{user};
1070 :     # Get a timestamp.
1071 :     my $timeString = Tracer::Now();
1072 :     # Open the log file for appending.
1073 :     my $oh = Open(undef, ">>$FIG_Config::var/attributes.log");
1074 :     # Write the data to it.
1075 :     Tracer::PutLine($oh, [$timeString, $user, $action, $target, $description]);
1076 :     # Close the log file.
1077 :     close $oh;
1078 :     }
1079 :    
1080 : parrello 1.15 =head2 Internal Utility Methods
1081 :    
1082 :     =head3 _KeywordString
1083 :    
1084 :     C<< my $keywordString = $ca->_KeywordString($key, $value); >>
1085 :    
1086 :     Compute the keyword string for a specified key/value pair. This consists of the
1087 :     key name and value converted to lower case with underscores translated to spaces.
1088 :    
1089 :     This method is for internal use only. It is called whenever we need to update or
1090 :     insert a B<HasValueFor> record.
1091 :    
1092 :     =over 4
1093 :    
1094 :     =item key
1095 :    
1096 :     Name of the relevant attribute key.
1097 :    
1098 :     =item target
1099 :    
1100 :     ID of the target object to which this key/value pair will be associated.
1101 :    
1102 :     =item value
1103 :    
1104 :     The value to store for this key/object combination.
1105 :    
1106 :     =item RETURN
1107 :    
1108 :     Returns the value that should be stored as the keyword string for the specified
1109 :     key/value pair.
1110 :    
1111 :     =back
1112 :    
1113 :     =cut
1114 :    
1115 :     sub _KeywordString {
1116 :     # Get the parameters.
1117 :     my ($self, $key, $value) = @_;
1118 :     # Get a copy of the key name and convert underscores to spaces.
1119 :     my $keywordString = $key;
1120 :     $keywordString =~ s/_/ /g;
1121 :     # Add the value convert it all to lower case.
1122 :     my $retVal = lc "$keywordString $value";
1123 :     # Return the result.
1124 :     return $retVal;
1125 :     }
1126 :    
1127 :     =head3 _QueryResults
1128 :    
1129 :     C<< my @attributeList = $attrDB->_QueryResults($query, @values); >>
1130 :    
1131 :     Match the results of a B<HasValueFor> query against value criteria and return
1132 :     the results. This is an internal method that splits the values coming back
1133 :     and matches the sections against the specified section patterns. It serves
1134 :     as the back end to L</GetAttributes> and L</FindAttributes>.
1135 :    
1136 :     =over 4
1137 :    
1138 :     =item query
1139 :    
1140 :     A query object that will return the desired B<HasValueFor> records.
1141 :    
1142 :     =item values
1143 :    
1144 :     List of the desired attribute values, section by section. If C<undef>
1145 :     or an empty string is specified, all values in that section will match. A
1146 :     generic match can be requested by placing a percent sign (C<%>) at the end.
1147 :     In that case, all values that match up to and not including the percent sign
1148 :     will match. You may also specify a regular expression enclosed
1149 :     in slashes. All values that match the regular expression will be returned. For
1150 :     performance reasons, only values have this extra capability.
1151 :    
1152 :     =item RETURN
1153 :    
1154 :     Returns a list of tuples. The first element in the tuple is an object ID, the
1155 :     second is an attribute key, and the remaining elements are the sections of
1156 :     the attribute value. All of the tuples will match the criteria set forth in
1157 :     the parameter list.
1158 :    
1159 :     =back
1160 :    
1161 :     =cut
1162 :    
1163 :     sub _QueryResults {
1164 :     # Get the parameters.
1165 :     my ($self, $query, @values) = @_;
1166 :     # Declare the return value.
1167 :     my @retVal = ();
1168 :     # Get the number of value sections we have to match.
1169 :     my $sectionCount = scalar(@values);
1170 :     # Loop through the assignments found.
1171 :     while (my $row = $query->Fetch()) {
1172 :     # Get the current row's data.
1173 : parrello 1.20 my ($id, $realKey, $subKey, $valueString) = $row->Values(['HasValueFor(to-link)',
1174 :     'HasValueFor(from-link)',
1175 :     'HasValueFor(subkey)',
1176 :     'HasValueFor(value)'
1177 :     ]);
1178 :     # Form the key from the real key and the sub key.
1179 :     my $key = $self->JoinKey($realKey, $subKey);
1180 : parrello 1.15 # Break the value into sections.
1181 :     my @sections = split($self->{splitter}, $valueString);
1182 :     # Match each section against the incoming values. We'll assume we're
1183 :     # okay unless we learn otherwise.
1184 :     my $matching = 1;
1185 :     for (my $i = 0; $i < $sectionCount && $matching; $i++) {
1186 :     # We need to check to see if this section is generic.
1187 :     my $value = $values[$i];
1188 :     Trace("Current value pattern is \"$value\".") if T(4);
1189 :     if (substr($value, -1, 1) eq '%') {
1190 :     Trace("Generic match used.") if T(4);
1191 :     # Here we have a generic match.
1192 : parrello 1.20 my $matchLen = length($values[$i]) - 1;
1193 : parrello 1.15 $matching = substr($sections[$i], 0, $matchLen) eq
1194 :     substr($values[$i], 0, $matchLen);
1195 :     } elsif ($value =~ m#^/(.+)/[a-z]*$#) {
1196 :     Trace("Regular expression detected.") if T(4);
1197 :     # Here we have a regular expression match.
1198 :     my $section = $sections[$i];
1199 :     $matching = eval("\$section =~ $value");
1200 :     } else {
1201 :     # Here we have a strict match.
1202 :     Trace("Strict match used.") if T(4);
1203 :     $matching = ($sections[$i] eq $values[$i]);
1204 :     }
1205 :     }
1206 :     # If we match, output this row to the return list.
1207 :     if ($matching) {
1208 :     push @retVal, [$id, $key, @sections];
1209 :     }
1210 :     }
1211 :     # Return the rows found.
1212 :     return @retVal;
1213 :     }
1214 :    
1215 : parrello 1.3 =head2 FIG Method Replacements
1216 :    
1217 :     The following methods are used by B<FIG.pm> to replace the previous attribute functionality.
1218 : parrello 1.10 Some of the old functionality is no longer present: controlled vocabulary is no longer
1219 : parrello 1.3 supported and there is no longer any searching by URL. Fortunately, neither of these
1220 :     capabilities were used in the old system.
1221 :    
1222 : parrello 1.4 The methods here are the only ones supported by the B<RemoteCustomAttributes> object.
1223 :     The idea is that these methods represent attribute manipulation allowed by all users, while
1224 :     the others are only for privileged users with access to the attribute server.
1225 :    
1226 : parrello 1.20 In the previous implementation, an attribute had a value and a URL. In this implementation,
1227 :     each attribute has only a value. These methods will treat the value as a list with the individual
1228 :     elements separated by the value of the splitter parameter on the constructor (L</new>). The default
1229 :     is double colons C<::>.
1230 : parrello 1.3
1231 : parrello 1.10 So, for example, an old-style keyword with a value of C<essential> and a URL of
1232 : parrello 1.3 C<http://www.sciencemag.org/cgi/content/abstract/293/5538/2266> using the default
1233 :     splitter value would be stored as
1234 :    
1235 :     essential::http://www.sciencemag.org/cgi/content/abstract/293/5538/2266
1236 :    
1237 :     The best performance is achieved by searching for a particular key for a specified
1238 :     feature or genome.
1239 :    
1240 :     =head3 GetAttributes
1241 :    
1242 : parrello 1.10 C<< my @attributeList = $attrDB->GetAttributes($objectID, $key, @values); >>
1243 : parrello 1.3
1244 :     In the database, attribute values are sectioned into pieces using a splitter
1245 :     value specified in the constructor (L</new>). This is not a requirement of
1246 :     the attribute system as a whole, merely a convenience for the purpose of
1247 : parrello 1.10 these methods. If a value has multiple sections, each section
1248 :     is matched against the corresponding criterion in the I<@valuePatterns> list.
1249 : parrello 1.3
1250 :     This method returns a series of tuples that match the specified criteria. Each tuple
1251 :     will contain an object ID, a key, and one or more values. The parameters to this
1252 : parrello 1.10 method therefore correspond structurally to the values expected in each tuple. In
1253 :     addition, you can ask for a generic search by suffixing a percent sign (C<%>) to any
1254 :     of the parameters. So, for example,
1255 : parrello 1.3
1256 : parrello 1.10 my @attributeList = $attrDB->GetAttributes('fig|100226.1.peg.1004', 'structure%', 1, 2);
1257 : parrello 1.3
1258 :     would return something like
1259 :    
1260 :     ['fig}100226.1.peg.1004', 'structure', 1, 2]
1261 :     ['fig}100226.1.peg.1004', 'structure1', 1, 2]
1262 :     ['fig}100226.1.peg.1004', 'structure2', 1, 2]
1263 :     ['fig}100226.1.peg.1004', 'structureA', 1, 2]
1264 :    
1265 : parrello 1.10 Use of C<undef> in any position acts as a wild card (all values). You can also specify
1266 :     a list reference in the ID column. Thus,
1267 :    
1268 :     my @attributeList = $attrDB->GetAttributes(['100226.1', 'fig|100226.1.%'], 'PUBMED');
1269 :    
1270 :     would get the PUBMED attribute data for Streptomyces coelicolor A3(2) and all its
1271 :     features.
1272 : parrello 1.3
1273 :     In addition to values in multiple sections, a single attribute key can have multiple
1274 :     values, so even
1275 :    
1276 : parrello 1.10 my @attributeList = $attrDB->GetAttributes($peg, 'virulent');
1277 : parrello 1.3
1278 :     which has no wildcard in the key or the object ID, may return multiple tuples.
1279 :    
1280 : parrello 1.10 Value matching in this system works very poorly, because of the way multiple values are
1281 : parrello 1.20 stored. For the object ID, key name, and first value, we create queries that filter for the
1282 :     desired results. On any filtering by value, we must do a comparison after the attributes are
1283 :     retrieved from the database, since the database has no notion of the multiple values, which
1284 :     are stored in a single string. As a result, queries in which filter only on value end up
1285 :     reading a lot more than they need to.
1286 : parrello 1.3
1287 :     =over 4
1288 :    
1289 :     =item objectID
1290 :    
1291 : parrello 1.10 ID of object whose attributes are desired. If the attributes are desired for multiple
1292 :     objects, this parameter can be specified as a list reference. If the attributes are
1293 :     desired for all objects, specify C<undef> or an empty string. Finally, you can specify
1294 :     attributes for a range of object IDs by putting a percent sign (C<%>) at the end.
1295 : parrello 1.3
1296 :     =item key
1297 :    
1298 : parrello 1.10 Attribute key name. A value of C<undef> or an empty string will match all
1299 :     attribute keys. If the values are desired for multiple keys, this parameter can be
1300 :     specified as a list reference. Finally, you can specify attributes for a range of
1301 :     keys by putting a percent sign (C<%>) at the end.
1302 : parrello 1.3
1303 : parrello 1.10 =item values
1304 : parrello 1.3
1305 :     List of the desired attribute values, section by section. If C<undef>
1306 : parrello 1.10 or an empty string is specified, all values in that section will match. A
1307 :     generic match can be requested by placing a percent sign (C<%>) at the end.
1308 :     In that case, all values that match up to and not including the percent sign
1309 : parrello 1.14 will match. You may also specify a regular expression enclosed
1310 :     in slashes. All values that match the regular expression will be returned. For
1311 :     performance reasons, only values have this extra capability.
1312 : parrello 1.3
1313 :     =item RETURN
1314 :    
1315 :     Returns a list of tuples. The first element in the tuple is an object ID, the
1316 :     second is an attribute key, and the remaining elements are the sections of
1317 :     the attribute value. All of the tuples will match the criteria set forth in
1318 :     the parameter list.
1319 :    
1320 :     =back
1321 :    
1322 :     =cut
1323 :    
1324 :     sub GetAttributes {
1325 : parrello 1.4 # Get the parameters.
1326 : parrello 1.10 my ($self, $objectID, $key, @values) = @_;
1327 : parrello 1.20 # This hash will map "HasValueFor" fields to patterns. We use it to build the
1328 :     # SQL statement.
1329 :     my %data;
1330 :     # Before we do anything else, we must parse the key. The key is treated by the
1331 :     # user as a single field, but to us it's actually a real key and a subkey.
1332 :     # If the key has no splitter and is exact, the real key is the original key
1333 :     # and the subkey is an empty string. If the key has a splitter, it is
1334 :     # split into two pieces and each piece is processed separately. If the key has
1335 :     # no splitter and is generic, the real key is the incoming key and the subkey
1336 :     # is allowed to be wild. Of course, this only matters if an actual key has
1337 :     # been specified.
1338 :     if (defined $key) {
1339 :     if ($key =~ /$self->{splitter}/) {
1340 :     # Here we have a two-part key, so we split it normally.
1341 :     my ($realKey, $subKey) = $self->SplitKey($key);
1342 :     $data{'HasValueFor(from-link)'} = $realKey;
1343 :     $data{'HasValueFor(subkey)'} = $subKey;
1344 :     } elsif (substr($key, -1, 1) eq '%') {
1345 :     $data{'HasValueFor(from-link)'} = $key;
1346 :     } else {
1347 :     $data{'HasValueFor(from-link)'} = $key;
1348 :     $data{'HasValueFor(subkey)'} = '';
1349 :     }
1350 :     }
1351 :     # Add the object ID to the key information.
1352 :     $data{'HasValueFor(to-link)'} = $objectID;
1353 :     # The first value represents a problem, because we can search it using SQL, but not
1354 :     # in the normal way. If the user specifies a generic search or exact match for
1355 :     # every alternative value (remember, the values may be specified as a list),
1356 :     # then we can create SQL filtering for it. If any of the values are specified
1357 :     # as a regular expression, however, that's a problem, because we need to read
1358 :     # every value to verify a match.
1359 :     if (@values > 0) {
1360 :     # Get the first value and put its alternatives in an array.
1361 :     my $valueParm = $values[0];
1362 :     my @valueList;
1363 :     if (ref $valueParm eq 'ARRAY') {
1364 :     @valueList = @{$valueParm};
1365 :     } else {
1366 :     @valueList = ($valueParm);
1367 :     }
1368 :     # Okay, now we have all the possible criteria for the first value in the list
1369 :     # @valueList. We'll copy the values to a new array in which they have been
1370 :     # converted to generic requests. If we find a regular-expression match
1371 :     # anywhere in the list, we toss the whole thing.
1372 :     my @valuePatterns = ();
1373 :     my $okValues = 1;
1374 :     for my $valuePattern (@valueList) {
1375 :     # Check the pattern type.
1376 :     if (substr($valuePattern, 0, 1) eq '/') {
1377 :     # Regular expressions invalidate the entire process.
1378 :     $okValues = 0;
1379 :     } elsif (substr($valuePattern, -1, 1) eq '%') {
1380 :     # A Generic pattern is passed in unmodified.
1381 :     push @valuePatterns, $valuePattern;
1382 :     } else {
1383 :     # An exact match is converted to generic.
1384 :     push @valuePatterns, "$valuePattern%";
1385 :     }
1386 :     }
1387 :     # If everything works, add the value data to the filtering hash.
1388 :     if ($okValues) {
1389 :     $data{'HasValueFor(value)'} = \@valuePatterns;
1390 :     }
1391 :     }
1392 :     # Create some lists to contain the filter fragments and parameter values.
1393 : parrello 1.10 my @filter = ();
1394 :     my @parms = ();
1395 :     # This next loop goes through the different fields that can be specified in the
1396 : parrello 1.20 # parameter list and generates filters for each. The %data hash that we built above
1397 :     # contains all the necessary information to do this.
1398 : parrello 1.10 for my $field (keys %data) {
1399 :     # Accumulate filter information for this field. We will OR together all the
1400 :     # elements accumulated to create the final result.
1401 :     my @fieldFilter = ();
1402 :     # Get the specified data from the caller.
1403 :     my $fieldPattern = $data{$field};
1404 :     # Only proceed if the pattern is one that won't match everything.
1405 :     if (defined($fieldPattern) && $fieldPattern ne "" && $fieldPattern ne "%") {
1406 :     # Convert the pattern to an array.
1407 :     my @patterns = ();
1408 :     if (ref $fieldPattern eq 'ARRAY') {
1409 :     push @patterns, @{$fieldPattern};
1410 :     } else {
1411 :     push @patterns, $fieldPattern;
1412 :     }
1413 :     # Only proceed if the array is nonempty. The loop will work fine if the
1414 :     # array is empty, but when we build the filter string at the end we'll
1415 :     # get "()" in the filter list, which will result in an SQL syntax error.
1416 :     if (@patterns) {
1417 :     # Loop through the individual patterns.
1418 :     for my $pattern (@patterns) {
1419 :     # Check for a generic request.
1420 :     if (substr($pattern, -1, 1) ne '%') {
1421 :     # Here we have a normal request.
1422 :     push @fieldFilter, "$field = ?";
1423 :     push @parms, $pattern;
1424 :     } else {
1425 : parrello 1.20 # Here we have a generic request, so we will use the LIKE operator to
1426 : parrello 1.10 # filter the field to this value pattern.
1427 :     push @fieldFilter, "$field LIKE ?";
1428 :     # We must convert the pattern value to an SQL match pattern. First
1429 : parrello 1.11 # we get a copy of it.
1430 :     my $actualPattern = $pattern;
1431 : parrello 1.10 # Now we escape the underscores. Underscores are an SQL wild card
1432 :     # character, but they are used frequently in key names and object IDs.
1433 : parrello 1.11 $actualPattern =~ s/_/\\_/g;
1434 : parrello 1.10 # Add the escaped pattern to the bound parameter list.
1435 :     push @parms, $actualPattern;
1436 :     }
1437 :     }
1438 :     # Form the filter for this field.
1439 :     my $fieldFilterString = join(" OR ", @fieldFilter);
1440 :     push @filter, "($fieldFilterString)";
1441 :     }
1442 :     }
1443 :     }
1444 :     # Now @filter contains one or more filter strings and @parms contains the parameter
1445 :     # values to bind to them.
1446 :     my $actualFilter = join(" AND ", @filter);
1447 :     # Now we're ready to make our query.
1448 : parrello 1.11 my $query = $self->Get(['HasValueFor'], $actualFilter, \@parms);
1449 : parrello 1.15 # Format the results.
1450 :     my @retVal = $self->_QueryResults($query, @values);
1451 : parrello 1.10 # Return the rows found.
1452 : parrello 1.3 return @retVal;
1453 :     }
1454 :    
1455 :     =head3 AddAttribute
1456 :    
1457 :     C<< $attrDB->AddAttribute($objectID, $key, @values); >>
1458 :    
1459 :     Add an attribute key/value pair to an object. This method cannot add a new key, merely
1460 :     add a value to an existing key. Use L</StoreAttributeKey> to create a new key.
1461 :    
1462 :     =over 4
1463 :    
1464 :     =item objectID
1465 :    
1466 : parrello 1.10 ID of the object to which the attribute is to be added.
1467 : parrello 1.3
1468 :     =item key
1469 :    
1470 : parrello 1.10 Attribute key name.
1471 : parrello 1.3
1472 :     =item values
1473 :    
1474 :     One or more values to be associated with the key. The values are joined together with
1475 :     the splitter value before being stored as field values. This enables L</GetAttributes>
1476 :     to split them apart during retrieval. The splitter value defaults to double colons C<::>.
1477 :    
1478 :     =back
1479 :    
1480 :     =cut
1481 :    
1482 :     sub AddAttribute {
1483 :     # Get the parameters.
1484 : parrello 1.4 my ($self, $objectID, $key, @values) = @_;
1485 : parrello 1.3 # Don't allow undefs.
1486 :     if (! defined($objectID)) {
1487 :     Confess("No object ID specified for AddAttribute call.");
1488 :     } elsif (! defined($key)) {
1489 :     Confess("No attribute key specified for AddAttribute call.");
1490 :     } elsif (! @values) {
1491 :     Confess("No values specified in AddAttribute call for key $key.");
1492 :     } else {
1493 : parrello 1.11 # Okay, now we have some reason to believe we can do this. Form the values
1494 :     # into a scalar.
1495 : parrello 1.3 my $valueString = join($self->{splitter}, @values);
1496 : parrello 1.20 # Split up the key.
1497 :     my ($realKey, $subKey) = $self->SplitKey($key);
1498 : parrello 1.11 # Connect the object to the key.
1499 : parrello 1.20 $self->InsertObject('HasValueFor', { 'from-link' => $realKey,
1500 : parrello 1.11 'to-link' => $objectID,
1501 : parrello 1.20 'subkey' => $subKey,
1502 : parrello 1.11 'value' => $valueString,
1503 :     });
1504 : parrello 1.3 }
1505 : parrello 1.10 # Return a one, indicating success. We do this for backward compatability.
1506 : parrello 1.3 return 1;
1507 :     }
1508 :    
1509 :     =head3 DeleteAttribute
1510 :    
1511 :     C<< $attrDB->DeleteAttribute($objectID, $key, @values); >>
1512 :    
1513 :     Delete the specified attribute key/value combination from the database.
1514 :    
1515 :     =over 4
1516 :    
1517 :     =item objectID
1518 :    
1519 : parrello 1.10 ID of the object whose attribute is to be deleted.
1520 : parrello 1.3
1521 :     =item key
1522 :    
1523 : parrello 1.10 Attribute key name.
1524 : parrello 1.3
1525 :     =item values
1526 :    
1527 : parrello 1.10 One or more values associated with the key. If no values are specified, then all values
1528 :     will be deleted. Otherwise, only a matching value will be deleted.
1529 : parrello 1.3
1530 :     =back
1531 :    
1532 :     =cut
1533 :    
1534 :     sub DeleteAttribute {
1535 :     # Get the parameters.
1536 : parrello 1.4 my ($self, $objectID, $key, @values) = @_;
1537 : parrello 1.3 # Don't allow undefs.
1538 :     if (! defined($objectID)) {
1539 :     Confess("No object ID specified for DeleteAttribute call.");
1540 :     } elsif (! defined($key)) {
1541 :     Confess("No attribute key specified for DeleteAttribute call.");
1542 :     } else {
1543 : parrello 1.20 # Split the key into the real key and the subkey.
1544 :     my ($realKey, $subKey) = $self->SplitKey($key);
1545 :     if ($subKey eq '' && scalar(@values) == 0) {
1546 :     # Here we erase the entire key for this object.
1547 :     $self->DeleteRow('HasValueFor', $key, $objectID);
1548 :     } else {
1549 :     # Here we erase the matching values.
1550 :     my $valueString = join($self->{splitter}, @values);
1551 :     $self->DeleteRow('HasValueFor', $realKey, $objectID,
1552 :     { subkey => $subKey, value => $valueString });
1553 :     }
1554 : parrello 1.3 }
1555 :     # Return a one. This is for backward compatability.
1556 :     return 1;
1557 :     }
1558 :    
1559 : parrello 1.16 =head3 DeleteMatchingAttributes
1560 :    
1561 :     C<< my @deleted = $attrDB->DeleteMatchingAttributes($objectID, $key, @values); >>
1562 :    
1563 :     Delete all attributes that match the specified criteria. This is equivalent to
1564 :     calling L</GetAttributes> and then invoking L</DeleteAttribute> for each
1565 :     row found.
1566 :    
1567 :     =over 4
1568 :    
1569 :     =item objectID
1570 :    
1571 :     ID of object whose attributes are to be deleted. If the attributes for multiple
1572 :     objects are to be deleted, this parameter can be specified as a list reference. If
1573 :     attributes are to be deleted for all objects, specify C<undef> or an empty string.
1574 :     Finally, you can delete attributes for a range of object IDs by putting a percent
1575 :     sign (C<%>) at the end.
1576 :    
1577 :     =item key
1578 :    
1579 :     Attribute key name. A value of C<undef> or an empty string will match all
1580 :     attribute keys. If the values are to be deletedfor multiple keys, this parameter can be
1581 :     specified as a list reference. Finally, you can delete attributes for a range of
1582 :     keys by putting a percent sign (C<%>) at the end.
1583 :    
1584 :     =item values
1585 :    
1586 :     List of the desired attribute values, section by section. If C<undef>
1587 :     or an empty string is specified, all values in that section will match. A
1588 :     generic match can be requested by placing a percent sign (C<%>) at the end.
1589 :     In that case, all values that match up to and not including the percent sign
1590 :     will match. You may also specify a regular expression enclosed
1591 :     in slashes. All values that match the regular expression will be deleted. For
1592 :     performance reasons, only values have this extra capability.
1593 :    
1594 :     =item RETURN
1595 :    
1596 :     Returns a list of tuples for the attributes that were deleted, in the
1597 :     same form as L</GetAttributes>.
1598 :    
1599 :     =back
1600 :    
1601 :     =cut
1602 :    
1603 :     sub DeleteMatchingAttributes {
1604 :     # Get the parameters.
1605 :     my ($self, $objectID, $key, @values) = @_;
1606 :     # Get the matching attributes.
1607 :     my @retVal = $self->GetAttributes($objectID, $key, @values);
1608 :     # Loop through the attributes, deleting them.
1609 :     for my $tuple (@retVal) {
1610 :     $self->DeleteAttribute(@{$tuple});
1611 :     }
1612 : parrello 1.18 # Log this operation.
1613 :     my $count = @retVal;
1614 :     $self->LogOperation("Mass Delete", $key, "$count matching attributes deleted.");
1615 : parrello 1.16 # Return the deleted attributes.
1616 :     return @retVal;
1617 :     }
1618 :    
1619 : parrello 1.3 =head3 ChangeAttribute
1620 :    
1621 :     C<< $attrDB->ChangeAttribute($objectID, $key, \@oldValues, \@newValues); >>
1622 :    
1623 :     Change the value of an attribute key/value pair for an object.
1624 :    
1625 :     =over 4
1626 :    
1627 :     =item objectID
1628 :    
1629 :     ID of the genome or feature to which the attribute is to be changed. In general, an ID that
1630 :     starts with C<fig|> is treated as a feature ID, and an ID that is all digits and periods
1631 :     is treated as a genome ID. For IDs of other types, this parameter should be a reference
1632 :     to a 2-tuple consisting of the entity type name followed by the object ID.
1633 :    
1634 :     =item key
1635 :    
1636 :     Attribute key name. This corresponds to the name of a field in the database.
1637 :    
1638 :     =item oldValues
1639 :    
1640 :     One or more values identifying the key/value pair to change.
1641 :    
1642 :     =item newValues
1643 :    
1644 :     One or more values to be put in place of the old values.
1645 :    
1646 :     =back
1647 :    
1648 :     =cut
1649 :    
1650 :     sub ChangeAttribute {
1651 :     # Get the parameters.
1652 : parrello 1.4 my ($self, $objectID, $key, $oldValues, $newValues) = @_;
1653 : parrello 1.3 # Don't allow undefs.
1654 :     if (! defined($objectID)) {
1655 :     Confess("No object ID specified for ChangeAttribute call.");
1656 :     } elsif (! defined($key)) {
1657 :     Confess("No attribute key specified for ChangeAttribute call.");
1658 :     } elsif (! defined($oldValues) || ref $oldValues ne 'ARRAY') {
1659 :     Confess("No old values specified in ChangeAttribute call for key $key.");
1660 :     } elsif (! defined($newValues) || ref $newValues ne 'ARRAY') {
1661 :     Confess("No new values specified in ChangeAttribute call for key $key.");
1662 :     } else {
1663 : parrello 1.10 # We do the change as a delete/add.
1664 : parrello 1.3 $self->DeleteAttribute($objectID, $key, @{$oldValues});
1665 :     $self->AddAttribute($objectID, $key, @{$newValues});
1666 :     }
1667 :     # Return a one. We do this for backward compatability.
1668 :     return 1;
1669 :     }
1670 :    
1671 : parrello 1.7 =head3 EraseAttribute
1672 :    
1673 : parrello 1.11 C<< $attrDB->EraseAttribute($key); >>
1674 : parrello 1.7
1675 :     Erase all values for the specified attribute key. This does not remove the
1676 :     key from the database; it merely removes all the values.
1677 :    
1678 :     =over 4
1679 :    
1680 :     =item key
1681 :    
1682 : parrello 1.20 Key to erase. This must be a real key; that is, it cannot have a subkey
1683 :     component.
1684 : parrello 1.7
1685 :     =back
1686 :    
1687 :     =cut
1688 :    
1689 :     sub EraseAttribute {
1690 :     # Get the parameters.
1691 : parrello 1.10 my ($self, $key) = @_;
1692 : parrello 1.16 # Delete everything connected to the key.
1693 :     $self->Disconnect('HasValueFor', 'AttributeKey', $key);
1694 : parrello 1.18 # Log the operation.
1695 :     $self->LogOperation("Erase Data", $key);
1696 : parrello 1.7 # Return a 1, for backward compatability.
1697 :     return 1;
1698 :     }
1699 :    
1700 : parrello 1.9 =head3 GetAttributeKeys
1701 :    
1702 : parrello 1.10 C<< my @keyList = $attrDB->GetAttributeKeys($groupName); >>
1703 : parrello 1.9
1704 : parrello 1.10 Return a list of the attribute keys for a particular group.
1705 : parrello 1.9
1706 :     =over 4
1707 :    
1708 : parrello 1.10 =item groupName
1709 : parrello 1.9
1710 : parrello 1.10 Name of the group whose keys are desired.
1711 : parrello 1.9
1712 :     =item RETURN
1713 :    
1714 : parrello 1.10 Returns a list of the attribute keys for the specified group.
1715 : parrello 1.9
1716 :     =back
1717 :    
1718 :     =cut
1719 :    
1720 :     sub GetAttributeKeys {
1721 :     # Get the parameters.
1722 : parrello 1.10 my ($self, $groupName) = @_;
1723 :     # Get the attributes for the specified group.
1724 :     my @groups = $self->GetFlat(['IsInGroup'], "IsInGroup(to-link) = ?", [$groupName],
1725 :     'IsInGroup(from-link)');
1726 : parrello 1.9 # Return the keys.
1727 : parrello 1.10 return sort @groups;
1728 : parrello 1.9 }
1729 :    
1730 : parrello 1.24 =head3 QueryAttributes
1731 :    
1732 :     C<< my @attributeData = $ca->QueryAttributes($filter, $filterParms); >>
1733 :    
1734 :     Return the attribute data based on an SQL filter clause. In the filter clause,
1735 :     the name C<$object> should be used for the object ID, C<$key> should be used for
1736 :     the key name, C<$subkey> for the subkey value, and C<$value> for the value field.
1737 :    
1738 :     =over 4
1739 :    
1740 :     =item filter
1741 :    
1742 :     Filter clause in the standard ERDB format, except that the field names are C<$object> for
1743 :     the object ID field, C<$key> for the key name field, C<$subkey> for the subkey field,
1744 :     and C<$value> for the value field. This abstraction enables us to hide the details of
1745 :     the database construction from the user.
1746 :    
1747 :     =item filterParms
1748 :    
1749 :     Parameters for the filter clause.
1750 :    
1751 :     =item RETURN
1752 :    
1753 :     Returns a list of tuples. Each tuple consists of an object ID, a key (with optional subkey), and
1754 :     one or more attribute values.
1755 :    
1756 :     =back
1757 :    
1758 :     =cut
1759 :    
1760 :     # This hash is used to drive the substitution process.
1761 :     my %AttributeParms = (object => 'HasValueFor(to-link)',
1762 :     key => 'HasValueFor(from-link)',
1763 :     subkey => 'HasValueFor(subkey)',
1764 :     value => 'HasValueFor(value)');
1765 :    
1766 :     sub QueryAttributes {
1767 :     # Get the parameters.
1768 :     my ($self, $filter, $filterParms) = @_;
1769 :     # Declare the return variable.
1770 :     my @retVal = ();
1771 :     # Make sue we have filter parameters.
1772 :     my $realParms = (defined($filterParms) ? $filterParms : []);
1773 :     # Create the query by converting the filter.
1774 :     my $realFilter = $filter;
1775 :     for my $name (keys %AttributeParms) {
1776 :     $realFilter =~ s/\$$name/$AttributeParms{$name}/g;
1777 :     }
1778 :     my $query = $self->Get(['HasValueFor'], $realFilter, $realParms);
1779 :     # Loop through the results, forming the output attribute tuples.
1780 :     while (my $result = $query->Fetch()) {
1781 :     # Get the four values from this query result row.
1782 :     my ($objectID, $key, $subkey, $value) = $result->Values([$AttributeParms{object},
1783 :     $AttributeParms{key},
1784 :     $AttributeParms{subkey},
1785 :     $AttributeParms{value}]);
1786 :     # Combine the key and the subkey.
1787 :     my $realKey = ($subkey ? $key . $self->{splitter} . $subkey : $key);
1788 :     # Split the value.
1789 :     my @values = split $self->{splitter}, $value;
1790 :     # Output the result.
1791 :     push @retVal, [$objectID, $realKey, @values];
1792 :     }
1793 :     # Return the result.
1794 :     return @retVal;
1795 :     }
1796 :    
1797 : parrello 1.20 =head2 Key and ID Manipulation Methods
1798 :    
1799 : parrello 1.19 =head3 ParseID
1800 :    
1801 :     C<< my ($type, $id) = CustomAttributes::ParseID($idValue); >>
1802 :    
1803 :     Determine the type and object ID corresponding to an ID value from the attribute database.
1804 :     Most ID values consist of a type name and an ID, separated by a colon (e.g. C<Family:aclame|cluster10>);
1805 :     however, Genomes, Features, and Subsystems are not stored with a type name, so we need to
1806 :     deduce the type from the ID value structure.
1807 :    
1808 :     The theory here is that you can plug the ID and type directly into a Sprout database method, as
1809 :     follows
1810 :    
1811 :     my ($type, $id) = CustomAttributes::ParseID($attrList[$num]->[0]);
1812 :     my $target = $sprout->GetEntity($type, $id);
1813 :    
1814 :     =over 4
1815 :    
1816 :     =item idValue
1817 :    
1818 :     ID value taken from the attribute database.
1819 :    
1820 :     =item RETURN
1821 :    
1822 :     Returns a two-element list. The first element is the type of object indicated by the ID value,
1823 :     and the second element is the actual object ID.
1824 :    
1825 :     =back
1826 :    
1827 :     =cut
1828 :    
1829 :     sub ParseID {
1830 :     # Get the parameters.
1831 :     my ($idValue) = @_;
1832 :     # Declare the return variables.
1833 :     my ($type, $id);
1834 :     # Parse the incoming ID. We first check for the presence of an entity name. Entity names
1835 :     # can only contain letters, which helps to insure typed object IDs don't collide with
1836 :     # subsystem names (which are untyped).
1837 :     if ($idValue =~ /^([A-Za-z]+):(.+)/) {
1838 :     # Here we have a typed ID.
1839 :     ($type, $id) = ($1, $2);
1840 :     } elsif ($idValue =~ /fig\|/) {
1841 :     # Here we have a feature ID.
1842 :     ($type, $id) = (Feature => $idValue);
1843 :     } elsif ($idValue =~ /\d+\.\d+/) {
1844 :     # Here we have a genome ID.
1845 :     ($type, $id) = (Genome => $idValue);
1846 :     } else {
1847 :     # The default is a subsystem ID.
1848 :     ($type, $id) = (Subsystem => $idValue);
1849 :     }
1850 :     # Return the results.
1851 :     return ($type, $id);
1852 :     }
1853 :    
1854 :     =head3 FormID
1855 :    
1856 :     C<< my $idValue = CustomAttributes::FormID($type, $id); >>
1857 :    
1858 :     Convert an object type and ID pair into an object ID string for the attribute system. Subsystems,
1859 :     genomes, and features are stored in the database without type information, but all other object IDs
1860 :     must be prefixed with the object type.
1861 :    
1862 :     =over 4
1863 :    
1864 :     =item type
1865 :    
1866 :     Relevant object type.
1867 :    
1868 :     =item id
1869 :    
1870 :     ID of the object in question.
1871 :    
1872 :     =item RETURN
1873 :    
1874 :     Returns a string that will be recognized as an object ID in the attribute database.
1875 :    
1876 :     =back
1877 :    
1878 :     =cut
1879 :    
1880 :     sub FormID {
1881 :     # Get the parameters.
1882 :     my ($type, $id) = @_;
1883 :     # Declare the return variable.
1884 :     my $retVal;
1885 :     # Compute the ID string from the type.
1886 :     if (grep { $type eq $_ } qw(Feature Genome Subsystem)) {
1887 :     $retVal = $id;
1888 :     } else {
1889 :     $retVal = "$type:$id";
1890 :     }
1891 :     # Return the result.
1892 :     return $retVal;
1893 :     }
1894 :    
1895 :     =head3 GetTargetObject
1896 :    
1897 :     C<< my $object = CustomAttributes::GetTargetObject($erdb, $idValue); >>
1898 :    
1899 :     Return the database object corresponding to the specified attribute object ID. The
1900 :     object type associated with the ID value must correspond to an entity name in the
1901 :     specified database.
1902 :    
1903 :     =over 4
1904 :    
1905 :     =item erdb
1906 :    
1907 :     B<ERDB> object for accessing the target database.
1908 :    
1909 :     =item idValue
1910 :    
1911 :     ID value retrieved from the attribute database.
1912 :    
1913 :     =item RETURN
1914 :    
1915 : parrello 1.22 Returns a B<ERDBObject> for the attribute value's target object.
1916 : parrello 1.19
1917 :     =back
1918 :    
1919 :     =cut
1920 :    
1921 :     sub GetTargetObject {
1922 :     # Get the parameters.
1923 :     my ($erdb, $idValue) = @_;
1924 :     # Declare the return variable.
1925 :     my $retVal;
1926 :     # Get the type and ID for the target object.
1927 :     my ($type, $id) = ParseID($idValue);
1928 :     # Plug them into the GetEntity method.
1929 :     $retVal = $erdb->GetEntity($type, $id);
1930 :     # Return the resulting object.
1931 :     return $retVal;
1932 :     }
1933 :    
1934 : parrello 1.20 =head3 SplitKey
1935 :    
1936 :     C<< my ($realKey, $subKey) = $ca->SplitKey($key); >>
1937 :    
1938 :     Split an external key (that is, one passed in by a caller) into the real key and the sub key.
1939 :     The real and sub keys are separated by a splitter value (usually C<::>). If there is no splitter,
1940 :     then the sub key is presumed to be an empty string.
1941 :    
1942 :     =over 4
1943 :    
1944 :     =item key
1945 :    
1946 :     Incoming key to be split.
1947 :    
1948 :     =item RETURN
1949 :    
1950 :     Returns a two-element list, the first element of which is the real key and the second element of
1951 :     which is the sub key.
1952 :    
1953 :     =back
1954 :    
1955 :     =cut
1956 :    
1957 :     sub SplitKey {
1958 :     # Get the parameters.
1959 :     my ($self, $key) = @_;
1960 :     # Do the split.
1961 :     my ($realKey, $subKey) = split($self->{splitter}, $key, 2);
1962 :     # Insure the subkey has a value.
1963 :     if (! defined $subKey) {
1964 :     $subKey = '';
1965 :     }
1966 :     # Return the results.
1967 :     return ($realKey, $subKey);
1968 :     }
1969 :    
1970 :     =head3 JoinKey
1971 :    
1972 :     C<< my $key = $ca->JoinKey($realKey, $subKey); >>
1973 :    
1974 :     Join a real key and a subkey together to make an external key. The external key is the attribute key
1975 :     used by the caller. The real key and the subkey are how the keys are represented in the database. The
1976 :     real key is the key to the B<AttributeKey> entity. The subkey is an attribute of the B<HasValueFor>
1977 :     relationship.
1978 :    
1979 :     =over 4
1980 :    
1981 :     =item realKey
1982 :    
1983 :     The real attribute key.
1984 :    
1985 :     =item subKey
1986 :    
1987 :     The subordinate portion of the attribute key.
1988 :    
1989 :     =item RETURN
1990 :    
1991 :     Returns a single string representing both keys.
1992 :    
1993 :     =back
1994 :    
1995 :     =cut
1996 :    
1997 :     sub JoinKey {
1998 :     # Get the parameters.
1999 :     my ($self, $realKey, $subKey) = @_;
2000 :     # Declare the return variable.
2001 :     my $retVal;
2002 :     # Check for a subkey.
2003 :     if ($subKey eq '') {
2004 :     # No subkey, so the real key is the key.
2005 :     $retVal = $realKey;
2006 :     } else {
2007 :     # Subkey found, so the two pieces must be joined by a splitter.
2008 :     $retVal = "$realKey$self->{splitter}$subKey";
2009 :     }
2010 :     # Return the result.
2011 :     return $retVal;
2012 :     }
2013 :    
2014 : parrello 1.1 1;

MCS Webmaster
ViewVC Help
Powered by ViewVC 1.0.3