- Literals
- Removing Keys
- Testing Membership
- Using Classes as the KeyType
- Using Structs or Unions as the KeyType
- Construction or Assignment on Setting AA Entries
- Inserting if not present
- Advanced updating
- Runtime Initialization of Immutable AAs
- Construction and Reference Semantics
- Properties and Operations
- Examples
Associative Arrays
Associative arrays have an index that is not necessarily an integer, and can be sparsely populated. The index for an associative array is called the key, and its type is called the KeyType.
Associative arrays are declared by placing the KeyType within the [ ] of an array declaration:
int[string] aa; // Associative array of ints that are // indexed by string keys. // The KeyType is string. aa["hello"] = 3; // set value associated with key "hello" to 3 int value = aa["hello"]; // lookup value from a key assert(value == 3);
Neither the KeyTypes nor the element types of an associative array can be function types or void.
Literals
auto aa = [21u: "he", 38: "ho", 2: "hi"]; static assert(is(typeof(aa) == string[uint])); assert(aa[2] == "hi");
See Associative Array Literals.
Removing Keys
Particular keys in an associative array can be removed with the remove function:
aa.remove("hello");
remove(key) does nothing if the given key does not exist and returns false. If the given key does exist, it removes it from the AA and returns true.
All keys can be removed by using the method clear.
Testing Membership
The InExpression yields a pointer to the value if the key is in the associative array, or null if not:
int* p; p = "hello" in aa; if (p !is null) { *p = 4; // update value associated with key assert(aa["hello"] == 4); }
Using Classes as the KeyType
Classes can be used as the KeyType. The behavior is controlled by the following member functions of class Object:
- size_t toHash() @trusted nothrow
- bool opEquals(Object)
Note that the parameter to opEquals is of type Object, not the type of the class in which it is defined.
For example:
class Foo { int a, b; override size_t toHash() { return a + b; } override bool opEquals(Object o) { Foo foo = cast(Foo) o; return foo && a == foo.a && b == foo.b; } }The default implementation of opEquals uses the address of the instance for comparisons, and the default implementation of toHash hashes the address of the instance.
- If toHash must consistently be the same value when opEquals returns true. In other words, two objects that are considered equal should always have the same hash value. Otherwise, undefined behavior will result.
- Use the attributes @safe, @nogc, pure, const, and scope as much as possible on the toHash and opEquals overrides.
Using Structs or Unions as the KeyType
If the KeyType is a struct or union type, a default mechanism is used to compute the hash and comparisons of it based on the fields of the struct value. A custom mechanism can be used by providing the following functions as struct members:
size_t toHash() const @safe pure nothrow; bool opEquals(ref const typeof(this) s) const @safe pure nothrow;
For example:
import std.string; struct MyString { string str; size_t toHash() const @safe pure nothrow { size_t hash; foreach (char c; str) hash = (hash * 9) + c; return hash; } bool opEquals(ref const MyString s) const @safe pure nothrow { return std.string.cmp(this.str, s.str) == 0; } }
The functions can use @trusted instead of @safe.
- If toHash must consistently be the same value when opEquals returns true. In other words, two structs that are considered equal should always have the same hash value. Otherwise, undefined behavior will result.
- Use the attributes @nogc as much as possible on the toHash and opEquals overrides.
Construction or Assignment on Setting AA Entries
When an AA indexing access appears on the left side of an assignment operator, it is specially handled for setting an AA entry associated with the key.
string[int] aa; string s; //s = aa[1]; // throws RangeError in runtime aa[1] = "hello"; // handled for setting AA entry s = aa[1]; // succeeds to lookup assert(s == "hello");
If the assigned value type is equivalent with the AA element type:
- If the indexing key does not yet exist in AA, a new AA entry will be allocated, and it will be initialized with the assigned value.
- If the indexing key already exists in the AA, the setting runs normal assignment.
struct S { int val; void opAssign(S rhs) { this.val = rhs.val * 2; } } S[int] aa; aa[1] = S(10); // first setting initializes the entry aa[1] assert(aa[1].val == 10); aa[1] = S(10); // second setting invokes normal assignment, and // operator-overloading rewrites it to member opAssign function. assert(aa[1].val == 20);
If the assigned value type is not equivalent with the AA element type, the expression could invoke operator overloading with normal indexing access:
struct S { int val; void opAssign(int v) { this.val = v * 2; } } S[int] aa; aa[1] = 10; // is rewritten to: aa[1].opAssign(10), and // throws RangeError before opAssign is called
However, if the AA element type is a struct which supports an implicit constructor call from the assigned value, implicit construction is used for setting the AA entry:
struct S { int val; this(int v) { this.val = v; } void opAssign(int v) { this.val = v * 2; } } S s = 1; // OK, rewritten to: S s = S(1); s = 1; // OK, rewritten to: s.opAssign(1); S[int] aa; aa[1] = 10; // first setting is rewritten to: aa[1] = S(10); assert(aa[1].val == 10); aa[1] = 10; // second setting is rewritten to: aa[1].opAssign(10); assert(aa[1].val == 20);
import std.bigint; BigInt[string] aa; aa["a"] = 10; // construct BigInt(10) and move it in AA aa["a"] = 20; // call aa["a"].opAssign(20)
Inserting if not present
When AA access requires that there must be a value corresponding to the key, a value must be constructed and inserted if not present. The require function provides a means to construct a new value via a lazy argument. The lazy argument is evaluated when the key is not present. The require operation avoids the need to perform multiple key lookups.
class C{} C[string] aa; auto a = aa.require("a", new C); // lookup "a", construct if not present
Sometimes it is necessary to know whether the value was constructed or already exists. The require function doesn't provide a boolean parameter to indicate whether the value was constructed but instead allows the construction via a function or delegate. This allows the use of any mechanism as demonstrated below.
class C{} C[string] aa; bool constructed; auto a = aa.require("a", { constructed=true; return new C;}()); assert(constructed == true); C newc; auto b = aa.require("b", { newc = new C; return newc;}()); assert(b is newc);
Advanced updating
Typically updating a value in an associative array is simply done with an assign statement.
int[string] aa; aa["a"] = 3; // set value associated with key "a" to 3
Sometimes it is necessary to perform different operations depending on whether a value already exists or needs to be constructed. The update function provides a means to construct a new value via the creator or update an existing value via the updater. The update operation avoids the need to perform multiple key lookups.
int[string] aa; // create aa.update("key", () => 1, (int) {} // not executed ); assert(aa["key"] == 1); // update value by ref aa.update("key", () => 0, // not executed (ref int v) { v += 1; }); assert(aa["key"] == 2);
For details, see update.
Runtime Initialization of Immutable AAs
Immutable associative arrays are often desirable, but sometimes initialization must be done at runtime. This can be achieved with a constructor (static constructor depending on scope), a buffer associative array and assumeUnique:
immutable long[string] aa; shared static this() { import std.exception : assumeUnique; import std.conv : to; long[string] temp; // mutable buffer foreach (i; 0 .. 10) { temp[to!string(i)] = i; } temp.rehash; // for faster lookups aa = assumeUnique(temp); } void main() { assert(aa["1"] == 1); assert(aa["5"] == 5); assert(aa["9"] == 9); }
Construction and Reference Semantics
An Associative Array defaults to null, and is constructed upon assigning the first key/value pair. However, once constructed, an associative array has reference semantics, meaning that assigning one array to another does not copy the data. This is especially important when attempting to create multiple references to the same array.
int[int] aa; // defaults to null int[int] aa2 = aa; // copies the null reference assert(aa is null); aa[1] = 1; assert(aa2.length == 0); // aa2 still is null aa2 = aa; aa2[2] = 2; assert(aa[2] == 2); // now both refer to the same instance
A NewExpression allows constructing an associative array instance immediately, rather than when inserting a key.
int[string] a = new int[string]; auto b = a; // a and b point to the same AA instance assert(b !is null); a["1"] = 1; assert(b["1"] == 1);
Properties and Operations
| Name | Description |
|---|---|
| sizeof | The size of the reference to the associative array; it is 4 in 32-bit builds and 8 on 64-bit builds. |
| length | The number of values in the associative array. Unlike for dynamic arrays, it is read-only. |
| dup | Returns null if the associative array is null; otherwise returns a newly allocated associative array with copies of the keys and values of the associative array. |
| rehash | Reorganizes the associative array in place so that lookups are more efficient. Calling rehash is effective when, for example, the program is done loading up a symbol table and now needs fast lookups in it. Returns a reference to the reorganized array. |
| clear | Removes all keys and values from an associative array. The array is not rehashed after removal to allow for the existing storage to be reused. This will affect all references to the same instance and is not equivalent to destroy(aa) which only sets the current reference to null. |
Iteration Operations
| Operation | Description |
|---|---|
| keys | Returns a newly allocated dynamic array containing copies of the keys in the associative array. The order is consistent with values() but otherwise unspecified. |
| values | Returns a newly allocated dynamic array containing copies of the values in the associative array. The order is consistent with keys() but otherwise unspecified. |
| byKey | Returns a forward range enumerating the keys by reference.
The order is consistent with byValue() but otherwise unspecified. Bug: The keys are provided as mutable, but mutating them is undefined behavior. |
| byValue | Returns a forward range enumerating the values by reference. The order is consistent with byKey() but otherwise unspecified. |
| byKeyValue | Returns a forward range enumerating opaque objects that provide key and value properties.
These properties return their result by reference.
The order of elements is unspecified. Bug: The keys are provided as mutable, but mutating them is undefined behavior. |
The order of keys and values returned by keys() and values() as well as byKey(), byValue(), and byKeyValue() is unspecified, but is guaranteed to be consistent as long as the associative array has not been reorganized, e.g. by adding or removing keys between the calls. Associating a new value to an existing key does not reorganize an associative array. Reorganizing an associative array invalidates any input ranges returned by byKey(), byValue(), and byKeyValue().
- Calling keys() and values() incurs an allocation (unless the associative array is null or empty). Use them if you need an independent copy of the keys and/or values; otherwise consider byKey() and byValue().
- Associative arrays support foreach directly for value iteration and key-value iteration. Use ref on the key and value variables when necessary to avoid unnecessary copies. For iterating the keys only, use key-value iteration and ignore the value. Use byKey(), byValue(), or byKeyValue() for more elaborate cases such as range algorithms.
Key Lookup Operations
| Operation | Description |
|---|---|
| Value get(Key key, lazy Value defVal) | If the key exists, returns corresponding value; otherwise evaluates and returns defVal without associating it with key. |
| ref Value require(Key key, lazy Value value) | If the key exists, returns corresponding value by reference; otherwise evaluates value and associates it with key in the associative array, then returns the newly stored value by reference. |
| void update(Key key, Creator creator, Updater updater) | If the key exists, it calls updater with the corresponding value; if it returns a value, it associates the value with the key. If the key was not found, it invokes creator and associates the result with the key. |
The update operation works with any creator and updater that is invokable as specified. updater can modify the value in-place if it binds its argument by reference.
Examples
Associative Array Example: word count
too many cooks
too many ingredients
import std.algorithm; import std.stdio; void main() { ulong[string] dictionary; ulong wordCount, lineCount, charCount; foreach (line; stdin.byLine(KeepTerminator.yes)) { charCount += line.length; foreach (word; splitter(line)) { wordCount += 1; if (auto count = word in dictionary) *count += 1; else dictionary[word.idup] = 1; } lineCount += 1; } writeln(" lines words bytes"); writefln("%8s%8s%8s", lineCount, wordCount, charCount); const char[37] hr = '-'; writeln(hr); foreach (word; sort(dictionary.keys)) { writefln("%3s %s", dictionary[word], word); } }
See wc for the full version.
Associative Array Example: counting pairs
An Associative Array can be iterated in key/value fashion using a foreach statement. As an example, the number of occurrences of all possible substrings of length 2 (aka 2-mers) in a string will be counted:
import std.range : slide; import std.stdio : writefln; import std.utf : byCodeUnit; // avoids UTF-8 auto-decoding int[string] aa; // The string `arr` has a limited alphabet: {A, C, G, T} // Thus, for better performance, iteration can be done _without_ decoding auto arr = "AGATAGA".byCodeUnit; // iterate over all pairs in the string and count each pair // ('A', 'G'), ('G', 'A'), ('A', 'T'), ... foreach (window; arr.slide(2)) aa[window.source]++; // source unwraps the code unit range // iterate over all key/value pairs of the Associative Array foreach (key, value; aa) { writefln("key: %s, value: %d", key, value); }
> rdmd count.d key: AT, value: 1 key: GA, value: 2 key: TA, value: 1 key: AG, value: 2