Data modeling
Last updated
Last updated
When a data model serves to build an information system, it must ensure that all data that is needed in practice can be represented in the database. So you need a practical modeling technique based on actual data. By using real-life samples of data, you can decide which data elements to include or leave out in the new model and be reasonably confident that you don't leave any gaps.
In this section we will systematically extract concepts and relations based on data from a spreadsheet. The result of this analysis is an Ampersand model, which you can use to generate a data model for you.
Let us start by looking at an example:
Since Ampersand works with relations, it must represent this table as relations. Three relations can do the job in the following manner:
In our example, each row in the spreadsheet represents a president. So, the source concept of each relation is President. Each column represents a different relation. So we can use the name of each column as relation name. Then, we invent names to describe the content of each column: Name, Surname, Date.
When things get bigger, it is useful to draw the relations on a whiteboard or in your notebook. This helps you keep overview. Here is how it is done:
This drawing shows every relation als a line, drawn from source to target. The arrowhead in the middle is only to remind the reader of which is the source and which is the target concept. If you point the arrowhead from source to target, you will always know how the relation is defined.
Suppose we have a second table, which also has information
This table is similar with respect to the interpretation of a row: here too, each row represents a president. However, the presidents aren't numbered in this table, so we have to add these numbers.
Numbering rows has the advantage that it is easier to recognise a president.
There seems to be something funny about the relation capital[President*City]. In the model this relation pairs presidents to capital cities of the state in which they were born. This meaning can be made more obvious, by redefining one relation somewhat:
Obviously, the relation capital[State*City] feels more natural. The reason is obvious: a capital city belongs more to the state than it belongs to a president who happens to have been born in that state.
This example illustrates that you may find "strange things" in your data samples. You can fix them as you go, as we did with the relation capital in this example.
So far, we have looked at relations that can be extracted from existing spreadsheet data. With some practice, you will soon learn to do larger and more realistic problems. The essence of this technique is to break down knowledge in relations, to get to the bottom of the conceptual structure.
More often than not, the meaning of data in a spreadsheet is obvious. For instance, in the relation firstname it hardly needs to be said that it contains the first name of each president. But it is not always that obvious. In the second example we saw that the meaning of the relation capital[President*City] was far from obvious. It relates a president to the capital city of the state in which he was born. There are two things we need to do about it:
replace a relation with a complicated meaning for a simpler one;
document the meaning of each relation.
The second thing, to document each relation, is necessary to ensure consensus and support. To make the meaning of every relation explicit is meant to trigger stakeholders to stand up and voice any different insights.
For making a data model, you need to do one more thing: decide which relations must be constrained to unique elements. Consider for example the fact that anyone is born in at most one state. A duplicate state of birth therefore considered a mistake. President Van Buren cannot have been born both in New York and in Maine. We can impose that on a data model by stating that RELATION birth[President*State] must be univalent:
Two properties are relevant for the data model: univalent (UNI) and injective (INJ):
Relation r[A*B] [UNI,INJ] means the relation is both univalent and injective.
We have to do this for every relation:
Five decisions have been made here:
We will register only one first name for every president, as a result of constraining the relation firstname to be univalent.
The system may register multiple last names, as a result of not imposing any constraints on the relation lastname.
Only one date of birth will be registered, as a result of constraining the relation birth to be univalent
Only one state of birth will be registered, as a result of constraining the relation state to be univalent
Every state has only one capital city and every city is capital to only one state, as a result of constraining the relation capital to be univalent and injective.
In this video you sit in in a private lecture in Dutch on data modeling. In 32 minutes, most of the above is being discussed. It may help you to get a different perspective on the theory above.
Generate a functional specification from this script, open the generated document, and look up what your data model looks like.
Make a data analysis of a small problem of your own choosing; then generate a functional specification from that script.
After finishing your assignment, you have learned:
why it makes sense to analyse actual data samples for creating a data model;
how to analyze spreadsheet data and produce relations from it;
why it is necessary to document meaning for each relation;
how to constrain relations with univalence and injectivity;
how easily mistakes are made (by using the Ampersand compiler in the assignment);
how Ampersand's messages help you fix mistakes;
how to make Ampersand create a data model based on your data analysis.
Notice that this deviates slightly from the previous recipe. Instead of making a new relation president[President*President], we have reused the relation lastname. By doing so, we have interpreted the third column of the spreadsheet as the last name of the president. More importantly, we have reused an earlier relation. The drawing can also be extended:
The meaning of a relation gives guidance to the reader in the way we should speak about the contents of the relation. For instance, if the pair is a pair from RELATION birth[President*State], the reader should interpret that as "President was born in ."
Relation r[A*B] [UNI] means that there is at most one pair in the relation for every in A.
Relation r[A*B] [INJ] means that there is at most one pair in the relation for every in B.
Note that we can envelop the relation definition in a CONTEXT and run it on RAP3. Ampersand will produce the following data model:
firstname
lastname
birth
1
Abraham
Lincoln
February 12, 1809
2
Barack
Obama
August 4, 1961
3
Calvin
Coolidge
July 4, 1872
4
Dwight
Eisenhower
October 14, 1890
[State]
capital
president
Vermont
Plymouth
Coolidge
Hawaï
Honolulu
Obama
Kentucky
Frankfort
Lincoln
New York
New York
Roosevelt
Georgia
Atlanta
Carter
[State]
capital
president
3
Vermont
Plymouth
Coolidge
2
Hawaii
Honolulu
Obama
1
Kentucky
Frankfort
Lincoln
5
New York
New York
Roosevelt
6
Georgia
Atlanta
Carter
