Human Generated Data

Title

Untitled (blank, left page); Untitled (village scene, right page)

Date

1944

People

Artist: Otto Piene, German 1928 - 2014

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.3.25

Human Generated Data

Title

Untitled (blank, left page); Untitled (village scene, right page)

People

Artist: Otto Piene, German 1928 - 2014

Date

1944

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2022-06-24

Furniture 99.6
Person 99.4
Human 99.4
Table 98.6
Desk 91.4
Indoors 85.6
Room 83.1
Chair 77.3
Electronics 73.8
Face 73.5
Dining Table 67.4
Screen 64.2
Monitor 59.1
Display 59.1
Portrait 57.9
Photography 57.9
Photo 57.9
Shelf 57.8
Workshop 57.8
Classroom 56.7
School 56.7
Computer 55.2

Imagga
created on 2022-06-24

shelter 77.3
birdhouse 62.4
church 62.1
tower 60.2
protective covering 59.2
architecture 55.9
building 51.3
old 40.5
history 38.5
religion 36.8
bell cote 34.8
town 34.4
tourism 31.4
city 30.8
cathedral 30.3
landmark 29.8
travel 29.6
bell 28.4
sky 27.1
ancient 26
historic 24.8
wall 24.8
roof 22.1
medieval 22.1
stone 21.3
castle 20.7
famous 20.5
religious 19.7
culture 19.7
historical 18.8
cross 17.9
house 17
catholic 15.6
urban 14.9
brick 14.9
faith 14.4
covering 14.4
construction 13.7
fortress 13.6
capital 13.3
dome 13.2
monument 13.1
chapel 12.8
monastery 12.5
exterior 12
winter 11.9
structure 11.9
clock 11.8
traditional 11.7
worship 11.6
window 10.6
acoustic device 9.9
sightseeing 9.7
st 9.7
architectural 9.6
scene 9.5
antique 9.5
sunny 9.5
orthodox 8.8
palace 8.8
god 8.6
temple 8.6
hill 8.4
place 8.4
street 8.3
vintage 8.3
snow 8.2
landscape 8.2
facade 7.9
steeple 7.9
fortification 7.9
towers 7.8
pray 7.8
heritage 7.7
tree 7.7
signaling device 7.7
england 7.6
cityscape 7.6
buildings 7.6
destination 7.5
river 7.1
trees 7.1
day 7.1

Google
created on 2022-06-24

Microsoft
created on 2022-06-24

table 99.4
person 94.6
indoor 93.4
black and white 88.7
clothing 72.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Female, 100%
Calm 97.5%
Surprised 6.8%
Fear 5.9%
Sad 2.3%
Happy 0.3%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a person sitting at a table 92.7%
a group of people sitting at a table 89.1%
a person sitting on a table 86.6%