Human Generated Data

Title

Untitled (office of Dr. Herman M. Juergens, Belle Plaine, MN)
Date

1964-67
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.188

Human Generated Data

Title

Untitled (office of Dr. Herman M. Juergens, Belle Plaine, MN)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1964-67

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.188

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Person 97.6
Person 97.1
Person 96.8
Person 96.5
Person 96.4
Person 96.2
Person 96.2
Person 96.1
Person 96.1
Person 96.1
Person 95.6
Person 95.6
Person 95.6
Person 95.4
Person 95.4
Person 95.4
Person 95.3
Person 95.1
Person 95
Person 95
Person 94.8
Adult 94.8
Bride 94.8
Female 94.8
Wedding 94.8
Woman 94.8
Person 94.6
Person 94.5
Person 94.1
Person 93.7
Person 93.6
Person 93.6
Person 93.6
Person 93.1
Person 92.5
Person 92.4
Person 92
Person 91.8
Person 91.6
Person 91.5
Person 91.2
Adult 91.2
Male 91.2
Man 91.2
Person 90.9
Adult 90.9
Male 90.9
Man 90.9
Person 90.9
Person 90.8
Person 90.2
Person 89.7
Person 88.9
Person 88.6
Person 88.5
Person 87.9
Person 86.6
Adult 86.6
Male 86.6
Man 86.6
Person 85.8
Person 83.7
Face 83.3
Head 83.3
Person 82.8
Person 82.4
Person 82.2
Person 80.6
Person 80.1
Person 75.5
Person 71.1
Person 69.9
Person 65.2
Person 64.8
Photographic Film 59.9
Person 58.2
Person 56.2
Shelf 55.5

Clarifai
created on 2019-02-18

people 99.2
many 99.2
group 98.5
no person 97.5
one 97.2
shelf 96.4
adult 95.5
stock 94.9
two 94.1
medicine 91.2
man 90.5
market 90.3
desktop 89.6
portrait 89.6
indoors 88.3
retro 87.8
art 87.7
sale 87
woman 86.8
business 86.5

Imagga
created on 2019-02-18

shop 63.1
shoe shop 52.2
mercantile establishment 41.1
case 29.2
place of business 27.1
shelf 24.5
market 14.2
store 14.1
establishment 13.3
business 12.7
retail 12.3
food 11.8
warehouse 11.8
traditional 11.6
texture 11.1
brown 11
pattern 10.9
design 10.7
old 10.4
bottle 9.9
fashion 9.8
sale 9.2
bakery 9.2
group 8.8
colorful 8.6
modern 8.4
black 8.4
clothing 8.3
style 8.1
collection 8.1
close 8
art 7.8
travel 7.7
culture 7.7
supermarket 7.6
box 7.6
nutrition 7.5
window 7.5
wood 7.5
cabinet 7.5
clothes 7.5
furniture 7.5
commerce 7.5
rack 7.4
retro 7.4
footwear 7.3
detail 7.2
container 7.2
interior 7.1

Google
created on 2019-02-18

Photograph 95.9
Collection 90.6
Picture frame 85
Photography 70.6
Black-and-white 56.4
Team 52.3
Art 50.2

Microsoft
created on 2019-02-18

indoor 89.3
black and white 89.3
art 72.7
window 40.7
monochrome 35.6
collection 32.1
summer 19.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 97.4%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Angry 0.8%
Confused 0.5%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Calm 83.9%
Confused 10.4%
Surprised 7.4%
Fear 6%
Sad 2.4%
Disgusted 1.2%
Happy 0.9%
Angry 0.4%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 91.5%
Surprised 8.6%
Fear 6.1%
Sad 2.2%
Angry 1.9%
Disgusted 1.1%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 58-66
Gender Male, 99.9%
Fear 89.1%
Surprised 9.5%
Calm 9.2%
Angry 4.2%
Sad 3%
Disgusted 2.9%
Happy 1.9%
Confused 1.6%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 69.9%
Surprised 37%
Fear 6.5%
Sad 2.3%
Angry 0.9%
Disgusted 0.7%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 16-24
Gender Male, 91.5%
Calm 60.9%
Happy 34.1%
Surprised 6.5%
Fear 6.1%
Sad 2.7%
Confused 1.1%
Disgusted 0.7%
Angry 0.5%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 54.3%
Disgusted 14.8%
Confused 10%
Surprised 9.2%
Angry 8.5%
Fear 7%
Sad 3.8%
Happy 0.7%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Disgusted 83.7%
Fear 7.8%
Surprised 7%
Calm 5%
Sad 3.1%
Confused 1.9%
Angry 0.8%
Happy 0.3%

AWS Rekognition

Age 31-41
Gender Male, 93.6%
Fear 81.5%
Surprised 36.7%
Disgusted 3.8%
Sad 2.8%
Confused 2.3%
Angry 1.7%
Calm 1.3%
Happy 0.5%

AWS Rekognition

Age 41-49
Gender Male, 95%
Confused 84.4%
Surprised 6.7%
Fear 6.2%
Sad 5.2%
Calm 4.3%
Disgusted 2.5%
Angry 0.6%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 93.9%
Calm 67.2%
Happy 24.4%
Surprised 6.6%
Fear 6%
Sad 2.5%
Confused 2.4%
Disgusted 2.1%
Angry 1.9%

AWS Rekognition

Age 45-53
Gender Male, 97.9%
Calm 66.7%
Surprised 18.9%
Happy 6.8%
Fear 6.5%
Sad 5.5%
Confused 1.5%
Disgusted 1.4%
Angry 0.7%

AWS Rekognition

Age 27-37
Gender Female, 60.9%
Angry 51.5%
Sad 20.6%
Disgusted 17.6%
Calm 9.1%
Surprised 6.9%
Fear 6%
Happy 2.4%
Confused 0.5%

AWS Rekognition

Age 29-39
Gender Male, 90%
Calm 80.6%
Angry 8.3%
Surprised 8.2%
Fear 6%
Disgusted 4.6%
Sad 2.4%
Happy 1.1%
Confused 0.7%

AWS Rekognition

Age 19-27
Gender Male, 82.9%
Sad 37.4%
Disgusted 36.4%
Calm 27.4%
Fear 7.2%
Surprised 7.2%
Confused 2.8%
Angry 2.7%
Happy 2.5%

AWS Rekognition

Age 39-47
Gender Male, 79.4%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.8%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 40-48
Gender Female, 97.8%
Calm 96%
Surprised 7.2%
Fear 5.9%
Sad 2.2%
Happy 1.4%
Angry 0.5%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Sad 40.3%
Fear 33.5%
Calm 24%
Surprised 8.1%
Happy 7.7%
Angry 6.4%
Confused 2.4%
Disgusted 1.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 61.7%
Disgusted 19.8%
Surprised 12.8%
Fear 6%
Confused 4.3%
Happy 2.8%
Sad 2.5%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Male, 61%
Calm 94.3%
Surprised 6.8%
Fear 5.9%
Confused 3.3%
Sad 2.2%
Happy 0.6%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Male, 90.1%
Happy 55.8%
Disgusted 15.6%
Surprised 13.5%
Fear 7.1%
Confused 5.5%
Calm 3.6%
Sad 3.4%
Angry 3.2%

AWS Rekognition

Age 28-38
Gender Male, 90.1%
Calm 60.9%
Sad 51.1%
Surprised 7.6%
Fear 6.5%
Disgusted 2.5%
Confused 2%
Angry 1.9%
Happy 1.6%

AWS Rekognition

Age 39-47
Gender Female, 70.2%
Happy 49.3%
Calm 42.9%
Surprised 6.8%
Fear 6.2%
Sad 2.8%
Disgusted 2.1%
Confused 1.7%
Angry 0.6%

AWS Rekognition

Age 25-35
Gender Male, 99.4%
Sad 100%
Fear 8.1%
Happy 6.7%
Surprised 6.4%
Disgusted 1.1%
Calm 1%
Angry 0.6%
Confused 0.5%

AWS Rekognition

Age 14-22
Gender Female, 97.2%
Calm 88.7%
Fear 7%
Surprised 6.6%
Sad 3.7%
Happy 2.2%
Disgusted 0.7%
Angry 0.6%
Confused 0.6%

AWS Rekognition

Age 18-24
Gender Female, 89.6%
Calm 90%
Surprised 6.3%
Fear 6.1%
Disgusted 2.9%
Happy 2.5%
Sad 2.4%
Angry 1.5%
Confused 1.4%

AWS Rekognition

Age 21-29
Gender Male, 98.4%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.1%
Disgusted 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 23-33
Gender Male, 67.1%
Calm 70.7%
Happy 18.5%
Surprised 6.6%
Fear 6.1%
Sad 3.6%
Confused 2.9%
Angry 2.1%
Disgusted 0.7%

AWS Rekognition

Age 19-27
Gender Female, 61.8%
Calm 72.6%
Happy 19.9%
Surprised 6.4%
Fear 6%
Sad 4.3%
Confused 1.1%
Angry 0.6%
Disgusted 0.2%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 46.1%
Calm 36.3%
Angry 21.6%
Surprised 7.7%
Confused 7.3%
Fear 7.3%
Disgusted 2.3%
Happy 1%

Feature analysis

Amazon

Person 97.6%
Adult 94.8%
Bride 94.8%
Female 94.8%
Woman 94.8%
Male 91.2%
Man 91.2%

Categories

Imagga

interior objects 99.2%

Captions

Microsoft
created on 2019-02-18

a close up of a window 68.5%
close up of a window 60.5%
a group of men standing next to a window 28.8%

Text analysis

Amazon

28
29A
19A
25A
VCC
25
9A
30A
1
18A
22
-30
14A
>23
->27
12
>22A
19
-29
ЗАЯ 1
ZE
->28A
9E
SE
>12A
IOA
>10
>31
9C<
-23A
KODAI
17A
MODER
-22A
-26
16A
EE -
217
ЗАЯ
KOCAR
11
Le
VZE
PER
>21A
->>>

Google

→2 →14 →14A → 16A 17A →18A →19 BA →22A →23 →23A 24 → 25 → 25A →21A → 29A →30 A → 28 28A → 26 →26A →27
→
2
14
14A
16A
17A
18A
19
BA
22A
23
23A
24
25
25A
21A
29A
30
A
28
28A
26
26A
27