Human Generated Data

Title

Untitled (soldiers on patrol, Vietnam)
Date

1967-68
People

Artist: Gordon W. Gahan, American 1945 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.224

Human Generated Data

Title

Untitled (soldiers on patrol, Vietnam)

People

Artist: Gordon W. Gahan, American 1945 - 1984

Date

1967-68

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.224

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Art 99.9
Collage 99.9
Person 98.3
Person 98
Person 97.8
Person 97.7
Person 97.7
Person 97.6
Person 97
Person 96.9
Person 96.7
Person 95.7
Person 95.7
Face 95.7
Head 95.7
Person 95.4
Person 95.4
Person 95.2
Person 94.8
Person 94.7
Person 94.4
Baby 94.4
Person 94.3
Person 94
Person 93.9
Person 93.7
Person 93.7
Person 93.5
Person 92.4
Person 92.1
Person 91.9
Person 91.8
Person 91.2
Person 90.8
Person 89.4
Person 89.1
Person 86.5
Person 86.5
Person 85.2
Person 84.9
Person 81.4
Person 80.3
Person 78.8
Person 78.7
Person 78.6
Person 77.2
Person 76.5
Person 73.1
Photographic Film 69.8
Person 67.8
Person 67.5
Person 61.5
Person 61.5
Photo Booth 55.1

Clarifai
created on 2019-02-18

shelf 99.1
no person 98.2
people 96.5
window 95.5
indoors 95.4
stock 94.4
room 94
design 93
group 91.7
picture frame 91.7
old 90.7
antique 89.6
many 89.2
art 88.8
one 88.7
architecture 88.3
retro 87.6
glass items 87.5
family 86.4
vintage 86.3

Imagga
created on 2019-02-18

furniture 63.9
china cabinet 55.4
cabinet 50.3
furnishing 42.4
shop 22.8
bookcase 22.3
interior 20.3
shelf 17.3
business 16.4
case 16.3
design 15.8
modern 15.4
room 14.6
wood 14.2
home 12.7
brown 12.5
stack 12
market 11.5
slot machine 11.5
wooden 11.4
store 11.3
old 11.1
architecture 11
house 10.8
glass 10.7
building 10.5
rack 10.4
machine 10.4
food 10.4
wall 10.2
pattern 10.2
industry 10.2
television 9.7
style 9.6
mercantile establishment 9.5
center 9.4
colorful 9.3
communication 9.2
vending machine 9.1
technology 8.9
indoors 8.8
book 8.5
retail 8.5
web 8.5
display 8.4
box 8.2
antique 8.1
office 8.1
decoration 8
science 8
information 8
bakery 7.9
paper 7.8
video 7.7
money 7.6
vintage 7.6
device 7.3
screen 7.3
digital 7.3
color 7.2
work 7.2
history 7.1
window 7.1
cafeteria 7.1

Google
created on 2019-02-18

Photograph 94.8
Collection 87.3
Photography 70.6
Picture frame 67.8
Art 62.5
Black-and-white 56.4

Microsoft
created on 2019-02-18

indoor 91.1
window 86.2
black and white 86.2
art 17.7
monochrome 15.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Female, 94.4%
Happy 75%
Surprised 7.3%
Fear 6.9%
Confused 5.8%
Sad 4.6%
Disgusted 4.2%
Angry 2.6%
Calm 2.4%

AWS Rekognition

Age 19-27
Gender Male, 98%
Calm 87.9%
Surprised 7%
Fear 6.2%
Sad 5.3%
Disgusted 1.7%
Confused 0.7%
Angry 0.7%
Happy 0.3%

AWS Rekognition

Age 24-34
Gender Male, 98.2%
Sad 99.8%
Calm 29.3%
Surprised 6.4%
Fear 6%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 82.8%
Calm 92.6%
Surprised 7.1%
Fear 6.1%
Sad 2.6%
Angry 2.4%
Confused 0.5%
Happy 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-33
Gender Female, 94.6%
Happy 75.1%
Calm 12%
Surprised 8.2%
Fear 6.1%
Disgusted 6.1%
Sad 2.5%
Angry 0.9%
Confused 0.8%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Sad 48.7%
Calm 47.1%
Confused 17.6%
Surprised 6.9%
Fear 6.3%
Angry 3.7%
Disgusted 2.1%
Happy 0.8%

AWS Rekognition

Age 23-31
Gender Male, 55.3%
Calm 95.9%
Surprised 6.3%
Fear 6%
Sad 3%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 36-44
Gender Male, 78.9%
Calm 98%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Happy 0.4%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Sad 91.6%
Confused 23%
Calm 12.9%
Surprised 9.2%
Fear 8.3%
Angry 5.1%
Disgusted 2.7%
Happy 2.6%

AWS Rekognition

Age 24-34
Gender Male, 55.8%
Sad 100%
Surprised 6.4%
Fear 5.9%
Angry 2.1%
Disgusted 2%
Confused 0.7%
Calm 0.3%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Female, 96.8%
Calm 92.7%
Surprised 6.4%
Fear 6%
Sad 4.1%
Confused 1.3%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 35-43
Gender Female, 90.5%
Surprised 64.1%
Calm 52.7%
Fear 7.2%
Confused 2.6%
Sad 2.5%
Disgusted 1%
Happy 0.8%
Angry 0.4%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Happy 90.3%
Surprised 6.8%
Fear 6.3%
Sad 3.4%
Calm 1.6%
Disgusted 1.1%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 98.2%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 10-18
Gender Female, 82.1%
Sad 70.1%
Calm 51.6%
Surprised 7.4%
Confused 6.5%
Fear 6.2%
Happy 4.9%
Disgusted 0.9%
Angry 0.5%

AWS Rekognition

Age 22-30
Gender Male, 91.7%
Happy 71%
Surprised 8.2%
Fear 6.8%
Disgusted 6.7%
Calm 5.5%
Sad 5%
Confused 3.3%
Angry 1.7%

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Calm 31%
Surprised 20.7%
Angry 19.7%
Sad 16.7%
Happy 8.5%
Fear 7%
Disgusted 5.4%
Confused 1.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Baby 94.4%

Categories

Imagga

interior objects 94.6%
streetview architecture 5%

Captions

Microsoft
created on 2019-02-18

a close up of a window 63.7%
close up of a window 55.2%
a close up of a glass window 46.1%

Text analysis

Amazon

29
30
29A
304
13A
28
340
ZIA
TE
VEGOT
LP
WHIP
DE
ICA

Google

34A 30 12
34A
30
12