Human Generated Data

Title

Untitled (boy scouts posing with trophy cup)

Date

1940

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2007

Human Generated Data

Title

Untitled (boy scouts posing with trophy cup)

People

Artist: Hamblin Studio, American active 1930s

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 96.5
Person 95.4
Person 94.9
Person 93.8
Person 91.7
Person 91.1
Person 88.5
Person 88.2
Person 88.2
Person 87.6
Person 86.5
People 85.4
Person 81.8
Person 79.5
Person 72.3
Military 66.9
Military Uniform 65.4
Text 64.6
Funeral 63.3
Crowd 61
Outdoors 60.8
Person 58.9
Symbol 56.7
Advertisement 55.6
Poster 55.6
Person 44.5

Imagga
created on 2021-12-14

glass 87.6
chandelier 70.8
lighting fixture 56
fixture 41.9
wineglass 28.7
water 28
ice 21.4
drink 20.9
cold 18.9
chemistry 17.4
chemical 17.4
laboratory 17.4
research 17.1
biology 17.1
biotechnology 16.7
experiment 16.6
menorah 16.1
lab 15.5
transparent 15.2
medical 15
medicine 15
wine 14.8
glassware 14.7
aqua 13.3
liquid 13
glasses 13
bar 12.9
candelabrum 12.9
genetic 12.8
beaker 12.7
drop 12.7
black 12.6
alcohol 12.4
development 12.4
clear 12.2
restaurant 12.1
ecology 11.9
agronomy 11.8
weeds 11.8
h2o 11.8
fluid 11.7
recycling 11.6
food 11.5
frozen 11.5
dirt 11.5
growing 11.4
engineering 11.4
plant 11.2
party 11.2
candlestick 10.9
ecological 10.7
cocktail 10.5
crystal 10.4
luxury 10.3
close 10.3
leaf 10.1
elegance 10.1
clean 10
geneticist 9.9
epidemiology 9.9
botanist 9.9
germinate 9.9
immature 9.9
sterilize 9.9
researcher 9.9
sterile 9.8
horticulture 9.8
cool 9.8
agricultural 9.7
herbal 9.5
table 9.5
solution 9.5
botanical 9.5
decoration 9.4
splash 9.4
botany 9.3
equipment 9.3
purity 9.2
beverage 9.2
design 9
shape 8.9
reflection 8.9
celebration 8.8
test 8.7
grunge 8.5
bubble 8.5
plants 8.3
vintage 8.3
wet 8
light 8
science 8
architecture 7.8
scientific 7.7
cup 7.7
old 7.7
drinking 7.7
freshness 7.5
container 7.4
fresh 7.2
night 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99
tree 98.8
drawing 74.2
black 70
posing 59.4
old 57.9
sketch 52.1
vintage 38.4

Face analysis

Amazon

Google

AWS Rekognition

Age 48-66
Gender Male, 67.8%
Calm 58%
Happy 32.1%
Surprised 2.7%
Confused 2.2%
Sad 1.6%
Angry 1.5%
Fear 1.1%
Disgusted 0.7%

AWS Rekognition

Age 43-61
Gender Female, 65.1%
Calm 97.2%
Happy 1.2%
Sad 0.8%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 24-38
Gender Male, 65.6%
Calm 61.5%
Happy 14.8%
Angry 10.6%
Sad 8.6%
Fear 2.6%
Disgusted 0.8%
Surprised 0.7%
Confused 0.4%

AWS Rekognition

Age 22-34
Gender Male, 64%
Calm 42.4%
Fear 20.2%
Happy 10.6%
Angry 8.9%
Surprised 7.6%
Sad 6.5%
Disgusted 2.1%
Confused 1.7%

AWS Rekognition

Age 24-38
Gender Female, 63.7%
Calm 89.3%
Sad 3.4%
Happy 2.4%
Angry 1.9%
Surprised 0.9%
Confused 0.9%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 24-38
Gender Female, 92.5%
Calm 85.1%
Sad 3.6%
Happy 3.2%
Angry 3.1%
Confused 1.8%
Fear 1.5%
Surprised 1.2%
Disgusted 0.6%

AWS Rekognition

Age 12-22
Gender Female, 86.3%
Happy 43.5%
Calm 43.3%
Sad 6.8%
Angry 3.5%
Disgusted 0.9%
Fear 0.7%
Surprised 0.6%
Confused 0.6%

AWS Rekognition

Age 27-43
Gender Female, 87%
Happy 42.9%
Calm 36.1%
Confused 8.4%
Sad 7.3%
Fear 2%
Surprised 1.4%
Angry 1.2%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Poster 55.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 89.2%
a vintage photo of a group of people posing for a picture 89.1%
a vintage photo of a group of people posing for a photo 88.1%

Text analysis

Amazon

S
1
100

Google

*****
S *****
S