Human Generated Data

Title

Untitled (children in bathing suits on dock by lake)

Date

1953

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17795

Human Generated Data

Title

Untitled (children in bathing suits on dock by lake)

People

Artist: Lucian and Mary Brown, American

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.7
Person 99.7
Shorts 99.6
Clothing 99.6
Apparel 99.6
Person 99.2
Person 99.1
Person 98.9
Person 98
Person 85.6
Helmet 76.7
Face 75.5
People 71.3
Coat 70.2
Overcoat 70.2
Suit 70.2
Female 67
Portrait 64.8
Photography 64.8
Photo 64.8
Helmet 55.7
Shirt 55.4
Man 55

Imagga
created on 2022-02-26

brass 91.2
wind instrument 70.5
musical instrument 48.5
trombone 45.7
cornet 27.2
person 23.9
people 21.7
man 21.5
black 19.9
male 19.1
silhouette 18.2
adult 17.5
sexy 16.9
portrait 16.8
body 14.4
lifestyle 13.7
model 13.2
lady 13
human 12.7
attractive 12.6
sunset 12.6
music 12.5
athlete 12.2
style 11.9
studio 11.4
couple 11.3
fashion 11.3
device 11.3
pretty 11.2
men 11.2
entertainment 11
musician 11
sensual 10.9
dark 10.9
bugle 10.8
holding 10.7
happy 10.6
hand 9.9
posing 9.8
sport 9.6
party 9.5
elegant 9.4
pose 9.1
bass 9
horn 8.9
runner 8.9
looking 8.8
together 8.8
hair 8.7
women 8.7
standing 8.7
performance 8.6
sax 8.6
friendship 8.4
instrument 8.4
outdoors 8.2
figure 8.1
group 8.1
love 7.9
boy 7.8
concert 7.8
musical 7.7
performer 7.7
sky 7.6
active 7.6
dusk 7.6
professional 7.6
fun 7.5
event 7.4
clothing 7.4
water 7.3
stage 7.3
teenager 7.3
dress 7.2
activity 7.2
face 7.1
summer 7.1
happiness 7

Microsoft
created on 2022-02-26

text 99.2
person 93.7
clothing 89.8
outdoor 87
posing 86.4
man 73.9
sketch 66.3
drawing 64.9
old 46.3

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 93.2%
Calm 43.5%
Happy 31.9%
Surprised 16.7%
Sad 3%
Angry 2.1%
Disgusted 1.6%
Fear 0.9%
Confused 0.3%

AWS Rekognition

Age 28-38
Gender Male, 77.6%
Happy 54.4%
Calm 18.5%
Sad 17.4%
Surprised 4.9%
Disgusted 1.8%
Angry 1.6%
Fear 0.7%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Male, 88%
Happy 50.8%
Calm 42.3%
Surprised 3.2%
Sad 1.1%
Disgusted 1.1%
Fear 0.7%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Female, 86.5%
Calm 81.5%
Happy 10.5%
Surprised 4.6%
Sad 1.6%
Fear 0.7%
Angry 0.5%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Male, 62.7%
Sad 81.4%
Calm 15.3%
Happy 1.4%
Surprised 0.9%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Female, 97.2%
Calm 41.7%
Sad 29.3%
Surprised 11.7%
Happy 10.9%
Confused 2.6%
Angry 2.4%
Disgusted 1.2%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 76.7%

Captions

Microsoft

a group of people posing for a photo 93%
a group of people posing for a picture 92.9%
a group of people posing for the camera 92.8%

Text analysis

Amazon

SIP