Human Generated Data

Title

Untitled (family with five children posed sitting on floor near Christmas tree)

Date

1962

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9860

Human Generated Data

Title

Untitled (family with five children posed sitting on floor near Christmas tree)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Play 99.9
Clothing 99.7
Apparel 99.7
Person 99.6
Human 99.6
Person 99.2
Person 99.1
Shorts 98.7
Person 98.1
Sand 98
Nature 98
Outdoors 98
Face 97.2
Person 95.9
Person 93.4
Head 89.5
Water 89.2
Boy 88.6
Child 87.7
Kid 87.7
Female 86.9
Dress 81.9
Tree 80.5
Plant 80.5
Smile 80
Portrait 76.3
Photo 76.3
Photography 76.3
Girl 74.4
Helmet 74.1
People 70.9
Costume 70.5
Helmet 69.8
Vacation 69.7
Beach 68.8
Shoreline 68.8
Sea 68.8
Coast 68.8
Ocean 68.8
Man 68.3
Snow 65.3
Suit 64.2
Coat 64.2
Overcoat 64.2
Ice 63.5
Accessories 63.5
Accessory 63.5
Glasses 63.5
Woman 62.6
Teen 59
Leisure Activities 57.1
Baby 56.4
Hat 55.8
Pool 55.4
Indoors 55.3
Military Uniform 55.3
Military 55.3
Soldier 55.3

Imagga
created on 2022-01-28

kin 47.7
beach 45.7
man 27.8
sand 26.6
people 26.2
sea 25
parent 25
vacation 23.7
summer 22.5
ocean 22.4
adult 22.1
child 22.1
male 20.9
silhouette 20.7
water 19.4
outdoor 19.1
sunset 18.9
love 18.2
mother 18.1
dad 18.1
happiness 18
father 17.6
couple 17.4
lifestyle 17.4
active 17.1
sky 16.6
happy 16.3
outdoors 16
boy 15.7
sport 15.4
person 15.3
coast 15.3
portrait 14.2
leisure 14.1
groom 14.1
two 13.6
relax 13.5
fun 13.5
together 13.2
family 12.5
walking 12.3
sun 12.1
attractive 11.9
women 11.9
relaxation 11.7
joy 11.7
romance 11.6
play 11.2
men 11.2
holiday 10.8
travel 10.6
sunny 10.3
black 10.2
life 10.1
recreation 9.9
sexy 9.6
body 9.6
dusk 9.5
walk 9.5
friends 9.4
relationship 9.4
playing 9.1
fashion 9.1
landscape 8.9
jump 8.6
married 8.6
sibling 8.6
outside 8.6
youth 8.5
shore 8.4
girls 8.2
exercise 8.2
dress 8.1
bikini 8.1
bride 8
kid 8
run 7.7
wife 7.6
juvenile 7.6
enjoy 7.5
world 7.5
friendship 7.5
freedom 7.3
lady 7.3
group 7.3
horizon 7.2
looking 7.2
hair 7.1
romantic 7.1
businessman 7.1

Google
created on 2022-01-28

Microsoft
created on 2022-01-28

text 98.9
outdoor 87.4
person 83.8
clothing 74.4
snow 68.5

Face analysis

Amazon

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Calm 62.9%
Sad 14.9%
Happy 9.1%
Confused 4.8%
Surprised 3.6%
Angry 2.2%
Disgusted 2%
Fear 0.5%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%
Surprised 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 39-47
Gender Male, 98.8%
Calm 92.2%
Sad 3%
Happy 1.9%
Confused 1.8%
Disgusted 0.4%
Surprised 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 38-46
Gender Male, 84.2%
Happy 73.5%
Calm 21.4%
Sad 3.5%
Surprised 0.5%
Angry 0.4%
Disgusted 0.3%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Female, 93.8%
Calm 93.8%
Happy 4.3%
Sad 1.1%
Surprised 0.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 29-39
Gender Male, 83.4%
Calm 88%
Sad 7.8%
Happy 2.9%
Angry 0.5%
Confused 0.2%
Fear 0.2%
Surprised 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person 99.6%
Helmet 74.1%

Captions

Microsoft

a group of people posing for a photo 70.4%
a group of people standing in front of a wall 70.3%
a group of people in a room 70.2%