Human Generated Data

Title

Untitled (portrait of eleven female grandchildren seated on and around couch)

Date

c. 1950

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2988

Human Generated Data

Title

Untitled (portrait of eleven female grandchildren seated on and around couch)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Person 99.2
Human 99.2
Interior Design 98.4
Indoors 98.4
Person 98.2
Person 98
Person 97.5
Person 96.8
Person 96.4
Person 94.3
Apparel 94.1
Clothing 94.1
Room 88.6
Shorts 87.9
Person 87.2
Helmet 86.4
Chair 80.3
Furniture 80.3
Helmet 76.6
Kid 76.3
Child 76.3
Dress 75.8
Person 74.5
Helmet 73.4
People 70.4
Person 70.2
Helmet 69.4
Person 68.2
Female 64.8
Helmet 64.5
Stage 64
Girl 61.2
Cream 60.8
Food 60.8
Creme 60.8
Icing 60.8
Dessert 60.8
Cake 60.8
Performer 60.1
Floor 60
Living Room 59
Play 58.2
Baby 55.3

Imagga
created on 2022-01-21

people 25.6
brass 24.7
person 23.7
man 21.5
wind instrument 20.2
male 19.2
sport 19
adult 18.6
silhouette 18.2
kin 17.4
player 17.1
athlete 16.3
musical instrument 15.5
dancer 14.9
fun 14.2
sky 14
child 14
lifestyle 13
black 12.6
performer 12.5
men 12
body 12
exercise 11.8
happiness 11.7
contestant 11.6
summer 11.6
ballplayer 11.4
boy 11.3
youth 11.1
women 11.1
art 11
beach 10.9
active 10.8
together 10.5
happy 10
human 9.7
group 9.7
ball 9.5
love 9.5
cornet 9.3
reflection 9.2
dark 9.2
football helmet 9.1
girls 9.1
portrait 9.1
fashion 9
sunset 9
outdoors 9
team 9
world 8.8
couple 8.7
water 8.7
jump 8.6
friendship 8.4
outdoor 8.4
joy 8.3
training 8.3
leisure 8.3
freedom 8.2
helmet 8.2
dress 8.1
recreation 8.1
activity 8.1
cool 8
clothing 8
dance 7.9
health 7.6
park 7.6
sibling 7.6
vacation 7.4
design 7.3
cheerful 7.3
teenager 7.3
entertainer 7.2
fitness 7.2
life 7.2
family 7.1

Google
created on 2022-01-21

Microsoft
created on 2022-01-21

text 99
person 91.2
clothing 87.6
dance 83.2
footwear 76.3
old 70.6
player 62.8
white 62.4
posing 62.2
vintage 28.2

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 98.6%
Calm 62.7%
Sad 17.7%
Happy 7.4%
Angry 3.5%
Disgusted 2.8%
Surprised 2.5%
Fear 2.3%
Confused 1.1%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 60.8%
Surprised 33.2%
Sad 1.6%
Calm 1.6%
Fear 0.9%
Confused 0.8%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 75.8%
Happy 12%
Sad 6.5%
Confused 2.4%
Angry 0.9%
Surprised 0.9%
Disgusted 0.9%
Fear 0.5%

AWS Rekognition

Age 30-40
Gender Female, 96.6%
Calm 55.9%
Sad 19.8%
Happy 19.1%
Surprised 1.6%
Angry 1.1%
Confused 1%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 35-43
Gender Female, 90.8%
Surprised 98.9%
Calm 0.7%
Fear 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 30-40
Gender Male, 96.7%
Calm 58%
Surprised 17.6%
Happy 14.3%
Fear 3.9%
Angry 3.6%
Sad 1.1%
Disgusted 1%
Confused 0.6%

AWS Rekognition

Age 19-27
Gender Female, 65.6%
Calm 87.5%
Surprised 6%
Sad 3%
Fear 1.1%
Happy 1.1%
Angry 0.6%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 37-45
Gender Male, 98.9%
Calm 98.2%
Sad 0.6%
Happy 0.5%
Disgusted 0.2%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.6%
Happy 53.3%
Calm 41.3%
Sad 2.3%
Confused 0.9%
Angry 0.8%
Disgusted 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 92%
Surprised 48.2%
Calm 46.3%
Sad 2%
Angry 1.4%
Disgusted 0.7%
Confused 0.7%
Happy 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Helmet 86.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 86.3%
a vintage photo of a group of people posing for a picture 86.2%
a vintage photo of a group of people posing for a photo 84.3%