Human Generated Data

Title

Untitled (woman with two young sons in ties)
Date

c. 1940
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1337

Human Generated Data

Title

Untitled (woman with two young sons in ties)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tie 99.9
Accessory 99.9
Accessories 99.9
Person 99.3
Human 99.3
Person 98.9
Tie 98.8
Person 97.7
People 94.9
Clothing 93.9
Apparel 93.9
Family 91.8
Shirt 81
Face 77.6
Necktie 76.3
Child 68.2
Kid 68.2
Female 67.2
Girl 67.2
Overcoat 65.5
Coat 65.5
Suit 65.5
Sleeve 64.9
Long Sleeve 61.5
Furniture 58.8
Couch 58.8
Photography 58.5
Photo 58.5
Sailor Suit 56.8
Sitting 56
Boy 55.6

Imagga
created on 2022-01-23

kin 66.1
family 60.6
child 58.1
father 57.9
sibling 43.9
male 43.3
mother 40.9
parent 39.7
home 39.1
happy 38.3
dad 37
man 34.3
smiling 34
son 32.5
people 32.4
boy 31.3
daughter 31.1
together 30.7
kid 29.3
couple 28.8
husband 28.7
love 27.6
children 27.4
lifestyle 25.3
little 24.8
portrait 24
happiness 23.5
senior 23.5
adult 23.4
fun 22.5
indoors 22
wife 21.8
casual 21.2
smile 20.7
grandfather 20.6
baby 19.9
childhood 19.7
sitting 17.2
cheerful 17.1
kids 17
group 16.9
cute 16.5
person 16.2
mature 15.8
30s 15.4
togetherness 15.1
joy 15.1
couch 14.5
brother 13.8
room 13.8
men 13.8
mom 13.6
two 13.6
parents 12.7
elderly 12.5
playing 11.9
retired 11.7
holding 11.6
looking camera 11.6
living 11.4
face 11.4
laughing 11.4
old 11.2
leisure 10.8
interior 10.6
color 10.6
loving 10.5
looking 10.4
women 10.3
three 10.2
youth 10.2
adorable 10.2
clothing 10.2
grandmother 9.8
living room 9.8
bonding 9.8
40s 9.7
two people 9.7
grandma 9.6
generation 9.6
married 9.6
four 9.6
sofa 9.6
school 9.4
indoor 9.1
domestic 9.1
grandchild 8.9
generations 8.9
multi ethnic 8.9
standing 8.7
infant 8.7
retirement 8.7
relaxed 8.5
camera 8.3
teacher 7.9
grandparent 7.9
4 7.8
parenthood 7.8
education 7.8
middle aged 7.8
thirties 7.8
newborn 7.8
toddler 7.7
world 7.6
human 7.5
relationship 7.5
girls 7.3
relaxing 7.3
attractive 7

Google
created on 2022-01-23

Smile 96.2
Outerwear 95.1
Standing 86.4
Sleeve 85.7
Vintage clothing 75.7
Collar 71.1
Classic 69.5
Room 69.4
Child 68.6
Picture frame 68.1
Event 65.7
Stock photography 64.7
Toddler 64.3
Sitting 63.8
Fun 63.1
Retro style 58.2
Family 56.3
Art 56.2
Portrait 56.1
Photographic paper 55.3

Microsoft
created on 2022-01-23

person 99.7
human face 98.4
wall 98.1
clothing 97.5
smile 96
black 82.9
child 79.3
standing 78.7
text 74.9
posing 73.7
old 72.2
white 71.2
group 64.6
baby 62.6
boy 53.4
toddler 51

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Female, 100%
Calm 98.9%
Confused 0.4%
Surprised 0.3%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 6-12
Gender Male, 93.3%
Happy 98.8%
Confused 0.4%
Sad 0.2%
Angry 0.2%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%
Calm 0%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Happy 99.3%
Calm 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Fear 0%

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Person 99.3%

Captions

Microsoft

a group of people posing for a photo 96.7%
a group of people posing for the camera 96.6%
an old photo of a group of people posing for the camera 95%