Human Generated Data

Title

Untitled (portrait of family women)

Date

c. 1945

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1436

Human Generated Data

Title

Untitled (portrait of family women)

People

Artist: Martin Schweig, American 20th century

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Family 99.3
People 99.3
Person 99.1
Person 98.3
Person 98
Accessory 83.9
Glasses 83.9
Accessories 83.9
Female 78.3
Face 70.3
Photo 65.7
Photography 65.7
Baby 63.6
Portrait 63
Couch 62.9
Furniture 62.9
Woman 62.8
Newborn 60
Clothing 59.3
Apparel 59.3

Imagga
created on 2022-01-22

kin 100
mother 48.3
family 43.6
home 42.3
happy 37.6
male 33.9
parent 33.4
people 31.8
man 30.9
happiness 29.8
couple 29.6
child 29.6
father 27.2
senior 24.4
smiling 23.9
love 23.7
portrait 23.3
together 22.8
daughter 21.5
smile 21.4
kid 20.4
indoors 20.2
husband 20
adult 19.6
cheerful 19.5
old 18.8
children 18.2
dad 16.8
son 16.6
lifestyle 16.6
boy 16.5
elderly 16.3
fun 15.7
face 15.6
person 15.6
sitting 15.5
wife 15.2
mature 14.9
30s 14.4
casual 14.4
childhood 14.3
women 14.2
kids 14.1
couch 13.5
room 13.5
grandfather 13.4
grandmother 12.7
two 12.7
interior 12.4
little 12.4
togetherness 12.3
men 12
horizontal 11.7
married 11.5
baby 11.4
group 11.3
joy 10.9
domestic 10.9
leisure 10.8
parents 10.8
retired 10.7
attractive 10.5
enjoying 10.4
cute 10
playing 10
house 10
sibling 10
clothing 9.9
living room 9.8
affection 9.7
looking 9.6
celebration 9.6
gift 9.5
indoor 9.1
dress 9
grandma 8.8
two people 8.7
mom 8.7
retirement 8.6
four 8.6
sofa 8.6
holiday 8.6
relationship 8.4
holding 8.3
girls 8.2
aged 8.1
blond 8.1
generations 7.9
70s 7.9
color 7.8
boys 7.8
affectionate 7.7
looking camera 7.7
youth 7.7
relaxed 7.5
emotion 7.4
joyful 7.4
decoration 7.2
black 7.2
day 7.1

Google
created on 2022-01-22

Smile 92.1
People 77.7
Vintage clothing 77.1
Family taking photos together 73.9
Event 71.7
Baby 71.5
Classic 69.5
Toddler 68.3
Picture frame 67.1
Monochrome 66.1
Sitting 65.8
Child 62.7
Lap 62.5
Family pictures 62.1
Room 59.4
Family reunion 58.4
Retro style 57.1
History 56.8
Hat 54.9
Family 54.7

Microsoft
created on 2022-01-22

person 100
baby 99.3
human face 99.2
clothing 99
toddler 97.6
smile 97.1
text 96.2
sitting 95.5
child 88.6
window 80.7
black 80
old 75.9
boy 75
woman 71.5
white 65.8
posing 62.7
family 59.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 64-74
Gender Female, 100%
Calm 46.7%
Happy 30.3%
Surprised 7.1%
Angry 5.4%
Disgusted 3.7%
Fear 2.6%
Sad 2.3%
Confused 1.9%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 98.9%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%
Calm 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 51-59
Gender Female, 99.9%
Calm 97.1%
Happy 1.2%
Fear 0.5%
Angry 0.3%
Confused 0.3%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%

AWS Rekognition

Age 0-3
Gender Female, 98%
Surprised 74.9%
Happy 23.5%
Calm 0.4%
Fear 0.3%
Angry 0.3%
Disgusted 0.3%
Sad 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 64
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Glasses 83.9%

Captions

Microsoft

a vintage photo of two people sitting posing for the camera 94.9%
a vintage photo of a group of people sitting posing for the camera 94.8%
a group of people sitting posing for the camera 94.7%

Text analysis

Amazon

PROOF
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
SAINT LOUS
LOUS

Google

SCHWEIG
PROOF
SAINTOUis
PROOF MARTIN SCHWEIG SAINTOUis
MARTIN