Human Generated Data

Title

Untitled (couple sitting with baby in front of mirror)

Date

1948, printed later

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.139

Human Generated Data

Title

Untitled (couple sitting with baby in front of mirror)

People

Artist: Martin Schweig, American 20th century

Date

1948, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.139

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99
Human 99
Person 98.8
Furniture 98.7
Person 94
Person 91.2
Couch 88.7
Face 82.9
Baby 82.8
Person 82.1
Outdoors 80.8
Female 80.4
Bed 80.3
Home Decor 73.7
Room 73.6
Indoors 73.6
Person 71.6
Clothing 66.9
Apparel 66.9
Countryside 66.5
Nature 66.5
Kid 65.4
Child 65.4
People 65
Girl 64.4
Living Room 63.1
Newborn 62.9
Shelter 61.3
Building 61.3
Rural 61.3
Bedroom 61.1
Woman 61
Portrait 60.4
Photography 60.4
Photo 60.4
Plant 55.3

Clarifai
created on 2023-10-25

people 99.9
child 99.3
son 99.1
sibling 98.2
group 98.1
family 98.1
monochrome 98.1
portrait 97.8
offspring 97.3
adult 97.3
woman 97.3
four 97
two 96.2
three 96.1
man 94.4
furniture 94
actress 92.1
group together 92
facial expression 91.5
girl 90.8

Imagga
created on 2022-01-08

person 35
adult 30.2
happy 28.2
people 27.9
man 25.5
home 25.5
couple 25.3
child 24.4
sitting 24.1
family 24
nurse 23.1
mother 23
love 22.1
happiness 22
male 21
attractive 20.3
smiling 20.3
portrait 20.1
parent 19.6
smile 19.2
couch 17.4
lifestyle 16.6
leisure 16.6
scholar 16.6
room 16
father 16
20s 15.6
pretty 15.4
daughter 15.3
indoors 14.1
together 14
model 14
cheerful 13.8
relaxing 13.6
fashion 13.6
casual 13.6
intellectual 13.2
life 13.2
sexy 12.9
indoor 12.8
patient 12.8
fun 12.7
women 12.7
relaxation 12.6
house 12.5
interior 12.4
sofa 12.1
brother 11.8
dress 11.8
loving 11.5
resting 11.4
bed 11.4
dad 11.3
hair 11.1
two 11
domestic 11
cute 10.8
comfortable 10.5
brunette 10.5
one 10.5
relaxed 10.3
face 9.9
bedroom 9.7
looking 9.6
boy 9.6
world 9.3
relax 9.3
joy 9.2
holding 9.1
gorgeous 9.1
human 9
husband 9
lady 8.9
cushions 8.9
kid 8.9
living room 8.8
chair 8.7
wife 8.5
youth 8.5
relationship 8.4
outdoors 8.2
teenager 8.2
sensual 8.2
style 8.2
clothing 8
romantic 8
summer 7.7
sexual 7.7
son 7.7
married 7.7
adults 7.6
females 7.6
sit 7.6
kin 7.5
teen 7.4
alone 7.3
playing 7.3
children 7.3
sensuality 7.3
romance 7.1
posing 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99.9
sitting 99.2
human face 97.6
clothing 97.5
baby 97.3
text 97.2
toddler 93.2
smile 84.7
boy 83
bed 76.7
picture frame 25.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Female, 99.2%
Happy 91.4%
Fear 4.8%
Angry 0.8%
Surprised 0.8%
Calm 0.6%
Disgusted 0.6%
Sad 0.6%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 94.8%
Happy 98%
Surprised 0.5%
Sad 0.4%
Angry 0.3%
Confused 0.3%
Fear 0.2%
Disgusted 0.2%
Calm 0%

AWS Rekognition

Age 0-3
Gender Female, 63.9%
Happy 93.2%
Calm 4.6%
Surprised 1.6%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 0-4
Gender Male, 95.9%
Calm 49.3%
Surprised 20.4%
Happy 10.2%
Angry 7.6%
Confused 4.5%
Sad 3%
Disgusted 2.5%
Fear 2.5%

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Bed 80.3%

Categories

Imagga

people portraits 94.5%
paintings art 3.9%

Captions

Text analysis

Amazon

SCHWEIG
MARTIN
LOUIS,
MARTIN SCHWEIG StuDio
1948
st
st LOUIS, Missouri
StuDio
Missouri

Google

MARTIN SCHWEIG StuDIO St. LoUis, YissoURi 1948
MARTIN
SCHWEIG
StuDIO
St.
LoUis,
YissoURi
1948