Human Generated Data

Title

Untitled (studio portrait of woman with two young sons and baby looking at toy duck)

Date

1925-1955

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10201

Human Generated Data

Title

Untitled (studio portrait of woman with two young sons and baby looking at toy duck)

People

Artist: Martin Schweig, American 20th century

Date

1925-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99.5
Person 98.9
People 96.9
Family 95.6
Person 90.8
Accessories 69.9
Accessory 69.9
Glasses 69.9
Baby 69.9
Newborn 68
Photography 66.3
Photo 66.3
Portrait 57.5
Face 57.5

Imagga
created on 2022-01-22

father 72.2
mother 58
parent 57.4
family 57
dad 55.9
child 51.2
nurse 49.3
home 44.7
male 42.6
kin 41.1
happy 40.8
love 37.9
daughter 36.7
together 34.2
man 33
people 32.4
happiness 31.4
couple 30.5
smiling 30.4
son 28.3
baby 28.2
adult 27.9
husband 25.8
indoors 25.5
lifestyle 24.6
kid 24
30s 23.1
wife 20.9
sitting 20.7
casual 20.4
children 20.1
portrait 19.4
couch 19.4
room 19.2
boy 19.2
joy 18.4
holding 18.2
cute 18
parents 17.6
attractive 17.5
mom 17.5
loving 17.2
smile 16.4
affectionate 15.5
laughing 15.1
interior 15.1
little 15
cheerful 14.7
hug 14.5
fun 14.2
thirties 13.6
face 13.5
togetherness 13.2
20s 12.8
cuddling 12.8
playing 12.8
living room 12.7
living 12.3
adults 12.3
kids 12.3
group 12.1
women 11.9
parenthood 11.7
embracing 11.7
clothing 11.7
house 11.7
childhood 11.7
generation 11.5
sofa 11.5
domestic 11.2
two 11
indoor 11
horizontal 10.9
affection 10.6
mid adult 10.6
hospital 10.6
looking camera 10.6
married 10.6
men 10.3
adorable 10.2
blond 9.9
cuddle 9.9
grandmother 9.8
mum 9.8
bonding 9.8
40s 9.8
four 9.6
brunette 9.6
play 9.5
color 9.5
mature 9.3
camera 9.3
brother 9.2
sibling 9.2
old 9.1
care 9.1
generations 8.9
looking 8.8
hugging 8.8
newborn 8.8
females 8.5
senior 8.4
relationship 8.4
studio 8.4
handsome 8
life 7.9
3 7.8
brown hair 7.8
half length 7.8
infant 7.7
pretty 7.7
toddler 7.7
three 7.5
relaxing 7.3
medical 7.1
grandfather 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 100
wall 99.8
baby 98.9
human face 98.2
toddler 97.1
clothing 96.4
child 94.1
smile 93.7
indoor 92.5
boy 87.6
black 85
text 83.4
posing 45.6
family 17.3
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 99.2%
Sad 60.9%
Calm 11.8%
Happy 11.3%
Surprised 5.2%
Fear 5%
Angry 2.3%
Disgusted 2.1%
Confused 1.4%

AWS Rekognition

Age 2-8
Gender Male, 100%
Calm 96.3%
Sad 2.5%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 95.5%
Calm 94.2%
Sad 4%
Fear 0.6%
Disgusted 0.3%
Surprised 0.3%
Angry 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 0-3
Gender Male, 84.4%
Calm 98.8%
Sad 0.4%
Confused 0.3%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Glasses 69.9%

Captions

Microsoft

a group of people sitting posing for the camera 96.6%
a group of people posing for a photo 96.1%
a group of people posing for the camera 96%

Text analysis

Amazon

THE
THIS
OF
OF TH
TH
STUDIO
SHOULD
IS
THIS PROOF IS THE PROPART
WITHIN
PROPART
PROOF
ND
WITHIN TEN
ND SHOULD BESETURNEL
VS
RTIN SCHWES STUDIO
TEN
SCHWES
RTIN
BESETURNEL

Google

T
PROP
TH
N
SCHW
SHOUGD
THIS
E
RY
IS
S
THIS PROOF IS T E PROP RY OF TH N SCHW STUO ND SHOUGD as TURNED WITHINTE S
OF
as
TURNED
WITHINTE
PROOF
STUO
ND