Human Generated Data

Title

Untitled (studio portrait of brunette woman with two young children)

Date

1930-1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10196

Human Generated Data

Title

Untitled (studio portrait of brunette woman with two young children)

People

Artist: Martin Schweig, American 20th century

Date

1930-1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.2
Human 99.2
Person 98.6
People 98.1
Family 95.7
Person 91.4
Female 80
Girl 73.5
Teen 72.6
Face 70.3
Kid 69
Child 69
Photo 62.4
Photography 62.4
Portrait 60.6
Woman 55.5

Imagga
created on 2022-01-22

child 94.2
family 70.4
mother 67.8
parent 66.7
father 61.4
son 60
sibling 52.2
male 48
dad 41.7
love 41.1
happy 40.2
children 38.4
daughter 38.3
kid 38.2
boy 35.7
together 34.3
happiness 33.8
childhood 32.3
baby 32.2
little 31.9
home 31.2
smiling 31.2
cute 30.9
fun 30
people 29.1
cheerful 26.9
kids 26.4
brother 26.4
portrait 24.7
offspring 24.5
kin 23.1
smile 22.9
joy 22.6
sitting 22.4
adult 21.4
mom 21.4
togetherness 20.8
man 19.5
casual 19.5
husband 19.1
lifestyle 18.8
toddler 18.2
couple 17.5
girls 17.4
loving 17.2
two 16.1
indoors 15.9
care 15.7
parenthood 15.7
boys 15.5
playing 15.5
infant 15.5
laughing 15.2
face 15
adorable 14.8
wife 14.3
holding 14.1
parents 13.7
hug 13.6
person 13
indoor 12.8
affectionate 12.6
30s 12.5
leisure 12.5
play 12.1
room 11.9
sister 11.8
embracing 11.7
four 11.5
interior 11.5
group 11.3
expression 11.1
women 11.1
youth 11.1
generations 10.9
looking camera 10.6
attractive 10.5
living 10.5
men 10.3
relationship 10.3
life 10.2
joyful 10.1
grandchild 9.9
granddaughter 9.9
cuddle 9.9
mum 9.8
grandmother 9.8
old 9.8
newborn 9.7
black 9.6
diversity 9.6
generation 9.6
color 9.5
friends 9.4
toy 9.2
house 9.2
domestic 9.2
human 9
blond 9
siblings 8.9
looking 8.8
bonding 8.8
hugging 8.8
grandfather 8.8
couch 8.7
senior 8.5
friendship 8.4
clothing 8.3
outdoors 8.2
mommy 7.9
grandparent 7.9
parenting 7.9
affection 7.7
comfort 7.7
laugh 7.7
ethnic 7.6
studio 7.6
enjoying 7.6
sit 7.6
playful 7.6
healthy 7.6
horizontal 7.6
enjoyment 7.5
three 7.5
mature 7.5
activity 7.2

Google
created on 2022-01-22

Face 98.6
Hair 98.4
Smile 98
Head 97.3
Photograph 94.3
Picture frame 90.3
Happy 79.4
People 78.6
Toddler 76.9
Vintage clothing 75.2
Chair 74.4
Snapshot 74.3
Classic 72.8
Art 68
Sitting 67.2
Stock photography 66.7
Fun 65.7
Child 65.5
Room 65.5
Monochrome 63.6

Microsoft
created on 2022-01-22

person 100
wall 99.6
human face 98.8
indoor 98.5
baby 98.4
clothing 97.6
toddler 97.4
smile 97.3
sitting 96.4
text 94.4
child 94
boy 90.1
window 87
posing 73.6
family 18.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Happy 98.2%
Disgusted 0.7%
Calm 0.3%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 2-8
Gender Female, 100%
Happy 77.4%
Calm 12.8%
Sad 4.6%
Confused 1.6%
Disgusted 1.1%
Surprised 1%
Angry 0.9%
Fear 0.6%

AWS Rekognition

Age 1-7
Gender Male, 98.8%
Happy 85.1%
Calm 9.5%
Confused 2.2%
Sad 1.7%
Angry 0.4%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people sitting posing for the camera 97.7%
a group of people posing for a photo 97.1%
a boy and girl posing for a photo 84%

Text analysis

Amazon

DA
RETURNED
STUDIO
shogua ER RETURNED
WITHINGTEN DA the
ER
HE
PROPEREN
skin 500 THIS STUDIO
the
WITHINGTEN
PROGRAMME PROPEREN
THIS
shogua
500
skin
PROGRAMME

Google

WITHI OAYS
WITHI
OAYS