Human Generated Data

Title

Untitled (woman seated on couch with two babies)
Date

c. 1942
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1441

Human Generated Data

Title

Untitled (woman seated on couch with two babies)

People

Artist: Martin Schweig, American 20th century

Date

c. 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1441

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Person 97.2
People 95.4
Person 93
Baby 89.8
Face 87.5
Newborn 74.3
Female 72.6
Family 70.6
Photography 69.7
Photo 69.7
Portrait 68.6
Clothing 58.7
Apparel 58.7
Girl 57.5

Clarifai
created on 2023-10-26

people 99.9
portrait 99
child 99
two 98.3
adult 96.2
three 95.6
indoors 95.4
family 95.3
woman 95
sepia 94.8
nostalgia 93.6
facial expression 93.5
monochrome 93.3
offspring 93.1
wear 92.2
sit 92.1
retro 91.7
son 90.2
sibling 90.2
group 89.2

Imagga
created on 2022-01-22

mother 100
parent 100
family 68.6
child 66.9
father 61.4
happy 45.2
kid 41.7
dad 38.5
daughter 37.7
son 36.2
children 35.6
together 35.1
childhood 34.1
boy 34
happiness 33.7
male 33.4
baby 31.3
love 30.8
fun 30.7
people 29
home 28.8
little 27.4
portrait 27.2
cute 26.6
smiling 26.1
kin 25.9
cheerful 25.2
smile 24.3
toddler 23.9
joy 22.6
brother 21.2
kids 20.8
adult 20.7
man 20.2
lifestyle 19.5
casual 19.5
infant 17.4
playing 17.4
togetherness 17
group 17
adorable 16.6
mom 16.5
room 16.4
sitting 16.3
two 16.1
couple 15.7
husband 15.3
indoors 15
play 14.7
girls 14.6
sibling 13.8
youth 13.6
boys 13.6
30s 13.5
living 13.3
interior 13.3
parents 12.7
women 12.7
holding 12.4
care 12.4
indoor 11.9
leisure 11.6
four 11.5
wife 11.4
generations 10.9
blond 10.8
grandmother 10.8
mum 10.8
parenthood 10.8
sister 10.8
couch 10.6
loving 10.5
offspring 10.5
laughing 10.4
joyful 10.1
house 10
face 10
granddaughter 9.9
bonding 9.8
newborn 9.7
generation 9.6
domestic 9.5
men 9.5
life 9.4
human 9
color 8.9
parenting 8.8
education 8.7
looking camera 8.7
friends 8.5
senior 8.5
studio 8.4
hand 8.4
toy 8.3
black 7.8
hug 7.8
affectionate 7.8
expression 7.7
sit 7.6
relationship 7.5
friendship 7.5
attractive 7
pretty 7

Google
created on 2022-01-22

Clothing 98.7
Baby 84.7
Toddler 79.6
Picture frame 79.3
Vintage clothing 75.6
Child 73.8
Monochrome 70.5
Monochrome photography 70.1
Classic 69.6
Room 69.5
Sitting 66.6
Event 66.2
Stock photography 64.7
Pattern 63.1
Retro style 57.8
Art 56.4
Family 53.7
Photo caption 52.8
Lap 51.5
Sibling 50.4

Microsoft
created on 2022-01-22

wall 99.5
baby 99.2
toddler 98.5
indoor 98.2
human face 98.2
person 96.7
clothing 96
smile 87
child 84.8
text 78.1
boy 76.6
bathroom 8.1
picture frame 6.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 99.4%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Happy 0.1%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 99.9%
Happy 99.8%
Calm 0.2%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 0-3
Gender Male, 97.2%
Surprised 80.9%
Fear 17.2%
Calm 1.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Sad 0.1%

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.1%
Person 97.2%
Person 93%

Categories

Imagga

people portraits 99.9%

Text analysis

Amazon

STUDIO
TEN
BE
WITHIN
OF
WITHIN TEN DAYS
OF THE
RETURNED
THE
DAYS
PROPERTY
AND SHOULD BE RETURNED
AND
SHOULD
MARTINSCHWEIG STUDIO
FROOF
TAIS FROOF
TAIS
MARTINSCHWEIG

Google

TS AOOF 2 PHOPS OF THE ARTIN SCHWEI STUDIO ND SOLD BE RETURNED WITHIN TEN DAYS
TS
AOOF
2
PHOPS
OF
THE
ARTIN
SCHWEI
STUDIO
ND
SOLD
BE
RETURNED
WITHIN
TEN
DAYS