Human Generated Data

Title

Untitled (studio portrait of two toddler boys standing in front of two blocks)
Date

1930-1945, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10284

Human Generated Data

Title

Untitled (studio portrait of two toddler boys standing in front of two blocks)

People

Artist: Martin Schweig, American 20th century

Date

1930-1945, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10284

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.9
Person 98.9
Clothing 98.7
Apparel 98.7
Shorts 98.7
Person 98.5
Footwear 97
Shoe 97
Shoe 96.7
Shoe 95.7
Shoe 82
Baby 80.9
Boy 80.8
Face 76.1
Indoors 75.6
Sleeve 66.2
Photo 65.2
Portrait 65.2
Photography 65.2
Child 64.2
Kid 64.2
Room 59.3
Flooring 56.9
Pants 56.4
Floor 56
Sailor Suit 55.8
Costume 55.6

Clarifai
created on 2019-11-16

child 99.9
people 99.7
son 99.1
baby 98.8
family 98.4
portrait 98.3
two 96.4
group 95.6
monochrome 95.1
love 94.1
boy 92.6
sibling 91.5
offspring 91.4
three 91.2
girl 91.1
facial expression 87.3
man 84.1
wear 83.3
little 82.4
fun 81.1

Imagga
created on 2019-11-16

kin 68.4
male 28.5
people 27.9
family 27.6
man 26.9
portrait 25.9
happy 25.7
child 25.6
adult 24.6
person 24.4
sibling 24.2
mother 24
couple 23.5
father 23.2
love 22.9
smiling 21
happiness 20.4
parent 19.6
smile 18.5
body 18.4
black 17
lifestyle 16.6
face 16.3
sexy 16.1
husband 15.3
wife 15.2
fashion 15.1
dad 14.6
cute 14.3
together 14
model 14
attractive 14
daughter 13.9
lady 13.8
studio 13.7
youth 13.6
hair 13.5
women 13.4
relationship 13.1
fun 12.7
two 12.7
pretty 12.6
human 12
world 12
blond 11.9
girls 11.9
holding 11.6
joy 10.9
hand 10.6
bow tie 10.6
married 10.5
baby 10.5
home 10.4
expression 10.2
son 10.1
clothing 10.1
dark 10
dress 9.9
romantic 9.8
sepia 9.7
style 9.6
boy 9.6
standing 9.6
healthy 9.4
senior 9.4
brother 9.1
athlete 9.1
old 9.1
fitness 9
necktie 8.6
eyes 8.6
men 8.6
casual 8.5
cheerful 8.1
lovely 8
posing 8
kid 8
brunette 7.8
hands 7.8
bride 7.7
sport 7.7
health 7.6
skin 7.6
elegance 7.6
wedding 7.4
playing 7.3
childhood 7.2
nurse 7.1
interior 7.1

Google
created on 2019-11-16

Photograph 97.4
People 95.4
Standing 88.4
Child 87.7
Snapshot 86.7
Picture frame 84.8
Photographic paper 83.6
Photography 82.2
Black-and-white 80.7
Room 71.4
Family 66.5
Stock photography 65.4
Monochrome 60.1
Toddler 51.7

Microsoft
created on 2019-11-16

baby 99.2
toddler 99
text 97.7
human face 97.2
posing 95.4
person 93.6
child 91.9
smile 91.9
boy 91.5
standing 90.9
clothing 89.9
window 86
black 80.4
black and white 70.5
player 61.7
white 61.4
old 60.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 65.8%
Angry 0%
Sad 0%
Confused 0%
Calm 0.2%
Surprised 0%
Happy 99.7%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 71.4%
Surprised 0%
Angry 0%
Sad 0%
Fear 0%
Disgusted 0%
Happy 92.2%
Calm 7.7%
Confused 0%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 97%

Categories

Imagga

people portraits 99.9%