Human Generated Data

Title

Slovak Group, Ellis Island
Date

1905
People

Artist: Lewis Wickes Hine, American 1874 - 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 55.1994

Human Generated Data

Title

Slovak Group, Ellis Island

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1905

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.1
Person 99.1
Person 97.8
Newborn 96.1
Baby 96.1
Person 95.8
Person 95.2
People 81.2
Painting 74.6
Art 74.6
Face 58.1
Cushion 56.4

Imagga
created on 2021-12-14

kin 62.5
child 61.7
family 38.2
father 33.7
happy 32.6
parent 32.3
kid 31.9
mother 28.5
people 27.9
male 27.5
happiness 27.4
dad 26.5
childhood 26
cute 24.4
portrait 23.9
home 23.9
love 22.9
joy 22.6
smile 22.1
casual 22
baby 21.8
man 21.5
little 21.2
cheerful 21.1
lifestyle 21
boy 20.9
daughter 20.7
fun 20.2
brother 20.1
person 19.8
adult 19.4
face 19.2
couple 18.3
children 18.2
smiling 18.1
together 16.6
girls 16.4
husband 16.2
adorable 15.7
two 15.2
blond 13.8
holding 13.2
old 12.5
son 12.3
indoors 12.3
eyes 12
women 11.9
playing 11.9
head 11.8
interior 11.5
hair 11.1
expression 11.1
toy 11.1
leisure 10.8
hand 10.6
attractive 10.5
wife 10.4
kids 10.4
enjoy 10.3
enjoyment 10.3
black 10.2
youth 10.2
studio 9.9
generations 9.9
life 9.5
color 9.5
laughing 9.5
togetherness 9.4
sibling 9.4
senior 9.4
mature 9.3
plaything 9.2
joyful 9.2
indoor 9.1
domestic 9
looking 8.8
mid adult 8.7
infant 8.7
toddler 8.6
sitting 8.6
loving 8.6
playful 8.5
clothing 8.4
world 8.3
outdoors 8.2
ball 8.2
hat 8.2
parenthood 7.8
bonding 7.8
play 7.8
mom 7.8
couch 7.7
pretty 7.7
fashion 7.5
human 7.5
friendship 7.5
one 7.5
close 7.4
care 7.4
teen 7.4
lady 7.3
group 7.3
holiday 7.2

Google
created on 2021-12-14

Photograph 94.3
White 92.2
Black 89.7
Gesture 85.3
Art 79.9
People 79.1
Monochrome photography 75.9
Monochrome 75
Baby 74.5
Snapshot 74.3
Toddler 72.6
Font 71.2
Vintage clothing 70.7
Child 70
Stock photography 67.4
Photo caption 63.9
Visual arts 62.3
History 61.5
Suit 61.3
Room 60.6

Microsoft
created on 2021-12-14

human face 98.6
text 97.3
baby 97.3
clothing 96.9
person 96.7
toddler 94.4
smile 88.9
boy 65.3
black and white 61.6
old 56.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-58
Gender Female, 99.9%
Calm 88.5%
Happy 6.3%
Sad 2.7%
Angry 0.7%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 0-3
Gender Male, 80.6%
Calm 89.2%
Happy 3.6%
Sad 2.3%
Surprised 2.2%
Angry 1.5%
Confused 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 90.2%
Calm 66.4%
Angry 26.2%
Sad 6.2%
Surprised 0.6%
Fear 0.5%
Happy 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 24-38
Gender Female, 70%
Calm 74.4%
Sad 21.9%
Fear 1.1%
Happy 1%
Angry 0.7%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 15-27
Gender Female, 88.1%
Calm 66.7%
Happy 26.7%
Sad 3.1%
Fear 0.9%
Confused 0.7%
Surprised 0.7%
Disgusted 0.6%
Angry 0.5%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.1%
Painting 74.6%

Captions

Microsoft

a group of people in an old photo of a person 66.6%
a group of people in an old photo of a person 66.5%
an old photo of a person 66.4%

Text analysis

Amazon

/
America
lovery America las
lovery
les
las
the