Human Generated Data

Title

Slovak Group, Ellis Island

Date

1905

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 55.1994

Human Generated Data

Title

Slovak Group, Ellis Island

People

Artist: Lewis Wickes Hine, American 1874 - 1940

Date

1905

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan, 55.1994

Machine Generated Data

Tags

Amazon
created on 2023-04-27

Clothing 100
Hat 100
Bonnet 99.2
Person 98.2
Face 97.6
Head 97.6
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 97
Baby 97
Person 71.8
Photography 57.8
Portrait 57.8
Newborn 57.4
People 57.2

Clarifai
created on 2023-10-13

people 100
child 99.4
portrait 99.4
two 99.2
group 98.9
adult 98.8
three 98.1
wear 98.1
baby 96.6
son 96.5
lid 95.4
man 94.5
family 94.5
art 94
administration 93.8
offspring 93.8
one 93.2
woman 92.4
facial expression 90
war 89.5

Imagga
created on 2023-04-27

child 66.8
kin 55.1
family 44.5
happy 38.2
kid 34.6
father 34.2
happiness 30.6
mother 29.7
male 28.6
parent 28
home 27.9
people 27.3
cute 27.3
smile 27.1
daughter 26
fun 25.4
joy 25.1
children 24.6
portrait 24.6
love 24.5
boy 24.3
dad 24.2
childhood 24.2
casual 23.7
smiling 23.2
together 22.8
cheerful 22.8
lifestyle 21.7
baby 21.6
person 21.4
little 21.2
man 20.8
adult 20
adorable 19.4
kids 18.8
face 18.5
brother 16.6
girls 16.4
husband 16.2
holding 15.7
two 15.2
couple 14.8
blond 14.8
indoors 14.1
old 13.9
group 12.9
generations 12.8
plaything 12.6
toddler 12.4
mature 12.1
playing 11.9
son 11.7
studio 11.4
laughing 11.3
enjoy 11.3
enjoyment 11.3
senior 11.2
women 11.1
toy 11.1
leisure 10.8
grandmother 10.8
mid adult 10.6
loving 10.5
friends 10.3
eyes 10.3
expression 10.2
youth 10.2
joyful 10.1
head 10.1
innocent 10
indoor 10
color 10
domestic 9.9
interior 9.7
life 9.7
clothing 9.6
enjoying 9.5
sitting 9.4
friendship 9.4
sibling 9.1
world 9
looking 8.8
parents 8.8
bonding 8.8
boys 8.7
hair 8.7
couch 8.7
30s 8.7
play 8.6
men 8.6
wife 8.5
teddy 8.5
togetherness 8.5
attractive 8.4
hand 8.4
room 8.3
teen 8.3
care 8.2
1 2 years 7.9
granddaughter 7.9
holiday 7.9
black 7.8
education 7.8
mom 7.8
affectionate 7.7
pretty 7.7
hat 7.7
living 7.6
playful 7.6
relaxed 7.5
human 7.5
outdoors 7.5
one 7.5
teenager 7.3
present 7.3
grandma 7.1

Google
created on 2023-04-27

Head 97.2
Photograph 94.4
White 92.2
Black 89.8
Gesture 85.3
Art 76.2
Baby 75
Snapshot 74.3
Monochrome 72.7
Monochrome photography 71.1
Vintage clothing 70.6
Toddler 68.1
Child 67.7
Stock photography 67.3
Font 65.8
Photo caption 64.6
Room 59.1
Illustration 59.1
Visual arts 58
History 56.6

Microsoft
created on 2023-04-27

human face 98
person 97.4
baby 97
toddler 94.6
clothing 94.2
text 87.4
drawing 84.8
sketch 73
smile 71
black and white 70.9
boy 65.6
painting 50.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Female, 100%
Calm 84.5%
Happy 8.1%
Surprised 6.6%
Fear 6.1%
Sad 3.5%
Confused 1.3%
Angry 0.7%
Disgusted 0.5%

AWS Rekognition

Age 0-3
Gender Male, 99.9%
Surprised 52.3%
Happy 28.2%
Confused 11%
Calm 10.6%
Fear 7.3%
Sad 5.7%
Disgusted 4.3%
Angry 2.9%

AWS Rekognition

Age 28-38
Gender Female, 100%
Sad 96.8%
Calm 47.4%
Surprised 6.4%
Fear 6%
Confused 0.6%
Angry 0.5%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 92.8%
Calm 95.2%
Surprised 6.5%
Fear 6%
Sad 2.7%
Happy 1.6%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Adult 97.6%
Male 97.6%
Man 97.6%
Baby 97%

Categories

Imagga

paintings art 79.6%
people portraits 20.3%

Text analysis

Amazon

American
Line
Hamsurg American Line
Hamsurg
I
to

Google

Hamburg-Americas Line
Hamburg
-
Americas
Line