Human Generated Data

Title

Untitled (three boys in front of Christmas tree, with patterned rug)
Date

c.1950, printed later
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18386

Human Generated Data

Title

Untitled (three boys in front of Christmas tree, with patterned rug)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

c.1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.6
Human 99.6
Shoe 99.2
Clothing 99.2
Footwear 99.2
Apparel 99.2
Shoe 98.9
Shoe 98.8
Person 98.1
Shoe 95.3
Chair 87.9
Furniture 87.9
Person 83.7
Sitting 79.6
Person 74
People 64.1
Dish 58.8
Food 58.8
Meal 58.8

Clarifai
created on 2019-11-16

people 100
child 99
adult 98.7
two 98.3
group 98.2
group together 97.4
woman 97.3
man 96.5
boy 93.9
three 93.1
monochrome 90.3
four 90
several 90
wear 89.9
facial expression 89.8
portrait 89.5
offspring 88.2
sit 87.5
family 85.8
street 85.6

Imagga
created on 2019-11-16

plaything 100
swing 100
mechanical device 100
mechanism 90.1
child 42.8
kid 30.1
happy 28.8
people 26.8
family 26.7
fun 23.2
childhood 22.4
person 22.2
smiling 21
male 20.9
smile 20.7
adult 20
children 20
boy 20
happiness 19.6
sitting 18.9
lifestyle 18.1
cute 17.9
park 17.3
cheerful 17.1
youth 17
man 16.8
outdoors 16.4
portrait 16.2
play 15.5
little 15
outside 14.5
outdoor 14.5
mother 14.1
playing 13.7
kids 13.2
girls 12.8
casual 12.7
daughter 12.4
together 12.3
face 12.1
love 11.8
day 11.8
resort area 11.2
one 11.2
adorable 11.1
summer 10.9
looking 10.4
holding 9.9
school 9.9
parent 9.8
home 9.6
togetherness 9.4
friends 9.4
playground 8.8
mom 8.7
area 8.7
men 8.6
expression 8.5
black 8.4
joy 8.4
leisure 8.3
fashion 8.3
teen 8.3
teenager 8.2
father 8.1
group 8.1
indoors 7.9
education 7.8
color 7.8
pretty 7.7
laugh 7.7
toddler 7.6
two 7.6
enjoying 7.6
human 7.5
baby 7.5
son 7.5
friendship 7.5
brother 7.2
active 7.2
recreation 7.2
clothing 7.2

Google
created on 2019-11-16

Photograph 97.2
Black-and-white 89.9
Snapshot 89.6
Monochrome 82.6
Photography 77
Stock photography 72.8
Room 71.4
Monochrome photography 64.7
Child 57.3
Sitting 54.1
Style 51
Picture frame 50.8

Microsoft
created on 2019-11-16

clothing 97.3
person 96.6
human face 94.3
toddler 91.7
boy 84.6
baby 83.2
text 81.4
smile 74.2
black 70.9
child 70.1
black and white 66

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 71.1%
Happy 0.3%
Disgusted 0%
Calm 99%
Sad 0.1%
Surprised 0.2%
Confused 0.1%
Fear 0%
Angry 0.1%

AWS Rekognition

Age 3-9
Gender Female, 92.4%
Sad 1.3%
Angry 0.9%
Happy 0.3%
Calm 93.8%
Fear 0.1%
Disgusted 2.6%
Confused 0.7%
Surprised 0.3%

AWS Rekognition

Age 0-3
Gender Female, 54.3%
Calm 45%
Confused 45%
Fear 45%
Sad 45%
Angry 45%
Surprised 45%
Disgusted 45%
Happy 55%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 0
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 99.2%

Captions

Microsoft

a black and white photo of a boy 73.4%
a black and white photo of a girl 73.3%
black and white photo of a boy 66.8%