Human Generated Data

Title

Untitled (proof of three children smiling in front of fireplace with stockings)
Date

1951
People

Artist: Francis J. Sullivan, American 1916 - 1996
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18251

Human Generated Data

Title

Untitled (proof of three children smiling in front of fireplace with stockings)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Human 99.6
Person 99.6
Apparel 99.5
Clothing 99.5
Person 99.3
Furniture 99
Shoe 98.3
Footwear 98.3
Person 97.5
Chair 95
Sitting 90.8
People 63.9
Portrait 60.9
Photo 60.9
Face 60.9
Photography 60.9
Couch 59.1
Shoe 58.7
Shorts 57.9
Sailor Suit 56.1
Girl 55.1
Female 55.1
Shoe 52.6

Imagga
created on 2022-02-25

sibling 66.5
family 41.8
kin 35.8
people 33.5
child 33.3
happy 32
male 31.2
mother 30.8
smiling 28.9
man 28.9
couple 27
adult 26
love 24.5
home 23.9
father 23.8
person 23.2
happiness 22.7
together 21.9
boy 20.9
parent 20.5
indoors 19.3
smile 18.5
portrait 18.1
lifestyle 18.1
casual 17.8
fun 17.2
cheerful 17.1
attractive 16.8
daughter 16.7
husband 15.3
two 15.2
cute 15.1
interior 15
women 15
childhood 14.3
son 14.1
men 13.7
room 13.7
girls 13.7
children 13.7
youth 13.6
brother 13.3
clothing 12.5
kid 12.4
wife 12.3
kids 12.2
face 12.1
sitting 12
black 12
dad 11.8
boys 11.6
enjoying 11.4
playing 10.9
joy 10.9
handsome 10.7
laughing 10.4
togetherness 10.4
senior 10.3
blond 10.1
dress 9.9
care 9.9
looking 9.6
chair 9.6
school 9.4
friends 9.4
house 9.2
indoor 9.1
pretty 9.1
holding 9.1
color 8.9
30s 8.7
day 8.6
married 8.6
adults 8.5
pair 8.5
baby 8.4
old 8.4
20s 8.2
teenager 8.2
group 8.1
body 8
little 7.9
25 30 years 7.8
parents 7.8
world 7.7
wheelchair 7.6
fashion 7.5
human 7.5
relationship 7.5
friendship 7.5
leisure 7.5
one 7.5
outdoors 7.5
mature 7.4
teen 7.4
new 7.3
domestic 7.2
sexy 7.2
active 7.2

Google
created on 2022-02-25

Smile 97.6
Shoe 94.8
Mammal 86
Chair 75.9
Vintage clothing 75.3
Snapshot 74.3
Tints and shades 74
Picture frame 73.5
Classic 71.6
Room 70.4
Monochrome 70
Sitting 68.3
Event 66.8
Monochrome photography 63.9
Stock photography 63.7
History 61.6
Retro style 55.1
Team 55
Family 51.2
Photographic paper 50.2

Microsoft
created on 2022-02-25

clothing 99.3
person 98.6
smile 98.5
human face 97.7
text 97
sitting 95.4
footwear 84.2
child 79.8
posing 78.7
boy 65.7
woman 57.6
family 55.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Male, 99.6%
Happy 98.6%
Calm 0.6%
Surprised 0.4%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 11-19
Gender Female, 99.8%
Happy 96.7%
Calm 1.9%
Angry 0.4%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Male, 100%
Happy 98.7%
Calm 0.5%
Surprised 0.3%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Sad 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 98.3%
Chair 95%

Captions

Microsoft

a group of people sitting posing for the camera 97.9%
a group of people posing for a photo 97.5%
a group of people sitting posing for a photo 97.1%

Text analysis

Amazon

IN