Human Generated Data

Title

Untitled (two photographs: studio portrait of baby in white gown; studio portrait of baby in white gown seated on bench between parents)
Date

c. 1935, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6101

Human Generated Data

Title

Untitled (two photographs: studio portrait of baby in white gown; studio portrait of baby in white gown seated on bench between parents)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Person 99.7
Person 99.1
Baby 96.3
Person 96
Newborn 95.6
Person 93.7
Clothing 87.9
Apparel 87.9
Face 83.6
Finger 74
Electronics 71.4
Screen 71.4
Display 66.3
Monitor 66.3
Advertisement 62.1
Photography 60.5
Photo 60.5
Portrait 58.3
Poster 57
LCD Screen 55.6
Collage 55.4

Clarifai
created on 2019-11-16

people 99.9
child 99.8
baby 97.7
family 97.1
portrait 96.7
group 96
woman 94.4
room 94.3
adult 94
wear 92.9
offspring 92.7
man 92
indoors 91.5
monochrome 90.8
sit 88.8
two 88.7
son 88.4
music 88.4
actress 86.9
movie 86.6

Imagga
created on 2019-11-16

television 100
telecommunication system 95.1
people 27.9
man 26.2
person 22.4
male 19.9
portrait 19.4
love 15
couple 14.8
happy 14.4
black 13.8
adult 13.7
symbol 13.5
happiness 13.3
silhouette 13.2
world 12.7
player 12.5
bride 12.5
family 12.5
child 12.4
smile 12.1
face 12.1
business 11.5
sport 11.5
park 11.5
youth 11.1
smiling 10.9
athlete 10.6
match 10.6
businessman 10.6
one 10.5
wife 10.4
event 10.2
training 10.2
nighttime 9.8
championship 9.7
office 9.6
looking 9.6
field 9.2
wedding 9.2
flag 9.2
competition 9.1
room 9.1
blackboard 8.9
cheering 8.8
audience 8.8
stadium 8.8
boy 8.7
lifestyle 8.7
skill 8.7
crowd 8.6
patriotic 8.6
married 8.6
muscular 8.6
mother 8.6
husband 8.6
nation 8.5
bouquet 8.5
pretty 8.4
attractive 8.4
future 8.4
dark 8.3
lights 8.3
dress 8.1
home 8
icon 7.9
art 7.9
broadcasting 7.7
culture 7.7
hand 7.6
head 7.6
joy 7.5
computer 7.3
bright 7.1
kid 7.1
interior 7.1

Google
created on 2019-11-16

Photograph 97
Snapshot 86.1
Photographic paper 84.3
Black-and-white 82.7
Photography 78
Television set 76
Room 71.4
Stock photography 68.5
Adaptation 67
Picture frame 64.8
Child 64.5
Television 57.6
Monochrome 54.4
Screen 53.1
Family 51
Art 50.2

Microsoft
created on 2019-11-16

monitor 98.9
baby 98.8
toddler 98.7
text 97.7
television 96.9
person 96.6
clothing 95
human face 93.9
screen 91.3
indoor 88.7
boy 83.1
smile 77.4
black and white 70.5
child 63.8
flat 57.4
image 36.7
picture frame 29.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-3
Gender Female, 83.5%
Disgusted 0%
Sad 89%
Calm 2.2%
Fear 8.5%
Happy 0%
Confused 0.1%
Angry 0%
Surprised 0.2%

AWS Rekognition

Age 24-38
Gender Female, 54.8%
Happy 49.7%
Sad 48.7%
Confused 45.2%
Disgusted 45.2%
Angry 45.1%
Surprised 45.1%
Calm 45.8%
Fear 45.2%

AWS Rekognition

Age 0-3
Gender Male, 54.8%
Disgusted 45%
Fear 46.1%
Confused 45%
Calm 45%
Surprised 45%
Angry 45%
Sad 53.8%
Happy 45%

AWS Rekognition

Age 28-44
Gender Male, 54.9%
Happy 54.1%
Sad 45%
Disgusted 45.1%
Calm 45.3%
Angry 45.1%
Surprised 45.2%
Fear 45.1%
Confused 45%

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person standing in front of a flat screen television 77.3%
a person standing in front of a flat screen television 73.8%
a person standing in front of a flat screen tv 73.7%