Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, man in dinosaur suit)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15656

Human Generated Data

Title

Untitled (people in costume at Beaux Arts Ball, man in dinosaur suit)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.2
Human 99.2
Person 98.8
Person 98.6
Person 91.5
Flooring 76.4
People 74.7
Painting 69.3
Art 69.3
Performer 67.6
Face 66.8
Costume 65.7
Military 63.2
Military Uniform 63.2
Photography 63.1
Photo 63.1
Person 59.2
Portrait 58.6
Astronaut 56

Imagga
created on 2022-02-05

home 40.7
happy 30.1
room 30
adult 29.2
indoors 27.2
sitting 26.6
person 26
house 23.4
child 21.6
happiness 21.2
people 20.6
casual 20.3
smiling 19.5
lifestyle 19.5
interior 19.5
sofa 17.8
attractive 17.5
portrait 17.5
furniture 17.2
looking 16.8
bedroom 15.8
book 15.8
relaxing 15.5
couch 15.5
pretty 15.4
smile 15
face 14.2
one 14.2
cute 13.6
box 13.1
cheerful 13
indoor 12.8
man 12.8
women 12.6
baby bed 12.6
relaxation 12.6
kid 12.4
20s 11.9
device 11.4
bed 11.3
blond 10.8
paper 10.4
color 10
holding 9.9
male 9.9
fun 9.7
furnishing 9.6
resting 9.5
living 9.5
females 9.5
expression 9.4
youth 9.4
relax 9.3
student 9.2
joy 9.2
leisure 9.1
girls 9.1
carton 9
office 8.9
clothing 8.8
luxury 8.6
model 8.6
horizontal 8.4
camera 8.3
fashion 8.3
inside 8.3
cup 8.3
human 8.2
chair 8.2
alone 8.2
children 8.2
childhood 8.1
pillow 8
hair 7.9
brunette 7.8
standing 7.8
homework 7.8
education 7.8
mid adult 7.7
modern 7.7
moving 7.6
reading 7.6
domestic 7.6
sit 7.6
lying 7.5
window 7.5
study 7.5
life 7.4
light 7.3
business 7.3
hand blower 7.2
dress 7.2
family 7.1
day 7.1
crib 7

Google
created on 2022-02-05

Microsoft
created on 2022-02-05

text 92.9
person 92
man 90.5
clothing 88.7
human face 80.3
cartoon 68.8
woman 61.5
drawing 60
old 52.3
posing 52

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-22
Gender Female, 99.9%
Happy 70.6%
Calm 25.2%
Confused 1.5%
Surprised 0.7%
Angry 0.6%
Disgusted 0.6%
Fear 0.4%
Sad 0.3%

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 99.2%
Calm 0.2%
Fear 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 54-62
Gender Male, 78.7%
Calm 70.6%
Disgusted 20.6%
Confused 3.4%
Sad 3.2%
Angry 0.8%
Surprised 0.7%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Female, 96%
Happy 86.5%
Confused 6.9%
Calm 2.6%
Surprised 1.8%
Disgusted 0.6%
Fear 0.6%
Sad 0.6%
Angry 0.4%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 69.3%

Captions

Microsoft

an old photo of a person 83%
old photo of a person 81%
an old photo of a man and a woman posing for a picture 55.5%