Human Generated Data

Title

Untitled (family portrait in studio)

Date

c. 1945

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1836

Human Generated Data

Title

Untitled (family portrait in studio)

People

Artist: John Deusing, American active 1940s

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 100
Apparel 100
Person 99
Human 99
Person 97.9
Person 97.6
Person 94.9
Costume 89.4
Coat 88.6
Face 77.2
Sleeve 73.4
Portrait 67.5
Photography 67.5
Photo 67.5
Furniture 67.4
Chair 67.4
Dress 61.7
Tie 61.2
Accessories 61.2
Accessory 61.2
Indoors 60.1
Long Sleeve 59
Hat 56.8
Crystal 55.6

Imagga
created on 2021-12-14

people 27.9
person 23.1
fashion 22.6
human 22.5
body 20.8
adult 20.2
dress 19.9
sexy 18.5
male 18.4
black 18.2
portrait 18.1
model 16.3
pose 15.4
attractive 15.4
nurse 15
style 14.8
group 14.5
posing 14.2
clothing 13.8
man 13.6
art 13.6
anatomy 13.5
face 13.5
elegance 13.4
crutch 13.1
pretty 12.6
medical 12.4
lady 12.2
staff 12.1
men 12
skin 11.8
science 11.6
women 11.1
gorgeous 10.9
silhouette 10.8
biology 10.4
standing 10.4
render 10.4
negative 10.1
3d 10.1
sensuality 10
film 9.9
health 9.7
business 9.7
elegant 9.4
happiness 9.4
leg 9.1
active 9
stick 8.8
skeleton 8.8
happy 8.8
motion 8.6
figure 8.3
stylish 8.1
dance 8.1
costume 7.9
hair 7.9
cute 7.9
party 7.7
brass 7.6
trombone 7.6
studio 7.6
head 7.6
legs 7.5
child 7.5
clothes 7.5
vintage 7.4
shape 7.3
girls 7.3
sensual 7.3
fitness 7.2
kin 7.2
modern 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

wall 97.9
clothing 93.8
dress 93.4
text 91.5
person 88.3
woman 84.9
posing 84.6
smile 75.8
black and white 73.3
wedding dress 64.4
footwear 64.1
human face 52.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Male, 61.3%
Happy 38.8%
Surprised 34%
Calm 14.4%
Fear 4.5%
Angry 3.3%
Confused 3.1%
Sad 1%
Disgusted 0.9%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Calm 82%
Confused 9.1%
Happy 4.3%
Sad 1.7%
Surprised 1%
Fear 0.8%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 23-35
Gender Female, 91%
Happy 87.9%
Calm 6.3%
Sad 2.1%
Angry 2%
Fear 0.7%
Surprised 0.6%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Female, 55.4%
Calm 95.3%
Happy 2.1%
Surprised 1.1%
Sad 0.5%
Angry 0.5%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 61.2%

Captions

Microsoft

a group of people posing for a photo 92.3%
a group of people posing for the camera 92.2%
a group of people posing for a picture 92.1%