Human Generated Data

Title

Untitled (portrait of boy in white holding bible and rosary, standing next to table with ceramic horn of plenty)

Date

c. 1950

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13339

Human Generated Data

Title

Untitled (portrait of boy in white holding bible and rosary, standing next to table with ceramic horn of plenty)

People

Artist: John Deusing, American active 1940s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.3
Clothing 99.3
Person 99.1
Human 99.1
Shoe 90.9
Footwear 90.9
Shoe 76.8
Pants 75.7
Suit 75.6
Coat 75.6
Overcoat 75.6
Plant 72.8
Flower 72.8
Blossom 72.8
Furniture 67.2
Table 65.6
Sleeve 65.1
Flower Arrangement 61.5
Pottery 61.2
Evening Dress 60
Fashion 60
Gown 60
Robe 60
Long Sleeve 58.6
Flower Bouquet 56.4

Imagga
created on 2022-01-23

man 26.9
people 26.8
male 25.6
person 25.6
adult 25.4
portrait 22.6
couple 21.8
home 17.5
happy 17.5
dress 15.4
lifestyle 15.2
musical instrument 14.7
waiter 14.6
interior 14.1
happiness 14.1
black 13.9
love 13.4
attractive 13.3
indoors 13.2
smiling 13
men 12.9
bride 12.6
pretty 12.6
room 12.3
senior 12.2
smile 12.1
fashion 12.1
sexy 12
women 11.9
two 11.9
stringed instrument 11.8
romantic 11.6
family 11.6
clothing 11.5
device 11.4
standing 11.3
old 11.1
dining-room attendant 11
elegance 10.9
mother 10.8
together 10.5
casual 10.2
color 10
face 9.9
human 9.7
lady 9.7
style 9.6
looking 9.6
hair 9.5
wife 9.5
shirt 9.3
violin 9.3
business 9.1
brunette 8.7
husband 8.6
luxury 8.6
worker 8.5
groom 8.4
wedding 8.3
wind instrument 8.3
child 8.2
one 8.2
bowed stringed instrument 8.2
cheerful 8.1
horn 8
celebration 8
to 8
employee 7.9
bouquet 7.9
model 7.8
sitting 7.7
coat 7.7
culture 7.7
decoration 7.5
traditional 7.5
fun 7.5
vintage 7.4
mature 7.4
emotion 7.4
life 7.3
art 7.3
aged 7.2
kitchen 7.2
romance 7.1
handsome 7.1
professional 7.1
antique 7.1
brass 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

floor 97.8
indoor 96.4
person 94.7
standing 90.1
clothing 71.9
man 63.6
vase 62.8
posing 38.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-12
Gender Male, 99.9%
Happy 83.8%
Calm 10.3%
Confused 3.3%
Sad 0.9%
Disgusted 0.6%
Angry 0.5%
Surprised 0.5%
Fear 0.2%

Microsoft Cognitive Services

Age 12
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Shoe 90.9%

Captions

Microsoft

a person standing posing for the camera 93.1%
a person standing in front of a mirror posing for the camera 66.2%
a person standing in a room 66.1%