Human Generated Data

Title

Untitled (portrait of an older couple)

Date

1938

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1698

Human Generated Data

Title

Untitled (portrait of an older couple)

People

Artist: John Deusing, American active 1940s

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 99.7
Coat 99.7
Clothing 99.7
Person 96.9
Human 96.9
Shoe 94.7
Footwear 94.7
Person 93.9
Sunglasses 83.6
Accessories 83.6
Accessory 83.6
Sleeve 77.5
Bag 76.7
Overcoat 75.6
Female 74.7
Curtain 66.3
Handbag 65.2
Shoe 60.6
Dress 59.6
Long Sleeve 59.6
Woman 59.3
Floor 57.9
Suit 56
Tie 56
Purse 55.6

Imagga
created on 2021-12-14

suit 89.4
garment 56.3
clothing 51.1
man 39.7
male 36.2
businessman 33.6
business 33.4
corporate 30.9
executive 30.1
covering 28.1
professional 27.7
consumer goods 27.7
people 25.7
adult 24.7
office 22.6
work 21.2
success 20.9
happy 20.7
handsome 20.5
person 20.4
attractive 20.3
successful 19.2
standing 18.3
men 18
job 17.7
black 17.4
fashion 17.3
businesswoman 17.3
building 15.1
portrait 14.2
tie 14.2
career 14.2
worker 14.1
pretty 14
businesspeople 13.3
couple 13.1
smile 12.8
women 12.7
team 12.5
manager 12.1
guy 11.9
two 11.9
jacket 11.8
confident 11.8
briefcase 11.7
smiling 11.6
working 11.5
boss 11.5
adults 11.4
group 11.3
company 11.2
20s 11
lifestyle 10.8
commodity 10.8
city 10.8
formal 10.5
gown 10.3
clothes 10.3
happiness 10.2
model 10.1
human 9.7
style 9.6
walking 9.5
elegant 9.4
outside 9.4
life 9.3
handshake 8.8
full length 8.7
partner 8.7
corporation 8.7
partnership 8.6
day 8.6
meeting 8.5
teamwork 8.3
holding 8.3
outdoors 8.2
stylish 8.1
dress 8.1
looking 8
together 7.9
hands 7.8
colleagues 7.8
diversity 7.7
outdoor 7.6
casual 7.6
ethnic 7.6
talking 7.6
fashionable 7.6
smart 7.5
groom 7.5
lady 7.3
bright 7.2
family 7.1
indoors 7
secretary 7
modern 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 97.8
person 95.1
standing 92.9
suit 91.8
posing 90.1
clothing 87.3
dress 83.4
black and white 76.8
coat 62.5

Face analysis

Amazon

Google

AWS Rekognition

Age 28-44
Gender Male, 87.6%
Calm 99.1%
Surprised 0.3%
Sad 0.2%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-37
Gender Male, 91.9%
Calm 96.8%
Surprised 1.2%
Sad 0.7%
Happy 0.4%
Confused 0.3%
Fear 0.3%
Angry 0.2%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.7%
Person 96.9%
Shoe 94.7%
Sunglasses 83.6%
Tie 56%

Captions

Microsoft

a man and a woman posing for a photo 81.7%
a man and woman posing for a photo 77.4%
a person standing posing for the camera 77.3%

Text analysis

Amazon

-d
U
٢/٤
of
insurance U und of
20
und
a
insurance