Human Generated Data

Title

Untitled (portrait of a couple, man holding top hat)

Date

c. 1930

People

Artist: Curtis Studio, American active 1891 - 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1233

Human Generated Data

Title

Untitled (portrait of a couple, man holding top hat)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Coat 99.9
Apparel 99.9
Clothing 99.9
Person 97.8
Human 97.8
Person 97.8
Overcoat 97.6
Officer 71.3
Military 71.3
Military Uniform 71.3
Art 68.3
Suit 61.1
Photography 57.3
Face 57.3
Portrait 57.3
Photo 57.3

Imagga
created on 2022-01-23

military uniform 36.7
trench coat 33.5
clothing 31.3
uniform 31
raincoat 27.7
coat 24.7
man 23.6
people 21.7
black 21.3
person 20.4
male 17.7
fashion 17.3
dress 17.2
portrait 16.2
adult 15.6
helmet 14.7
model 14
hair 12.7
suit 12.6
dark 12.5
covering 12
style 11.9
mask 11.7
garment 11.4
love 11
hand 10.6
couple 10.4
sexy 10.4
statue 10.1
attractive 9.8
consumer goods 9.7
happy 9.4
business 9.1
human 9
one 9
history 8.9
lady 8.9
posing 8.9
happiness 8.6
culture 8.5
armor plate 8.4
old 8.4
performer 8.3
city 8.3
silhouette 8.3
vintage 8.3
musician 8.3
kin 8.1
new 8.1
night 8
together 7.9
singer 7.7
wife 7.6
elegance 7.6
passion 7.5
groom 7.5
weapon 7.5
holding 7.4
protection 7.3
pose 7.2
looking 7.2
body 7.2
religion 7.2
smile 7.1
businessman 7.1
outfit 7

Google
created on 2022-01-23

Overcoat 89.7
Sleeve 87.2
Gesture 85.3
Collar 83.2
Blazer 78
Art 76.7
Formal wear 74.8
Vintage clothing 74.2
Victorian fashion 73.4
Frock coat 72.1
Picture frame 70.9
Trench coat 69.9
Classic 67.9
Uniform 67.7
Stock photography 65.7
Rectangle 65.3
Monarch 61.1
History 60.8
Duster 57.4
Hat 56.9

Microsoft
created on 2022-01-23

person 98
text 96.8
clothing 93.6
standing 89
dress 75.3
posing 70
vintage clothing 60
old 56.6
clothes 16.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Confused 94.1%
Fear 2.2%
Surprised 1.6%
Calm 1.4%
Sad 0.2%
Angry 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Female, 74.1%
Calm 98.1%
Confused 0.9%
Sad 0.6%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

Microsoft Cognitive Services

Age 43
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.9%
Person 97.8%
Suit 61.1%

Captions

Microsoft

a man and a woman standing in front of a building 79%
a man and woman posing for a photo 75.9%
a man and a woman posing for a photo 75.8%