Human Generated Data

Title

Untitled (engagement portrait)
Date

1954
People

Artist: Claseman Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.649

Human Generated Data

Title

Untitled (engagement portrait)

People

Artist: Claseman Studio, American 20th century

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.9
Human 99.9
Tie 99.7
Accessories 99.7
Accessory 99.7
Person 98.6
Suit 97.4
Coat 97.4
Overcoat 97.4
Clothing 97.4
Apparel 97.4
Finger 92.9
Tuxedo 55.9

Imagga
created on 2022-01-09

groom 100
man 49.8
suit 43.8
person 39.1
male 39.1
businessman 37.1
couple 31.4
people 30.7
adult 30.4
business 28.6
handsome 26.8
tie 26.6
professional 25.4
happy 24.5
executive 24.2
portrait 24
corporate 21.5
love 20.5
attractive 19.6
office 19.3
confident 19.1
men 18.9
smiling 18.8
smile 18.5
successful 18.3
standing 18.3
success 17.7
happiness 17.3
looking 16
group 14.5
two 14.4
businesswoman 13.7
married 13.4
together 13.2
manager 13.1
phone 12.9
outdoors 12.7
work 12.6
team 12.6
relationship 12.2
expression 12
boyfriend 11.6
lifestyle 11.6
serious 11.5
cheerful 11.4
fashion 11.3
meeting 11.3
black 11
holding 10.7
romance 10.7
colleagues 10.7
job 10.6
mobile 10.4
guy 10.4
mature 10.2
face 10
dress 10
romantic 9.8
cellphone 9.7
leadership 9.6
building 9.5
businesspeople 9.5
elegant 9.4
smart 9.4
teamwork 9.3
wedding 9.2
husband 9.1
partners 8.8
women 8.7
affection 8.7
girlfriend 8.7
boss 8.6
sitting 8.6
outside 8.6
shirt 8.4
communication 8.4
alone 8.2
sexy 8
family 8
celebration 8
call 7.9
look 7.9
partner 7.7
modern 7.7
jacket 7.7
30s 7.7
partnership 7.7
laugh 7.7
formal 7.6
workplace 7.6
hand 7.6
wife 7.6
elegance 7.6
togetherness 7.6
senior 7.5
one 7.5
darling 7.3
friendly 7.3
hair 7.1
indoors 7
pretty 7

Google
created on 2022-01-09

Face 98.3
Smile 98.3
Hairstyle 95.1
Photograph 94.1
Human 89.1
Coat 89
Flash photography 88.6
Happy 86.6
Gesture 85.3
Black-and-white 84.3
Style 84.2
Tie 81.8
Suit 80.9
Formal wear 78
Blazer 77.8
Monochrome 76.1
Fun 75.6
Monochrome photography 75.1
Vintage clothing 74.8
Snapshot 74.3

Microsoft
created on 2022-01-09

person 100
smile 98
human face 97.2
clothing 92.5
fashion accessory 89.2
dress 88.2
text 86.3
standing 84.2
woman 81
man 71.4
wedding dress 62
tie 61.2
bride 58.1
suit 34
microphone 17.9
necktie 17.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 100%
Happy 96.5%
Confused 1.2%
Calm 0.5%
Angry 0.5%
Sad 0.4%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.9%
Surprised 0%
Calm 0%
Disgusted 0%
Angry 0%
Sad 0%
Fear 0%
Confused 0%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Tie 99.7%
Suit 97.4%

Captions

Microsoft

a woman standing next to a man in a suit and tie 92.2%
a man and woman holding each other 57.3%
a man and a woman taking a selfie 48%