Human Generated Data

Title

Untitled (men in suits)

Date

c. 1955, printed later

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.207

Human Generated Data

Title

Untitled (men in suits)

People

Artist: Martin Schweig, American 20th century

Date

c. 1955, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Tie 98.9
Accessories 98.9
Accessory 98.9
Person 98.7
Human 98.7
Person 97.5
Clothing 97.2
Coat 97.2
Apparel 97.2
Suit 97.2
Overcoat 97.2
Person 97.1
Person 95.9
Suit 94.1
Person 93.9
Person 93
Tie 92.9
Person 88.7
Face 87.2
Suit 86.2
Tie 84.1
People 80.8
Suit 78.2
Crowd 76
Suit 73.8
Text 69
Attorney 64.8
Man 59
Jury 57.6
Sitting 56.6
Court 55.5
Indoors 55.5
Room 55.5

Imagga
created on 2022-01-08

man 49.7
kin 47
male 39.7
people 34.6
person 33.7
senior 32.8
portrait 32.3
old 29.2
businessman 24.7
elderly 23.9
business 23.7
happy 23.2
couple 21.8
grandfather 21.6
mature 21.4
adult 20.2
men 19.7
suit 19.5
executive 19.3
home 18.3
office 17.9
handsome 17.8
face 17.8
grandma 16.4
tie 16.1
professional 15.5
retired 14.5
smile 14.3
glasses 13.9
corporate 13.7
looking 13.6
love 13.4
family 13.3
manager 13
black 12.8
human 12.7
older 12.6
smiling 12.3
look 12.3
retirement 11.5
hand 11.4
happiness 11
head 10.9
lifestyle 10.8
metropolitan 10.8
husband 10.5
success 10.5
one 10.4
hair 10.3
expression 10.2
work 10.2
casual 10.2
bow tie 10.2
jacket 10
gray 9.9
boss 9.6
standing 9.6
wife 9.5
successful 9.1
indoor 9.1
aged 9
cheerful 8.9
60s 8.8
indoors 8.8
world 8.6
necktie 8.5
modern 8.4
room 8.4
communication 8.4
holding 8.3
confident 8.2
computer 8
job 8
working 8
seniors 7.9
day 7.8
hands 7.8
eyes 7.7
guy 7.6
laughing 7.6
horizontal 7.5
house 7.5
pensioner 7.4
worker 7.4
romance 7.1
beard 7.1
together 7

Google
created on 2022-01-08

Tie 88.5
Coat 87.5
Black-and-white 84.9
Style 83.9
Blazer 77.9
Formal wear 75.7
Monochrome photography 75.7
Font 75.5
Suit 75.4
Monochrome 74.1
Event 73.6
Collar 73.2
White-collar worker 73.1
Smile 70.3
Vintage clothing 69.9
Room 65.3
Stock photography 63
History 63
Art 60.8
Eyewear 57.8

Microsoft
created on 2022-01-08

person 99.7
human face 99
clothing 98.8
wall 98.6
smile 98.4
suit 97.1
man 97
standing 96.2
posing 89
text 75.8
people 74.9
tie 72.5
glasses 61.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Confused 75.8%
Calm 18.3%
Sad 1.6%
Disgusted 1.4%
Surprised 1.1%
Angry 0.8%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 92.2%
Angry 4.7%
Disgusted 0.9%
Surprised 0.7%
Happy 0.5%
Confused 0.5%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 50.3%
Surprised 25.4%
Confused 11.4%
Angry 3.8%
Fear 3.6%
Sad 2.8%
Disgusted 1.9%
Happy 0.7%

AWS Rekognition

Age 48-54
Gender Male, 100%
Calm 99.8%
Sad 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 100%
Sad 35.7%
Calm 31.2%
Disgusted 13.9%
Confused 11.8%
Angry 3.1%
Happy 1.9%
Surprised 1.3%
Fear 1.3%

Microsoft Cognitive Services

Age 47
Gender Male

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.9%
Person 98.7%
Suit 97.2%

Captions

Microsoft

a group of people posing for a photo 97.6%
a person standing in front of a group of people posing for a photo 94.1%
a group of people posing for the camera 94%