Human Generated Data

Title

Untitled (studio portrait of two men wearing military pins with one in a jacket and another holding a cigar)

Date

1942

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9965

Human Generated Data

Title

Untitled (studio portrait of two men wearing military pins with one in a jacket and another holding a cigar)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 99.9
Clothing 99.9
Person 99.4
Human 99.4
Hat 99.3
Sleeve 95.3
Person 91.6
Home Decor 82.3
Long Sleeve 79.9
Sun Hat 74.4
Overcoat 62.7
Suit 62.7
Coat 62.7
Finger 60.6
Linen 58.3
Door 56.3

Imagga
created on 2022-01-29

nurse 48.3
man 47
male 44
person 37.9
adult 33.2
professional 30.8
people 30.1
job 27.4
portrait 27.2
business 26.1
coat 25.7
clothing 25.4
work 25.1
doctor 23.5
businessman 23
medical 22.9
worker 22.7
handsome 22.3
suit 22
garment 20.6
occupation 20.2
men 19.7
uniform 19.5
lab coat 18.9
smiling 18.8
hat 18
hospital 18
bow tie 17.4
smile 17.1
office 16.9
jacket 16.9
looking 16.8
necktie 16.4
happy 16.3
corporate 15.5
profession 15.3
medicine 15
standing 14.8
tie 14.2
face 14.2
care 14
mature 13.9
health 13.9
attractive 13.3
shirt 13.2
patient 13.1
success 12.9
executive 12.7
surgeon 12.7
guy 12.6
senior 12.2
construction 12
confident 11.8
lab 11.7
mid adult 11.6
laboratory 11.6
stethoscope 11.5
working 11.5
human 11.2
one 11.2
manager 11.2
helmet 10.8
serious 10.5
builder 10.1
equipment 9.9
covering 9.8
expertise 9.7
clinic 9.7
architect 9.7
technology 9.6
illness 9.5
building 9.5
industry 9.4
casual 9.3
hand 9.1
headdress 9.1
black 9
engineer 8.8
look 8.8
middle aged 8.8
designer 8.7
lifestyle 8.7
collar 8.6
ethnic 8.6
successful 8.2
friendly 8.2
team 8.1
consumer goods 8
physician 7.8
consultant 7.8
corporation 7.7
modern 7.7
skill 7.7
expression 7.7
smart 7.5
student 7.4
safety 7.4
practitioner 7.3
20s 7.3
to 7.1
happiness 7.1
architecture 7
indoors 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

hat 99.8
person 99.5
fashion accessory 99.1
text 98.4
wall 98.2
fedora 97.5
clothing 97.3
cowboy hat 96.4
posing 95.7
sun hat 94.8
human face 92.1
woman 90.9
man 90.6
standing 89.6
smile 83.6
black and white 63.7
old 58.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99%
Confused 57.4%
Sad 31.1%
Calm 7.9%
Happy 1.6%
Surprised 0.9%
Disgusted 0.6%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Happy 92.5%
Confused 1.6%
Disgusted 1.6%
Surprised 1.3%
Calm 1%
Sad 0.9%
Fear 0.8%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 99.3%
Suit 62.7%

Captions

Microsoft

a man and a woman posing for a photo 90.3%
a man and woman posing for a photo 87.7%
a man and woman posing for a picture 87.6%

Text analysis

Amazon

3100
M
M 11- VITELA2
ICEJE
11-
VITELA2
KISSA

Google

S100
S100