Human Generated Data

Title

Untitled (studio portrait of young man in army uniform with younger sister)

Date

1945

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9977

Human Generated Data

Title

Untitled (studio portrait of young man in army uniform with younger sister)

People

Artist: Martin Schweig, American 20th century

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.4
Apparel 99.4
Person 98.5
Human 98.5
Person 96.8
Face 95.7
Home Decor 80.2
Female 77.5
People 76.5
Sleeve 76.2
Shirt 70.4
Shorts 69.7
Pants 69.7
Portrait 69.5
Photography 69.5
Photo 69.5
Girl 69.1
Smile 68.8
Coat 60.8
Child 60
Kid 60
Finger 59.8
Suit 59
Overcoat 59
Head 58.5
Costume 57.9
Woman 57.9
Outdoors 56
Long Sleeve 55.3

Imagga
created on 2022-01-29

military uniform 87.6
uniform 78.7
clothing 60.2
person 37.5
covering 35.4
consumer goods 35.3
man 34.9
male 32.9
adult 32.5
people 30.7
portrait 30.4
nurse 29.9
doctor 25.4
professional 24.8
medical 22.1
happy 21.3
business 20.7
hospital 20.4
confident 20
smile 18.5
medicine 18.5
smiling 18.1
looking 17.6
standing 17.4
health 17.4
coat 17.2
handsome 16.9
stethoscope 16.9
job 16.8
attractive 16.8
confidence 16.3
one 15.7
care 15.6
face 15.6
black 15
businessman 15
commodity 14.5
shirt 14
occupation 13.7
office 13.7
hair 13.5
innocent 13.4
clinic 13.4
work 13.3
lifestyle 13
casual 12.7
suit 12.3
brunette 12.2
pretty 11.9
friendly 11.9
women 11.9
worker 11.8
jacket 11.8
child 11.6
home 11.2
mature 11.2
doctors 10.8
lab coat 10.6
career 10.4
20s 10.1
businesswoman 10
team 9.9
guy 9.8
lady 9.7
working 9.7
indoors 9.7
mid adult 9.6
style 9.6
boy 9.6
color 9.5
happiness 9.4
youth 9.4
single 9
cheerful 8.9
family 8.9
sexy 8.8
healthy 8.8
formal 8.6
men 8.6
patient 8.6
model 8.6
businesspeople 8.5
tie 8.5
camera 8.3
fashion 8.3
successful 8.2
alone 8.2
group 8.1
success 8
cute 7.9
physician 7.8
staff 7.6
serious 7.6
holding 7.4
teamwork 7.4
indoor 7.3
specialist 7.2
mother 7.2
kid 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.1
wall 97.4
person 97
smile 92.9
human face 91
clothing 90.3
posing 87.6
fashion accessory 84.2
woman 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 92.5%
Calm 71.6%
Happy 24.2%
Surprised 1%
Sad 0.9%
Confused 0.8%
Angry 0.8%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Happy 62.6%
Calm 31.3%
Fear 1.6%
Surprised 1.5%
Angry 0.9%
Sad 0.7%
Confused 0.7%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a man and woman posing for a photo 88.4%
a man and a woman posing for a photo 88.3%
a man and woman posing for a picture 88.2%

Text analysis

Amazon

[
1)
MORR
MORR BIBRAS РОГИА
من
РОГИА
BIBRAS