Human Generated Data

Title

Untitled (double studio portrait of older couple wearing glasses)

Date

1943

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9971

Human Generated Data

Title

Untitled (double studio portrait of older couple wearing glasses)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 99.7
Clothing 99.7
Accessory 99.5
Accessories 99.5
Tie 99.5
Person 98.3
Human 98.3
Person 97.5
Tie 96
Sunglasses 94
Person 92.3
Coat 92.1
Shirt 92
Lab Coat 91.6
Person 89.7
Sunglasses 87.5
Overcoat 80
Suit 80
Face 70.9
Doctor 70.5
Head 64.2
Suit 60.8
Jaw 60
Clinic 59.5
Portrait 59.2
Photography 59.2
Photo 59.2
Dress Shirt 58.8
Glasses 57.3
Steamer 55.8

Imagga
created on 2022-01-29

man 54.5
male 53.9
lab coat 46
person 45
coat 43.1
businessman 42.4
executive 38.9
professional 38.9
adult 37.9
people 34
doctor 32.9
business 32.8
portrait 31.1
looking 29.6
handsome 29.4
senior 27.2
mature 27
smiling 25.3
men 24.9
medical 24.7
office 24.1
work 23.6
hospital 22.6
happy 22.6
job 22.1
elderly 22
team 20.6
occupation 20.2
baron 20.2
stethoscope 19.6
medicine 19.4
smile 19.2
specialist 18.9
patient 18.6
glasses 18.5
health 18.1
old 17.4
businesspeople 17.1
suit 16.8
garment 16.8
teamwork 16.7
care 16.5
corporate 16.3
teacher 16.2
worker 16.1
working 15.9
face 15.6
colleagues 15.5
laptop 15.5
confident 15.5
cheerful 15.4
tie 15.2
manager 14.9
standing 14.8
staff 14.4
surgeon 13.8
computer 13.7
casual 13.6
profession 13.4
clothing 13.3
uniform 13.3
desk 13.2
indoors 13.2
success 12.9
successful 12.8
friendly 12.8
indoor 12.8
older 12.6
modern 12.6
leader 12.5
clinic 12.5
serious 12.4
hand 12.2
two 11.9
happiness 11.8
40s 11.7
student 11.6
formal 11.5
human 11.3
sitting 11.2
camera 11.1
gray hair 10.8
physician 10.7
nurse 10.7
mid adult 10.6
group 10.5
black 10.2
lifestyle 10.1
color 10
bright 10
expertise 9.7
busy 9.6
30s 9.6
leadership 9.6
confidence 9.6
table 9.5
women 9.5
horizontal 9.2
studio 9.1
associates 8.9
diagnosis 8.8
practitioner 8.7
education 8.7
notebook 8.6
chart 8.6
career 8.5
meeting 8.5
shirt 8.4
planner 8.4
holding 8.3
home 8
hair 7.9
doctors 7.9
coworkers 7.9
day 7.8
couple 7.8
middle aged 7.8
corporation 7.7
boss 7.7
only 7.6
guy 7.6
one person 7.5
smart 7.5
company 7.4
technology 7.4
light 7.4
20s 7.3
necktie 7.1
writing 7.1

Google
created on 2022-01-29

Smile 90.5
Black 89.6
Coat 88.9
Collar 84
Sleeve 82.6
Font 80
Suit 76.8
Formal wear 76.8
Blazer 76.5
Monochrome photography 72.4
White-collar worker 72.3
Monochrome 71.4
Vintage clothing 70.1
History 67.2
Uniform 67
Event 65.5
Room 65.3
Stock photography 64.9
Dress shirt 58.9
Tie 58.1

Microsoft
created on 2022-01-29

wall 99.4
human face 98.4
clothing 94.6
man 94.5
posing 93.7
smile 91.6
person 90.1
glasses 89.2
text 88.5
suit 77.6
white 67.7
shirt 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 100%
Happy 92.9%
Surprised 4.1%
Calm 2.3%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 96.1%
Surprised 1.1%
Happy 1%
Sad 0.6%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 99.1%
Happy 0.4%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 92.9%
Calm 88.9%
Happy 10%
Confused 0.3%
Sad 0.2%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.5%
Person 98.3%
Suit 80%
Glasses 57.3%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people posing for the camera 97.9%
a group of people posing for a picture 97.8%

Text analysis

Amazon

MJI7
MJI7 A7aA
A7aA
-
5
2055E 5
2055E

Google

ARAA
MJ13
MJ13 YT3RA2 ARAA
YT3RA2