Human Generated Data

Title

Untitled (old man with glasses posed between two old women in hats inside elegant room)

Date

1949

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9225

Human Generated Data

Title

Untitled (old man with glasses posed between two old women in hats inside elegant room)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.3
Apparel 99.3
Human 98.7
Person 98.7
Person 98.2
Person 97.6
Accessory 97.2
Tie 97.2
Accessories 97.2
Sleeve 81.8
Suit 80.8
Overcoat 80.8
Coat 80.8
Home Decor 71
Plant 65.7
Door 61.1
Face 60.6
People 59.4
Text 58.5
Veil 56.7

Imagga
created on 2022-01-23

person 39.3
man 37.6
people 35.7
male 34.8
adult 33.7
nurse 31.8
professional 30.1
businessman 29.1
patient 27.9
business 26.7
office 24.1
job 23.9
men 23.2
doctor 22.6
executive 22.5
portrait 22
lab coat 22
medical 21.2
coat 20.8
happy 20.7
corporate 20.6
senior 20.6
indoors 20.2
clothing 20.1
worker 19.2
health 18.8
looking 18.4
hospital 18.2
casual 17.8
smiling 17.4
team 17
couple 16.6
occupation 16.5
work 16.5
indoor 16.4
suit 15.6
elderly 15.3
businesspeople 15.2
home 15.2
medicine 15
mature 14.9
colleagues 14.6
bright 14.3
handsome 14.3
20s 13.7
lifestyle 13.7
group 13.7
women 13.4
color 13.3
day 13.3
happiness 13.3
care 13.2
teamwork 13
clinic 12.9
specialist 12.9
face 12.8
human 12.7
old 12.5
working 12.4
smile 12.1
sick person 11.8
case 11.7
meeting 11.3
computer 11.2
camera 11.1
two 11
businesswoman 10.9
businessmen 10.7
corporation 10.6
laboratory 10.6
formal 10.5
attractive 10.5
manager 10.2
glasses 10.2
horizontal 10
associates 9.8
coworkers 9.8
modern 9.8
lab 9.7
expertise 9.7
mid adult 9.6
look 9.6
illness 9.5
building 9.5
adults 9.5
career 9.5
desk 9.4
jacket 9.4
garment 9.1
cheerful 8.9
family 8.9
success 8.8
40s 8.8
standing 8.7
busy 8.7
groom 8.7
30s 8.7
exam 8.6
sitting 8.6
biology 8.5
uniform 8.5
company 8.4
successful 8.2
aged 8.1
kin 8
gray hair 7.9
70s 7.9
surgeon 7.8
25 30 years 7.8
black 7.8
chemistry 7.7
stethoscope 7.7
test 7.7
angle 7.7
expression 7.7
profession 7.7
research 7.6
room 7.6
hand 7.6
mother 7.6
technology 7.4
inside 7.4
alone 7.3
science 7.1
interior 7.1
together 7

Google
created on 2022-01-23

Hat 88.1
Sleeve 87.2
Black-and-white 83.9
Style 83.9
Fashion design 77.6
Vintage clothing 75.1
Formal wear 73.8
Monochrome photography 73.7
Monochrome 73.3
Font 72.3
Classic 71.8
Event 66.3
Room 64.7
Art 63.8
Stock photography 63.7
Pattern 63.5
Uniform 63.5
Tie 61.4
History 59.8
Retro style 56.7

Microsoft
created on 2022-01-23

text 97.4
man 95.7
person 94.8
clothing 89.9
dress 88.2
sketch 87.1
drawing 86.3
standing 85.7
wedding dress 84.6
smile 81
posing 80.2
bride 68.6
old 64.5
black and white 62.6
human face 53.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 89.1%
Calm 83.9%
Disgusted 3.6%
Confused 3.4%
Happy 3.3%
Angry 2.4%
Surprised 1.8%
Sad 1%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 97.2%

Captions

Microsoft

a group of people posing for a photo 93.4%
a group of people posing for the camera 93.3%
a person standing in front of a group of people posing for a photo 84%

Text analysis

Amazon

12885