Human Generated Data

Title

Untitled (portrait of three men, three generations)

Date

1940

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2122

Human Generated Data

Title

Untitled (portrait of three men, three generations)

People

Artist: Hamblin Studio, American active 1930s

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 99.2
Clothing 99.1
Apparel 99.1
Person 98
Furniture 85.6
Chair 85.6
People 83.7
Shirt 77.8
Sitting 71.9
Coat 70.7
Portrait 67.2
Photography 67.2
Photo 67.2
Face 67.2
Home Decor 62.7
Linen 62.7
Pants 62.1
Suit 61.8
Overcoat 61.8
Text 59.2
Family 55.3
Sleeve 55.1

Imagga
created on 2021-12-14

person 45.7
man 43
nurse 39
coat 38.5
professional 37.8
doctor 37.6
male 35.5
hospital 35
lab coat 34.7
medical 34.4
people 33.5
adult 32.2
job 29.2
health 29.2
business 27.9
businessman 26.5
happy 26.3
clinic 26
occupation 25.7
patient 25.2
mature 25.1
office 24.9
medicine 24.7
stethoscope 24
portrait 22.7
care 22.2
team 20.6
colleagues 20.4
businesspeople 19.9
handsome 18.7
uniform 18.3
confident 18.2
businesswoman 18.2
smiling 18.1
lifestyle 18.1
corporate 18
smile 17.8
casual 17.8
looking 17.6
indoors 17.6
attractive 17.5
indoor 17.4
clothing 16.6
practitioner 16.5
work 16.5
face 16.3
men 16.3
group 16.1
camera 15.7
worker 15.6
profession 15.3
working 15
bright 15
golfer 14.7
20s 14.7
laboratory 14.5
elderly 14.4
day 14.1
happiness 14.1
couple 13.9
teamwork 13.9
clinical 13.7
30s 13.5
color 13.4
desk 13.2
associates 12.8
meeting 12.3
senior 12.2
success 12.1
healthy 12
player 11.8
garment 11.8
doctors 11.8
horizontal 11.7
computer 11.2
case 11.2
surgeon 11
successful 11
discussing 10.8
good mood 10.8
expertise 10.7
cheerful 10.6
standing 10.4
sick person 10.4
healing 10.4
friendly 10.1
coworkers 9.8
modern 9.8
25 30 years 9.8
consultant 9.7
40s 9.7
mid adult 9.7
partnership 9.6
exam 9.6
formal 9.6
career 9.5
contestant 9.3
treatment 9.2
suit 9.2
room 9.1
life 9
crew 8.9
light 8.8
together 8.8
discussion 8.8
examination 8.8
lab 8.7
busy 8.7
ethnic 8.6
talking 8.6
specialist 8.5
groom 8.5
aged 8.1
employee 8
jacket 8
home 8
clinician 7.9
general practitioner 7.9
expert 7.9
heal 7.9
forties 7.8
eye contact 7.8
black 7.8
table 7.8
practice 7.7
sitting 7.7
corporation 7.7
four 7.7
illness 7.6
two 7.6
mother 7.6
one 7.5
staff 7.2
active 7.2
building 7.1
women 7.1
family 7.1
executive 7.1

Google
created on 2021-12-14

Style 83.8
Line 81.6
Suit 76.8
Tints and shades 76.1
Snapshot 74.3
Monochrome 73.9
Monochrome photography 73.4
Motor vehicle 73.2
Classic 71.1
Event 71.1
Vintage clothing 70
Formal wear 69.1
Stock photography 65.2
Sitting 65
Hat 59.6
Room 59.5
Art 58.4
Team 56.1
Crew 52.5
Illustration 51.5

Microsoft
created on 2021-12-14

text 97.5
man 95.3
outdoor 90.6
clothing 90.1
person 89.7
wedding 76.9
posing 64.8
smile 59.6
black and white 57.2
old 40.4

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Male, 71.2%
Calm 61%
Sad 25.8%
Surprised 4.5%
Confused 3.5%
Happy 2.2%
Fear 2%
Angry 0.5%
Disgusted 0.4%

AWS Rekognition

Age 38-56
Gender Male, 85.9%
Calm 52.4%
Happy 20%
Sad 14%
Confused 9.1%
Surprised 2.6%
Angry 1%
Disgusted 0.5%
Fear 0.5%

AWS Rekognition

Age 22-34
Gender Female, 71.5%
Happy 67.8%
Calm 12.3%
Sad 7.3%
Surprised 6.8%
Fear 2.5%
Angry 1.7%
Confused 1.4%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Chair 85.6%

Captions

Microsoft

a group of people posing for a photo 90.7%
a group of people posing for the camera 90.6%
a group of men posing for a photo 88.8%

Text analysis

Amazon

S.A.