Human Generated Data

Title

Untitled (portrait of three men, three generations)
Date

1940
People

Artist: Hamblin Studio, American active 1930s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2121

Human Generated Data

Title

Untitled (portrait of three men, three generations)

People

Artist: Hamblin Studio, American active 1930s

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.6
Human 99.6
Clothing 99.5
Apparel 99.5
Person 98.4
Person 96.7
Shirt 96.4
Tie 85.5
Accessories 85.5
Accessory 85.5
Sitting 78.8
Suit 77
Coat 77
Overcoat 77
Shorts 67.4
People 66.9
Tie 64.9
Dress Shirt 64.4
Sleeve 58.5

Imagga
created on 2021-12-14

man 56
male 48.3
person 41.5
adult 39.8
people 37.4
professional 36.5
elderly 35.5
senior 34.7
businessman 34.5
happy 33.2
smiling 31.1
doctor 31.1
mature 30.7
business 30.4
men 30.1
grandfather 29.7
colleagues 29.2
office 28.1
businesspeople 27.5
portrait 27.2
coat 26.9
lab coat 25.1
looking 24.8
team 24.2
medical 23.9
job 22.1
occupation 22
hospital 21.8
handsome 21.4
work 21.2
indoors 21.1
old 20.9
smile 20.7
corporate 20.6
worker 19.8
casual 19.5
health 19.5
group 19.4
businesswoman 19.1
nurse 18.9
happiness 18.8
lifestyle 18.8
sitting 18.1
human 18
executive 17.8
working 17.7
camera 17.6
together 17.5
women 17.4
cheerful 17.1
face 17.1
meeting 17
computer 16.8
specialist 16.8
associates 16.7
teamwork 16.7
stethoscope 16.5
indoor 16.5
clinic 16.4
confident 16.4
desk 16.1
medicine 15.9
bright 15.7
care 15.7
older 15.6
patient 15.5
attractive 15.4
couple 14.8
laptop 14.6
modern 14
coworkers 13.8
20s 13.8
40s 13.6
color 13.4
day 13.4
suit 12.9
successful 12.8
home 12.8
horizontal 12.6
joy 12.5
30s 12.5
staff 12.4
success 12.1
clothing 11.9
two 11.9
uniform 11.7
cooperation 11.6
profession 11.5
talking 11.4
crew 10.8
doctors 10.8
good mood 10.8
holding 10.7
garment 10.7
consultant 10.7
life 10.7
illness 10.5
standing 10.4
wife 10.4
company 10.2
hand 9.9
clinical 9.8
expertise 9.7
corporation 9.7
mid adult 9.7
practitioner 9.6
females 9.5
light 9.4
glasses 9.3
friendly 9.2
aged 9.1
husband 8.9
expert 8.9
businessmen 8.8
discussion 8.8
assistant 8.8
retired 8.7
laboratory 8.7
table 8.7
student 8.4
manager 8.4
healing 8.1
family 8
pensioner 8
general practitioner 7.9
boardroom 7.9
fifties 7.9
50s 7.8
conference 7.8
physician 7.8
education 7.8
busy 7.7
retirement 7.7
four 7.7
formal 7.7
joyful 7.4

Google
created on 2021-12-14

Coat 91
Sleeve 87.2
Smile 85.6
Gesture 85.3
Black-and-white 82.8
Hat 82
Formal wear 75.1
Monochrome 74.8
Monochrome photography 73.1
Vintage clothing 73
White-collar worker 71.2
Uniform 71.1
Event 69.5
Suit 68.4
Art 63.8
Room 62.8
Sitting 62.7
Stock photography 62.1
History 58.7
Team 56.6

Microsoft
created on 2021-12-14

posing 99.5
wall 96.9
text 96.6
person 96
clothing 94.5
old 94.1
smile 91.6
human face 89.2
man 86.1
standing 79.6
white 72.1
black 68.1
ceremony 56.7
vintage 42

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 91.6%
Calm 77.8%
Sad 11.1%
Confused 4%
Happy 2.7%
Surprised 2.4%
Angry 1.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Female, 50.5%
Sad 56%
Calm 41.3%
Confused 0.9%
Happy 0.5%
Surprised 0.5%
Fear 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 60.3%
Calm 60.8%
Happy 8.9%
Surprised 8.3%
Sad 7.7%
Angry 6.1%
Fear 4.2%
Confused 3.3%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 85.5%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97.1%
a vintage photo of a group of people posing for a picture 97%
a group of people posing for a photo 96.9%

Text analysis

Amazon

JAS