Human Generated Data

Title

Untitled (portrait of man and three boys on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16417

Human Generated Data

Title

Untitled (portrait of man and three boys on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.4
Apparel 99.4
Person 99.1
Human 99.1
Person 98.5
Person 98
Person 97.4
Accessory 86.1
Accessories 86.1
Tie 86.1
Tie 83.5
Chair 81.7
Furniture 81.7
Face 78.4
People 74.4
Robe 72.3
Fashion 72.3
Gown 71.9
Suit 70.7
Overcoat 70.7
Coat 70.7
Indoors 70.1
Clinic 66.7
Room 66.3
Photography 64.3
Portrait 64.3
Photo 64.3
Wedding 64
Couch 60.3
Wedding Gown 59.7

Imagga
created on 2022-02-11

person 42.5
man 42.3
nurse 38.4
people 36.2
male 34
adult 32.3
businessman 30
professional 28.6
business 27.3
doctor 27.2
coat 26.6
golfer 24.6
team 24.2
medical 23.8
lab coat 23.8
work 22.8
smiling 21.7
colleagues 21.4
worker 21.3
office 20.9
hospital 20.9
men 20.6
indoors 20.2
group 20.1
portrait 20.1
happy 20
desk 19.8
mature 19.5
job 19.5
clinic 19.4
player 19.1
businesspeople 19
medicine 17.6
patient 17.5
couple 17.4
occupation 17.4
waiter 17.3
health 16.7
lifestyle 16.6
30s 16.3
senior 15.9
working 15.9
teamwork 15.8
table 15.6
indoor 15.5
businesswoman 15.4
women 15
contestant 15
room 14.7
cheerful 14.6
laptop 14.6
looking 14.4
handsome 14.3
talking 14.3
meeting 14.1
clothing 14
employee 13.9
dining-room attendant 13.9
associates 13.8
corporate 13.7
home 13.6
casual 13.6
care 13.2
20s 12.8
computer 12.8
confident 12.7
two 12.7
laboratory 12.5
executive 12.1
smile 12.1
face 12.1
sitting 12
camera 12
attractive 11.9
elderly 11.5
modern 11.2
happiness 11
color 10.6
together 10.5
student 10.3
day 10.2
uniform 9.9
stethoscope 9.9
life 9.9
doctors 9.8
coworkers 9.8
30 35 years 9.8
clinical 9.8
40s 9.7
lab 9.7
expertise 9.7
practitioner 9.4
bright 9.3
treatment 9.2
suit 9.1
human 9
science 8.9
assistant 8.7
mid adult 8.7
busy 8.7
education 8.7
profession 8.6
research 8.6
garment 8.4
old 8.4
technology 8.2
surgeon 8.1
teacher 8.1
light 8
chemical 7.9
discussing 7.9
scientist 7.8
25 30 years 7.8
standing 7.8
businessmen 7.8
corporation 7.7
test 7.7
four 7.7
husband 7.6
serious 7.6
communication 7.6
horizontal 7.5
case 7.5
new 7.3
success 7.2
love 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

wall 99.5
text 95.4
person 90.1
clothing 84.5
wedding 77.1
wedding dress 75.6
group 74.9
old 67
smile 66.9
posing 62.3
bride 61.6
human face 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 92%
Happy 98.5%
Calm 0.6%
Surprised 0.3%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Happy 86.9%
Sad 5.6%
Calm 4.5%
Angry 0.9%
Surprised 0.8%
Disgusted 0.5%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Surprised 85.9%
Happy 13.5%
Fear 0.2%
Calm 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Female, 86.2%
Calm 47.8%
Happy 36.3%
Angry 4.3%
Sad 3.9%
Fear 2.4%
Surprised 1.9%
Disgusted 1.8%
Confused 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 86.1%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a group of people posing for a picture 97.6%

Text analysis

Amazon

7
KADOK

Google

MJA--YT37A°2 NAGON
MJA--YT37A°2
NAGON