Human Generated Data

Title

Untitled (two men standing next to bust)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20050

Human Generated Data

Title

Untitled (two men standing next to bust)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Accessory 99.7
Tie 99.7
Accessories 99.7
Overcoat 99
Coat 99
Shirt 97
Person 97
Human 97
Person 91.5
Suit 87
Door 86.6
Person 84
Tuxedo 76.3
Tie 74.9
Man 71.5
Dress Shirt 67
Portrait 60.8
Photo 60.8
Face 60.8
Photography 60.8
Sleeve 58.3
Home Decor 58.2

Imagga
created on 2022-03-05

male 44
man 43
person 35.8
doctor 35.7
professional 35.3
adult 32.2
people 31.2
medical 30
hospital 29.1
businessman 29.1
coat 27.1
business 26.1
nurse 25.8
lab coat 25.1
stethoscope 23.9
portrait 23.3
job 23
suit 23
happy 22.6
corporate 22.3
men 22.3
medicine 21.1
office 20.9
health 20.8
looking 20.8
mature 20.5
worker 20.3
occupation 20.2
care 19.8
senior 19.7
handsome 19.6
work 18.1
clinic 17.4
patient 17.4
smile 17.1
executive 16.8
clothing 16.6
confident 16.4
uniform 16.3
smiling 15.9
profession 15.3
success 15.3
team 15.2
standing 14.8
practitioner 14.7
garment 14.4
indoors 14.1
successful 13.7
friendly 13.7
elderly 13.4
day 13.3
bright 12.9
indoor 12.8
casual 12.7
40s 12.7
brass 12.6
happiness 12.5
cheerful 12.2
metropolitan 12.1
staff 11.9
specialist 11.9
building 11.9
two 11.9
surgeon 11.5
businesspeople 11.4
manager 11.2
old 11.1
teamwork 11.1
corporation 10.6
laboratory 10.6
wind instrument 10.6
confidence 10.5
illness 10.5
group 10.5
tie 10.4
company 10.2
lifestyle 10.1
employee 9.9
attractive 9.8
clinical 9.8
physician 9.8
examination 9.7
lab 9.7
expertise 9.7
mid adult 9.6
30s 9.6
black 9.6
diversity 9.6
couple 9.6
ethnic 9.5
women 9.5
color 9.5
meeting 9.4
camera 9.2
face 9.2
human 9
one 9
working 8.8
consultant 8.8
middle aged 8.8
hair 8.7
partnership 8.6
glasses 8.3
baron 8.3
healthy 8.2
businesswoman 8.2
home 8
doctors 7.9
diagnosis 7.8
architecture 7.8
colleagues 7.8
health care 7.8
partner 7.7
exam 7.7
only 7.6
serious 7.6
teacher 7.6
hand 7.6
adults 7.6
career 7.6
cornet 7.6
letter 7.6
desk 7.6
horizontal 7.5
holding 7.4
musical instrument 7.4
gray 7.2
waiter 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 96.6
clothing 96.6
standing 95.4
man 92.4
posing 87.1
text 86
suit 78
coat 77.3
black and white 75.5
old 58.1

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Sad 34.5%
Disgusted 33.8%
Surprised 11.5%
Angry 10.2%
Fear 3%
Calm 2.5%
Confused 2.3%
Happy 2.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Fear 74%
Sad 12.7%
Surprised 7.5%
Angry 2.1%
Calm 1.6%
Confused 0.9%
Disgusted 0.7%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.7%
Person 97%
Suit 87%

Captions

Microsoft

a man and a woman standing in front of a building 87.4%
a person standing in front of a group of people posing for a photo 86.8%
a man and woman posing for a photo in front of a building 81.2%

Text analysis

Amazon

RI
YE3
XAOOX

Google

VT
VT 3A2
3A2