Human Generated Data

Title

Untitled (men at desk with large bottle)

Date

c. 1950

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20271

Human Generated Data

Title

Untitled (men at desk with large bottle)

People

Artist: Peter James Studio, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.2
Apparel 99.2
Human 96.9
Person 96.9
Person 96.7
Person 96
Person 95.7
Person 94.6
Coat 88.5
Overcoat 85.7
Suit 82.3
Suit 82.3
Home Decor 77.3
Suit 73.9
Accessories 72.8
Tie 72.8
Accessory 72.8
Indoors 69.2
Shirt 67.3
Tie 66.7
Lab 64.9
Furniture 59.6
Lab Coat 59.5
Head 59.1
Tuxedo 57.9
Floor 57.1
Room 55.2

Imagga
created on 2022-03-05

lab coat 52.6
man 51.8
coat 50.6
male 44.7
professional 36.8
nurse 36
person 35.8
doctor 34.8
office 32.3
medical 30
businessman 29.2
people 29
hospital 28.7
adult 28.6
business 28
team 26
happy 24.5
practitioner 24.3
meeting 22.6
men 22.3
job 22.1
medicine 22
work 22
worker 21.9
smiling 21.7
executive 21.4
stethoscope 21
clinic 20.5
health 20.2
portrait 20.1
colleagues 19.4
corporate 18.9
group 18.6
smile 18.5
standing 18.3
care 18.1
mature 17.7
teamwork 17.6
looking 17.6
garment 17.6
occupation 17.4
teacher 16.7
indoors 16.7
businesspeople 16.1
desk 16.1
patient 15.9
room 15.6
sitting 15.5
30s 15.4
handsome 15.2
suit 14.6
mid adult 14.5
working 14.2
surgeon 14.1
senior 14.1
lifestyle 13.7
successful 13.7
indoor 13.7
success 13.7
confident 13.7
businesswoman 13.6
clothing 13.4
talking 13.3
waiter 13.3
laptop 12.8
40s 12.7
staff 12.4
cheerful 12.2
table 12.1
computer 12
camera 12
modern 11.9
casual 11.9
communication 11.8
clinical 11.7
specialist 11.5
color 11.1
physician 10.7
expertise 10.7
uniform 10.5
employee 10.4
classroom 10.3
women 10.3
manager 10.3
friendly 10.1
bright 10
board 10
holding 9.9
associates 9.8
doctors 9.8
attractive 9.8
discussion 9.7
middle aged 9.7
together 9.6
diversity 9.6
couple 9.6
elderly 9.6
profession 9.6
presentation 9.3
company 9.3
horizontal 9.2
inside 9.2
20s 9.2
dining-room attendant 9.1
technology 8.9
diverse 8.8
conference 8.8
colleague 8.8
consultant 8.8
thirties 8.8
education 8.7
student 8.6
face 8.5
two 8.5
black 8.4
human 8.3
building 8.1
coworkers 7.9
happiness 7.8
diagnosis 7.8
workers 7.8
laboratory 7.7
partnership 7.7
entrepreneur 7.7
workplace 7.6
life 7.6
one person 7.5
educator 7.4
positive 7.4
light 7.4

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.1
wall 98.3
man 94.7
standing 85.6
clothing 85.4
text 84.5
posing 64.2
group 63.3
table 57.7

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 78.7%
Happy 8.7%
Surprised 6.7%
Angry 2.6%
Disgusted 1.5%
Sad 0.7%
Confused 0.6%
Fear 0.5%

AWS Rekognition

Age 53-61
Gender Male, 99.8%
Calm 44.8%
Surprised 29.4%
Sad 12%
Happy 6.4%
Confused 2%
Disgusted 1.9%
Fear 1.8%
Angry 1.7%

AWS Rekognition

Age 43-51
Gender Male, 99.6%
Calm 30.2%
Happy 24.7%
Angry 12%
Surprised 10.7%
Disgusted 8.7%
Sad 7.7%
Confused 4%
Fear 2%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Sad 49.4%
Confused 27%
Surprised 7%
Happy 5%
Calm 4.3%
Angry 4.1%
Disgusted 2.1%
Fear 1.2%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Happy 54.5%
Surprised 37.4%
Sad 2.7%
Disgusted 1.7%
Confused 1.2%
Angry 1.1%
Calm 0.9%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%
Suit 82.3%
Tie 72.8%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 94%
a group of men standing in front of a mirror posing for the camera 89.9%
a group of people in front of a mirror posing for the camera 89.8%

Text analysis

Amazon

YOU
BETTER
CAN
BOURBON
FIND
BI
FIND A BETTER
"IF YOU CAN
A
BUY
BUY IT!
"IF
IT!
THI
СУИ
محمد
НИЯ
KENTOOK
سعد
NAGOY
محمد Mode سعد
PRODUCT KENTOOK social
social
PRODUCT
Mode