Human Generated Data

Title

Untitled (two men sitting, holding bottle)
Date

c. 1950
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20205

Human Generated Data

Title

Untitled (two men sitting, holding bottle)

People

Artist: Peter James Studio, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Chair 99.6
Furniture 99.6
Person 99
Human 99
Person 97
Overcoat 79.1
Clothing 79.1
Coat 79.1
Suit 79.1
Apparel 79.1
Couch 67.7
Flooring 67.5
Electronics 63.5
Photography 56.3
Photo 56.3
Sitting 55.6

Imagga
created on 2022-03-05

man 50.4
person 47.5
male 45.4
businessman 42.4
people 36.8
professional 36.1
business 35.9
office 35.5
adult 32.6
executive 29
businesspeople 28.5
working 27.4
patient 27.3
worker 26.7
work 25.1
team 25.1
indoors 24.6
businesswoman 24.6
meeting 24.5
corporate 24.1
sitting 24.1
desk 23.6
colleagues 23.3
computer 21.7
doctor 21.6
happy 21.3
laptop 21
medical 20.3
men 19.8
teamwork 19.5
job 19.5
20s 19.3
indoor 19.2
table 19.1
smiling 18.8
group 18.6
face 18.5
talking 17.1
mature 16.7
casual 16.1
associates 15.8
portrait 15.5
room 15
together 14.9
coworkers 14.7
occupation 14.7
looking 14.4
hospital 14.3
day 14.1
entrepreneur 14
document 13.7
30s 13.5
women 13.5
employee 13.4
horizontal 13.4
color 13.4
suit 13.1
sick person 12.9
bright 12.9
waiter 12.8
25 30 years 12.7
case 12.7
clothing 12.7
white 12.3
lifestyle 12.3
senior 12.2
coat 12.2
education 12.1
conference 11.7
businessmen 11.7
40s 11.7
handsome 11.6
mid adult 11.6
medicine 11.5
letter 11.2
health 11.1
confident 10.9
clinic 10.9
discussing 10.8
scientist 10.8
smile 10.7
lab 10.7
couple 10.5
lab coat 10.5
happiness 10.2
collaboration 9.9
modern 9.8
teacher 9.7
cooperation 9.7
corporation 9.7
laboratory 9.6
four 9.6
home 9.6
profession 9.6
career 9.5
text 9.4
nurse 9.3
manager 9.3
presentation 9.3
inside 9.2
successful 9.2
hand 9.1
care 9.1
cheerful 8.9
student 8.9
chemical 8.9
business people 8.9
discussion 8.8
concentration 8.7
busy 8.7
using 8.7
serious 8.6
adults 8.5
shirt 8.4
writing 8.4
success 8.1
light 8
necktie 8
dining-room attendant 7.9
crew 7.9
about 7.9
thirties 7.8
expertise 7.8
staff 7.8
attractive 7.7
elderly 7.7
pharmacist 7.7
twenties 7.6
formal 7.6
two 7.6
research 7.6
biology 7.6
sit 7.6
learning 7.5
sax 7.5
study 7.5
company 7.4
focus 7.4
camera 7.4
paper 7.1

Google
created on 2022-03-05

Furniture 93.8
Chair 87.9
Comfort 84.9
Style 83.8
Suit 83.7
Black-and-white 83.5
Table 81.8
Coffee table 79.7
Picture frame 76.1
Event 73.6
White-collar worker 72.3
Couch 71.7
Monochrome photography 70.9
Lamp 70.5
Monochrome 69.6
Sitting 69
Television program 66.3
Font 66.1
Room 65.5
Conversation 64.9

Microsoft
created on 2022-03-05

text 90.7
furniture 89.2
clothing 87.1
person 84.1
man 75.4
black and white 71.4
chair 67.2
table 53

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 87.3%
Sad 71.4%
Calm 25.2%
Confused 1.2%
Surprised 0.6%
Happy 0.5%
Angry 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Happy 79.3%
Sad 6.1%
Confused 5.2%
Fear 2.7%
Disgusted 2.6%
Calm 2%
Surprised 1.2%
Angry 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.6%
Person 99%
Suit 79.1%

Captions

Microsoft

a man and a woman sitting on a table 48.1%
a group of people sitting at a table 48%
a man and a woman sitting at a table 47.9%

Text analysis

Amazon

R
E
حصحد