Human Generated Data

Title

Untitled (four men having cocktails)
Date

1949
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20055

Human Generated Data

Title

Untitled (four men having cocktails)

People

Artist: Peter James Studio, American

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Tie 99.4
Accessories 99.4
Accessory 99.4
Person 98.5
Human 98.5
Person 97.9
Person 97.7
Chair 97.4
Furniture 97.4
Chair 97
Table 94.1
Dining Table 93.2
Clinic 89.8
Person 78.5
Tie 70.7
Tabletop 67.8
Portrait 64.7
Photography 64.7
Photo 64.7
Face 64.7
Indoors 64.2
Room 64.2
Apparel 60.7
Clothing 60.7
Dining Room 57.8
People 57.3
Hospital 56.5
Drawing 55.2
Art 55.2
Person 45.6

Imagga
created on 2022-03-05

man 41.7
person 41.4
male 38.3
people 32.4
patient 28
smiling 27.5
sitting 27.5
room 26.2
business 25.5
table 25.1
happy 23.2
businessman 23
adult 22.9
couple 21.8
meeting 21.7
men 21.5
cheerful 21.1
indoors 21.1
talking 20.9
senior 20.6
together 20.2
nurse 19.6
office 19.6
professional 18.6
mature 18.6
worker 18.5
colleagues 18.5
30s 18.3
women 18.2
businesswoman 18.2
classroom 18.1
team 17.9
group 17.7
home 17.6
working 16.8
teamwork 16.7
lifestyle 16.6
hospital 16.2
businesspeople 16.1
day 15.7
sick person 15
waiter 14.7
case 14.7
laptop 14.7
restaurant 14.6
40s 14.6
work 14.5
desk 14.2
color 13.4
friends 13.2
teacher 13
corporate 12.9
20s 12.8
smile 12.8
chair 12.7
job 12.4
student 12.4
executive 12.2
computer 12
communication 11.8
employee 11.6
four 11.5
medical 11.5
doctor 11.3
casual 11
suit 10.8
casual clothing 10.8
two people 10.7
happiness 10.2
four people 9.9
discussing 9.8
coworkers 9.8
food 9.8
middle aged 9.7
mid adult 9.7
musical instrument 9.6
drinking 9.6
education 9.5
ethnic 9.5
enjoying 9.5
adults 9.5
dining-room attendant 9.5
holding 9.1
associates 8.9
discussion 8.8
thirties 8.8
elderly 8.6
grandfather 8.6
enjoyment 8.4
side 8.4
meal 8.4
friendship 8.4
portrait 8.4
modern 8.4
manager 8.4
drink 8.4
health 8.3
clothing 8.3
coat 8.2
outdoors 8.2
new 8.1
family 8
lunch 7.9
forties 7.9
50s 7.8
older 7.8
retired 7.8
having 7.8
content 7.7
twenties 7.7
eating 7.6
horizontal 7.5
relationship 7.5
presentation 7.4
technology 7.4
coffee 7.4
clinic 7.4
wine 7.4
lab coat 7.4
inside 7.4
occupation 7.3
successful 7.3
indoor 7.3
handsome 7.1
love 7.1
to 7.1

Google
created on 2022-03-05

Chair 88.6
Style 83.9
Black-and-white 83.5
Table 80.3
Monochrome photography 77.3
Monochrome 77.3
Snapshot 74.3
Event 70.2
Vintage clothing 70
Room 67.4
Stock photography 65.5
Sitting 65.3
History 64.5
Classic 63.2
Suit 62
Art 58.1
Curtain 57.3
Motor vehicle 52.3
Folding chair 50.3

Microsoft
created on 2022-03-05

text 96.7
person 94.2
furniture 91.1
man 90.5
chair 87.1
clothing 72.3
black and white 72.1
old 44
posing 36.4
table 26.1

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.8%
Confused 78.9%
Sad 10.9%
Disgusted 4.6%
Calm 2.3%
Angry 1.8%
Fear 0.6%
Surprised 0.5%
Happy 0.3%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 94.9%
Sad 3.9%
Confused 0.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Calm 99.9%
Sad 0%
Confused 0%
Happy 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.4%
Person 98.5%
Chair 97.4%

Captions

Microsoft

a group of people sitting at a table 89.6%
a group of people sitting around a table 89.1%
a group of people posing for a photo 85.8%

Text analysis

Amazon

19
SNBREWE
РИССО SNBREWE ARE
РИССО
ARE

Google

19
19