Human Generated Data

Title

Untitled (people drinking cocktails, man on telephone)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17266

Human Generated Data

Title

Untitled (people drinking cocktails, man on telephone)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.6
Person 99.6
Person 99.4
Person 98.7
Person 96.7
Worker 94.8
Sitting 93.5
Person 92
Footwear 91.8
Shoe 91.8
Clothing 91.8
Apparel 91.8
Hairdresser 79.6
Furniture 68.4
Meal 67.8
Food 67.8
Female 61.7
Couch 60.9

Imagga
created on 2022-02-26

man 30.9
people 30.7
brass 28.6
male 27.7
person 21.6
wind instrument 21.6
kin 20.9
adult 19.9
cornet 19.7
businessman 19.4
business 18.8
men 18
room 16.4
home 15.9
smiling 15.9
indoors 15.8
office 15.7
musical instrument 15.3
sitting 14.6
group 14.5
worker 13.6
team 13.4
family 13.3
happy 13.1
couple 13.1
professional 12.8
work 12.6
women 12.6
working 12.4
portrait 12.3
cheerful 12.2
job 11.5
nurse 11.5
businesspeople 11.4
teamwork 11.1
together 10.5
interior 9.7
colleagues 9.7
computer 9.6
executive 9.6
meeting 9.4
happiness 9.4
lifestyle 9.4
casual 9.3
device 9.3
smile 9.3
vintage 9.1
old 9.1
dress 9
handsome 8.9
color 8.9
medical 8.8
looking 8.8
40s 8.8
love 8.7
corporate 8.6
clothing 8.4
communication 8.4
patient 8.3
mother 8.3
leisure 8.3
human 8.2
20s 8.2
businesswoman 8.2
hospital 8
building 7.9
newspaper 7.8
black 7.8
face 7.8
antique 7.8
lab 7.8
laboratory 7.7
30s 7.7
employee 7.6
talking 7.6
doctor 7.5
manager 7.4
instrument 7.4
mature 7.4
horn 7.4
care 7.4
retro 7.4
occupation 7.3
indoor 7.3
medicine 7
modern 7

Google
created on 2022-02-26

Black 89.6
Window 87
Picture frame 86.8
Chair 85.5
Black-and-white 84.8
Style 84
Table 83.2
Building 82.9
Monochrome 73.5
Bookcase 73.1
Monochrome photography 72.3
House 72.2
Event 69.4
Room 67.2
Sitting 65.8
Television 65.6
T-shirt 64.8
Art 63.7
Shelf 62.8
Conversation 62.5

Microsoft
created on 2022-02-26

text 99.8
person 93
clothing 90.1
man 75.8
black and white 69.9
furniture 67.7
table 60

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 78%
Calm 50.3%
Sad 23.1%
Confused 12.3%
Happy 10%
Disgusted 1.8%
Angry 1.1%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 23-33
Gender Male, 99.3%
Calm 72.8%
Surprised 25.6%
Sad 0.8%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Sad 97.1%
Happy 2.1%
Calm 0.3%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 91.8%

Captions

Microsoft

a group of people sitting in front of a store 69.8%
a group of people sitting and standing in front of a store 69.7%
a group of people standing in front of a store 69.6%

Text analysis

Amazon

MJI7
Y133A2
MJI7 Y133A2 00200
00200

Google

MJIAN
MJIAN